2023-11-20T06:24:50.716 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-20T06:24:50.717 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_vshankar@teuthology --name vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi --archive /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463035 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} -- /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463035/orig.config.yaml 2023-11-20T06:24:50.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-20T06:24:50.844 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463035 branch: wip-57087-3 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} email: vshankar@redhat.com first_in_suite: false job_id: '7463035' kernel: flavor: default kdb: true sha1: 7678e1afe51c4ac0c30e2c032e042c836160928a ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-57087-3 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - bad backtrace - object missing on disk - error reading table object - error reading sessionmap - unmatched fragstat - unmatched rstat - was unreadable, recreating it now - Scrub error on inode - Metadata damage detected - inconsistent rstat on inode - Error recovering journal sha1: 895e5adad9a763a0f13587c485b17f1ad3f04528 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 895e5adad9a763a0f13587c485b17f1ad3f04528 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-57087-3 sha1: dc2d87c1fc8f518422f0be9931df0b31dc6a3bad owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9639 sha1: 895e5adad9a763a0f13587c485b17f1ad3f04528 sleep_before_teardown: 0 suite: fs suite_branch: wip-57087-3 suite_path: /home/teuthworker/src/github.com_vshankar_ceph_dc2d87c1fc8f518422f0be9931df0b31dc6a3bad/qa suite_relpath: qa suite_repo: https://github.com/vshankar/ceph.git suite_sha1: dc2d87c1fc8f518422f0be9931df0b31dc6a3bad syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi019.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEGoUEYvv8Xx4Y3u448+gdyzT3VDVyIvIQ0BBsftBrnQIp3iGuixD10crS4Lqyw3w63VGQkE2rdYq+2T+5uGOGM= smithi190.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBYMWoE2uFuoUOEUElZDU1ZN8xpaiogsPDQMBOGBzoRjhquNJsZno6nE8l9XUVzazdqi3+MVusP36wRDJsfPOfQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-20_06:01:31 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-20T06:24:50.844 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_vshankar_ceph_dc2d87c1fc8f518422f0be9931df0b31dc6a3bad/qa; will attempt to use it 2023-11-20T06:24:50.844 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_vshankar_ceph_dc2d87c1fc8f518422f0be9931df0b31dc6a3bad/qa/tasks 2023-11-20T06:24:50.845 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-20T06:24:50.846 INFO:teuthology.task.internal:Checking packages... 2023-11-20T06:24:50.869 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '895e5adad9a763a0f13587c485b17f1ad3f04528' 2023-11-20T06:24:50.869 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-20T06:24:50.869 INFO:teuthology.packaging:ref: None 2023-11-20T06:24:50.869 INFO:teuthology.packaging:tag: None 2023-11-20T06:24:50.869 INFO:teuthology.packaging:branch: wip-57087-3 2023-11-20T06:24:50.869 INFO:teuthology.packaging:sha1: 895e5adad9a763a0f13587c485b17f1ad3f04528 2023-11-20T06:24:50.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-57087-3 2023-11-20T06:24:51.125 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6612-g895e5ada-1jammy 2023-11-20T06:24:51.125 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-20T06:24:51.133 INFO:teuthology.task.internal:no buildpackages task found 2023-11-20T06:24:51.133 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-20T06:24:51.186 INFO:teuthology.task.internal:Saving configuration 2023-11-20T06:24:51.215 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-20T06:24:51.229 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-20T06:24:51.253 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463035', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-20 06:19:18.002533', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILUCTnZjXb9BH7h6SAMOuiyYlQcPD0gI1rude9eDh+sk'} 2023-11-20T06:24:51.274 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463035', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-20 06:19:18.004123', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIH+WqsdM6+ZPiIJPtSd6tFcdNgdPFNHWpP8S6vooO0NC'} 2023-11-20T06:24:51.275 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-20T06:24:51.284 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-20T06:24:51.284 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-20T06:24:51.284 INFO:teuthology.run_tasks:Running task console_log... 2023-11-20T06:24:51.394 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7febd793ef70>, signals=[15]) 2023-11-20T06:24:51.395 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-20T06:24:51.404 INFO:teuthology.task.internal:Opening connections... 2023-11-20T06:24:51.404 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi019.front.sepia.ceph.com 2023-11-20T06:24:51.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:24:51.480 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi190.front.sepia.ceph.com 2023-11-20T06:24:51.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:24:51.553 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-20T06:24:51.566 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2023-11-20T06:24:51.573 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2023-11-20T06:24:51.573 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2023-11-20T06:24:51.619 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-20T06:24:51.619 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="Ubuntu" 2023-11-20T06:24:51.620 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="22.04" 2023-11-20T06:24:51.620 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-20T06:24:51.620 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_CODENAME=jammy 2023-11-20T06:24:51.620 INFO:teuthology.orchestra.run.smithi019.stdout:ID=ubuntu 2023-11-20T06:24:51.620 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE=debian 2023-11-20T06:24:51.620 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-20T06:24:51.620 INFO:teuthology.orchestra.run.smithi019.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-20T06:24:51.620 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-20T06:24:51.620 INFO:teuthology.orchestra.run.smithi019.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-20T06:24:51.620 INFO:teuthology.orchestra.run.smithi019.stdout:UBUNTU_CODENAME=jammy 2023-11-20T06:24:51.621 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2023-11-20T06:24:51.643 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-11-20T06:24:51.648 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-11-20T06:24:51.648 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-11-20T06:24:51.695 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-20T06:24:51.695 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Ubuntu" 2023-11-20T06:24:51.695 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="22.04" 2023-11-20T06:24:51.695 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-20T06:24:51.695 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_CODENAME=jammy 2023-11-20T06:24:51.696 INFO:teuthology.orchestra.run.smithi190.stdout:ID=ubuntu 2023-11-20T06:24:51.696 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE=debian 2023-11-20T06:24:51.696 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-20T06:24:51.696 INFO:teuthology.orchestra.run.smithi190.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-20T06:24:51.696 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-20T06:24:51.696 INFO:teuthology.orchestra.run.smithi190.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-20T06:24:51.696 INFO:teuthology.orchestra.run.smithi190.stdout:UBUNTU_CODENAME=jammy 2023-11-20T06:24:51.696 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-11-20T06:24:51.718 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-20T06:24:51.730 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-20T06:24:51.767 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-20T06:24:51.767 DEBUG:teuthology.orchestra.run.smithi019:> test '!' -e /home/ubuntu/cephtest 2023-11-20T06:24:51.770 DEBUG:teuthology.orchestra.run.smithi190:> test '!' -e /home/ubuntu/cephtest 2023-11-20T06:24:51.774 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-20T06:24:51.817 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-20T06:24:51.817 DEBUG:teuthology.orchestra.run.smithi019:> test -z $(ls -A /var/lib/ceph) 2023-11-20T06:24:51.819 DEBUG:teuthology.orchestra.run.smithi190:> test -z $(ls -A /var/lib/ceph) 2023-11-20T06:24:51.826 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-20T06:24:51.909 INFO:teuthology.run_tasks:Running task kernel... 2023-11-20T06:24:51.928 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '7678e1afe51c4ac0c30e2c032e042c836160928a'} 2023-11-20T06:24:51.928 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '7678e1afe51c4ac0c30e2c032e042c836160928a'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '7678e1afe51c4ac0c30e2c032e042c836160928a'}}, timeout 300 2023-11-20T06:24:51.928 DEBUG:teuthology.orchestra.run.smithi019:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-20T06:24:51.929 DEBUG:teuthology.orchestra.run.smithi190:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-20T06:24:51.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:24:51.934 DEBUG:teuthology.task.kernel:sha1 for mon.a is 7678e1afe51c4ac0c30e2c032e042c836160928a 2023-11-20T06:24:51.934 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "7678e1afe51c4ac0c30e2c032e042c836160928a"... 2023-11-20T06:24:51.934 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2023-11-20T06:24:51.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:24:51.935 DEBUG:teuthology.task.kernel:sha1 for mon.b is 7678e1afe51c4ac0c30e2c032e042c836160928a 2023-11-20T06:24:51.935 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "7678e1afe51c4ac0c30e2c032e042c836160928a"... 2023-11-20T06:24:51.935 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2023-11-20T06:24:51.980 INFO:teuthology.orchestra.run.smithi019.stdout:5.15.0-56-generic 2023-11-20T06:24:51.980 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 7678e1afe51c4ac0c30e2c032e042c836160928a 2023-11-20T06:24:51.980 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-20T06:24:51.981 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7678e1afe51c4ac0c30e2c032e042c836160928a 2023-11-20T06:24:51.984 INFO:teuthology.orchestra.run.smithi190.stdout:5.15.0-56-generic 2023-11-20T06:24:51.984 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 7678e1afe51c4ac0c30e2c032e042c836160928a 2023-11-20T06:24:51.985 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-20T06:24:51.985 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7678e1afe51c4ac0c30e2c032e042c836160928a 2023-11-20T06:24:52.127 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-11-20T06:24:52.127 DEBUG:teuthology.orchestra.run.smithi019:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-20T06:24:52.133 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-11-20T06:24:52.133 DEBUG:teuthology.orchestra.run.smithi190:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-20T06:24:52.140 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-20T06:24:52.160 INFO:teuthology.orchestra.run.smithi190.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-20T06:24:52.282 INFO:teuthology.orchestra.run.smithi019.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-20T06:24:52.282 INFO:teuthology.orchestra.run.smithi019.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-20T06:24:52.282 INFO:teuthology.orchestra.run.smithi019.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-20T06:24:52.282 INFO:teuthology.orchestra.run.smithi019.stderr:hint: 2023-11-20T06:24:52.282 INFO:teuthology.orchestra.run.smithi019.stderr:hint: git config --global init.defaultBranch 2023-11-20T06:24:52.282 INFO:teuthology.orchestra.run.smithi019.stderr:hint: 2023-11-20T06:24:52.283 INFO:teuthology.orchestra.run.smithi019.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-20T06:24:52.283 INFO:teuthology.orchestra.run.smithi019.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-20T06:24:52.283 INFO:teuthology.orchestra.run.smithi019.stderr:hint: 2023-11-20T06:24:52.283 INFO:teuthology.orchestra.run.smithi019.stderr:hint: git branch -m 2023-11-20T06:24:52.284 INFO:teuthology.orchestra.run.smithi019.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-20T06:24:52.285 DEBUG:teuthology.orchestra.run.smithi019:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-20T06:24:52.314 INFO:teuthology.orchestra.run.smithi190.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-20T06:24:52.314 INFO:teuthology.orchestra.run.smithi190.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-20T06:24:52.314 INFO:teuthology.orchestra.run.smithi190.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-20T06:24:52.314 INFO:teuthology.orchestra.run.smithi190.stderr:hint: 2023-11-20T06:24:52.314 INFO:teuthology.orchestra.run.smithi190.stderr:hint: git config --global init.defaultBranch 2023-11-20T06:24:52.315 INFO:teuthology.orchestra.run.smithi190.stderr:hint: 2023-11-20T06:24:52.315 INFO:teuthology.orchestra.run.smithi190.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-20T06:24:52.315 INFO:teuthology.orchestra.run.smithi190.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-20T06:24:52.315 INFO:teuthology.orchestra.run.smithi190.stderr:hint: 2023-11-20T06:24:52.315 INFO:teuthology.orchestra.run.smithi190.stderr:hint: git branch -m 2023-11-20T06:24:52.316 INFO:teuthology.orchestra.run.smithi190.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-20T06:24:52.317 DEBUG:teuthology.orchestra.run.smithi190:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-20T06:24:52.350 DEBUG:teuthology.orchestra.run.smithi019:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-20T06:24:52.384 DEBUG:teuthology.orchestra.run.smithi190:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-20T06:24:52.406 DEBUG:teuthology.orchestra.run.smithi019:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-20T06:24:52.441 DEBUG:teuthology.orchestra.run.smithi190:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-20T06:26:11.394 INFO:teuthology.orchestra.run.smithi019.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-20T06:26:11.394 INFO:teuthology.orchestra.run.smithi019.stderr: * [new branch] main -> origin/main 2023-11-20T06:26:11.425 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20190312 -> 20190312 2023-11-20T06:26:11.425 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20190416 -> 20190416 2023-11-20T06:26:11.425 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20190514 -> 20190514 2023-11-20T06:26:11.425 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20190618 -> 20190618 2023-11-20T06:26:11.426 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20190717 -> 20190717 2023-11-20T06:26:11.426 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20190815 -> 20190815 2023-11-20T06:26:11.427 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20190923 -> 20190923 2023-11-20T06:26:11.427 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20191022 -> 20191022 2023-11-20T06:26:11.427 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20191215 -> 20191215 2023-11-20T06:26:11.427 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20200122 -> 20200122 2023-11-20T06:26:11.427 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20200316 -> 20200316 2023-11-20T06:26:11.427 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20200421 -> 20200421 2023-11-20T06:26:11.427 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20200519 -> 20200519 2023-11-20T06:26:11.427 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20200619 -> 20200619 2023-11-20T06:26:11.427 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20200721 -> 20200721 2023-11-20T06:26:11.430 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20200817 -> 20200817 2023-11-20T06:26:11.430 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20200918 -> 20200918 2023-11-20T06:26:11.430 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20201022 -> 20201022 2023-11-20T06:26:11.430 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20201118 -> 20201118 2023-11-20T06:26:11.430 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20201218 -> 20201218 2023-11-20T06:26:11.430 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20210208 -> 20210208 2023-11-20T06:26:11.430 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20210315 -> 20210315 2023-11-20T06:26:11.430 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20210511 -> 20210511 2023-11-20T06:26:11.430 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20210716 -> 20210716 2023-11-20T06:26:11.431 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20210818 -> 20210818 2023-11-20T06:26:11.431 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20210919 -> 20210919 2023-11-20T06:26:11.431 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20211027 -> 20211027 2023-11-20T06:26:11.431 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20211216 -> 20211216 2023-11-20T06:26:11.431 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20220209 -> 20220209 2023-11-20T06:26:11.431 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20220310 -> 20220310 2023-11-20T06:26:11.431 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20220411 -> 20220411 2023-11-20T06:26:11.431 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20220509 -> 20220509 2023-11-20T06:26:11.431 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20220610 -> 20220610 2023-11-20T06:26:11.431 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20220708 -> 20220708 2023-11-20T06:26:11.431 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20220815 -> 20220815 2023-11-20T06:26:11.431 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20220913 -> 20220913 2023-11-20T06:26:11.432 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20221012 -> 20221012 2023-11-20T06:26:11.432 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20221109 -> 20221109 2023-11-20T06:26:11.433 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20221214 -> 20221214 2023-11-20T06:26:11.433 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20230117 -> 20230117 2023-11-20T06:26:11.433 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20230210 -> 20230210 2023-11-20T06:26:11.433 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20230310 -> 20230310 2023-11-20T06:26:11.433 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20230404 -> 20230404 2023-11-20T06:26:11.433 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20230515 -> 20230515 2023-11-20T06:26:11.433 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20230625 -> 20230625 2023-11-20T06:26:11.433 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20230804 -> 20230804 2023-11-20T06:26:11.433 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20230919 -> 20230919 2023-11-20T06:26:11.434 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20231030 -> 20231030 2023-11-20T06:26:11.434 INFO:teuthology.orchestra.run.smithi019.stderr: * [new tag] 20231111 -> 20231111 2023-11-20T06:26:11.652 INFO:teuthology.orchestra.run.smithi190.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-20T06:26:11.652 INFO:teuthology.orchestra.run.smithi190.stderr: * [new branch] main -> origin/main 2023-11-20T06:26:11.683 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20190312 -> 20190312 2023-11-20T06:26:11.684 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20190416 -> 20190416 2023-11-20T06:26:11.684 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20190514 -> 20190514 2023-11-20T06:26:11.684 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20190618 -> 20190618 2023-11-20T06:26:11.684 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20190717 -> 20190717 2023-11-20T06:26:11.684 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20190815 -> 20190815 2023-11-20T06:26:11.685 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20190923 -> 20190923 2023-11-20T06:26:11.685 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20191022 -> 20191022 2023-11-20T06:26:11.685 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20191215 -> 20191215 2023-11-20T06:26:11.685 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20200122 -> 20200122 2023-11-20T06:26:11.686 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20200316 -> 20200316 2023-11-20T06:26:11.686 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20200421 -> 20200421 2023-11-20T06:26:11.686 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20200519 -> 20200519 2023-11-20T06:26:11.686 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20200619 -> 20200619 2023-11-20T06:26:11.686 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20200721 -> 20200721 2023-11-20T06:26:11.689 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20200817 -> 20200817 2023-11-20T06:26:11.689 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20200918 -> 20200918 2023-11-20T06:26:11.689 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20201022 -> 20201022 2023-11-20T06:26:11.689 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20201118 -> 20201118 2023-11-20T06:26:11.689 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20201218 -> 20201218 2023-11-20T06:26:11.689 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20210208 -> 20210208 2023-11-20T06:26:11.689 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20210315 -> 20210315 2023-11-20T06:26:11.689 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20210511 -> 20210511 2023-11-20T06:26:11.689 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20210716 -> 20210716 2023-11-20T06:26:11.689 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20210818 -> 20210818 2023-11-20T06:26:11.689 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20210919 -> 20210919 2023-11-20T06:26:11.690 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20211027 -> 20211027 2023-11-20T06:26:11.690 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20211216 -> 20211216 2023-11-20T06:26:11.690 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20220209 -> 20220209 2023-11-20T06:26:11.690 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20220310 -> 20220310 2023-11-20T06:26:11.690 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20220411 -> 20220411 2023-11-20T06:26:11.690 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20220509 -> 20220509 2023-11-20T06:26:11.690 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20220610 -> 20220610 2023-11-20T06:26:11.690 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20220708 -> 20220708 2023-11-20T06:26:11.690 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20220815 -> 20220815 2023-11-20T06:26:11.690 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20220913 -> 20220913 2023-11-20T06:26:11.690 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20221012 -> 20221012 2023-11-20T06:26:11.690 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20221109 -> 20221109 2023-11-20T06:26:11.691 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20221214 -> 20221214 2023-11-20T06:26:11.691 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20230117 -> 20230117 2023-11-20T06:26:11.691 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20230210 -> 20230210 2023-11-20T06:26:11.691 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20230310 -> 20230310 2023-11-20T06:26:11.691 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20230404 -> 20230404 2023-11-20T06:26:11.692 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20230515 -> 20230515 2023-11-20T06:26:11.692 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20230625 -> 20230625 2023-11-20T06:26:11.692 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20230804 -> 20230804 2023-11-20T06:26:11.692 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20230919 -> 20230919 2023-11-20T06:26:11.692 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20231030 -> 20231030 2023-11-20T06:26:11.692 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20231111 -> 20231111 2023-11-20T06:26:15.637 INFO:teuthology.orchestra.run.smithi019.stderr:Updating files: 48% (1588/3248) Updating files: 49% (1592/3248) Updating files: 50% (1624/3248) Updating files: 51% (1657/3248) Updating files: 52% (1689/3248) Updating files: 53% (1722/3248) Updating files: 54% (1754/3248) Updating files: 55% (1787/3248) Updating files: 56% (1819/3248) Updating files: 57% (1852/3248) Updating files: 58% (1884/3248) Updating files: 59% (1917/3248) Updating files: 60% (1949/3248) Updating files: 61% (1982/3248) Updating files: 62% (2014/3248) Updating files: 63% (2047/3248) Updating files: 63% (2072/3248) Updating files: 64% (2079/3248) Updating files: 65% (2112/3248) Updating files: 66% (2144/3248) Updating files: 67% (2177/3248) Updating files: 68% (2209/3248) Updating files: 69% (2242/3248) Updating files: 70% (2274/3248) Updating files: 71% (2307/3248) Updating files: 72% (2339/3248) Updating files: 73% (2372/3248) Updating files: 74% (2404/3248) Updating files: 75% (2436/3248) Updating files: 76% (2469/3248) Updating files: 77% (2501/3248) Updating files: 78% (2534/3248) Updating files: 79% (2566/3248) Updating files: 79% (2579/3248) Updating files: 80% (2599/3248) Updating files: 81% (2631/3248) Updating files: 82% (2664/3248) Updating files: 83% (2696/3248) Updating files: 84% (2729/3248) Updating files: 85% (2761/3248) Updating files: 85% (2764/3248) Updating files: 86% (2794/3248) Updating files: 87% (2826/3248) Updating files: 88% (2859/3248) Updating files: 89% (2891/3248) Updating files: 90% (2924/3248) Updating files: 91% (2956/3248) Updating files: 92% (2989/3248) Updating files: 93% (3021/3248) Updating files: 94% (3054/3248) Updating files: 95% (3086/3248) Updating files: 96% (3119/3248) Updating files: 97% (3151/3248) Updating files: 98% (3184/3248) Updating files: 99% (3216/3248) Updating files: 100% (3248/3248) Updating files: 100% (3248/3248), done. 2023-11-20T06:26:15.642 INFO:teuthology.orchestra.run.smithi019.stdout:HEAD is now at 7124ce30 Merge branch 'mlimonci/encoding' into 'main' 2023-11-20T06:26:15.664 INFO:teuthology.task.kernel:Downloading kernel 7678e1afe51c4ac0c30e2c032e042c836160928a on mon.a... 2023-11-20T06:26:15.664 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7678e1afe51c4ac0c30e2c032e042c836160928a 2023-11-20T06:26:15.685 INFO:teuthology.orchestra.run.smithi190.stderr:Updating files: 51% (1663/3248) Updating files: 52% (1689/3248) Updating files: 53% (1722/3248) Updating files: 54% (1754/3248) Updating files: 55% (1787/3248) Updating files: 56% (1819/3248) Updating files: 57% (1852/3248) Updating files: 58% (1884/3248) Updating files: 59% (1917/3248) Updating files: 60% (1949/3248) Updating files: 61% (1982/3248) Updating files: 62% (2014/3248) Updating files: 63% (2047/3248) Updating files: 64% (2079/3248) Updating files: 64% (2108/3248) Updating files: 65% (2112/3248) Updating files: 66% (2144/3248) Updating files: 67% (2177/3248) Updating files: 68% (2209/3248) Updating files: 69% (2242/3248) Updating files: 70% (2274/3248) Updating files: 71% (2307/3248) Updating files: 72% (2339/3248) Updating files: 73% (2372/3248) Updating files: 74% (2404/3248) Updating files: 75% (2436/3248) Updating files: 76% (2469/3248) Updating files: 77% (2501/3248) Updating files: 78% (2534/3248) Updating files: 79% (2566/3248) Updating files: 80% (2599/3248) Updating files: 81% (2631/3248) Updating files: 81% (2648/3248) Updating files: 82% (2664/3248) Updating files: 83% (2696/3248) Updating files: 84% (2729/3248) Updating files: 85% (2761/3248) Updating files: 86% (2794/3248) Updating files: 87% (2826/3248) Updating files: 88% (2859/3248) Updating files: 89% (2891/3248) Updating files: 90% (2924/3248) Updating files: 91% (2956/3248) Updating files: 92% (2989/3248) Updating files: 93% (3021/3248) Updating files: 94% (3054/3248) Updating files: 95% (3086/3248) Updating files: 96% (3119/3248) Updating files: 97% (3151/3248) Updating files: 98% (3184/3248) Updating files: 99% (3216/3248) Updating files: 100% (3248/3248) Updating files: 100% (3248/3248), done. 2023-11-20T06:26:15.689 INFO:teuthology.orchestra.run.smithi190.stdout:HEAD is now at 7124ce30 Merge branch 'mlimonci/encoding' into 'main' 2023-11-20T06:26:15.711 INFO:teuthology.task.kernel:Downloading kernel 7678e1afe51c4ac0c30e2c032e042c836160928a on mon.b... 2023-11-20T06:26:15.712 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7678e1afe51c4ac0c30e2c032e042c836160928a 2023-11-20T06:26:15.859 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7678e1afe51c4ac0c30e2c032e042c836160928a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g7678e1afe51c/ 2023-11-20T06:26:15.860 DEBUG:teuthology.orchestra.run.smithi190:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g7678e1afe51c_6.6.0-g7678e1afe51c-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/7678e1afe51c4ac0c30e2c032e042c836160928a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g7678e1afe51c/ --input-file=- 2023-11-20T06:26:15.862 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi190.front.sepia.ceph.com to complete... 2023-11-20T06:26:15.885 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7678e1afe51c4ac0c30e2c032e042c836160928a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g7678e1afe51c/ 2023-11-20T06:26:15.885 DEBUG:teuthology.orchestra.run.smithi019:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g7678e1afe51c_6.6.0-g7678e1afe51c-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/7678e1afe51c4ac0c30e2c032e042c836160928a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g7678e1afe51c/ --input-file=- 2023-11-20T06:26:15.888 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi019.front.sepia.ceph.com to complete... 2023-11-20T06:26:18.044 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20 06:26:18 URL:https://2.chacra.ceph.com/r/kernel/testing/7678e1afe51c4ac0c30e2c032e042c836160928a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g7678e1afe51c/linux-image-6.6.0-g7678e1afe51c_6.6.0-g7678e1afe51c-1_amd64.deb [38913850/38913850] -> "/tmp/linux-image.deb" [1] 2023-11-20T06:26:18.044 INFO:teuthology.orchestra.run.smithi190.stderr:FINISHED --2023-11-20 06:26:18-- 2023-11-20T06:26:18.044 INFO:teuthology.orchestra.run.smithi190.stderr:Total wall clock time: 2.0s 2023-11-20T06:26:18.045 INFO:teuthology.orchestra.run.smithi190.stderr:Downloaded: 1 files, 37M in 1.9s (19.6 MB/s) 2023-11-20T06:26:18.047 INFO:teuthology.task.kernel:Installing kernel 7678e1afe51c4ac0c30e2c032e042c836160928a on mon.b... 2023-11-20T06:26:18.048 DEBUG:teuthology.orchestra.run.smithi190:> sudo dpkg -i /tmp/linux-image.deb 2023-11-20T06:26:18.474 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-image-6.6.0-g7678e1afe51c. 2023-11-20T06:26:18.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20 06:26:19 URL:https://2.chacra.ceph.com/r/kernel/testing/7678e1afe51c4ac0c30e2c032e042c836160928a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g7678e1afe51c/linux-image-6.6.0-g7678e1afe51c_6.6.0-g7678e1afe51c-1_amd64.deb [38913850/38913850] -> "/tmp/linux-image.deb" [1] 2023-11-20T06:26:18.939 INFO:teuthology.orchestra.run.smithi019.stderr:FINISHED --2023-11-20 06:26:19-- 2023-11-20T06:26:18.939 INFO:teuthology.orchestra.run.smithi019.stderr:Total wall clock time: 3.0s 2023-11-20T06:26:18.939 INFO:teuthology.orchestra.run.smithi019.stderr:Downloaded: 1 files, 37M in 2.8s (13.2 MB/s) 2023-11-20T06:26:18.942 INFO:teuthology.task.kernel:Installing kernel 7678e1afe51c4ac0c30e2c032e042c836160928a on mon.a... 2023-11-20T06:26:18.942 DEBUG:teuthology.orchestra.run.smithi019:> sudo dpkg -i /tmp/linux-image.deb 2023-11-20T06:26:19.221 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-image-6.6.0-g7678e1afe51c. 2023-11-20T06:26:20.456 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-20T06:26:20.460 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-20T06:26:20.551 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-image-6.6.0-g7678e1afe51c (6.6.0-g7678e1afe51c-1) ... 2023-11-20T06:26:21.168 INFO:teuthology.orchestra.run.smithi019.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-20T06:26:21.173 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-20T06:26:21.287 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-image-6.6.0-g7678e1afe51c (6.6.0-g7678e1afe51c-1) ... 2023-11-20T06:26:23.873 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-image-6.6.0-g7678e1afe51c (6.6.0-g7678e1afe51c-1) ... 2023-11-20T06:26:23.966 INFO:teuthology.orchestra.run.smithi190.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g7678e1afe51c 2023-11-20T06:26:24.755 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-image-6.6.0-g7678e1afe51c (6.6.0-g7678e1afe51c-1) ... 2023-11-20T06:26:24.864 INFO:teuthology.orchestra.run.smithi019.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g7678e1afe51c 2023-11-20T06:26:43.213 INFO:teuthology.orchestra.run.smithi190.stderr:Sourcing file `/etc/default/grub' 2023-11-20T06:26:43.233 INFO:teuthology.orchestra.run.smithi190.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-20T06:26:43.251 INFO:teuthology.orchestra.run.smithi190.stderr:Generating grub configuration file ... 2023-11-20T06:26:43.535 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-6.6.0-g7678e1afe51c 2023-11-20T06:26:43.554 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-6.6.0-g7678e1afe51c 2023-11-20T06:26:43.817 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-20T06:26:43.828 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-20T06:26:43.893 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-20T06:26:43.898 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-20T06:26:44.048 INFO:teuthology.orchestra.run.smithi190.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-20T06:26:44.048 INFO:teuthology.orchestra.run.smithi190.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-20T06:26:44.048 INFO:teuthology.orchestra.run.smithi190.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-20T06:26:44.089 INFO:teuthology.orchestra.run.smithi190.stderr:done 2023-11-20T06:26:44.254 DEBUG:teuthology.orchestra.run.smithi190:> dpkg-deb -c /tmp/linux-image.deb 2023-11-20T06:26:44.261 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./ 2023-11-20T06:26:44.262 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./boot/ 2023-11-20T06:26:44.262 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 4415617 2023-11-20 01:52 ./boot/System.map-6.6.0-g7678e1afe51c 2023-11-20T06:26:44.274 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 169214 2023-11-20 01:52 ./boot/config-6.6.0-g7678e1afe51c 2023-11-20T06:26:44.274 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11352928 2023-11-20 01:52 ./boot/vmlinuz-6.6.0-g7678e1afe51c 2023-11-20T06:26:44.294 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/ 2023-11-20T06:26:44.294 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/kernel/ 2023-11-20T06:26:44.294 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/kernel/postinst.d/ 2023-11-20T06:26:44.294 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/kernel/postrm.d/ 2023-11-20T06:26:44.294 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/kernel/preinst.d/ 2023-11-20T06:26:44.294 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/kernel/prerm.d/ 2023-11-20T06:26:44.295 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/ 2023-11-20T06:26:44.295 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/ 2023-11-20T06:26:44.295 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/ 2023-11-20T06:26:44.295 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/ 2023-11-20T06:26:44.295 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/ 2023-11-20T06:26:44.295 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/ 2023-11-20T06:26:44.295 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/ 2023-11-20T06:26:44.296 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 490233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-20T06:26:44.299 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-20T06:26:44.300 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-20T06:26:44.300 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-20T06:26:44.300 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 93113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-20T06:26:44.300 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 106729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-20T06:26:44.300 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 152241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-20T06:26:44.300 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-20T06:26:44.300 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-20T06:26:44.300 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 83889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-20T06:26:44.300 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-20T06:26:44.300 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-20T06:26:44.301 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-20T06:26:44.301 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-20T06:26:44.301 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-20T06:26:44.301 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-20T06:26:44.301 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 58585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-20T06:26:44.301 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-20T06:26:44.301 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-20T06:26:44.301 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-20T06:26:44.301 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/ 2023-11-20T06:26:44.301 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/cpu/ 2023-11-20T06:26:44.302 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/cpu/mce/ 2023-11-20T06:26:44.302 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-20T06:26:44.302 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/cpuid.ko 2023-11-20T06:26:44.302 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/msr.ko 2023-11-20T06:26:44.302 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kvm/ 2023-11-20T06:26:44.302 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 354433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-20T06:26:44.302 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 881625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-20T06:26:44.302 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 2275865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kvm/kvm.ko 2023-11-20T06:26:44.343 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/ 2023-11-20T06:26:44.344 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/af_alg.ko 2023-11-20T06:26:44.344 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/algif_hash.ko 2023-11-20T06:26:44.344 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/algif_skcipher.ko 2023-11-20T06:26:44.344 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/ansi_cprng.ko 2023-11-20T06:26:44.344 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/anubis.ko 2023-11-20T06:26:44.344 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/arc4.ko 2023-11-20T06:26:44.344 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/asymmetric_keys/ 2023-11-20T06:26:44.344 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-20T06:26:44.344 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/ 2023-11-20T06:26:44.344 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/async_memcpy.ko 2023-11-20T06:26:44.344 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/async_pq.ko 2023-11-20T06:26:44.345 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-20T06:26:44.345 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/async_tx.ko 2023-11-20T06:26:44.345 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/async_xor.ko 2023-11-20T06:26:44.345 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/raid6test.ko 2023-11-20T06:26:44.345 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/authenc.ko 2023-11-20T06:26:44.345 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/authencesn.ko 2023-11-20T06:26:44.345 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/blake2b_generic.ko 2023-11-20T06:26:44.345 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/blowfish_common.ko 2023-11-20T06:26:44.345 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/blowfish_generic.ko 2023-11-20T06:26:44.345 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/camellia_generic.ko 2023-11-20T06:26:44.346 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cast5_generic.ko 2023-11-20T06:26:44.346 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cast6_generic.ko 2023-11-20T06:26:44.346 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cast_common.ko 2023-11-20T06:26:44.346 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/ccm.ko 2023-11-20T06:26:44.346 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cmac.ko 2023-11-20T06:26:44.346 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/crc32_generic.ko 2023-11-20T06:26:44.346 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cryptd.ko 2023-11-20T06:26:44.346 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/crypto_engine.ko 2023-11-20T06:26:44.346 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/crypto_simd.ko 2023-11-20T06:26:44.347 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/crypto_user.ko 2023-11-20T06:26:44.347 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cts.ko 2023-11-20T06:26:44.347 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/des_generic.ko 2023-11-20T06:26:44.347 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/dh_generic.ko 2023-11-20T06:26:44.347 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/echainiv.ko 2023-11-20T06:26:44.347 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/essiv.ko 2023-11-20T06:26:44.347 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/fcrypt.ko 2023-11-20T06:26:44.347 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/khazad.ko 2023-11-20T06:26:44.347 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/lrw.ko 2023-11-20T06:26:44.347 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/lz4.ko 2023-11-20T06:26:44.347 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/lz4hc.ko 2023-11-20T06:26:44.347 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/md4.ko 2023-11-20T06:26:44.348 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/michael_mic.ko 2023-11-20T06:26:44.348 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/pcbc.ko 2023-11-20T06:26:44.348 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/pcrypt.ko 2023-11-20T06:26:44.348 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/rmd160.ko 2023-11-20T06:26:44.348 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/seed.ko 2023-11-20T06:26:44.348 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/serpent_generic.ko 2023-11-20T06:26:44.348 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 149193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/tcrypt.ko 2023-11-20T06:26:44.348 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/tea.ko 2023-11-20T06:26:44.348 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/twofish_common.ko 2023-11-20T06:26:44.348 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/twofish_generic.ko 2023-11-20T06:26:44.348 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/vmac.ko 2023-11-20T06:26:44.349 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/wp512.ko 2023-11-20T06:26:44.349 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/xcbc.ko 2023-11-20T06:26:44.349 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/xor.ko 2023-11-20T06:26:44.349 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/xts.ko 2023-11-20T06:26:44.349 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/xxhash_generic.ko 2023-11-20T06:26:44.349 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ 2023-11-20T06:26:44.349 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/ 2023-11-20T06:26:44.349 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/acpi_extlog.ko 2023-11-20T06:26:44.349 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-20T06:26:44.349 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/acpi_pad.ko 2023-11-20T06:26:44.349 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/apei/ 2023-11-20T06:26:44.349 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/apei/einj.ko 2023-11-20T06:26:44.349 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/ec_sys.ko 2023-11-20T06:26:44.350 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/platform_profile.ko 2023-11-20T06:26:44.350 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/sbs.ko 2023-11-20T06:26:44.350 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/sbshc.ko 2023-11-20T06:26:44.350 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 103025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/video.ko 2023-11-20T06:26:44.350 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/ 2023-11-20T06:26:44.350 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/acard-ahci.ko 2023-11-20T06:26:44.350 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 88865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/ahci.ko 2023-11-20T06:26:44.350 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/ahci_platform.ko 2023-11-20T06:26:44.350 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 88289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/libahci.ko 2023-11-20T06:26:44.350 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/libahci_platform.ko 2023-11-20T06:26:44.350 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_acpi.ko 2023-11-20T06:26:44.350 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_ali.ko 2023-11-20T06:26:44.351 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_amd.ko 2023-11-20T06:26:44.351 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_artop.ko 2023-11-20T06:26:44.351 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_atiixp.ko 2023-11-20T06:26:44.351 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_atp867x.ko 2023-11-20T06:26:44.351 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_cmd640.ko 2023-11-20T06:26:44.351 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_cmd64x.ko 2023-11-20T06:26:44.351 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_cypress.ko 2023-11-20T06:26:44.351 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_efar.ko 2023-11-20T06:26:44.351 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_hpt366.ko 2023-11-20T06:26:44.351 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_hpt37x.ko 2023-11-20T06:26:44.351 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-20T06:26:44.351 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-20T06:26:44.352 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_it8213.ko 2023-11-20T06:26:44.352 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_it821x.ko 2023-11-20T06:26:44.352 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_jmicron.ko 2023-11-20T06:26:44.352 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_legacy.ko 2023-11-20T06:26:44.352 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_marvell.ko 2023-11-20T06:26:44.352 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_mpiix.ko 2023-11-20T06:26:44.352 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_netcell.ko 2023-11-20T06:26:44.352 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_ninja32.ko 2023-11-20T06:26:44.352 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_ns87410.ko 2023-11-20T06:26:44.352 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_ns87415.ko 2023-11-20T06:26:44.352 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_oldpiix.ko 2023-11-20T06:26:44.352 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_opti.ko 2023-11-20T06:26:44.353 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_optidma.ko 2023-11-20T06:26:44.353 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_pcmcia.ko 2023-11-20T06:26:44.353 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-20T06:26:44.353 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-20T06:26:44.353 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_piccolo.ko 2023-11-20T06:26:44.353 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_radisys.ko 2023-11-20T06:26:44.353 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_rdc.ko 2023-11-20T06:26:44.353 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_rz1000.ko 2023-11-20T06:26:44.353 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_sch.ko 2023-11-20T06:26:44.353 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_serverworks.ko 2023-11-20T06:26:44.353 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_sil680.ko 2023-11-20T06:26:44.353 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_sl82c105.ko 2023-11-20T06:26:44.354 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_triflex.ko 2023-11-20T06:26:44.354 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_via.ko 2023-11-20T06:26:44.354 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pdc_adma.ko 2023-11-20T06:26:44.354 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_inic162x.ko 2023-11-20T06:26:44.354 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 83345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_mv.ko 2023-11-20T06:26:44.354 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 70393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_nv.ko 2023-11-20T06:26:44.354 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_promise.ko 2023-11-20T06:26:44.354 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_qstor.ko 2023-11-20T06:26:44.354 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_sil.ko 2023-11-20T06:26:44.354 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_sil24.ko 2023-11-20T06:26:44.354 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_sis.ko 2023-11-20T06:26:44.354 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_svw.ko 2023-11-20T06:26:44.355 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_sx4.ko 2023-11-20T06:26:44.355 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_uli.ko 2023-11-20T06:26:44.355 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_via.ko 2023-11-20T06:26:44.355 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_vsc.ko 2023-11-20T06:26:44.355 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/auxdisplay/ 2023-11-20T06:26:44.355 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/auxdisplay/ks0108.ko 2023-11-20T06:26:44.355 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/bcma/ 2023-11-20T06:26:44.355 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 124473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/bcma/bcma.ko 2023-11-20T06:26:44.355 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/ 2023-11-20T06:26:44.355 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/aoe/ 2023-11-20T06:26:44.355 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 113665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/aoe/aoe.ko 2023-11-20T06:26:44.356 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/drbd/ 2023-11-20T06:26:44.356 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 965585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/drbd/drbd.ko 2023-11-20T06:26:44.356 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 173225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/floppy.ko 2023-11-20T06:26:44.356 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/mtip32xx/ 2023-11-20T06:26:44.356 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 94297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-20T06:26:44.356 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 115793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/nbd.ko 2023-11-20T06:26:44.356 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/null_blk/ 2023-11-20T06:26:44.356 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 110385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/null_blk/null_blk.ko 2023-11-20T06:26:44.356 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 98193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/pktcdvd.ko 2023-11-20T06:26:44.356 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 263769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/rbd.ko 2023-11-20T06:26:44.356 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/xen-blkback/ 2023-11-20T06:26:44.356 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 98145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-20T06:26:44.357 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/zram/ 2023-11-20T06:26:44.357 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 60217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/zram/zram.ko 2023-11-20T06:26:44.357 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ 2023-11-20T06:26:44.357 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/applicom.ko 2023-11-20T06:26:44.357 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hangcheck-timer.ko 2023-11-20T06:26:44.357 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/ 2023-11-20T06:26:44.357 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-20T06:26:44.357 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-20T06:26:44.357 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-20T06:26:44.357 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/via-rng.ko 2023-11-20T06:26:44.357 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-20T06:26:44.357 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ 2023-11-20T06:26:44.358 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-20T06:26:44.358 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 148601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-20T06:26:44.358 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-20T06:26:44.358 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 139313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-20T06:26:44.358 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 70921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-20T06:26:44.358 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-20T06:26:44.358 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/lp.ko 2023-11-20T06:26:44.358 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/mwave/ 2023-11-20T06:26:44.358 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 84097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/mwave/mwave.ko 2023-11-20T06:26:44.358 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/nvram.ko 2023-11-20T06:26:44.358 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ppdev.ko 2023-11-20T06:26:44.359 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tlclk.ko 2023-11-20T06:26:44.359 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/ 2023-11-20T06:26:44.359 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-20T06:26:44.359 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-20T06:26:44.359 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-20T06:26:44.359 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-20T06:26:44.359 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-20T06:26:44.359 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-20T06:26:44.359 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-20T06:26:44.359 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/xillybus/ 2023-11-20T06:26:44.360 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-20T06:26:44.360 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-20T06:26:44.360 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-20T06:26:44.360 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/clk/ 2023-11-20T06:26:44.360 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/clk/clk-palmas.ko 2023-11-20T06:26:44.360 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/clk/clk-si5351.ko 2023-11-20T06:26:44.360 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/clk/clk-twl6040.ko 2023-11-20T06:26:44.360 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/clk/clk-wm831x.ko 2023-11-20T06:26:44.360 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/cpufreq/ 2023-11-20T06:26:44.360 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-20T06:26:44.360 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-20T06:26:44.361 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-20T06:26:44.361 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/ 2023-11-20T06:26:44.361 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/ccp/ 2023-11-20T06:26:44.361 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 70801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-20T06:26:44.361 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 243025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/ccp/ccp.ko 2023-11-20T06:26:44.361 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/ 2023-11-20T06:26:44.361 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/qat/ 2023-11-20T06:26:44.361 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-20T06:26:44.361 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 438761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-20T06:26:44.361 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-20T06:26:44.361 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-20T06:26:44.361 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/padlock-aes.ko 2023-11-20T06:26:44.362 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/padlock-sha.ko 2023-11-20T06:26:44.362 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/virtio/ 2023-11-20T06:26:44.362 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 70273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-20T06:26:44.362 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dca/ 2023-11-20T06:26:44.362 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dca/dca.ko 2023-11-20T06:26:44.362 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dma/ 2023-11-20T06:26:44.362 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dma/dw/ 2023-11-20T06:26:44.362 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-20T06:26:44.362 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dma/ioat/ 2023-11-20T06:26:44.362 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 122569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-20T06:26:44.362 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/ 2023-11-20T06:26:44.362 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 79953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/amd64_edac.ko 2023-11-20T06:26:44.363 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/e752x_edac.ko 2023-11-20T06:26:44.363 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 63617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/edac_mce_amd.ko 2023-11-20T06:26:44.363 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i3000_edac.ko 2023-11-20T06:26:44.363 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i3200_edac.ko 2023-11-20T06:26:44.363 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i5100_edac.ko 2023-11-20T06:26:44.363 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i5400_edac.ko 2023-11-20T06:26:44.363 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i7300_edac.ko 2023-11-20T06:26:44.363 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 52041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i7core_edac.ko 2023-11-20T06:26:44.363 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i82975x_edac.ko 2023-11-20T06:26:44.363 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/ie31200_edac.ko 2023-11-20T06:26:44.363 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 56825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/sb_edac.ko 2023-11-20T06:26:44.363 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/x38_edac.ko 2023-11-20T06:26:44.364 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/ 2023-11-20T06:26:44.364 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-gpio.ko 2023-11-20T06:26:44.364 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-max14577.ko 2023-11-20T06:26:44.364 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-max77693.ko 2023-11-20T06:26:44.364 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-max8997.ko 2023-11-20T06:26:44.364 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-palmas.ko 2023-11-20T06:26:44.364 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-20T06:26:44.364 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-20T06:26:44.364 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/firmware/ 2023-11-20T06:26:44.364 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-20T06:26:44.364 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/firmware/efi/ 2023-11-20T06:26:44.364 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-20T06:26:44.364 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-20T06:26:44.365 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/ 2023-11-20T06:26:44.365 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-20T06:26:44.365 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-20T06:26:44.365 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-arizona.ko 2023-11-20T06:26:44.365 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-da9052.ko 2023-11-20T06:26:44.365 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-da9055.ko 2023-11-20T06:26:44.365 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-dln2.ko 2023-11-20T06:26:44.365 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 77849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-20T06:26:44.365 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-generic.ko 2023-11-20T06:26:44.365 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-ich.ko 2023-11-20T06:26:44.365 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-20T06:26:44.365 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-kempld.ko 2023-11-20T06:26:44.366 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-20T06:26:44.366 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-max7300.ko 2023-11-20T06:26:44.366 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-max730x.ko 2023-11-20T06:26:44.366 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-max732x.ko 2023-11-20T06:26:44.366 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-20T06:26:44.366 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-20T06:26:44.366 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-20T06:26:44.366 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-20T06:26:44.366 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-sch.ko 2023-11-20T06:26:44.366 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-20T06:26:44.366 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-20T06:26:44.366 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-20T06:26:44.367 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-20T06:26:44.367 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-20T06:26:44.367 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-vx855.ko 2023-11-20T06:26:44.367 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-20T06:26:44.367 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-20T06:26:44.367 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-20T06:26:44.367 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/ 2023-11-20T06:26:44.367 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-a4tech.ko 2023-11-20T06:26:44.367 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-apple.ko 2023-11-20T06:26:44.367 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-appleir.ko 2023-11-20T06:26:44.367 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-aureal.ko 2023-11-20T06:26:44.368 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-axff.ko 2023-11-20T06:26:44.368 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-belkin.ko 2023-11-20T06:26:44.368 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-cherry.ko 2023-11-20T06:26:44.368 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-chicony.ko 2023-11-20T06:26:44.368 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 60649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-cp2112.ko 2023-11-20T06:26:44.368 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-cypress.ko 2023-11-20T06:26:44.368 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-dr.ko 2023-11-20T06:26:44.368 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-elecom.ko 2023-11-20T06:26:44.368 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-elo.ko 2023-11-20T06:26:44.368 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-emsff.ko 2023-11-20T06:26:44.368 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-ezkey.ko 2023-11-20T06:26:44.369 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-gaff.ko 2023-11-20T06:26:44.369 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-generic.ko 2023-11-20T06:26:44.369 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-gt683r.ko 2023-11-20T06:26:44.369 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-gyration.ko 2023-11-20T06:26:44.369 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-20T06:26:44.369 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-20T06:26:44.369 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-holtekff.ko 2023-11-20T06:26:44.369 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-hyperv.ko 2023-11-20T06:26:44.369 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-icade.ko 2023-11-20T06:26:44.369 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-kensington.ko 2023-11-20T06:26:44.369 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-keytouch.ko 2023-11-20T06:26:44.370 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-kye.ko 2023-11-20T06:26:44.370 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-lcpower.ko 2023-11-20T06:26:44.370 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-led.ko 2023-11-20T06:26:44.370 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-lenovo.ko 2023-11-20T06:26:44.370 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-lg-g15.ko 2023-11-20T06:26:44.370 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 58185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-20T06:26:44.370 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 101481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-20T06:26:44.370 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 80993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-logitech.ko 2023-11-20T06:26:44.370 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-magicmouse.ko 2023-11-20T06:26:44.370 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-microsoft.ko 2023-11-20T06:26:44.370 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-monterey.ko 2023-11-20T06:26:44.371 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-multitouch.ko 2023-11-20T06:26:44.371 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-ntrig.ko 2023-11-20T06:26:44.371 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-ortek.ko 2023-11-20T06:26:44.371 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-penmount.ko 2023-11-20T06:26:44.371 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-petalynx.ko 2023-11-20T06:26:44.371 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 72937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-picolcd.ko 2023-11-20T06:26:44.371 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-pl.ko 2023-11-20T06:26:44.371 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-plantronics.ko 2023-11-20T06:26:44.371 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-primax.ko 2023-11-20T06:26:44.371 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-rmi.ko 2023-11-20T06:26:44.371 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-20T06:26:44.371 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-common.ko 2023-11-20T06:26:44.372 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-20T06:26:44.372 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-20T06:26:44.372 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-20T06:26:44.372 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-20T06:26:44.372 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-20T06:26:44.372 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-20T06:26:44.372 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-20T06:26:44.372 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-20T06:26:44.372 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-20T06:26:44.372 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat.ko 2023-11-20T06:26:44.372 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-saitek.ko 2023-11-20T06:26:44.372 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-samsung.ko 2023-11-20T06:26:44.373 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-20T06:26:44.373 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-sjoy.ko 2023-11-20T06:26:44.373 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-sony.ko 2023-11-20T06:26:44.373 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-speedlink.ko 2023-11-20T06:26:44.373 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-steelseries.ko 2023-11-20T06:26:44.373 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-sunplus.ko 2023-11-20T06:26:44.373 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-20T06:26:44.373 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-tivo.ko 2023-11-20T06:26:44.373 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-tmff.ko 2023-11-20T06:26:44.373 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-topseed.ko 2023-11-20T06:26:44.373 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-twinhan.ko 2023-11-20T06:26:44.373 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 71073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-uclogic.ko 2023-11-20T06:26:44.374 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-waltop.ko 2023-11-20T06:26:44.374 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 143473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-wiimote.ko 2023-11-20T06:26:44.374 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-xinmo.ko 2023-11-20T06:26:44.374 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-zpff.ko 2023-11-20T06:26:44.374 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-zydacron.ko 2023-11-20T06:26:44.374 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 267825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid.ko 2023-11-20T06:26:44.374 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/uhid.ko 2023-11-20T06:26:44.374 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/usbhid/ 2023-11-20T06:26:44.374 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 125721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-20T06:26:44.374 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-20T06:26:44.375 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-20T06:26:44.375 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 217873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/wacom.ko 2023-11-20T06:26:44.375 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hv/ 2023-11-20T06:26:44.375 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 64201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hv/hv_balloon.ko 2023-11-20T06:26:44.375 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 89625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hv/hv_utils.ko 2023-11-20T06:26:44.375 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 305465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hv/hv_vmbus.ko 2023-11-20T06:26:44.375 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ 2023-11-20T06:26:44.375 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 66521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/abituguru.ko 2023-11-20T06:26:44.375 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 61393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/abituguru3.ko 2023-11-20T06:26:44.375 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-20T06:26:44.375 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ad7414.ko 2023-11-20T06:26:44.375 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ad7418.ko 2023-11-20T06:26:44.376 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adc128d818.ko 2023-11-20T06:26:44.376 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adm1025.ko 2023-11-20T06:26:44.376 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 97977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adm1026.ko 2023-11-20T06:26:44.376 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adm1029.ko 2023-11-20T06:26:44.376 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 45553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adm1031.ko 2023-11-20T06:26:44.376 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adm9240.ko 2023-11-20T06:26:44.376 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ads7828.ko 2023-11-20T06:26:44.376 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7410.ko 2023-11-20T06:26:44.376 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7411.ko 2023-11-20T06:26:44.376 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 74433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7462.ko 2023-11-20T06:26:44.376 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7470.ko 2023-11-20T06:26:44.376 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 67929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7475.ko 2023-11-20T06:26:44.377 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7x10.ko 2023-11-20T06:26:44.377 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/amc6821.ko 2023-11-20T06:26:44.377 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 55201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/applesmc.ko 2023-11-20T06:26:44.377 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/asb100.ko 2023-11-20T06:26:44.377 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 58617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/asc7621.ko 2023-11-20T06:26:44.377 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-20T06:26:44.377 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/atxp1.ko 2023-11-20T06:26:44.377 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/coretemp.ko 2023-11-20T06:26:44.377 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-20T06:26:44.377 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-20T06:26:44.377 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-20T06:26:44.377 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 99601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/dme1737.ko 2023-11-20T06:26:44.377 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ds1621.ko 2023-11-20T06:26:44.378 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ds620.ko 2023-11-20T06:26:44.378 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/emc1403.ko 2023-11-20T06:26:44.378 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/emc2103.ko 2023-11-20T06:26:44.378 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/emc6w201.ko 2023-11-20T06:26:44.378 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 66985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/f71805f.ko 2023-11-20T06:26:44.378 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 94457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/f71882fg.ko 2023-11-20T06:26:44.378 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/f75375s.ko 2023-11-20T06:26:44.378 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/fam15h_power.ko 2023-11-20T06:26:44.378 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 55449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/fschmd.ko 2023-11-20T06:26:44.378 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/g760a.ko 2023-11-20T06:26:44.378 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/g762.ko 2023-11-20T06:26:44.378 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 46801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/gl518sm.ko 2023-11-20T06:26:44.379 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 45529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/gl520sm.ko 2023-11-20T06:26:44.379 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/hih6130.ko 2023-11-20T06:26:44.379 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-20T06:26:44.379 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/i5500_temp.ko 2023-11-20T06:26:44.379 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/i5k_amb.ko 2023-11-20T06:26:44.379 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ibmaem.ko 2023-11-20T06:26:44.379 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ibmpex.ko 2023-11-20T06:26:44.379 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ina209.ko 2023-11-20T06:26:44.379 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ina2xx.ko 2023-11-20T06:26:44.379 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 130449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/it87.ko 2023-11-20T06:26:44.379 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/jc42.ko 2023-11-20T06:26:44.379 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/k10temp.ko 2023-11-20T06:26:44.379 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/k8temp.ko 2023-11-20T06:26:44.380 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lineage-pem.ko 2023-11-20T06:26:44.380 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 48601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm63.ko 2023-11-20T06:26:44.380 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm73.ko 2023-11-20T06:26:44.380 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm75.ko 2023-11-20T06:26:44.380 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm77.ko 2023-11-20T06:26:44.380 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm78.ko 2023-11-20T06:26:44.380 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm80.ko 2023-11-20T06:26:44.380 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm83.ko 2023-11-20T06:26:44.380 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 72833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm85.ko 2023-11-20T06:26:44.380 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 46153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm87.ko 2023-11-20T06:26:44.380 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm90.ko 2023-11-20T06:26:44.380 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm92.ko 2023-11-20T06:26:44.381 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 108841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm93.ko 2023-11-20T06:26:44.381 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm95234.ko 2023-11-20T06:26:44.381 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm95241.ko 2023-11-20T06:26:44.381 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm95245.ko 2023-11-20T06:26:44.381 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc2945.ko 2023-11-20T06:26:44.381 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4151.ko 2023-11-20T06:26:44.381 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4215.ko 2023-11-20T06:26:44.381 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4222.ko 2023-11-20T06:26:44.381 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4245.ko 2023-11-20T06:26:44.381 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4260.ko 2023-11-20T06:26:44.381 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4261.ko 2023-11-20T06:26:44.381 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max16065.ko 2023-11-20T06:26:44.381 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max1619.ko 2023-11-20T06:26:44.382 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max1668.ko 2023-11-20T06:26:44.382 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max197.ko 2023-11-20T06:26:44.382 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max6639.ko 2023-11-20T06:26:44.382 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max6650.ko 2023-11-20T06:26:44.382 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max6697.ko 2023-11-20T06:26:44.382 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-20T06:26:44.382 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/mcp3021.ko 2023-11-20T06:26:44.382 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-20T06:26:44.382 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/nct6683.ko 2023-11-20T06:26:44.382 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 119817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/nct6775-core.ko 2023-11-20T06:26:44.382 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 60705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/nct6775.ko 2023-11-20T06:26:44.383 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 59737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/nct7802.ko 2023-11-20T06:26:44.383 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 82337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pc87360.ko 2023-11-20T06:26:44.383 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pc87427.ko 2023-11-20T06:26:44.383 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pcf8591.ko 2023-11-20T06:26:44.383 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/ 2023-11-20T06:26:44.383 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-20T06:26:44.383 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-20T06:26:44.383 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-20T06:26:44.383 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-20T06:26:44.383 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-20T06:26:44.383 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-20T06:26:44.383 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-20T06:26:44.384 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 82577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-20T06:26:44.384 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-20T06:26:44.384 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-20T06:26:44.384 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-20T06:26:44.384 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-20T06:26:44.384 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/powr1220.ko 2023-11-20T06:26:44.384 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sch5627.ko 2023-11-20T06:26:44.384 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sch5636.ko 2023-11-20T06:26:44.384 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-20T06:26:44.384 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sht15.ko 2023-11-20T06:26:44.384 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sht21.ko 2023-11-20T06:26:44.384 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/shtc1.ko 2023-11-20T06:26:44.384 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sis5595.ko 2023-11-20T06:26:44.385 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/smsc47b397.ko 2023-11-20T06:26:44.385 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/smsc47m1.ko 2023-11-20T06:26:44.385 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/smsc47m192.ko 2023-11-20T06:26:44.385 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/thmc50.ko 2023-11-20T06:26:44.385 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/tmp102.ko 2023-11-20T06:26:44.385 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/tmp103.ko 2023-11-20T06:26:44.385 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/tmp401.ko 2023-11-20T06:26:44.385 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/tmp421.ko 2023-11-20T06:26:44.385 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/via-cputemp.ko 2023-11-20T06:26:44.385 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/via686a.ko 2023-11-20T06:26:44.385 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 52457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/vt1211.ko 2023-11-20T06:26:44.385 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/vt8231.ko 2023-11-20T06:26:44.386 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 57449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83627ehf.ko 2023-11-20T06:26:44.386 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 78873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83627hf.ko 2023-11-20T06:26:44.386 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 71345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83781d.ko 2023-11-20T06:26:44.386 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 63225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83791d.ko 2023-11-20T06:26:44.386 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 71321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83792d.ko 2023-11-20T06:26:44.386 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 101473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83793.ko 2023-11-20T06:26:44.386 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 119505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83795.ko 2023-11-20T06:26:44.386 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83l785ts.ko 2023-11-20T06:26:44.386 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83l786ng.ko 2023-11-20T06:26:44.386 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-20T06:26:44.386 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-20T06:26:44.386 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/ 2023-11-20T06:26:44.387 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/algos/ 2023-11-20T06:26:44.387 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-20T06:26:44.387 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-20T06:26:44.387 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/ 2023-11-20T06:26:44.387 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-20T06:26:44.387 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-20T06:26:44.387 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-20T06:26:44.387 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-20T06:26:44.387 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-20T06:26:44.387 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-20T06:26:44.387 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-20T06:26:44.387 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 6929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-20T06:26:44.387 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-20T06:26:44.388 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-20T06:26:44.388 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-20T06:26:44.388 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-20T06:26:44.388 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-20T06:26:44.388 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-20T06:26:44.388 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-20T06:26:44.388 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 62817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-20T06:26:44.388 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-20T06:26:44.388 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-20T06:26:44.388 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-20T06:26:44.388 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-20T06:26:44.389 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-20T06:26:44.389 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-20T06:26:44.389 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-20T06:26:44.389 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-20T06:26:44.389 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-20T06:26:44.389 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-20T06:26:44.389 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-20T06:26:44.389 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-20T06:26:44.389 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-20T06:26:44.389 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-20T06:26:44.389 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-20T06:26:44.389 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-20T06:26:44.389 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-20T06:26:44.390 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-20T06:26:44.390 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-20T06:26:44.390 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-20T06:26:44.390 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-20T06:26:44.390 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/i2c-mux.ko 2023-11-20T06:26:44.390 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/i2c-smbus.ko 2023-11-20T06:26:44.390 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/i2c-stub.ko 2023-11-20T06:26:44.390 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/muxes/ 2023-11-20T06:26:44.390 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-20T06:26:44.390 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-20T06:26:44.390 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-20T06:26:44.390 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ 2023-11-20T06:26:44.391 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/ 2023-11-20T06:26:44.391 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 273609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-20T06:26:44.391 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 879969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/ib_core.ko 2023-11-20T06:26:44.391 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 69273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-20T06:26:44.391 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 324217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-20T06:26:44.391 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 97985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-20T06:26:44.391 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 282273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-20T06:26:44.391 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 66201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-20T06:26:44.391 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/ 2023-11-20T06:26:44.391 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-20T06:26:44.391 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 493073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-20T06:26:44.392 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mlx4/ 2023-11-20T06:26:44.392 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 419737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-20T06:26:44.392 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mlx5/ 2023-11-20T06:26:44.392 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 739025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-20T06:26:44.392 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mthca/ 2023-11-20T06:26:44.392 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 296625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-20T06:26:44.392 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-20T06:26:44.392 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 153697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-20T06:26:44.392 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/usnic/ 2023-11-20T06:26:44.392 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 168969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-20T06:26:44.477 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/ 2023-11-20T06:26:44.477 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-20T06:26:44.477 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 263081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-20T06:26:44.477 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/iser/ 2023-11-20T06:26:44.477 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 100241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-20T06:26:44.477 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/isert/ 2023-11-20T06:26:44.478 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 111425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-20T06:26:44.478 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/srp/ 2023-11-20T06:26:44.478 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 128753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-20T06:26:44.478 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/srpt/ 2023-11-20T06:26:44.478 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 129529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-20T06:26:44.478 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/ 2023-11-20T06:26:44.478 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/evbug.ko 2023-11-20T06:26:44.478 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/ff-memless.ko 2023-11-20T06:26:44.478 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/gameport/ 2023-11-20T06:26:44.478 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-20T06:26:44.478 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-20T06:26:44.479 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/gameport/gameport.ko 2023-11-20T06:26:44.479 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/joydev.ko 2023-11-20T06:26:44.479 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/ 2023-11-20T06:26:44.479 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-20T06:26:44.479 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-20T06:26:44.479 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-20T06:26:44.479 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-20T06:26:44.479 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-20T06:26:44.479 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-20T06:26:44.479 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-20T06:26:44.480 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/lm8323.ko 2023-11-20T06:26:44.480 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/lm8333.ko 2023-11-20T06:26:44.480 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-20T06:26:44.480 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-20T06:26:44.480 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-20T06:26:44.480 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-20T06:26:44.480 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-20T06:26:44.480 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-20T06:26:44.480 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/qt1070.ko 2023-11-20T06:26:44.480 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/qt2160.ko 2023-11-20T06:26:44.480 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-20T06:26:44.480 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/stowaway.ko 2023-11-20T06:26:44.481 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-20T06:26:44.481 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-20T06:26:44.481 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-20T06:26:44.481 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-20T06:26:44.481 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-20T06:26:44.481 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/matrix-keymap.ko 2023-11-20T06:26:44.481 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/ 2023-11-20T06:26:44.481 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/appletouch.ko 2023-11-20T06:26:44.481 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/bcm5974.ko 2023-11-20T06:26:44.481 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 123681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/cyapatp.ko 2023-11-20T06:26:44.481 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 89449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-20T06:26:44.482 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-20T06:26:44.482 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 335929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/psmouse.ko 2023-11-20T06:26:44.482 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/sermouse.ko 2023-11-20T06:26:44.482 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-20T06:26:44.482 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-20T06:26:44.482 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-20T06:26:44.482 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/rmi4/ 2023-11-20T06:26:44.482 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 109873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-20T06:26:44.482 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/ 2023-11-20T06:26:44.482 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/altera_ps2.ko 2023-11-20T06:26:44.482 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/arc_ps2.ko 2023-11-20T06:26:44.483 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/ct82c710.ko 2023-11-20T06:26:44.483 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-20T06:26:44.483 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/parkbd.ko 2023-11-20T06:26:44.483 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/pcips2.ko 2023-11-20T06:26:44.483 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/ps2mult.ko 2023-11-20T06:26:44.483 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/serio_raw.ko 2023-11-20T06:26:44.483 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/serport.ko 2023-11-20T06:26:44.483 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/sparse-keymap.ko 2023-11-20T06:26:44.483 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/iommu/ 2023-11-20T06:26:44.483 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/iommu/amd/ 2023-11-20T06:26:44.483 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-20T06:26:44.483 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/ 2023-11-20T06:26:44.484 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-88pm860x.ko 2023-11-20T06:26:44.484 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-adp5520.ko 2023-11-20T06:26:44.484 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 59753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-bd2802.ko 2023-11-20T06:26:44.484 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-blinkm.ko 2023-11-20T06:26:44.484 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-da903x.ko 2023-11-20T06:26:44.484 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-da9052.ko 2023-11-20T06:26:44.484 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-gpio.ko 2023-11-20T06:26:44.484 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lm3530.ko 2023-11-20T06:26:44.484 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lm3533.ko 2023-11-20T06:26:44.484 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lm355x.ko 2023-11-20T06:26:44.484 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lm3642.ko 2023-11-20T06:26:44.485 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lp3944.ko 2023-11-20T06:26:44.485 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lp8788.ko 2023-11-20T06:26:44.485 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-max8997.ko 2023-11-20T06:26:44.485 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-mc13783.ko 2023-11-20T06:26:44.485 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-20T06:26:44.485 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-pca9532.ko 2023-11-20T06:26:44.485 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-pca955x.ko 2023-11-20T06:26:44.485 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-pca963x.ko 2023-11-20T06:26:44.485 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-ss4200.ko 2023-11-20T06:26:44.485 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-tca6507.ko 2023-11-20T06:26:44.485 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-20T06:26:44.485 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-wm8350.ko 2023-11-20T06:26:44.486 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ 2023-11-20T06:26:44.486 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-20T06:26:44.486 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-20T06:26:44.486 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-20T06:26:44.486 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-20T06:26:44.486 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-20T06:26:44.486 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-20T06:26:44.486 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-20T06:26:44.486 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-20T06:26:44.486 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/ 2023-11-20T06:26:44.487 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/bcache/ 2023-11-20T06:26:44.487 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 654969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/bcache/bcache.ko 2023-11-20T06:26:44.487 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-bio-prison.ko 2023-11-20T06:26:44.487 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 89601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-bufio.ko 2023-11-20T06:26:44.487 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-cache-smq.ko 2023-11-20T06:26:44.487 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 156009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-cache.ko 2023-11-20T06:26:44.487 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 106897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-crypt.ko 2023-11-20T06:26:44.487 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-delay.ko 2023-11-20T06:26:44.487 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-era.ko 2023-11-20T06:26:44.487 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-flakey.ko 2023-11-20T06:26:44.488 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-log-userspace.ko 2023-11-20T06:26:44.488 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-log.ko 2023-11-20T06:26:44.488 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-mirror.ko 2023-11-20T06:26:44.488 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 78033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-multipath.ko 2023-11-20T06:26:44.488 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-queue-length.ko 2023-11-20T06:26:44.488 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 70825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-raid.ko 2023-11-20T06:26:44.488 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-region-hash.ko 2023-11-20T06:26:44.488 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-round-robin.ko 2023-11-20T06:26:44.488 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-service-time.ko 2023-11-20T06:26:44.488 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 109529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-snapshot.ko 2023-11-20T06:26:44.488 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-switch.ko 2023-11-20T06:26:44.488 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 181865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-thin-pool.ko 2023-11-20T06:26:44.489 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-verity.ko 2023-11-20T06:26:44.489 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-zero.ko 2023-11-20T06:26:44.489 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/faulty.ko 2023-11-20T06:26:44.489 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/linear.ko 2023-11-20T06:26:44.489 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/multipath.ko 2023-11-20T06:26:44.489 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/persistent-data/ 2023-11-20T06:26:44.489 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 199937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-20T06:26:44.489 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/raid0.ko 2023-11-20T06:26:44.489 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 113073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/raid1.ko 2023-11-20T06:26:44.489 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 158681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/raid10.ko 2023-11-20T06:26:44.489 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 395721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/raid456.ko 2023-11-20T06:26:44.489 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/ 2023-11-20T06:26:44.490 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/ 2023-11-20T06:26:44.490 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 178137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptbase.ko 2023-11-20T06:26:44.490 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 63385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptctl.ko 2023-11-20T06:26:44.490 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptfc.ko 2023-11-20T06:26:44.490 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptlan.ko 2023-11-20T06:26:44.490 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 123321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptsas.ko 2023-11-20T06:26:44.490 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 79041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptscsih.ko 2023-11-20T06:26:44.490 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptspi.ko 2023-11-20T06:26:44.490 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/ 2023-11-20T06:26:44.490 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/88pm800.ko 2023-11-20T06:26:44.490 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/88pm805.ko 2023-11-20T06:26:44.490 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/88pm80x.ko 2023-11-20T06:26:44.491 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/arizona-i2c.ko 2023-11-20T06:26:44.491 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 123721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/arizona.ko 2023-11-20T06:26:44.491 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/bcm590xx.ko 2023-11-20T06:26:44.491 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-20T06:26:44.491 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/dln2.ko 2023-11-20T06:26:44.491 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/janz-cmodio.ko 2023-11-20T06:26:44.491 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/kempld-core.ko 2023-11-20T06:26:44.491 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/lm3533-core.ko 2023-11-20T06:26:44.491 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-20T06:26:44.491 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/lp3943.ko 2023-11-20T06:26:44.491 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/lpc_ich.ko 2023-11-20T06:26:44.491 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/lpc_sch.ko 2023-11-20T06:26:44.491 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/max8907.ko 2023-11-20T06:26:44.492 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-20T06:26:44.492 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-20T06:26:44.492 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/menf21bmc.ko 2023-11-20T06:26:44.492 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-20T06:26:44.492 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-20T06:26:44.492 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/pcf50633.ko 2023-11-20T06:26:44.492 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-20T06:26:44.492 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/retu-mfd.ko 2023-11-20T06:26:44.492 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 80425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/si476x-core.ko 2023-11-20T06:26:44.492 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 48457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/sm501.ko 2023-11-20T06:26:44.492 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-20T06:26:44.492 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/tps65010.ko 2023-11-20T06:26:44.493 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/tps6507x.ko 2023-11-20T06:26:44.493 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/viperboard.ko 2023-11-20T06:26:44.493 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/vx855.ko 2023-11-20T06:26:44.493 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/wl1273-core.ko 2023-11-20T06:26:44.493 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/wm8994.ko 2023-11-20T06:26:44.493 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ 2023-11-20T06:26:44.493 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-20T06:26:44.493 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 48489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ad525x_dpot.ko 2023-11-20T06:26:44.493 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/altera-stapl/ 2023-11-20T06:26:44.493 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 46585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-20T06:26:44.493 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/apds9802als.ko 2023-11-20T06:26:44.493 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/apds990x.ko 2023-11-20T06:26:44.493 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 45593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/bh1770glc.ko 2023-11-20T06:26:44.494 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/c2port/ 2023-11-20T06:26:44.494 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-20T06:26:44.494 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/c2port/core.ko 2023-11-20T06:26:44.494 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/cb710/ 2023-11-20T06:26:44.494 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/cb710/cb710.ko 2023-11-20T06:26:44.494 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ds1682.ko 2023-11-20T06:26:44.494 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/dummy-irq.ko 2023-11-20T06:26:44.494 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/echo/ 2023-11-20T06:26:44.494 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/echo/echo.ko 2023-11-20T06:26:44.494 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/eeprom/ 2023-11-20T06:26:44.494 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/eeprom/at24.ko 2023-11-20T06:26:44.494 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-20T06:26:44.495 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-20T06:26:44.495 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/eeprom/max6875.ko 2023-11-20T06:26:44.495 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/enclosure.ko 2023-11-20T06:26:44.495 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/genwqe/ 2023-11-20T06:26:44.495 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 152201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-20T06:26:44.495 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/hmc6352.ko 2023-11-20T06:26:44.495 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/hpilo.ko 2023-11-20T06:26:44.495 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ibmasm/ 2023-11-20T06:26:44.495 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 72129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-20T06:26:44.495 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ics932s401.ko 2023-11-20T06:26:44.495 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/isl29003.ko 2023-11-20T06:26:44.496 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/isl29020.ko 2023-11-20T06:26:44.496 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/lis3lv02d/ 2023-11-20T06:26:44.496 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-20T06:26:44.496 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-20T06:26:44.496 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/mei/ 2023-11-20T06:26:44.496 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 125209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/mei/mei-me.ko 2023-11-20T06:26:44.496 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 56521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/mei/mei-txe.ko 2023-11-20T06:26:44.496 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 310113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/mei/mei.ko 2023-11-20T06:26:44.496 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/phantom.ko 2023-11-20T06:26:44.497 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ti-st/ 2023-11-20T06:26:44.497 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 74265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-20T06:26:44.497 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/tifm_7xx1.ko 2023-11-20T06:26:44.497 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/tifm_core.ko 2023-11-20T06:26:44.497 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/tsl2550.ko 2023-11-20T06:26:44.497 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 48697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/vmw_balloon.ko 2023-11-20T06:26:44.497 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/vmw_vmci/ 2023-11-20T06:26:44.497 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 183609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-20T06:26:44.497 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ 2023-11-20T06:26:44.497 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/bonding/ 2023-11-20T06:26:44.497 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 490129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/bonding/bonding.ko 2023-11-20T06:26:44.497 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/ 2023-11-20T06:26:44.497 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/b53/ 2023-11-20T06:26:44.498 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 106033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-20T06:26:44.498 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-20T06:26:44.498 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-20T06:26:44.498 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-20T06:26:44.498 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 453737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-20T06:26:44.498 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dummy.ko 2023-11-20T06:26:44.498 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/eql.ko 2023-11-20T06:26:44.498 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/ 2023-11-20T06:26:44.498 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/3com/ 2023-11-20T06:26:44.498 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 45785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-20T06:26:44.498 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-20T06:26:44.498 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 130553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-20T06:26:44.499 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 68849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-20T06:26:44.499 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/8390/ 2023-11-20T06:26:44.499 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-20T06:26:44.499 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 59689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-20T06:26:44.499 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-20T06:26:44.499 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 99049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-20T06:26:44.499 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/adaptec/ 2023-11-20T06:26:44.499 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-20T06:26:44.499 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/agere/ 2023-11-20T06:26:44.499 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 69137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-20T06:26:44.499 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/alteon/ 2023-11-20T06:26:44.500 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 59585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-20T06:26:44.500 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/altera/ 2023-11-20T06:26:44.500 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-20T06:26:44.500 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/amd/ 2023-11-20T06:26:44.500 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-20T06:26:44.500 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-20T06:26:44.500 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 87297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-20T06:26:44.500 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/ 2023-11-20T06:26:44.500 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-20T06:26:44.500 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 97337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-20T06:26:44.500 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-20T06:26:44.501 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 104673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-20T06:26:44.501 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-20T06:26:44.501 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 90257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-20T06:26:44.501 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-20T06:26:44.501 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 81569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-20T06:26:44.501 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 69729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-20T06:26:44.501 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/ 2023-11-20T06:26:44.501 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 78401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-20T06:26:44.501 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 176761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-20T06:26:44.501 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-20T06:26:44.501 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1421497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-20T06:26:44.502 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 128569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-20T06:26:44.502 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-20T06:26:44.502 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 132089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-20T06:26:44.502 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 312081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-20T06:26:44.502 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/brocade/ 2023-11-20T06:26:44.502 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-20T06:26:44.502 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 323513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-20T06:26:44.502 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/ 2023-11-20T06:26:44.502 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-20T06:26:44.502 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 193497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-20T06:26:44.502 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-20T06:26:44.502 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 347417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-20T06:26:44.503 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-20T06:26:44.503 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1044497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-20T06:26:44.503 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-20T06:26:44.503 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 166193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-20T06:26:44.503 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-20T06:26:44.503 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-20T06:26:44.503 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/cisco/ 2023-11-20T06:26:44.503 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-20T06:26:44.503 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 204345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-20T06:26:44.503 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/ 2023-11-20T06:26:44.503 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-20T06:26:44.504 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 69449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-20T06:26:44.504 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 61489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-20T06:26:44.504 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 141225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-20T06:26:44.504 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-20T06:26:44.504 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 62817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-20T06:26:44.504 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-20T06:26:44.504 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dlink/ 2023-11-20T06:26:44.504 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 60873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-20T06:26:44.504 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 62833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-20T06:26:44.504 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 45721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dnet.ko 2023-11-20T06:26:44.504 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-20T06:26:44.505 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/emulex/ 2023-11-20T06:26:44.505 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-20T06:26:44.505 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 281137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-20T06:26:44.505 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/ethoc.ko 2023-11-20T06:26:44.505 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/fealnx.ko 2023-11-20T06:26:44.505 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/fujitsu/ 2023-11-20T06:26:44.505 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 45345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-20T06:26:44.505 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/ 2023-11-20T06:26:44.505 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 90465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-20T06:26:44.505 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-20T06:26:44.505 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 295577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-20T06:26:44.505 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-20T06:26:44.505 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 584497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-20T06:26:44.506 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-20T06:26:44.506 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 246209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-20T06:26:44.506 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-20T06:26:44.506 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 925825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-20T06:26:44.506 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-20T06:26:44.506 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 302937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-20T06:26:44.506 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/igb/ 2023-11-20T06:26:44.506 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 514641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-20T06:26:44.506 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-20T06:26:44.506 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 93593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-20T06:26:44.506 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-20T06:26:44.506 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 734305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-20T06:26:44.507 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-20T06:26:44.507 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 151769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-20T06:26:44.507 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 86921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/jme.ko 2023-11-20T06:26:44.507 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/marvell/ 2023-11-20T06:26:44.507 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-20T06:26:44.507 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 102289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-20T06:26:44.507 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 122649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-20T06:26:44.507 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/ 2023-11-20T06:26:44.507 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-20T06:26:44.507 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 727601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-20T06:26:44.507 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 278937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-20T06:26:44.507 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-20T06:26:44.508 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-20T06:26:44.508 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1113681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-20T06:26:44.508 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/micrel/ 2023-11-20T06:26:44.508 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-20T06:26:44.508 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-20T06:26:44.508 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-20T06:26:44.508 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 95665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-20T06:26:44.508 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/myricom/ 2023-11-20T06:26:44.508 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-20T06:26:44.508 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 108649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-20T06:26:44.508 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/natsemi/ 2023-11-20T06:26:44.508 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 73441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-20T06:26:44.509 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-20T06:26:44.509 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/neterion/ 2023-11-20T06:26:44.509 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 150905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-20T06:26:44.509 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/nvidia/ 2023-11-20T06:26:44.509 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 136721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-20T06:26:44.509 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/packetengines/ 2023-11-20T06:26:44.509 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-20T06:26:44.509 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 43145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-20T06:26:44.509 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/ 2023-11-20T06:26:44.509 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-20T06:26:44.509 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 227897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-20T06:26:44.510 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 87081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-20T06:26:44.510 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-20T06:26:44.510 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 672049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-20T06:26:44.510 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/rdc/ 2023-11-20T06:26:44.510 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 43017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-20T06:26:44.510 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/realtek/ 2023-11-20T06:26:44.510 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 67385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-20T06:26:44.510 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 83985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-20T06:26:44.510 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-20T06:26:44.510 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 189801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-20T06:26:44.510 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/samsung/ 2023-11-20T06:26:44.511 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-20T06:26:44.511 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 104241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-20T06:26:44.511 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sfc/ 2023-11-20T06:26:44.511 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1052497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-20T06:26:44.511 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/silan/ 2023-11-20T06:26:44.511 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-20T06:26:44.511 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sis/ 2023-11-20T06:26:44.511 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-20T06:26:44.511 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 63337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-20T06:26:44.511 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/smsc/ 2023-11-20T06:26:44.511 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 61537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-20T06:26:44.511 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 67193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-20T06:26:44.512 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 73409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-20T06:26:44.512 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 68177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-20T06:26:44.512 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/ 2023-11-20T06:26:44.512 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-20T06:26:44.512 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-20T06:26:44.512 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-20T06:26:44.512 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-20T06:26:44.512 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 487025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-20T06:26:44.512 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sun/ 2023-11-20T06:26:44.512 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 103337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-20T06:26:44.512 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 166097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-20T06:26:44.512 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 66329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-20T06:26:44.513 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 78801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-20T06:26:44.513 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/tehuti/ 2023-11-20T06:26:44.513 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-20T06:26:44.513 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/ti/ 2023-11-20T06:26:44.513 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 86529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-20T06:26:44.513 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/via/ 2023-11-20T06:26:44.513 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 80273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-20T06:26:44.513 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 83633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-20T06:26:44.513 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/wiznet/ 2023-11-20T06:26:44.513 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 46241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-20T06:26:44.513 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-20T06:26:44.513 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/xircom/ 2023-11-20T06:26:44.513 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 59993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-20T06:26:44.514 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/fddi/ 2023-11-20T06:26:44.514 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/fddi/defxx.ko 2023-11-20T06:26:44.514 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/fddi/skfp/ 2023-11-20T06:26:44.514 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 216985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-20T06:26:44.514 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 77345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/geneve.ko 2023-11-20T06:26:44.514 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/hyperv/ 2023-11-20T06:26:44.514 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 235521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-20T06:26:44.514 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ieee802154/ 2023-11-20T06:26:44.514 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-20T06:26:44.514 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ifb.ko 2023-11-20T06:26:44.514 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ipvlan/ 2023-11-20T06:26:44.514 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 83769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-20T06:26:44.515 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 62145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/macvlan.ko 2023-11-20T06:26:44.515 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/macvtap.ko 2023-11-20T06:26:44.515 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio/ 2023-11-20T06:26:44.515 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-20T06:26:44.515 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-20T06:26:44.515 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-20T06:26:44.515 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-20T06:26:44.515 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio.ko 2023-11-20T06:26:44.515 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mii.ko 2023-11-20T06:26:44.515 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 43953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/netconsole.ko 2023-11-20T06:26:44.515 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/nlmon.ko 2023-11-20T06:26:44.515 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/pcs/ 2023-11-20T06:26:44.516 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-20T06:26:44.516 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-20T06:26:44.516 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/ 2023-11-20T06:26:44.516 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/amd.ko 2023-11-20T06:26:44.516 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-20T06:26:44.516 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-20T06:26:44.516 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/bcm87xx.ko 2023-11-20T06:26:44.516 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/broadcom.ko 2023-11-20T06:26:44.516 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/cicada.ko 2023-11-20T06:26:44.516 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/davicom.ko 2023-11-20T06:26:44.516 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/et1011c.ko 2023-11-20T06:26:44.516 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/icplus.ko 2023-11-20T06:26:44.516 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/lxt.ko 2023-11-20T06:26:44.517 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 82049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/marvell.ko 2023-11-20T06:26:44.517 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 76113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/micrel.ko 2023-11-20T06:26:44.517 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/national.ko 2023-11-20T06:26:44.517 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 97857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/phylink.ko 2023-11-20T06:26:44.517 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/qsemi.ko 2023-11-20T06:26:44.517 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/realtek.ko 2023-11-20T06:26:44.517 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/smsc.ko 2023-11-20T06:26:44.517 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/ste10Xp.ko 2023-11-20T06:26:44.517 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/vitesse.ko 2023-11-20T06:26:44.517 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/plip/ 2023-11-20T06:26:44.517 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 43505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/plip/plip.ko 2023-11-20T06:26:44.518 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/ 2023-11-20T06:26:44.518 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-20T06:26:44.518 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/ppp_async.ko 2023-11-20T06:26:44.518 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-20T06:26:44.518 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-20T06:26:44.518 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-20T06:26:44.518 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/pppoe.ko 2023-11-20T06:26:44.518 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/pppox.ko 2023-11-20T06:26:44.518 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/pptp.ko 2023-11-20T06:26:44.518 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/sb1000.ko 2023-11-20T06:26:44.518 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/slip/ 2023-11-20T06:26:44.519 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/slip/slip.ko 2023-11-20T06:26:44.519 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/sungem_phy.ko 2023-11-20T06:26:44.519 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 64449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/tap.ko 2023-11-20T06:26:44.519 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/ 2023-11-20T06:26:44.519 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 106169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team.ko 2023-11-20T06:26:44.519 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-20T06:26:44.519 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-20T06:26:44.519 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-20T06:26:44.519 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team_mode_random.ko 2023-11-20T06:26:44.519 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-20T06:26:44.519 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 87017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/veth.ko 2023-11-20T06:26:44.519 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/vmxnet3/ 2023-11-20T06:26:44.520 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 144297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-20T06:26:44.520 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/vxlan/ 2023-11-20T06:26:44.520 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 297329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/vxlan/vxlan.ko 2023-11-20T06:26:44.520 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/xen-netback/ 2023-11-20T06:26:44.520 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 144585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-20T06:26:44.520 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ntb/ 2023-11-20T06:26:44.520 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ntb/ntb.ko 2023-11-20T06:26:44.520 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/nvme/ 2023-11-20T06:26:44.520 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/nvme/host/ 2023-11-20T06:26:44.520 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 265121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/nvme/host/nvme-core.ko 2023-11-20T06:26:44.520 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 102209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/nvme/host/nvme.ko 2023-11-20T06:26:44.520 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/parport/ 2023-11-20T06:26:44.521 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 133841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/parport/parport.ko 2023-11-20T06:26:44.521 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/parport/parport_cs.ko 2023-11-20T06:26:44.521 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 84465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/parport/parport_pc.ko 2023-11-20T06:26:44.521 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/parport/parport_serial.ko 2023-11-20T06:26:44.521 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/ 2023-11-20T06:26:44.521 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/hotplug/ 2023-11-20T06:26:44.521 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-20T06:26:44.521 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-20T06:26:44.521 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-20T06:26:44.521 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/pci-stub.ko 2023-11-20T06:26:44.522 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 46465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/xen-pcifront.ko 2023-11-20T06:26:44.522 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/ 2023-11-20T06:26:44.522 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/i82092.ko 2023-11-20T06:26:44.522 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 145809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/pcmcia.ko 2023-11-20T06:26:44.522 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 62137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-20T06:26:44.522 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-20T06:26:44.522 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/pd6729.ko 2023-11-20T06:26:44.522 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 112889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-20T06:26:44.522 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/phy/ 2023-11-20T06:26:44.522 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/phy/broadcom/ 2023-11-20T06:26:44.522 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-20T06:26:44.523 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/phy/samsung/ 2023-11-20T06:26:44.523 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-20T06:26:44.523 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pinctrl/ 2023-11-20T06:26:44.523 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pinctrl/intel/ 2023-11-20T06:26:44.523 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 70153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-20T06:26:44.523 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/ 2023-11-20T06:26:44.523 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/ 2023-11-20T06:26:44.523 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-20T06:26:44.523 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-20T06:26:44.523 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-20T06:26:44.523 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-20T06:26:44.523 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-20T06:26:44.524 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-20T06:26:44.524 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-20T06:26:44.524 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/ 2023-11-20T06:26:44.524 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 67097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-20T06:26:44.524 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/acerhdf.ko 2023-11-20T06:26:44.524 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-20T06:26:44.524 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 59665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-20T06:26:44.524 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-20T06:26:44.524 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 127441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-20T06:26:44.524 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-20T06:26:44.524 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-20T06:26:44.525 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-20T06:26:44.525 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-20T06:26:44.525 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-20T06:26:44.525 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/hdaps.ko 2023-11-20T06:26:44.525 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-20T06:26:44.525 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/intel/ 2023-11-20T06:26:44.525 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-20T06:26:44.525 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-20T06:26:44.525 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 43497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/intel_ips.ko 2023-11-20T06:26:44.525 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-20T06:26:44.525 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-20T06:26:44.525 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-20T06:26:44.526 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-20T06:26:44.526 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-20T06:26:44.526 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-20T06:26:44.526 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-20T06:26:44.526 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-20T06:26:44.526 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-20T06:26:44.526 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 57569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/wmi.ko 2023-11-20T06:26:44.526 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/ 2023-11-20T06:26:44.526 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/ 2023-11-20T06:26:44.526 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-20T06:26:44.527 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-20T06:26:44.527 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 55057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-20T06:26:44.527 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-20T06:26:44.527 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-20T06:26:44.527 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-20T06:26:44.527 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/da9030_battery.ko 2023-11-20T06:26:44.527 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/da9052-battery.ko 2023-11-20T06:26:44.527 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-20T06:26:44.527 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-20T06:26:44.527 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-20T06:26:44.527 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-20T06:26:44.528 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/gpio-charger.ko 2023-11-20T06:26:44.528 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-20T06:26:44.528 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-20T06:26:44.528 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/max14577_charger.ko 2023-11-20T06:26:44.528 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/max17040_battery.ko 2023-11-20T06:26:44.528 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/max17042_battery.ko 2023-11-20T06:26:44.528 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/max8903_charger.ko 2023-11-20T06:26:44.528 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/max8925_power.ko 2023-11-20T06:26:44.528 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-20T06:26:44.528 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/sbs-battery.ko 2023-11-20T06:26:44.529 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/test_power.ko 2023-11-20T06:26:44.529 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-20T06:26:44.529 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-20T06:26:44.529 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/wm831x_power.ko 2023-11-20T06:26:44.529 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/wm8350_power.ko 2023-11-20T06:26:44.529 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/powercap/ 2023-11-20T06:26:44.529 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 57729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-20T06:26:44.529 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-20T06:26:44.530 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/ 2023-11-20T06:26:44.530 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/clients/ 2023-11-20T06:26:44.530 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-20T06:26:44.530 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-20T06:26:44.530 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/clients/pps_parport.ko 2023-11-20T06:26:44.530 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/pps_core.ko 2023-11-20T06:26:44.530 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ptp/ 2023-11-20T06:26:44.530 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 66385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ptp/ptp.ko 2023-11-20T06:26:44.530 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ptp/ptp_kvm.ko 2023-11-20T06:26:44.531 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/ 2023-11-20T06:26:44.531 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-20T06:26:44.531 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-20T06:26:44.531 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-20T06:26:44.531 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-da9052.ko 2023-11-20T06:26:44.531 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-da9055.ko 2023-11-20T06:26:44.531 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-da9063.ko 2023-11-20T06:26:44.531 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-20T06:26:44.532 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 68577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-20T06:26:44.532 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-20T06:26:44.532 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-20T06:26:44.532 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-20T06:26:44.532 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-20T06:26:44.532 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-20T06:26:44.532 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-20T06:26:44.532 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-20T06:26:44.532 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-em3027.ko 2023-11-20T06:26:44.532 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-20T06:26:44.532 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-20T06:26:44.533 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-20T06:26:44.533 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-20T06:26:44.533 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-20T06:26:44.533 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-20T06:26:44.533 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-20T06:26:44.533 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-20T06:26:44.533 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-max6900.ko 2023-11-20T06:26:44.533 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-max8907.ko 2023-11-20T06:26:44.533 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-max8925.ko 2023-11-20T06:26:44.533 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-max8997.ko 2023-11-20T06:26:44.533 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-max8998.ko 2023-11-20T06:26:44.533 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-20T06:26:44.533 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-20T06:26:44.534 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-palmas.ko 2023-11-20T06:26:44.534 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 46633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-20T06:26:44.534 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-20T06:26:44.534 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-20T06:26:44.534 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-20T06:26:44.534 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-20T06:26:44.534 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-20T06:26:44.534 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-20T06:26:44.534 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-20T06:26:44.534 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-20T06:26:44.534 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-20T06:26:44.535 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-20T06:26:44.535 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-20T06:26:44.535 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-20T06:26:44.535 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-20T06:26:44.535 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-20T06:26:44.535 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-20T06:26:44.535 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-20T06:26:44.535 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-20T06:26:44.535 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-x1205.ko 2023-11-20T06:26:44.535 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ 2023-11-20T06:26:44.535 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 77617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/3w-9xxx.ko 2023-11-20T06:26:44.535 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 57665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/3w-sas.ko 2023-11-20T06:26:44.536 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 55105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/3w-xxxx.ko 2023-11-20T06:26:44.536 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 135185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/BusLogic.ko 2023-11-20T06:26:44.536 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/a100u2w.ko 2023-11-20T06:26:44.536 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aacraid/ 2023-11-20T06:26:44.536 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 272305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-20T06:26:44.536 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 100617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/advansys.ko 2023-11-20T06:26:44.536 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aic7xxx/ 2023-11-20T06:26:44.536 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 356201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-20T06:26:44.536 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 295801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-20T06:26:44.536 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aic94xx/ 2023-11-20T06:26:44.536 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 189185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-20T06:26:44.537 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/am53c974.ko 2023-11-20T06:26:44.537 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/arcmsr/ 2023-11-20T06:26:44.537 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 106881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-20T06:26:44.537 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/atp870u.ko 2023-11-20T06:26:44.537 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/be2iscsi/ 2023-11-20T06:26:44.537 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 246985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-20T06:26:44.537 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bfa/ 2023-11-20T06:26:44.537 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1171945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bfa/bfa.ko 2023-11-20T06:26:44.537 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bnx2fc/ 2023-11-20T06:26:44.537 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 237273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-20T06:26:44.537 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bnx2i/ 2023-11-20T06:26:44.537 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 115369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-20T06:26:44.538 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ch.ko 2023-11-20T06:26:44.538 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/csiostor/ 2023-11-20T06:26:44.538 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 308921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-20T06:26:44.538 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/ 2023-11-20T06:26:44.538 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-20T06:26:44.538 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 76145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-20T06:26:44.538 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-20T06:26:44.538 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 101449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-20T06:26:44.538 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 146689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-20T06:26:44.538 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 75553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/dc395x.ko 2023-11-20T06:26:44.538 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/dmx3191d.ko 2023-11-20T06:26:44.538 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/esas2r/ 2023-11-20T06:26:44.539 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 212425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-20T06:26:44.539 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 60505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/esp_scsi.ko 2023-11-20T06:26:44.539 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fcoe/ 2023-11-20T06:26:44.539 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 78209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-20T06:26:44.539 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 158505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-20T06:26:44.539 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fdomain.ko 2023-11-20T06:26:44.539 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fnic/ 2023-11-20T06:26:44.539 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 263489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fnic/fnic.ko 2023-11-20T06:26:44.539 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 201817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/hpsa.ko 2023-11-20T06:26:44.539 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/hptiop.ko 2023-11-20T06:26:44.539 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/hv_storvsc.ko 2023-11-20T06:26:44.540 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/imm.ko 2023-11-20T06:26:44.540 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/initio.ko 2023-11-20T06:26:44.540 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 266537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ipr.ko 2023-11-20T06:26:44.540 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 101881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ips.ko 2023-11-20T06:26:44.540 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/isci/ 2023-11-20T06:26:44.540 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 317153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/isci/isci.ko 2023-11-20T06:26:44.540 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-20T06:26:44.540 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 52961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-20T06:26:44.540 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libfc/ 2023-11-20T06:26:44.540 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 314865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libfc/libfc.ko 2023-11-20T06:26:44.540 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 145585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libiscsi.ko 2023-11-20T06:26:44.540 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-20T06:26:44.540 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libsas/ 2023-11-20T06:26:44.541 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 216665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libsas/libsas.ko 2023-11-20T06:26:44.541 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/lpfc/ 2023-11-20T06:26:44.541 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 2197249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-20T06:26:44.541 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/megaraid/ 2023-11-20T06:26:44.541 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 73569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-20T06:26:44.541 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-20T06:26:44.541 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 310617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-20T06:26:44.541 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 84721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/megaraid.ko 2023-11-20T06:26:44.541 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/mpt3sas/ 2023-11-20T06:26:44.541 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 659825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-20T06:26:44.541 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/mvsas/ 2023-11-20T06:26:44.541 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 119561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-20T06:26:44.542 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 78129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/mvumi.ko 2023-11-20T06:26:44.542 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pcmcia/ 2023-11-20T06:26:44.542 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 81625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-20T06:26:44.542 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-20T06:26:44.542 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-20T06:26:44.542 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-20T06:26:44.542 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pm8001/ 2023-11-20T06:26:44.542 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 364105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-20T06:26:44.542 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 123617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pmcraid.ko 2023-11-20T06:26:44.542 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ppa.ko 2023-11-20T06:26:44.542 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 55361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla1280.ko 2023-11-20T06:26:44.542 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla2xxx/ 2023-11-20T06:26:44.543 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1876689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-20T06:26:44.543 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 85289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-20T06:26:44.543 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla4xxx/ 2023-11-20T06:26:44.543 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 559033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-20T06:26:44.543 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qlogicfas408.ko 2023-11-20T06:26:44.543 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/raid_class.ko 2023-11-20T06:26:44.543 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 238761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_debug.ko 2023-11-20T06:26:44.543 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 173937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-20T06:26:44.543 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 279313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-20T06:26:44.543 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 97729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-20T06:26:44.543 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 73881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-20T06:26:44.543 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-20T06:26:44.544 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ses.ko 2023-11-20T06:26:44.544 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 115889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/st.ko 2023-11-20T06:26:44.544 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 46825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/stex.ko 2023-11-20T06:26:44.544 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-20T06:26:44.544 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 162121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-20T06:26:44.544 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/virtio_scsi.ko 2023-11-20T06:26:44.544 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-20T06:26:44.544 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/wd719x.ko 2023-11-20T06:26:44.544 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/xen-scsifront.ko 2023-11-20T06:26:44.544 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ssb/ 2023-11-20T06:26:44.544 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 129441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ssb/ssb.ko 2023-11-20T06:26:44.544 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/ 2023-11-20T06:26:44.545 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/iscsi/ 2023-11-20T06:26:44.545 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 736601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-20T06:26:44.545 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/loopback/ 2023-11-20T06:26:44.545 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-20T06:26:44.545 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/target_core_file.ko 2023-11-20T06:26:44.545 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 43025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/target_core_iblock.ko 2023-11-20T06:26:44.545 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 930257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/target_core_mod.ko 2023-11-20T06:26:44.545 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/target_core_pscsi.ko 2023-11-20T06:26:44.545 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 122521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/target_core_user.ko 2023-11-20T06:26:44.545 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/tcm_fc/ 2023-11-20T06:26:44.545 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 75593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-20T06:26:44.545 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/ 2023-11-20T06:26:44.545 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/ 2023-11-20T06:26:44.546 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-20T06:26:44.546 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-20T06:26:44.546 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-20T06:26:44.546 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-20T06:26:44.546 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-20T06:26:44.546 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-20T06:26:44.546 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-20T06:26:44.546 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-20T06:26:44.546 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-20T06:26:44.546 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-20T06:26:44.546 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-20T06:26:44.547 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-20T06:26:44.547 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-20T06:26:44.547 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-20T06:26:44.547 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-20T06:26:44.547 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-20T06:26:44.547 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-20T06:26:44.547 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/ 2023-11-20T06:26:44.547 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/ipwireless/ 2023-11-20T06:26:44.547 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 78425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-20T06:26:44.547 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 57865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/moxa.ko 2023-11-20T06:26:44.547 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/mxser.ko 2023-11-20T06:26:44.547 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 108601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/n_gsm.ko 2023-11-20T06:26:44.548 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/n_hdlc.ko 2023-11-20T06:26:44.548 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 67929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/nozomi.ko 2023-11-20T06:26:44.548 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/ 2023-11-20T06:26:44.548 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/8250/ 2023-11-20T06:26:44.548 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-20T06:26:44.548 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 59497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-20T06:26:44.548 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-20T06:26:44.548 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/altera_uart.ko 2023-11-20T06:26:44.548 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/arc_uart.ko 2023-11-20T06:26:44.548 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 72425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-20T06:26:44.548 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/jsm/ 2023-11-20T06:26:44.548 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 103073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-20T06:26:44.549 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/rp2.ko 2023-11-20T06:26:44.549 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 52817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-20T06:26:44.549 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/ 2023-11-20T06:26:44.549 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/core/ 2023-11-20T06:26:44.549 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 531265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-20T06:26:44.549 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/host/ 2023-11-20T06:26:44.549 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-20T06:26:44.549 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-20T06:26:44.549 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/ 2023-11-20T06:26:44.549 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio.ko 2023-11-20T06:26:44.549 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_aec.ko 2023-11-20T06:26:44.550 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_cif.ko 2023-11-20T06:26:44.550 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-20T06:26:44.550 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_mf624.ko 2023-11-20T06:26:44.550 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_netx.ko 2023-11-20T06:26:44.550 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_pci_generic.ko 2023-11-20T06:26:44.550 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-20T06:26:44.550 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_sercos3.ko 2023-11-20T06:26:44.550 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/ 2023-11-20T06:26:44.550 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/c67x00/ 2023-11-20T06:26:44.550 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 73297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-20T06:26:44.550 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/chipidea/ 2023-11-20T06:26:44.550 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 144377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-20T06:26:44.551 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-20T06:26:44.551 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-20T06:26:44.551 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-20T06:26:44.551 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/class/ 2023-11-20T06:26:44.551 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 87089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/class/cdc-acm.ko 2023-11-20T06:26:44.551 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-20T06:26:44.551 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/class/usblp.ko 2023-11-20T06:26:44.551 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 89857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/class/usbtmc.ko 2023-11-20T06:26:44.551 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/common/ 2023-11-20T06:26:44.551 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/common/ulpi.ko 2023-11-20T06:26:44.551 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc2/ 2023-11-20T06:26:44.551 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-20T06:26:44.551 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc3/ 2023-11-20T06:26:44.552 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-20T06:26:44.552 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-20T06:26:44.552 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 448505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-20T06:26:44.552 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/ 2023-11-20T06:26:44.552 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/ 2023-11-20T06:26:44.552 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 60177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-20T06:26:44.552 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-20T06:26:44.552 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-20T06:26:44.552 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-20T06:26:44.552 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-20T06:26:44.552 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-20T06:26:44.553 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 92489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-20T06:26:44.553 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-20T06:26:44.553 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 122081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-20T06:26:44.553 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 57681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-20T06:26:44.553 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-20T06:26:44.553 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-20T06:26:44.553 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 57729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-20T06:26:44.553 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 85609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-20T06:26:44.553 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-20T06:26:44.553 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 58113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-20T06:26:44.553 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 67337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-20T06:26:44.553 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/ 2023-11-20T06:26:44.554 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-20T06:26:44.554 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-20T06:26:44.554 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-20T06:26:44.554 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-20T06:26:44.554 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-20T06:26:44.554 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-20T06:26:44.554 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-20T06:26:44.554 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-20T06:26:44.554 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-20T06:26:44.554 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-20T06:26:44.554 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-20T06:26:44.554 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-20T06:26:44.555 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 62185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-20T06:26:44.555 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-20T06:26:44.555 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 161225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-20T06:26:44.555 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/ 2023-11-20T06:26:44.555 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-20T06:26:44.555 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-20T06:26:44.555 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 157681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-20T06:26:44.555 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-20T06:26:44.555 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 52721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-20T06:26:44.555 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 69705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-20T06:26:44.555 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 56033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-20T06:26:44.555 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 76057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-20T06:26:44.556 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 75073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-20T06:26:44.556 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 73169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-20T06:26:44.556 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 65809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-20T06:26:44.556 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 66097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-20T06:26:44.556 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 81505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-20T06:26:44.556 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 156073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-20T06:26:44.556 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/ 2023-11-20T06:26:44.556 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-20T06:26:44.556 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 80113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-20T06:26:44.556 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 87353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-20T06:26:44.556 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 78873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-20T06:26:44.556 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-20T06:26:44.556 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/sl811_cs.ko 2023-11-20T06:26:44.557 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-20T06:26:44.557 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-20T06:26:44.557 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/image/ 2023-11-20T06:26:44.557 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/image/mdc800.ko 2023-11-20T06:26:44.557 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/image/microtek.ko 2023-11-20T06:26:44.557 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/ 2023-11-20T06:26:44.557 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/adutux.ko 2023-11-20T06:26:44.557 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/appledisplay.ko 2023-11-20T06:26:44.557 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-20T06:26:44.557 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/cytherm.ko 2023-11-20T06:26:44.557 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/ehset.ko 2023-11-20T06:26:44.557 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/emi26.ko 2023-11-20T06:26:44.557 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/emi62.ko 2023-11-20T06:26:44.558 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/ezusb.ko 2023-11-20T06:26:44.558 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/idmouse.ko 2023-11-20T06:26:44.558 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/iowarrior.ko 2023-11-20T06:26:44.558 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-20T06:26:44.558 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/ldusb.ko 2023-11-20T06:26:44.558 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/legousbtower.ko 2023-11-20T06:26:44.558 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/lvstest.ko 2023-11-20T06:26:44.558 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/sisusbvga/ 2023-11-20T06:26:44.558 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 64841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-20T06:26:44.558 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-20T06:26:44.558 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/usb3503.ko 2023-11-20T06:26:44.558 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/usblcd.ko 2023-11-20T06:26:44.559 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-20T06:26:44.559 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 70809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/usbtest.ko 2023-11-20T06:26:44.559 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/uss720.ko 2023-11-20T06:26:44.559 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/yurex.ko 2023-11-20T06:26:44.559 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/mon/ 2023-11-20T06:26:44.559 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 72953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/mon/usbmon.ko 2023-11-20T06:26:44.559 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/musb/ 2023-11-20T06:26:44.559 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 301697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-20T06:26:44.559 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/phy/ 2023-11-20T06:26:44.559 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/phy/phy-generic.ko 2023-11-20T06:26:44.559 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-20T06:26:44.559 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-20T06:26:44.560 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-20T06:26:44.560 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ 2023-11-20T06:26:44.560 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/aircable.ko 2023-11-20T06:26:44.560 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ark3116.ko 2023-11-20T06:26:44.560 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-20T06:26:44.560 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ch341.ko 2023-11-20T06:26:44.560 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 70257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/cp210x.ko 2023-11-20T06:26:44.560 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/cyberjack.ko 2023-11-20T06:26:44.560 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 58217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-20T06:26:44.560 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-20T06:26:44.560 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/empeg.ko 2023-11-20T06:26:44.560 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/f81232.ko 2023-11-20T06:26:44.561 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 175137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-20T06:26:44.561 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-20T06:26:44.561 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 137081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-20T06:26:44.561 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 124833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/io_ti.ko 2023-11-20T06:26:44.561 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 67769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ipaq.ko 2023-11-20T06:26:44.561 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ipw.ko 2023-11-20T06:26:44.561 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ir-usb.ko 2023-11-20T06:26:44.561 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 58233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-20T06:26:44.561 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 107521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/keyspan.ko 2023-11-20T06:26:44.561 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-20T06:26:44.561 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-20T06:26:44.561 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-20T06:26:44.562 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/mct_u232.ko 2023-11-20T06:26:44.562 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/metro-usb.ko 2023-11-20T06:26:44.562 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 66449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/mos7720.ko 2023-11-20T06:26:44.562 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 78217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/mos7840.ko 2023-11-20T06:26:44.562 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 56337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/mxuport.ko 2023-11-20T06:26:44.562 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/navman.ko 2023-11-20T06:26:44.562 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/omninet.ko 2023-11-20T06:26:44.562 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/opticon.ko 2023-11-20T06:26:44.562 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 191137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/option.ko 2023-11-20T06:26:44.562 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/oti6858.ko 2023-11-20T06:26:44.562 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/pl2303.ko 2023-11-20T06:26:44.562 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/qcaux.ko 2023-11-20T06:26:44.563 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/qcserial.ko 2023-11-20T06:26:44.563 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/quatech2.ko 2023-11-20T06:26:44.563 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/safe_serial.ko 2023-11-20T06:26:44.563 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/sierra.ko 2023-11-20T06:26:44.563 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-20T06:26:44.563 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ssu100.ko 2023-11-20T06:26:44.563 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/symbolserial.ko 2023-11-20T06:26:44.563 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 61489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-20T06:26:44.563 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-20T06:26:44.563 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/usb_debug.ko 2023-11-20T06:26:44.563 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-20T06:26:44.563 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 125609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/usbserial.ko 2023-11-20T06:26:44.564 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/visor.ko 2023-11-20T06:26:44.564 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/whiteheat.ko 2023-11-20T06:26:44.564 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-20T06:26:44.564 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-20T06:26:44.564 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ 2023-11-20T06:26:44.564 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 52913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/uas.ko 2023-11-20T06:26:44.564 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-20T06:26:44.564 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-20T06:26:44.564 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-20T06:26:44.564 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-20T06:26:44.564 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-20T06:26:44.565 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-20T06:26:44.565 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-20T06:26:44.565 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-karma.ko 2023-11-20T06:26:44.565 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-20T06:26:44.565 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-20T06:26:44.565 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-20T06:26:44.565 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-20T06:26:44.565 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-20T06:26:44.565 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 179969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/usb-storage.ko 2023-11-20T06:26:44.565 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/usbip/ 2023-11-20T06:26:44.565 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 67481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-20T06:26:44.566 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 72177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-20T06:26:44.566 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 107001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-20T06:26:44.566 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/ 2023-11-20T06:26:44.566 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/pci/ 2023-11-20T06:26:44.566 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 154297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-20T06:26:44.566 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-20T06:26:44.566 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 108737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/vfio.ko 2023-11-20T06:26:44.566 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 77609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-20T06:26:44.566 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vhost/ 2023-11-20T06:26:44.566 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 113785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vhost/vhost.ko 2023-11-20T06:26:44.567 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-20T06:26:44.567 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 58089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vhost/vhost_net.ko 2023-11-20T06:26:44.567 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 89249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vhost/vhost_scsi.ko 2023-11-20T06:26:44.567 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/ 2023-11-20T06:26:44.567 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/ 2023-11-20T06:26:44.567 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-20T06:26:44.567 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-20T06:26:44.567 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-20T06:26:44.567 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-20T06:26:44.567 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-20T06:26:44.567 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/apple_bl.ko 2023-11-20T06:26:44.567 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-20T06:26:44.568 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/bd6107.ko 2023-11-20T06:26:44.568 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-20T06:26:44.568 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-20T06:26:44.568 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-20T06:26:44.568 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-20T06:26:44.568 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/lcd.ko 2023-11-20T06:26:44.568 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-20T06:26:44.568 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-20T06:26:44.568 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-20T06:26:44.568 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-20T06:26:44.568 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-20T06:26:44.568 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-20T06:26:44.569 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-20T06:26:44.569 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-20T06:26:44.569 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/ 2023-11-20T06:26:44.569 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/masters/ 2023-11-20T06:26:44.569 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/masters/ds2482.ko 2023-11-20T06:26:44.569 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/masters/ds2490.ko 2023-11-20T06:26:44.569 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-20T06:26:44.569 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-20T06:26:44.569 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/ 2023-11-20T06:26:44.569 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-20T06:26:44.569 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-20T06:26:44.569 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-20T06:26:44.569 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-20T06:26:44.570 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-20T06:26:44.570 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-20T06:26:44.570 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-20T06:26:44.570 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-20T06:26:44.570 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-20T06:26:44.570 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-20T06:26:44.570 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 56425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-20T06:26:44.570 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 102673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/wire.ko 2023-11-20T06:26:44.570 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/ 2023-11-20T06:26:44.570 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/acquirewdt.ko 2023-11-20T06:26:44.571 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/advantechwdt.ko 2023-11-20T06:26:44.571 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-20T06:26:44.571 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-20T06:26:44.571 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-20T06:26:44.571 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-20T06:26:44.571 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-20T06:26:44.571 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-20T06:26:44.571 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/dw_wdt.ko 2023-11-20T06:26:44.571 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-20T06:26:44.571 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-20T06:26:44.571 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/hpwdt.ko 2023-11-20T06:26:44.571 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/i6300esb.ko 2023-11-20T06:26:44.572 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-20T06:26:44.572 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-20T06:26:44.572 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/ib700wdt.ko 2023-11-20T06:26:44.572 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/ibmasr.ko 2023-11-20T06:26:44.572 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-20T06:26:44.572 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-20T06:26:44.572 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/it87_wdt.ko 2023-11-20T06:26:44.572 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-20T06:26:44.573 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/machzwd.ko 2023-11-20T06:26:44.573 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-20T06:26:44.573 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-20T06:26:44.573 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/nv_tco.ko 2023-11-20T06:26:44.573 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-20T06:26:44.573 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-20T06:26:44.573 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-20T06:26:44.573 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-20T06:26:44.573 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/retu_wdt.ko 2023-11-20T06:26:44.573 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-20T06:26:44.573 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-20T06:26:44.573 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-20T06:26:44.573 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-20T06:26:44.574 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-20T06:26:44.574 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-20T06:26:44.574 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/softdog.ko 2023-11-20T06:26:44.574 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-20T06:26:44.574 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-20T06:26:44.574 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/via_wdt.ko 2023-11-20T06:26:44.574 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-20T06:26:44.574 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-20T06:26:44.574 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-20T06:26:44.574 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-20T06:26:44.574 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/wdt_pci.ko 2023-11-20T06:26:44.575 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-20T06:26:44.575 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-20T06:26:44.575 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/xen_wdt.ko 2023-11-20T06:26:44.575 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/ 2023-11-20T06:26:44.575 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-evtchn.ko 2023-11-20T06:26:44.575 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-gntalloc.ko 2023-11-20T06:26:44.575 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-gntdev.ko 2023-11-20T06:26:44.575 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-pciback/ 2023-11-20T06:26:44.575 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 176377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-20T06:26:44.575 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-privcmd.ko 2023-11-20T06:26:44.575 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 71249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-scsiback.ko 2023-11-20T06:26:44.575 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xenfs/ 2023-11-20T06:26:44.576 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-20T06:26:44.576 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ 2023-11-20T06:26:44.576 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/9p/ 2023-11-20T06:26:44.576 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 166425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/9p/9p.ko 2023-11-20T06:26:44.576 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/adfs/ 2023-11-20T06:26:44.576 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 61073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/adfs/adfs.ko 2023-11-20T06:26:44.576 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/affs/ 2023-11-20T06:26:44.576 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 163593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/affs/affs.ko 2023-11-20T06:26:44.577 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/afs/ 2023-11-20T06:26:44.577 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 932817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/afs/kafs.ko 2023-11-20T06:26:44.577 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/autofs/ 2023-11-20T06:26:44.577 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 101057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/autofs/autofs4.ko 2023-11-20T06:26:44.577 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/befs/ 2023-11-20T06:26:44.577 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 64545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/befs/befs.ko 2023-11-20T06:26:44.577 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/bfs/ 2023-11-20T06:26:44.577 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/bfs/bfs.ko 2023-11-20T06:26:44.577 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/binfmt_misc.ko 2023-11-20T06:26:44.577 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/btrfs/ 2023-11-20T06:26:44.577 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 3402729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/btrfs/btrfs.ko 2023-11-20T06:26:44.577 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/cachefiles/ 2023-11-20T06:26:44.577 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 306009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/cachefiles/cachefiles.ko 2023-11-20T06:26:44.578 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ceph/ 2023-11-20T06:26:44.578 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1332449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ceph/ceph.ko 2023-11-20T06:26:44.620 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/coda/ 2023-11-20T06:26:44.620 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 100801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/coda/coda.ko 2023-11-20T06:26:44.621 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/configfs/ 2023-11-20T06:26:44.621 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 108393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/configfs/configfs.ko 2023-11-20T06:26:44.621 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/cramfs/ 2023-11-20T06:26:44.621 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/cramfs/cramfs.ko 2023-11-20T06:26:44.621 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/dlm/ 2023-11-20T06:26:44.621 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 642513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/dlm/dlm.ko 2023-11-20T06:26:44.621 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/efs/ 2023-11-20T06:26:44.621 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/efs/efs.ko 2023-11-20T06:26:44.621 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/f2fs/ 2023-11-20T06:26:44.621 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1505025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/f2fs/f2fs.ko 2023-11-20T06:26:44.621 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fat/ 2023-11-20T06:26:44.621 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fat/msdos.ko 2023-11-20T06:26:44.622 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/freevxfs/ 2023-11-20T06:26:44.622 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/freevxfs/freevxfs.ko 2023-11-20T06:26:44.622 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fscache/ 2023-11-20T06:26:44.622 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 226481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fscache/fscache.ko 2023-11-20T06:26:44.622 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fuse/ 2023-11-20T06:26:44.622 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fuse/cuse.ko 2023-11-20T06:26:44.622 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/gfs2/ 2023-11-20T06:26:44.622 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1231529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/gfs2/gfs2.ko 2023-11-20T06:26:44.622 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hfs/ 2023-11-20T06:26:44.622 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 141209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hfs/hfs.ko 2023-11-20T06:26:44.622 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hfsplus/ 2023-11-20T06:26:44.622 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 222817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hfsplus/hfsplus.ko 2023-11-20T06:26:44.623 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hpfs/ 2023-11-20T06:26:44.623 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 192329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hpfs/hpfs.ko 2023-11-20T06:26:44.623 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/isofs/ 2023-11-20T06:26:44.623 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 74065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/isofs/isofs.ko 2023-11-20T06:26:44.623 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/jfs/ 2023-11-20T06:26:44.623 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 419497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/jfs/jfs.ko 2023-11-20T06:26:44.623 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/lockd/ 2023-11-20T06:26:44.623 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 280313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/lockd/lockd.ko 2023-11-20T06:26:44.623 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/minix/ 2023-11-20T06:26:44.623 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 89193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/minix/minix.ko 2023-11-20T06:26:44.623 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/netfs/ 2023-11-20T06:26:44.623 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 124649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/netfs/netfs.ko 2023-11-20T06:26:44.624 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/ 2023-11-20T06:26:44.624 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/blocklayout/ 2023-11-20T06:26:44.624 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 81449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-20T06:26:44.624 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/filelayout/ 2023-11-20T06:26:44.624 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 59449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-20T06:26:44.624 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/flexfilelayout/ 2023-11-20T06:26:44.624 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 117465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-20T06:26:44.624 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1055721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/nfs.ko 2023-11-20T06:26:44.624 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 66441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/nfsv2.ko 2023-11-20T06:26:44.624 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 120177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/nfsv3.ko 2023-11-20T06:26:44.625 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 2042137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/nfsv4.ko 2023-11-20T06:26:44.625 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs_common/ 2023-11-20T06:26:44.625 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs_common/grace.ko 2023-11-20T06:26:44.625 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs_common/nfs_acl.ko 2023-11-20T06:26:44.625 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfsd/ 2023-11-20T06:26:44.625 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1516873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfsd/nfsd.ko 2023-11-20T06:26:44.625 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nilfs2/ 2023-11-20T06:26:44.625 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 592833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nilfs2/nilfs2.ko 2023-11-20T06:26:44.625 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/ 2023-11-20T06:26:44.625 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-celtic.ko 2023-11-20T06:26:44.625 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-centeuro.ko 2023-11-20T06:26:44.626 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-croatian.ko 2023-11-20T06:26:44.626 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-cyrillic.ko 2023-11-20T06:26:44.626 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-gaelic.ko 2023-11-20T06:26:44.626 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-greek.ko 2023-11-20T06:26:44.626 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-iceland.ko 2023-11-20T06:26:44.626 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-inuit.ko 2023-11-20T06:26:44.626 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-roman.ko 2023-11-20T06:26:44.626 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-romanian.ko 2023-11-20T06:26:44.626 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-turkish.ko 2023-11-20T06:26:44.626 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_ascii.ko 2023-11-20T06:26:44.626 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp1250.ko 2023-11-20T06:26:44.626 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp1251.ko 2023-11-20T06:26:44.627 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp1255.ko 2023-11-20T06:26:44.627 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp737.ko 2023-11-20T06:26:44.627 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp775.ko 2023-11-20T06:26:44.627 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp850.ko 2023-11-20T06:26:44.627 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp852.ko 2023-11-20T06:26:44.627 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp855.ko 2023-11-20T06:26:44.627 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp857.ko 2023-11-20T06:26:44.627 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp860.ko 2023-11-20T06:26:44.627 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp861.ko 2023-11-20T06:26:44.627 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp862.ko 2023-11-20T06:26:44.627 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp863.ko 2023-11-20T06:26:44.628 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp864.ko 2023-11-20T06:26:44.628 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp865.ko 2023-11-20T06:26:44.628 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp866.ko 2023-11-20T06:26:44.628 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp869.ko 2023-11-20T06:26:44.628 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp874.ko 2023-11-20T06:26:44.628 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 94137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp932.ko 2023-11-20T06:26:44.628 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 142673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp936.ko 2023-11-20T06:26:44.628 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 165745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp949.ko 2023-11-20T06:26:44.628 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 118121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp950.ko 2023-11-20T06:26:44.628 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_euc-jp.ko 2023-11-20T06:26:44.628 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-1.ko 2023-11-20T06:26:44.628 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-13.ko 2023-11-20T06:26:44.629 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-14.ko 2023-11-20T06:26:44.629 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-15.ko 2023-11-20T06:26:44.629 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-2.ko 2023-11-20T06:26:44.629 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-3.ko 2023-11-20T06:26:44.629 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-4.ko 2023-11-20T06:26:44.629 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-5.ko 2023-11-20T06:26:44.629 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-6.ko 2023-11-20T06:26:44.629 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-7.ko 2023-11-20T06:26:44.629 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-9.ko 2023-11-20T06:26:44.629 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_koi8-r.ko 2023-11-20T06:26:44.629 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_koi8-ru.ko 2023-11-20T06:26:44.629 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_koi8-u.ko 2023-11-20T06:26:44.630 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-20T06:26:44.630 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_utf8.ko 2023-11-20T06:26:44.630 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ntfs/ 2023-11-20T06:26:44.630 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 219417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ntfs/ntfs.ko 2023-11-20T06:26:44.630 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/ 2023-11-20T06:26:44.630 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/cluster/ 2023-11-20T06:26:44.630 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 244409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-20T06:26:44.630 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/dlm/ 2023-11-20T06:26:44.630 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 440737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-20T06:26:44.630 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/dlmfs/ 2023-11-20T06:26:44.630 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-20T06:26:44.631 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 2592433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/ocfs2.ko 2023-11-20T06:26:44.631 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-20T06:26:44.631 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-20T06:26:44.631 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-20T06:26:44.631 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/omfs/ 2023-11-20T06:26:44.631 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/omfs/omfs.ko 2023-11-20T06:26:44.631 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/overlayfs/ 2023-11-20T06:26:44.631 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 352161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/overlayfs/overlay.ko 2023-11-20T06:26:44.631 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/pstore/ 2023-11-20T06:26:44.631 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/pstore/ramoops.ko 2023-11-20T06:26:44.631 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/qnx4/ 2023-11-20T06:26:44.631 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/qnx4/qnx4.ko 2023-11-20T06:26:44.632 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/qnx6/ 2023-11-20T06:26:44.632 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 46689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/qnx6/qnx6.ko 2023-11-20T06:26:44.632 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/quota/ 2023-11-20T06:26:44.632 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/quota/quota_tree.ko 2023-11-20T06:26:44.632 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/quota/quota_v1.ko 2023-11-20T06:26:44.632 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/quota/quota_v2.ko 2023-11-20T06:26:44.632 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/reiserfs/ 2023-11-20T06:26:44.632 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 532673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/reiserfs/reiserfs.ko 2023-11-20T06:26:44.632 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/romfs/ 2023-11-20T06:26:44.632 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/romfs/romfs.ko 2023-11-20T06:26:44.632 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/ 2023-11-20T06:26:44.633 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/client/ 2023-11-20T06:26:44.633 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 2668401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/client/cifs.ko 2023-11-20T06:26:44.633 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/common/ 2023-11-20T06:26:44.633 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/common/cifs_arc4.ko 2023-11-20T06:26:44.633 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/common/cifs_md4.ko 2023-11-20T06:26:44.633 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/squashfs/ 2023-11-20T06:26:44.633 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 134641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/squashfs/squashfs.ko 2023-11-20T06:26:44.633 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/sysv/ 2023-11-20T06:26:44.633 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 90721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/sysv/sysv.ko 2023-11-20T06:26:44.633 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/udf/ 2023-11-20T06:26:44.633 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 247737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/udf/udf.ko 2023-11-20T06:26:44.633 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ufs/ 2023-11-20T06:26:44.634 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 162497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ufs/ufs.ko 2023-11-20T06:26:44.634 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/xfs/ 2023-11-20T06:26:44.634 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 4011017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/xfs/xfs.ko 2023-11-20T06:26:44.634 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/ 2023-11-20T06:26:44.634 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/locking/ 2023-11-20T06:26:44.634 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 75489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/locking/locktorture.ko 2023-11-20T06:26:44.634 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/time/ 2023-11-20T06:26:44.634 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/time/test_udelay.ko 2023-11-20T06:26:44.634 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 60553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/torture.ko 2023-11-20T06:26:44.634 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/ 2023-11-20T06:26:44.635 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 6833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crc-itu-t.ko 2023-11-20T06:26:44.635 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 6529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crc7.ko 2023-11-20T06:26:44.635 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crc8.ko 2023-11-20T06:26:44.635 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crypto/ 2023-11-20T06:26:44.635 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crypto/libarc4.ko 2023-11-20T06:26:44.635 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crypto/libdes.ko 2023-11-20T06:26:44.635 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/interval_tree_test.ko 2023-11-20T06:26:44.635 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/libcrc32c.ko 2023-11-20T06:26:44.635 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/lru_cache.ko 2023-11-20T06:26:44.635 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/lz4/ 2023-11-20T06:26:44.635 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/lz4/lz4_compress.ko 2023-11-20T06:26:44.635 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/lz4/lz4hc_compress.ko 2023-11-20T06:26:44.636 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/math/ 2023-11-20T06:26:44.636 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 6617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/math/cordic.ko 2023-11-20T06:26:44.636 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/memory-notifier-error-inject.ko 2023-11-20T06:26:44.636 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/notifier-error-inject.ko 2023-11-20T06:26:44.636 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/percpu_test.ko 2023-11-20T06:26:44.636 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/pm-notifier-error-inject.ko 2023-11-20T06:26:44.636 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/raid6/ 2023-11-20T06:26:44.636 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 143433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/raid6/raid6_pq.ko 2023-11-20T06:26:44.636 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/rbtree_test.ko 2023-11-20T06:26:44.636 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/reed_solomon/ 2023-11-20T06:26:44.636 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-20T06:26:44.636 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test-kstrtox.ko 2023-11-20T06:26:44.636 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test-string_helpers.ko 2023-11-20T06:26:44.637 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 4760425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test_bpf.ko 2023-11-20T06:26:44.637 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test_firmware.ko 2023-11-20T06:26:44.637 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 6369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test_module.ko 2023-11-20T06:26:44.637 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test_user_copy.ko 2023-11-20T06:26:44.637 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/ts_bm.ko 2023-11-20T06:26:44.637 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/ts_fsm.ko 2023-11-20T06:26:44.637 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/ts_kmp.ko 2023-11-20T06:26:44.637 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/xz/ 2023-11-20T06:26:44.637 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/xz/xz_dec_test.ko 2023-11-20T06:26:44.637 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/mm/ 2023-11-20T06:26:44.637 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/mm/hwpoison-inject.ko 2023-11-20T06:26:44.637 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ 2023-11-20T06:26:44.637 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/ 2023-11-20T06:26:44.638 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 55737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/6lowpan.ko 2023-11-20T06:26:44.638 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_dest.ko 2023-11-20T06:26:44.638 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_fragment.ko 2023-11-20T06:26:44.638 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_hop.ko 2023-11-20T06:26:44.638 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 6985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-20T06:26:44.638 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_mobility.ko 2023-11-20T06:26:44.638 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_routing.ko 2023-11-20T06:26:44.638 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_udp.ko 2023-11-20T06:26:44.638 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/ 2023-11-20T06:26:44.638 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/garp.ko 2023-11-20T06:26:44.638 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/mrp.ko 2023-11-20T06:26:44.638 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/p8022.ko 2023-11-20T06:26:44.639 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/psnap.ko 2023-11-20T06:26:44.639 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/stp.ko 2023-11-20T06:26:44.639 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/8021q/ 2023-11-20T06:26:44.639 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 81737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/8021q/8021q.ko 2023-11-20T06:26:44.639 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/9p/ 2023-11-20T06:26:44.639 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 198337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/9p/9pnet.ko 2023-11-20T06:26:44.639 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/9p/9pnet_fd.ko 2023-11-20T06:26:44.639 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/9p/9pnet_rdma.ko 2023-11-20T06:26:44.639 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/9p/9pnet_virtio.ko 2023-11-20T06:26:44.639 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/batman-adv/ 2023-11-20T06:26:44.639 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 649297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/batman-adv/batman-adv.ko 2023-11-20T06:26:44.639 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/ 2023-11-20T06:26:44.640 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 63809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/br_netfilter.ko 2023-11-20T06:26:44.640 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 777689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/bridge.ko 2023-11-20T06:26:44.640 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ 2023-11-20T06:26:44.640 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-20T06:26:44.640 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-20T06:26:44.640 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-20T06:26:44.640 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-20T06:26:44.640 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-20T06:26:44.640 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-20T06:26:44.640 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-20T06:26:44.640 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-20T06:26:44.641 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-20T06:26:44.641 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-20T06:26:44.641 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-20T06:26:44.641 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-20T06:26:44.641 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-20T06:26:44.641 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-20T06:26:44.641 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-20T06:26:44.641 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-20T06:26:44.641 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-20T06:26:44.641 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-20T06:26:44.641 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-20T06:26:44.641 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-20T06:26:44.641 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 55929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebtables.ko 2023-11-20T06:26:44.642 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-20T06:26:44.642 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-20T06:26:44.642 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ceph/ 2023-11-20T06:26:44.642 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1046833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ceph/libceph.ko 2023-11-20T06:26:44.642 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/core/ 2023-11-20T06:26:44.642 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 125993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/core/pktgen.ko 2023-11-20T06:26:44.642 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dccp/ 2023-11-20T06:26:44.642 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 194209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dccp/dccp.ko 2023-11-20T06:26:44.642 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dccp/dccp_diag.ko 2023-11-20T06:26:44.642 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 57881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dccp/dccp_ipv4.ko 2023-11-20T06:26:44.642 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 60337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dccp/dccp_ipv6.ko 2023-11-20T06:26:44.643 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/ 2023-11-20T06:26:44.643 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 390473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/dsa_core.ko 2023-11-20T06:26:44.643 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/tag_brcm.ko 2023-11-20T06:26:44.643 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/tag_dsa.ko 2023-11-20T06:26:44.643 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/tag_none.ko 2023-11-20T06:26:44.643 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/tag_trailer.ko 2023-11-20T06:26:44.643 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/hsr/ 2023-11-20T06:26:44.643 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 99729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/hsr/hsr.ko 2023-11-20T06:26:44.643 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ieee802154/ 2023-11-20T06:26:44.643 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ieee802154/6lowpan/ 2023-11-20T06:26:44.643 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 45233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-20T06:26:44.643 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 254625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ieee802154/ieee802154.ko 2023-11-20T06:26:44.644 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-20T06:26:44.644 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ 2023-11-20T06:26:44.644 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ah4.ko 2023-11-20T06:26:44.644 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/esp4.ko 2023-11-20T06:26:44.644 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 48337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/fou.ko 2023-11-20T06:26:44.644 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/gre.ko 2023-11-20T06:26:44.644 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 48657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/inet_diag.ko 2023-11-20T06:26:44.644 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 60633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ip_gre.ko 2023-11-20T06:26:44.644 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 61225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ip_tunnel.ko 2023-11-20T06:26:44.644 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ip_vti.ko 2023-11-20T06:26:44.644 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ipcomp.ko 2023-11-20T06:26:44.644 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ipip.ko 2023-11-20T06:26:44.645 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ 2023-11-20T06:26:44.645 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-20T06:26:44.645 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-20T06:26:44.645 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-20T06:26:44.645 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-20T06:26:44.645 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-20T06:26:44.645 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-20T06:26:44.645 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-20T06:26:44.645 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-20T06:26:44.645 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-20T06:26:44.645 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-20T06:26:44.645 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-20T06:26:44.646 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-20T06:26:44.646 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-20T06:26:44.646 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-20T06:26:44.646 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-20T06:26:44.646 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-20T06:26:44.646 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-20T06:26:44.646 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-20T06:26:44.646 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-20T06:26:44.646 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-20T06:26:44.646 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-20T06:26:44.646 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-20T06:26:44.647 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-20T06:26:44.647 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-20T06:26:44.647 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-20T06:26:44.647 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_bic.ko 2023-11-20T06:26:44.647 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_dctcp.ko 2023-11-20T06:26:44.647 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_diag.ko 2023-11-20T06:26:44.647 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_highspeed.ko 2023-11-20T06:26:44.647 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_htcp.ko 2023-11-20T06:26:44.647 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_hybla.ko 2023-11-20T06:26:44.647 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_illinois.ko 2023-11-20T06:26:44.647 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_lp.ko 2023-11-20T06:26:44.647 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_scalable.ko 2023-11-20T06:26:44.648 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_vegas.ko 2023-11-20T06:26:44.648 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_veno.ko 2023-11-20T06:26:44.648 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_westwood.ko 2023-11-20T06:26:44.648 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_yeah.ko 2023-11-20T06:26:44.648 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tunnel4.ko 2023-11-20T06:26:44.648 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/udp_diag.ko 2023-11-20T06:26:44.648 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/udp_tunnel.ko 2023-11-20T06:26:44.648 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-20T06:26:44.648 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ 2023-11-20T06:26:44.648 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ah6.ko 2023-11-20T06:26:44.648 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/esp6.ko 2023-11-20T06:26:44.649 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/fou6.ko 2023-11-20T06:26:44.649 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 80897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ip6_gre.ko 2023-11-20T06:26:44.649 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 93577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ip6_tunnel.ko 2023-11-20T06:26:44.649 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-20T06:26:44.649 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ip6_vti.ko 2023-11-20T06:26:44.649 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ipcomp6.ko 2023-11-20T06:26:44.649 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/mip6.ko 2023-11-20T06:26:44.649 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ 2023-11-20T06:26:44.649 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-20T06:26:44.649 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-20T06:26:44.649 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-20T06:26:44.649 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-20T06:26:44.649 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-20T06:26:44.649 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-20T06:26:44.650 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-20T06:26:44.650 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-20T06:26:44.650 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-20T06:26:44.650 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-20T06:26:44.650 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-20T06:26:44.650 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-20T06:26:44.650 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-20T06:26:44.650 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-20T06:26:44.650 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-20T06:26:44.650 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-20T06:26:44.650 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-20T06:26:44.650 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-20T06:26:44.651 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-20T06:26:44.651 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-20T06:26:44.651 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-20T06:26:44.651 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-20T06:26:44.651 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-20T06:26:44.651 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-20T06:26:44.651 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-20T06:26:44.651 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 74073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/sit.ko 2023-11-20T06:26:44.651 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/tunnel6.ko 2023-11-20T06:26:44.651 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-20T06:26:44.651 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/key/ 2023-11-20T06:26:44.651 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 82833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/key/af_key.ko 2023-11-20T06:26:44.652 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/ 2023-11-20T06:26:44.652 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 125281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_core.ko 2023-11-20T06:26:44.652 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-20T06:26:44.652 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_eth.ko 2023-11-20T06:26:44.652 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_ip.ko 2023-11-20T06:26:44.652 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_ip6.ko 2023-11-20T06:26:44.652 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_netlink.ko 2023-11-20T06:26:44.652 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_ppp.ko 2023-11-20T06:26:44.652 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/lapb/ 2023-11-20T06:26:44.652 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/lapb/lapb.ko 2023-11-20T06:26:44.652 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/llc/ 2023-11-20T06:26:44.652 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/llc/llc.ko 2023-11-20T06:26:44.653 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 267913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/llc/llc2.ko 2023-11-20T06:26:44.653 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/mac802154/ 2023-11-20T06:26:44.653 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 290417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/mac802154/mac802154.ko 2023-11-20T06:26:44.653 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/mpls/ 2023-11-20T06:26:44.653 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/mpls/mpls_gso.ko 2023-11-20T06:26:44.653 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ 2023-11-20T06:26:44.653 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ 2023-11-20T06:26:44.653 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 119585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set.ko 2023-11-20T06:26:44.653 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-20T06:26:44.653 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-20T06:26:44.653 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-20T06:26:44.653 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 100297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-20T06:26:44.654 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 101441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-20T06:26:44.654 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 102817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-20T06:26:44.654 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 103417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-20T06:26:44.654 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 112849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-20T06:26:44.654 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 60329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-20T06:26:44.654 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 109593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-20T06:26:44.654 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 113129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-20T06:26:44.654 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 112585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-20T06:26:44.654 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 111585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-20T06:26:44.654 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 114465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-20T06:26:44.654 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-20T06:26:44.654 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ 2023-11-20T06:26:44.655 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 411729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-20T06:26:44.655 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-20T06:26:44.655 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-20T06:26:44.655 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-20T06:26:44.655 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-20T06:26:44.655 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-20T06:26:44.655 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-20T06:26:44.655 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-20T06:26:44.655 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-20T06:26:44.655 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-20T06:26:44.655 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-20T06:26:44.655 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-20T06:26:44.656 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-20T06:26:44.656 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-20T06:26:44.656 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conncount.ko 2023-11-20T06:26:44.656 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 408257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack.ko 2023-11-20T06:26:44.656 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-20T06:26:44.656 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-20T06:26:44.656 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-20T06:26:44.656 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 118145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-20T06:26:44.656 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-20T06:26:44.656 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-20T06:26:44.656 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 107233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-20T06:26:44.657 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-20T06:26:44.657 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-20T06:26:44.657 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 66641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-20T06:26:44.657 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-20T06:26:44.657 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-20T06:26:44.657 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-20T06:26:44.657 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 89425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_flow_table.ko 2023-11-20T06:26:44.657 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-20T06:26:44.657 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_log_syslog.ko 2023-11-20T06:26:44.657 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 95353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat.ko 2023-11-20T06:26:44.657 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-20T06:26:44.658 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-20T06:26:44.658 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat_irc.ko 2023-11-20T06:26:44.658 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat_sip.ko 2023-11-20T06:26:44.658 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-20T06:26:44.658 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-20T06:26:44.658 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 615649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_tables.ko 2023-11-20T06:26:44.658 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink.ko 2023-11-20T06:26:44.658 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-20T06:26:44.658 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-20T06:26:44.658 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink_log.ko 2023-11-20T06:26:44.658 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-20T06:26:44.658 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-20T06:26:44.659 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_chain_nat.ko 2023-11-20T06:26:44.659 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_compat.ko 2023-11-20T06:26:44.659 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_ct.ko 2023-11-20T06:26:44.659 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-20T06:26:44.659 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_fib.ko 2023-11-20T06:26:44.659 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-20T06:26:44.659 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_hash.ko 2023-11-20T06:26:44.659 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_limit.ko 2023-11-20T06:26:44.659 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_log.ko 2023-11-20T06:26:44.659 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_masq.ko 2023-11-20T06:26:44.659 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_nat.ko 2023-11-20T06:26:44.659 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_numgen.ko 2023-11-20T06:26:44.660 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_osf.ko 2023-11-20T06:26:44.660 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_queue.ko 2023-11-20T06:26:44.660 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_redir.ko 2023-11-20T06:26:44.660 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_reject.ko 2023-11-20T06:26:44.660 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_reject_inet.ko 2023-11-20T06:26:44.660 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_socket.ko 2023-11-20T06:26:44.660 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_synproxy.ko 2023-11-20T06:26:44.660 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_tproxy.ko 2023-11-20T06:26:44.660 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 89313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/x_tables.ko 2023-11-20T06:26:44.660 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_AUDIT.ko 2023-11-20T06:26:44.660 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-20T06:26:44.660 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-20T06:26:44.661 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-20T06:26:44.661 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_CT.ko 2023-11-20T06:26:44.661 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_DSCP.ko 2023-11-20T06:26:44.661 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_HL.ko 2023-11-20T06:26:44.661 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_HMARK.ko 2023-11-20T06:26:44.661 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-20T06:26:44.661 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_LED.ko 2023-11-20T06:26:44.661 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_LOG.ko 2023-11-20T06:26:44.661 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-20T06:26:44.661 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_NETMAP.ko 2023-11-20T06:26:44.661 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_NFLOG.ko 2023-11-20T06:26:44.661 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-20T06:26:44.662 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_RATEEST.ko 2023-11-20T06:26:44.662 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-20T06:26:44.662 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_SECMARK.ko 2023-11-20T06:26:44.662 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-20T06:26:44.662 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-20T06:26:44.662 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_TEE.ko 2023-11-20T06:26:44.662 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_TPROXY.ko 2023-11-20T06:26:44.662 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_TRACE.ko 2023-11-20T06:26:44.662 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_addrtype.ko 2023-11-20T06:26:44.662 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_bpf.ko 2023-11-20T06:26:44.662 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_cgroup.ko 2023-11-20T06:26:44.662 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_cluster.ko 2023-11-20T06:26:44.663 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_comment.ko 2023-11-20T06:26:44.663 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_connbytes.ko 2023-11-20T06:26:44.663 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_connlabel.ko 2023-11-20T06:26:44.663 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_connlimit.ko 2023-11-20T06:26:44.663 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_connmark.ko 2023-11-20T06:26:44.663 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_conntrack.ko 2023-11-20T06:26:44.663 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_cpu.ko 2023-11-20T06:26:44.663 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_dccp.ko 2023-11-20T06:26:44.663 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_devgroup.ko 2023-11-20T06:26:44.663 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_dscp.ko 2023-11-20T06:26:44.663 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_ecn.ko 2023-11-20T06:26:44.664 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_esp.ko 2023-11-20T06:26:44.664 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 43289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_hashlimit.ko 2023-11-20T06:26:44.664 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_helper.ko 2023-11-20T06:26:44.664 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_hl.ko 2023-11-20T06:26:44.664 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_ipcomp.ko 2023-11-20T06:26:44.664 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_iprange.ko 2023-11-20T06:26:44.664 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_ipvs.ko 2023-11-20T06:26:44.664 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_l2tp.ko 2023-11-20T06:26:44.664 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_length.ko 2023-11-20T06:26:44.664 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_limit.ko 2023-11-20T06:26:44.664 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_mac.ko 2023-11-20T06:26:44.664 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_mark.ko 2023-11-20T06:26:44.664 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_multiport.ko 2023-11-20T06:26:44.665 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_nat.ko 2023-11-20T06:26:44.665 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_nfacct.ko 2023-11-20T06:26:44.665 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_osf.ko 2023-11-20T06:26:44.665 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_owner.ko 2023-11-20T06:26:44.665 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_physdev.ko 2023-11-20T06:26:44.665 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_pkttype.ko 2023-11-20T06:26:44.665 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_policy.ko 2023-11-20T06:26:44.665 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_quota.ko 2023-11-20T06:26:44.665 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_rateest.ko 2023-11-20T06:26:44.665 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_realm.ko 2023-11-20T06:26:44.665 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_recent.ko 2023-11-20T06:26:44.665 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_sctp.ko 2023-11-20T06:26:44.666 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_set.ko 2023-11-20T06:26:44.666 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_socket.ko 2023-11-20T06:26:44.666 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_state.ko 2023-11-20T06:26:44.666 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_statistic.ko 2023-11-20T06:26:44.666 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_string.ko 2023-11-20T06:26:44.666 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_tcpmss.ko 2023-11-20T06:26:44.666 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_tcpudp.ko 2023-11-20T06:26:44.666 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_time.ko 2023-11-20T06:26:44.666 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_u32.ko 2023-11-20T06:26:44.666 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netlink/ 2023-11-20T06:26:44.666 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netlink/netlink_diag.ko 2023-11-20T06:26:44.666 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/nsh/ 2023-11-20T06:26:44.667 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/nsh/nsh.ko 2023-11-20T06:26:44.667 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/openvswitch/ 2023-11-20T06:26:44.667 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 380033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/openvswitch/openvswitch.ko 2023-11-20T06:26:44.667 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/openvswitch/vport-geneve.ko 2023-11-20T06:26:44.667 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/openvswitch/vport-gre.ko 2023-11-20T06:26:44.667 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/openvswitch/vport-vxlan.ko 2023-11-20T06:26:44.667 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/packet/ 2023-11-20T06:26:44.667 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/packet/af_packet_diag.ko 2023-11-20T06:26:44.667 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/phonet/ 2023-11-20T06:26:44.667 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 110201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/phonet/phonet.ko 2023-11-20T06:26:44.667 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/phonet/pn_pep.ko 2023-11-20T06:26:44.667 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rds/ 2023-11-20T06:26:44.667 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 251481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rds/rds.ko 2023-11-20T06:26:44.668 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 164937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rds/rds_rdma.ko 2023-11-20T06:26:44.668 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 67377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rds/rds_tcp.ko 2023-11-20T06:26:44.668 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rxrpc/ 2023-11-20T06:26:44.668 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 819657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rxrpc/rxrpc.ko 2023-11-20T06:26:44.668 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/ 2023-11-20T06:26:44.668 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_csum.ko 2023-11-20T06:26:44.668 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_gact.ko 2023-11-20T06:26:44.668 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_ipt.ko 2023-11-20T06:26:44.668 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_mirred.ko 2023-11-20T06:26:44.668 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_nat.ko 2023-11-20T06:26:44.668 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 43449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_pedit.ko 2023-11-20T06:26:44.669 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_police.ko 2023-11-20T06:26:44.669 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_simple.ko 2023-11-20T06:26:44.669 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_skbedit.ko 2023-11-20T06:26:44.669 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_vlan.ko 2023-11-20T06:26:44.669 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_basic.ko 2023-11-20T06:26:44.669 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_bpf.ko 2023-11-20T06:26:44.669 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_cgroup.ko 2023-11-20T06:26:44.669 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_flow.ko 2023-11-20T06:26:44.669 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_fw.ko 2023-11-20T06:26:44.669 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_route.ko 2023-11-20T06:26:44.669 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 61409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_u32.ko 2023-11-20T06:26:44.669 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_cmp.ko 2023-11-20T06:26:44.669 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_ipset.ko 2023-11-20T06:26:44.670 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_meta.ko 2023-11-20T06:26:44.670 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_nbyte.ko 2023-11-20T06:26:44.670 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_text.ko 2023-11-20T06:26:44.670 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_u32.ko 2023-11-20T06:26:44.670 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_choke.ko 2023-11-20T06:26:44.670 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_codel.ko 2023-11-20T06:26:44.670 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_drr.ko 2023-11-20T06:26:44.670 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_fq.ko 2023-11-20T06:26:44.670 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_fq_codel.ko 2023-11-20T06:26:44.670 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_gred.ko 2023-11-20T06:26:44.670 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_hfsc.ko 2023-11-20T06:26:44.671 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_hhf.ko 2023-11-20T06:26:44.671 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 66393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_htb.ko 2023-11-20T06:26:44.671 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_ingress.ko 2023-11-20T06:26:44.671 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_mqprio.ko 2023-11-20T06:26:44.671 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_mqprio_lib.ko 2023-11-20T06:26:44.671 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_multiq.ko 2023-11-20T06:26:44.671 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_netem.ko 2023-11-20T06:26:44.671 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_pie.ko 2023-11-20T06:26:44.671 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_plug.ko 2023-11-20T06:26:44.671 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_prio.ko 2023-11-20T06:26:44.671 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 48729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_qfq.ko 2023-11-20T06:26:44.671 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_red.ko 2023-11-20T06:26:44.672 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_sfb.ko 2023-11-20T06:26:44.672 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_sfq.ko 2023-11-20T06:26:44.672 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_tbf.ko 2023-11-20T06:26:44.672 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_teql.ko 2023-11-20T06:26:44.672 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sctp/ 2023-11-20T06:26:44.672 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 929745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sctp/sctp.ko 2023-11-20T06:26:44.672 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sctp/sctp_diag.ko 2023-11-20T06:26:44.672 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/ 2023-11-20T06:26:44.672 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/auth_gss/ 2023-11-20T06:26:44.672 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 336529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-20T06:26:44.672 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-20T06:26:44.672 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1520097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/sunrpc.ko 2023-11-20T06:26:44.672 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/xprtrdma/ 2023-11-20T06:26:44.673 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 707657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-20T06:26:44.673 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/tipc/ 2023-11-20T06:26:44.673 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/tipc/diag.ko 2023-11-20T06:26:44.673 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 862665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/tipc/tipc.ko 2023-11-20T06:26:44.673 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/unix/ 2023-11-20T06:26:44.673 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/unix/unix_diag.ko 2023-11-20T06:26:44.673 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/ 2023-11-20T06:26:44.673 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 85409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-20T06:26:44.673 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 68049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-20T06:26:44.673 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 96193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/vsock.ko 2023-11-20T06:26:44.673 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-20T06:26:44.673 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-20T06:26:44.674 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/x25/ 2023-11-20T06:26:44.674 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 125177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/x25/x25.ko 2023-11-20T06:26:44.674 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/xfrm/ 2023-11-20T06:26:44.674 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/xfrm/xfrm_algo.ko 2023-11-20T06:26:44.674 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-20T06:26:44.674 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 102257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/xfrm/xfrm_user.ko 2023-11-20T06:26:44.674 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/virt/ 2023-11-20T06:26:44.674 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/virt/lib/ 2023-11-20T06:26:44.674 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/virt/lib/irqbypass.ko 2023-11-20T06:26:44.674 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 640081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.alias 2023-11-20T06:26:44.674 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 624107 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.alias.bin 2023-11-20T06:26:44.674 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7663 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.builtin 2023-11-20T06:26:44.675 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23428 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.builtin.alias.bin 2023-11-20T06:26:44.675 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9821 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.builtin.bin 2023-11-20T06:26:44.675 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 70004 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.builtin.modinfo 2023-11-20T06:26:44.675 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 146313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.dep 2023-11-20T06:26:44.675 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 232548 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.dep.bin 2023-11-20T06:26:44.675 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 210 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.devname 2023-11-20T06:26:44.675 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 72606 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.order 2023-11-20T06:26:44.675 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 879 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.softdep 2023-11-20T06:26:44.675 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 254438 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.symbols 2023-11-20T06:26:44.675 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 309363 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.symbols.bin 2023-11-20T06:26:44.675 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./usr/ 2023-11-20T06:26:44.675 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./usr/share/ 2023-11-20T06:26:44.676 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./usr/share/doc/ 2023-11-20T06:26:44.676 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./usr/share/doc/linux-image-6.6.0-g7678e1afe51c/ 2023-11-20T06:26:44.676 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 171 2023-11-20 01:52 ./usr/share/doc/linux-image-6.6.0-g7678e1afe51c/changelog.Debian.gz 2023-11-20T06:26:44.676 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 691 2023-11-20 01:52 ./usr/share/doc/linux-image-6.6.0-g7678e1afe51c/copyright 2023-11-20T06:26:44.677 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g7678e1afe51c 2023-11-20T06:26:44.677 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g7678e1afe51c 2023-11-20T06:26:44.677 DEBUG:teuthology.orchestra.run.smithi190:> egrep '(submenu|menuentry.*6.6.0-g7678e1afe51c).*{' /boot/grub/grub.cfg 2023-11-20T06:26:44.683 INFO:teuthology.orchestra.run.smithi190.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-20T06:26:44.684 INFO:teuthology.orchestra.run.smithi190.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g7678e1afe51c' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g7678e1afe51c-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-20T06:26:44.684 INFO:teuthology.orchestra.run.smithi190.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g7678e1afe51c (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g7678e1afe51c-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-20T06:26:44.684 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-20T06:26:44.684 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g7678e1afe51c 2023-11-20T06:26:44.684 DEBUG:teuthology.orchestra.run.smithi190:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-20T06:26:44.726 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi190.front.sepia.ceph.com to complete... 2023-11-20T06:26:45.072 INFO:teuthology.orchestra.run.smithi190.stderr:Sourcing file `/etc/default/grub' 2023-11-20T06:26:45.075 INFO:teuthology.orchestra.run.smithi190.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-20T06:26:45.081 INFO:teuthology.orchestra.run.smithi190.stderr:Generating grub configuration file ... 2023-11-20T06:26:45.121 INFO:teuthology.orchestra.run.smithi019.stderr:Sourcing file `/etc/default/grub' 2023-11-20T06:26:45.139 INFO:teuthology.orchestra.run.smithi019.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-20T06:26:45.156 INFO:teuthology.orchestra.run.smithi019.stderr:Generating grub configuration file ... 2023-11-20T06:26:45.258 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-6.6.0-g7678e1afe51c 2023-11-20T06:26:45.265 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-6.6.0-g7678e1afe51c 2023-11-20T06:26:45.410 INFO:teuthology.orchestra.run.smithi019.stderr:Found linux image: /boot/vmlinuz-6.6.0-g7678e1afe51c 2023-11-20T06:26:45.431 INFO:teuthology.orchestra.run.smithi019.stderr:Found initrd image: /boot/initrd.img-6.6.0-g7678e1afe51c 2023-11-20T06:26:45.566 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-20T06:26:45.571 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-20T06:26:45.612 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-20T06:26:45.618 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-20T06:26:45.689 INFO:teuthology.orchestra.run.smithi019.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-20T06:26:45.703 INFO:teuthology.orchestra.run.smithi019.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-20T06:26:45.769 INFO:teuthology.orchestra.run.smithi190.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-20T06:26:45.769 INFO:teuthology.orchestra.run.smithi190.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-20T06:26:45.769 INFO:teuthology.orchestra.run.smithi190.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-20T06:26:45.779 INFO:teuthology.orchestra.run.smithi019.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-20T06:26:45.784 INFO:teuthology.orchestra.run.smithi190.stderr:done 2023-11-20T06:26:45.785 INFO:teuthology.orchestra.run.smithi019.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-20T06:26:45.926 INFO:teuthology.orchestra.run.smithi019.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-20T06:26:45.926 INFO:teuthology.orchestra.run.smithi019.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-20T06:26:45.926 INFO:teuthology.orchestra.run.smithi019.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-20T06:26:45.962 INFO:teuthology.orchestra.run.smithi019.stderr:done 2023-11-20T06:26:46.129 DEBUG:teuthology.orchestra.run.smithi019:> dpkg-deb -c /tmp/linux-image.deb 2023-11-20T06:26:46.136 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./ 2023-11-20T06:26:46.137 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./boot/ 2023-11-20T06:26:46.137 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 4415617 2023-11-20 01:52 ./boot/System.map-6.6.0-g7678e1afe51c 2023-11-20T06:26:46.149 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 169214 2023-11-20 01:52 ./boot/config-6.6.0-g7678e1afe51c 2023-11-20T06:26:46.150 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11352928 2023-11-20 01:52 ./boot/vmlinuz-6.6.0-g7678e1afe51c 2023-11-20T06:26:46.173 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/ 2023-11-20T06:26:46.173 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/kernel/ 2023-11-20T06:26:46.173 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/kernel/postinst.d/ 2023-11-20T06:26:46.173 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/kernel/postrm.d/ 2023-11-20T06:26:46.173 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/kernel/preinst.d/ 2023-11-20T06:26:46.173 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/kernel/prerm.d/ 2023-11-20T06:26:46.173 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/ 2023-11-20T06:26:46.174 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/ 2023-11-20T06:26:46.174 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/ 2023-11-20T06:26:46.174 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/ 2023-11-20T06:26:46.174 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/ 2023-11-20T06:26:46.174 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/ 2023-11-20T06:26:46.174 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/ 2023-11-20T06:26:46.175 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 490233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-20T06:26:46.175 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-20T06:26:46.175 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-20T06:26:46.175 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-20T06:26:46.175 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 93113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-20T06:26:46.175 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 106729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-20T06:26:46.175 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 152241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-20T06:26:46.175 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-20T06:26:46.175 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-20T06:26:46.176 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 83889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-20T06:26:46.176 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-20T06:26:46.176 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 47225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-20T06:26:46.176 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 47209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-20T06:26:46.176 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 51801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-20T06:26:46.176 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 38937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-20T06:26:46.176 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 40529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-20T06:26:46.176 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 58585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-20T06:26:46.177 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 50497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-20T06:26:46.177 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 32065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-20T06:26:46.177 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-20T06:26:46.177 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/ 2023-11-20T06:26:46.177 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/cpu/ 2023-11-20T06:26:46.177 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/cpu/mce/ 2023-11-20T06:26:46.177 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 40113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-20T06:26:46.177 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/cpuid.ko 2023-11-20T06:26:46.178 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/msr.ko 2023-11-20T06:26:46.178 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kvm/ 2023-11-20T06:26:46.178 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 354433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-20T06:26:46.178 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 881625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-20T06:26:46.179 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 2275865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kvm/kvm.ko 2023-11-20T06:26:46.188 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/ 2023-11-20T06:26:46.189 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 53697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/af_alg.ko 2023-11-20T06:26:46.189 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/algif_hash.ko 2023-11-20T06:26:46.189 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/algif_skcipher.ko 2023-11-20T06:26:46.189 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/ansi_cprng.ko 2023-11-20T06:26:46.189 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/anubis.ko 2023-11-20T06:26:46.189 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/arc4.ko 2023-11-20T06:26:46.189 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/asymmetric_keys/ 2023-11-20T06:26:46.190 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-20T06:26:46.190 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/ 2023-11-20T06:26:46.190 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/async_memcpy.ko 2023-11-20T06:26:46.190 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/async_pq.ko 2023-11-20T06:26:46.190 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-20T06:26:46.190 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/async_tx.ko 2023-11-20T06:26:46.190 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/async_xor.ko 2023-11-20T06:26:46.190 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/raid6test.ko 2023-11-20T06:26:46.190 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/authenc.ko 2023-11-20T06:26:46.190 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/authencesn.ko 2023-11-20T06:26:46.191 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/blake2b_generic.ko 2023-11-20T06:26:46.191 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/blowfish_common.ko 2023-11-20T06:26:46.191 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/blowfish_generic.ko 2023-11-20T06:26:46.191 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 38809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/camellia_generic.ko 2023-11-20T06:26:46.191 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cast5_generic.ko 2023-11-20T06:26:46.191 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cast6_generic.ko 2023-11-20T06:26:46.191 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cast_common.ko 2023-11-20T06:26:46.191 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 35097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/ccm.ko 2023-11-20T06:26:46.191 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cmac.ko 2023-11-20T06:26:46.191 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/crc32_generic.ko 2023-11-20T06:26:46.191 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 47505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cryptd.ko 2023-11-20T06:26:46.191 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 39505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/crypto_engine.ko 2023-11-20T06:26:46.191 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/crypto_simd.ko 2023-11-20T06:26:46.191 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/crypto_user.ko 2023-11-20T06:26:46.192 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cts.ko 2023-11-20T06:26:46.192 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/des_generic.ko 2023-11-20T06:26:46.192 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/dh_generic.ko 2023-11-20T06:26:46.192 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/echainiv.ko 2023-11-20T06:26:46.192 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/essiv.ko 2023-11-20T06:26:46.192 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/fcrypt.ko 2023-11-20T06:26:46.192 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/khazad.ko 2023-11-20T06:26:46.192 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/lrw.ko 2023-11-20T06:26:46.192 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/lz4.ko 2023-11-20T06:26:46.192 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/lz4hc.ko 2023-11-20T06:26:46.193 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/md4.ko 2023-11-20T06:26:46.193 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/michael_mic.ko 2023-11-20T06:26:46.193 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/pcbc.ko 2023-11-20T06:26:46.193 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/pcrypt.ko 2023-11-20T06:26:46.193 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/rmd160.ko 2023-11-20T06:26:46.193 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/seed.ko 2023-11-20T06:26:46.194 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/serpent_generic.ko 2023-11-20T06:26:46.194 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 149193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/tcrypt.ko 2023-11-20T06:26:46.194 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/tea.ko 2023-11-20T06:26:46.194 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/twofish_common.ko 2023-11-20T06:26:46.194 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/twofish_generic.ko 2023-11-20T06:26:46.194 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/vmac.ko 2023-11-20T06:26:46.195 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 36185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/wp512.ko 2023-11-20T06:26:46.195 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/xcbc.ko 2023-11-20T06:26:46.195 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/xor.ko 2023-11-20T06:26:46.195 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/xts.ko 2023-11-20T06:26:46.195 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/xxhash_generic.ko 2023-11-20T06:26:46.195 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ 2023-11-20T06:26:46.195 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/ 2023-11-20T06:26:46.196 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/acpi_extlog.ko 2023-11-20T06:26:46.196 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-20T06:26:46.196 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/acpi_pad.ko 2023-11-20T06:26:46.196 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/apei/ 2023-11-20T06:26:46.196 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 31241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/apei/einj.ko 2023-11-20T06:26:46.196 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/ec_sys.ko 2023-11-20T06:26:46.196 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/platform_profile.ko 2023-11-20T06:26:46.196 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/sbs.ko 2023-11-20T06:26:46.197 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/sbshc.ko 2023-11-20T06:26:46.197 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 103025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/video.ko 2023-11-20T06:26:46.197 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/ 2023-11-20T06:26:46.197 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/acard-ahci.ko 2023-11-20T06:26:46.197 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 88865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/ahci.ko 2023-11-20T06:26:46.197 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/ahci_platform.ko 2023-11-20T06:26:46.197 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 88289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/libahci.ko 2023-11-20T06:26:46.197 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/libahci_platform.ko 2023-11-20T06:26:46.198 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_acpi.ko 2023-11-20T06:26:46.198 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_ali.ko 2023-11-20T06:26:46.198 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_amd.ko 2023-11-20T06:26:46.198 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_artop.ko 2023-11-20T06:26:46.198 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_atiixp.ko 2023-11-20T06:26:46.198 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_atp867x.ko 2023-11-20T06:26:46.198 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_cmd640.ko 2023-11-20T06:26:46.198 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_cmd64x.ko 2023-11-20T06:26:46.198 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_cypress.ko 2023-11-20T06:26:46.199 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_efar.ko 2023-11-20T06:26:46.199 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_hpt366.ko 2023-11-20T06:26:46.199 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_hpt37x.ko 2023-11-20T06:26:46.199 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-20T06:26:46.199 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-20T06:26:46.199 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_it8213.ko 2023-11-20T06:26:46.199 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 35273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_it821x.ko 2023-11-20T06:26:46.199 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_jmicron.ko 2023-11-20T06:26:46.199 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 51481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_legacy.ko 2023-11-20T06:26:46.199 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_marvell.ko 2023-11-20T06:26:46.199 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_mpiix.ko 2023-11-20T06:26:46.199 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_netcell.ko 2023-11-20T06:26:46.199 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_ninja32.ko 2023-11-20T06:26:46.200 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_ns87410.ko 2023-11-20T06:26:46.200 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_ns87415.ko 2023-11-20T06:26:46.200 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_oldpiix.ko 2023-11-20T06:26:46.200 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_opti.ko 2023-11-20T06:26:46.200 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_optidma.ko 2023-11-20T06:26:46.200 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 32585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_pcmcia.ko 2023-11-20T06:26:46.200 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 37793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-20T06:26:46.200 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-20T06:26:46.200 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_piccolo.ko 2023-11-20T06:26:46.200 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_radisys.ko 2023-11-20T06:26:46.200 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_rdc.ko 2023-11-20T06:26:46.200 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_rz1000.ko 2023-11-20T06:26:46.200 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_sch.ko 2023-11-20T06:26:46.200 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_serverworks.ko 2023-11-20T06:26:46.201 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_sil680.ko 2023-11-20T06:26:46.201 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_sl82c105.ko 2023-11-20T06:26:46.201 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_triflex.ko 2023-11-20T06:26:46.201 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_via.ko 2023-11-20T06:26:46.201 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pdc_adma.ko 2023-11-20T06:26:46.201 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_inic162x.ko 2023-11-20T06:26:46.201 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 83345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_mv.ko 2023-11-20T06:26:46.201 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 70393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_nv.ko 2023-11-20T06:26:46.201 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 37377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_promise.ko 2023-11-20T06:26:46.201 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_qstor.ko 2023-11-20T06:26:46.201 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_sil.ko 2023-11-20T06:26:46.201 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 38337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_sil24.ko 2023-11-20T06:26:46.201 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_sis.ko 2023-11-20T06:26:46.201 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_svw.ko 2023-11-20T06:26:46.202 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 44793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_sx4.ko 2023-11-20T06:26:46.202 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_uli.ko 2023-11-20T06:26:46.202 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 35065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_via.ko 2023-11-20T06:26:46.202 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_vsc.ko 2023-11-20T06:26:46.202 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/auxdisplay/ 2023-11-20T06:26:46.202 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/auxdisplay/ks0108.ko 2023-11-20T06:26:46.202 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/bcma/ 2023-11-20T06:26:46.202 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 124473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/bcma/bcma.ko 2023-11-20T06:26:46.202 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/ 2023-11-20T06:26:46.202 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/aoe/ 2023-11-20T06:26:46.202 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 113665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/aoe/aoe.ko 2023-11-20T06:26:46.202 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/drbd/ 2023-11-20T06:26:46.202 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 965585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/drbd/drbd.ko 2023-11-20T06:26:46.257 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 173225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/floppy.ko 2023-11-20T06:26:46.257 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/mtip32xx/ 2023-11-20T06:26:46.257 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 94297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-20T06:26:46.258 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 115793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/nbd.ko 2023-11-20T06:26:46.258 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/null_blk/ 2023-11-20T06:26:46.258 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 110385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/null_blk/null_blk.ko 2023-11-20T06:26:46.258 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 98193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/pktcdvd.ko 2023-11-20T06:26:46.258 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 263769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/rbd.ko 2023-11-20T06:26:46.258 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/xen-blkback/ 2023-11-20T06:26:46.258 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 98145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-20T06:26:46.258 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/zram/ 2023-11-20T06:26:46.258 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 60217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/zram/zram.ko 2023-11-20T06:26:46.258 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ 2023-11-20T06:26:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/applicom.ko 2023-11-20T06:26:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hangcheck-timer.ko 2023-11-20T06:26:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/ 2023-11-20T06:26:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-20T06:26:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-20T06:26:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-20T06:26:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/via-rng.ko 2023-11-20T06:26:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-20T06:26:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ 2023-11-20T06:26:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-20T06:26:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 148601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-20T06:26:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-20T06:26:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 139313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-20T06:26:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 70921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-20T06:26:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 53513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-20T06:26:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 36321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/lp.ko 2023-11-20T06:26:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/mwave/ 2023-11-20T06:26:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 84097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/mwave/mwave.ko 2023-11-20T06:26:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/nvram.ko 2023-11-20T06:26:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 32169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ppdev.ko 2023-11-20T06:26:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 51113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tlclk.ko 2023-11-20T06:26:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/ 2023-11-20T06:26:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-20T06:26:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-20T06:26:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-20T06:26:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 32985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-20T06:26:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-20T06:26:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-20T06:26:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-20T06:26:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/xillybus/ 2023-11-20T06:26:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-20T06:26:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 50945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-20T06:26:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-20T06:26:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/clk/ 2023-11-20T06:26:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/clk/clk-palmas.ko 2023-11-20T06:26:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 47849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/clk/clk-si5351.ko 2023-11-20T06:26:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/clk/clk-twl6040.ko 2023-11-20T06:26:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/clk/clk-wm831x.ko 2023-11-20T06:26:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/cpufreq/ 2023-11-20T06:26:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-20T06:26:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-20T06:26:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-20T06:26:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/ 2023-11-20T06:26:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/ccp/ 2023-11-20T06:26:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 70801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-20T06:26:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 243025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/ccp/ccp.ko 2023-11-20T06:26:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/ 2023-11-20T06:26:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/qat/ 2023-11-20T06:26:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-20T06:26:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 438761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-20T06:26:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-20T06:26:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-20T06:26:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/padlock-aes.ko 2023-11-20T06:26:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/padlock-sha.ko 2023-11-20T06:26:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/virtio/ 2023-11-20T06:26:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 70273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-20T06:26:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dca/ 2023-11-20T06:26:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dca/dca.ko 2023-11-20T06:26:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dma/ 2023-11-20T06:26:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dma/dw/ 2023-11-20T06:26:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-20T06:26:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dma/ioat/ 2023-11-20T06:26:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 122569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-20T06:26:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/ 2023-11-20T06:26:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 79953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/amd64_edac.ko 2023-11-20T06:26:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 35769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/e752x_edac.ko 2023-11-20T06:26:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 63617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/edac_mce_amd.ko 2023-11-20T06:26:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i3000_edac.ko 2023-11-20T06:26:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i3200_edac.ko 2023-11-20T06:26:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i5100_edac.ko 2023-11-20T06:26:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i5400_edac.ko 2023-11-20T06:26:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i7300_edac.ko 2023-11-20T06:26:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 52041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i7core_edac.ko 2023-11-20T06:26:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i82975x_edac.ko 2023-11-20T06:26:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/ie31200_edac.ko 2023-11-20T06:26:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 56825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/sb_edac.ko 2023-11-20T06:26:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/x38_edac.ko 2023-11-20T06:26:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/ 2023-11-20T06:26:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-gpio.ko 2023-11-20T06:26:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-max14577.ko 2023-11-20T06:26:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-max77693.ko 2023-11-20T06:26:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-max8997.ko 2023-11-20T06:26:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-palmas.ko 2023-11-20T06:26:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-20T06:26:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-20T06:26:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/firmware/ 2023-11-20T06:26:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-20T06:26:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/firmware/efi/ 2023-11-20T06:26:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-20T06:26:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-20T06:26:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/ 2023-11-20T06:26:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-20T06:26:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-20T06:26:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-arizona.ko 2023-11-20T06:26:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-da9052.ko 2023-11-20T06:26:46.267 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-da9055.ko 2023-11-20T06:26:46.267 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-dln2.ko 2023-11-20T06:26:46.267 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 77849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-20T06:26:46.267 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-generic.ko 2023-11-20T06:26:46.267 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-ich.ko 2023-11-20T06:26:46.267 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-20T06:26:46.267 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-kempld.ko 2023-11-20T06:26:46.267 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-20T06:26:46.267 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-max7300.ko 2023-11-20T06:26:46.267 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-max730x.ko 2023-11-20T06:26:46.267 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-max732x.ko 2023-11-20T06:26:46.267 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-20T06:26:46.268 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 47073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-20T06:26:46.268 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-20T06:26:46.268 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-20T06:26:46.268 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-sch.ko 2023-11-20T06:26:46.268 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-20T06:26:46.268 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-20T06:26:46.268 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-20T06:26:46.268 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-20T06:26:46.268 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-20T06:26:46.268 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-vx855.ko 2023-11-20T06:26:46.268 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-20T06:26:46.268 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-20T06:26:46.269 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-20T06:26:46.269 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/ 2023-11-20T06:26:46.269 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-a4tech.ko 2023-11-20T06:26:46.269 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 39169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-apple.ko 2023-11-20T06:26:46.269 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-appleir.ko 2023-11-20T06:26:46.269 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-aureal.ko 2023-11-20T06:26:46.269 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-axff.ko 2023-11-20T06:26:46.269 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-belkin.ko 2023-11-20T06:26:46.269 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-cherry.ko 2023-11-20T06:26:46.269 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-chicony.ko 2023-11-20T06:26:46.269 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 60649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-cp2112.ko 2023-11-20T06:26:46.269 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-cypress.ko 2023-11-20T06:26:46.270 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-dr.ko 2023-11-20T06:26:46.270 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-elecom.ko 2023-11-20T06:26:46.270 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-elo.ko 2023-11-20T06:26:46.270 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-emsff.ko 2023-11-20T06:26:46.270 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-ezkey.ko 2023-11-20T06:26:46.270 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-gaff.ko 2023-11-20T06:26:46.270 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-generic.ko 2023-11-20T06:26:46.270 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-gt683r.ko 2023-11-20T06:26:46.270 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-gyration.ko 2023-11-20T06:26:46.270 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-20T06:26:46.270 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-20T06:26:46.270 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-holtekff.ko 2023-11-20T06:26:46.270 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-hyperv.ko 2023-11-20T06:26:46.271 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-icade.ko 2023-11-20T06:26:46.271 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-kensington.ko 2023-11-20T06:26:46.271 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-keytouch.ko 2023-11-20T06:26:46.271 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-kye.ko 2023-11-20T06:26:46.271 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-lcpower.ko 2023-11-20T06:26:46.271 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-led.ko 2023-11-20T06:26:46.271 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 42297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-lenovo.ko 2023-11-20T06:26:46.271 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-lg-g15.ko 2023-11-20T06:26:46.271 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 58185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-20T06:26:46.271 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 101481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-20T06:26:46.271 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 80993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-logitech.ko 2023-11-20T06:26:46.271 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-magicmouse.ko 2023-11-20T06:26:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-microsoft.ko 2023-11-20T06:26:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-monterey.ko 2023-11-20T06:26:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 50161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-multitouch.ko 2023-11-20T06:26:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 32593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-ntrig.ko 2023-11-20T06:26:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-ortek.ko 2023-11-20T06:26:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-penmount.ko 2023-11-20T06:26:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-petalynx.ko 2023-11-20T06:26:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 72937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-picolcd.ko 2023-11-20T06:26:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-pl.ko 2023-11-20T06:26:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-plantronics.ko 2023-11-20T06:26:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-primax.ko 2023-11-20T06:26:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 35393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-rmi.ko 2023-11-20T06:26:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-20T06:26:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-common.ko 2023-11-20T06:26:46.273 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 31425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-20T06:26:46.273 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-20T06:26:46.273 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 31129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-20T06:26:46.273 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-20T06:26:46.273 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-20T06:26:46.273 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-20T06:26:46.273 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-20T06:26:46.273 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-20T06:26:46.273 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-20T06:26:46.273 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat.ko 2023-11-20T06:26:46.273 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-saitek.ko 2023-11-20T06:26:46.273 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-samsung.ko 2023-11-20T06:26:46.274 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 36817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-20T06:26:46.274 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-sjoy.ko 2023-11-20T06:26:46.274 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 51249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-sony.ko 2023-11-20T06:26:46.274 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-speedlink.ko 2023-11-20T06:26:46.274 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-steelseries.ko 2023-11-20T06:26:46.274 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-sunplus.ko 2023-11-20T06:26:46.274 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-20T06:26:46.274 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-tivo.ko 2023-11-20T06:26:46.274 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-tmff.ko 2023-11-20T06:26:46.274 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-topseed.ko 2023-11-20T06:26:46.275 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-twinhan.ko 2023-11-20T06:26:46.275 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 71073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-uclogic.ko 2023-11-20T06:26:46.275 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-waltop.ko 2023-11-20T06:26:46.275 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 143473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-wiimote.ko 2023-11-20T06:26:46.275 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-xinmo.ko 2023-11-20T06:26:46.275 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-zpff.ko 2023-11-20T06:26:46.275 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-zydacron.ko 2023-11-20T06:26:46.275 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 267825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid.ko 2023-11-20T06:26:46.275 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 32321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/uhid.ko 2023-11-20T06:26:46.275 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/usbhid/ 2023-11-20T06:26:46.275 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 125721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-20T06:26:46.275 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-20T06:26:46.276 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-20T06:26:46.276 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 217873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/wacom.ko 2023-11-20T06:26:46.276 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hv/ 2023-11-20T06:26:46.276 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 64201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hv/hv_balloon.ko 2023-11-20T06:26:46.276 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 89625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hv/hv_utils.ko 2023-11-20T06:26:46.276 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 305465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hv/hv_vmbus.ko 2023-11-20T06:26:46.276 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ 2023-11-20T06:26:46.276 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 66521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/abituguru.ko 2023-11-20T06:26:46.276 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 61393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/abituguru3.ko 2023-11-20T06:26:46.276 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-20T06:26:46.276 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ad7414.ko 2023-11-20T06:26:46.276 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ad7418.ko 2023-11-20T06:26:46.277 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adc128d818.ko 2023-11-20T06:26:46.277 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 31729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adm1025.ko 2023-11-20T06:26:46.277 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 97977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adm1026.ko 2023-11-20T06:26:46.277 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adm1029.ko 2023-11-20T06:26:46.277 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 45553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adm1031.ko 2023-11-20T06:26:46.277 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adm9240.ko 2023-11-20T06:26:46.277 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ads7828.ko 2023-11-20T06:26:46.277 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7410.ko 2023-11-20T06:26:46.277 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7411.ko 2023-11-20T06:26:46.277 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 74433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7462.ko 2023-11-20T06:26:46.277 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 39585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7470.ko 2023-11-20T06:26:46.277 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 67929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7475.ko 2023-11-20T06:26:46.278 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7x10.ko 2023-11-20T06:26:46.278 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 39073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/amc6821.ko 2023-11-20T06:26:46.278 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 55201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/applesmc.ko 2023-11-20T06:26:46.278 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 49913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/asb100.ko 2023-11-20T06:26:46.278 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 58617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/asc7621.ko 2023-11-20T06:26:46.278 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 40825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-20T06:26:46.278 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/atxp1.ko 2023-11-20T06:26:46.278 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/coretemp.ko 2023-11-20T06:26:46.278 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-20T06:26:46.278 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-20T06:26:46.278 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 44465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-20T06:26:46.278 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 99601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/dme1737.ko 2023-11-20T06:26:46.279 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ds1621.ko 2023-11-20T06:26:46.279 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ds620.ko 2023-11-20T06:26:46.279 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/emc1403.ko 2023-11-20T06:26:46.279 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/emc2103.ko 2023-11-20T06:26:46.279 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/emc6w201.ko 2023-11-20T06:26:46.279 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 66985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/f71805f.ko 2023-11-20T06:26:46.279 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 94457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/f71882fg.ko 2023-11-20T06:26:46.279 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 41401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/f75375s.ko 2023-11-20T06:26:46.279 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/fam15h_power.ko 2023-11-20T06:26:46.279 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 55449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/fschmd.ko 2023-11-20T06:26:46.279 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/g760a.ko 2023-11-20T06:26:46.279 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/g762.ko 2023-11-20T06:26:46.280 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 46801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/gl518sm.ko 2023-11-20T06:26:46.280 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 45529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/gl520sm.ko 2023-11-20T06:26:46.280 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/hih6130.ko 2023-11-20T06:26:46.280 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-20T06:26:46.280 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/i5500_temp.ko 2023-11-20T06:26:46.280 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/i5k_amb.ko 2023-11-20T06:26:46.280 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ibmaem.ko 2023-11-20T06:26:46.280 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ibmpex.ko 2023-11-20T06:26:46.280 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ina209.ko 2023-11-20T06:26:46.280 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ina2xx.ko 2023-11-20T06:26:46.280 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 130449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/it87.ko 2023-11-20T06:26:46.280 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/jc42.ko 2023-11-20T06:26:46.281 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/k10temp.ko 2023-11-20T06:26:46.281 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/k8temp.ko 2023-11-20T06:26:46.281 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lineage-pem.ko 2023-11-20T06:26:46.281 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 48601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm63.ko 2023-11-20T06:26:46.281 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm73.ko 2023-11-20T06:26:46.281 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 36777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm75.ko 2023-11-20T06:26:46.281 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm77.ko 2023-11-20T06:26:46.281 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm78.ko 2023-11-20T06:26:46.281 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 31745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm80.ko 2023-11-20T06:26:46.281 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm83.ko 2023-11-20T06:26:46.281 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 72833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm85.ko 2023-11-20T06:26:46.281 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 46153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm87.ko 2023-11-20T06:26:46.282 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 37913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm90.ko 2023-11-20T06:26:46.282 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm92.ko 2023-11-20T06:26:46.282 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 108841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm93.ko 2023-11-20T06:26:46.282 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm95234.ko 2023-11-20T06:26:46.282 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm95241.ko 2023-11-20T06:26:46.282 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm95245.ko 2023-11-20T06:26:46.282 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc2945.ko 2023-11-20T06:26:46.282 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4151.ko 2023-11-20T06:26:46.282 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4215.ko 2023-11-20T06:26:46.282 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4222.ko 2023-11-20T06:26:46.282 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4245.ko 2023-11-20T06:26:46.283 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4260.ko 2023-11-20T06:26:46.283 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4261.ko 2023-11-20T06:26:46.283 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max16065.ko 2023-11-20T06:26:46.283 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max1619.ko 2023-11-20T06:26:46.283 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max1668.ko 2023-11-20T06:26:46.283 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max197.ko 2023-11-20T06:26:46.283 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max6639.ko 2023-11-20T06:26:46.283 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max6650.ko 2023-11-20T06:26:46.283 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 35777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max6697.ko 2023-11-20T06:26:46.283 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-20T06:26:46.283 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/mcp3021.ko 2023-11-20T06:26:46.283 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-20T06:26:46.284 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 44129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/nct6683.ko 2023-11-20T06:26:46.284 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 119817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/nct6775-core.ko 2023-11-20T06:26:46.284 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 60705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/nct6775.ko 2023-11-20T06:26:46.284 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 59737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/nct7802.ko 2023-11-20T06:26:46.284 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 82337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pc87360.ko 2023-11-20T06:26:46.284 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 54433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pc87427.ko 2023-11-20T06:26:46.284 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pcf8591.ko 2023-11-20T06:26:46.284 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/ 2023-11-20T06:26:46.284 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-20T06:26:46.284 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-20T06:26:46.284 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-20T06:26:46.284 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-20T06:26:46.285 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-20T06:26:46.285 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-20T06:26:46.285 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-20T06:26:46.285 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 82577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-20T06:26:46.285 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-20T06:26:46.285 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-20T06:26:46.285 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-20T06:26:46.285 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-20T06:26:46.285 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/powr1220.ko 2023-11-20T06:26:46.285 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sch5627.ko 2023-11-20T06:26:46.285 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sch5636.ko 2023-11-20T06:26:46.285 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-20T06:26:46.286 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 32137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sht15.ko 2023-11-20T06:26:46.286 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sht21.ko 2023-11-20T06:26:46.286 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/shtc1.ko 2023-11-20T06:26:46.286 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 40105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sis5595.ko 2023-11-20T06:26:46.286 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/smsc47b397.ko 2023-11-20T06:26:46.286 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 39193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/smsc47m1.ko 2023-11-20T06:26:46.286 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 37385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/smsc47m192.ko 2023-11-20T06:26:46.286 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/thmc50.ko 2023-11-20T06:26:46.286 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/tmp102.ko 2023-11-20T06:26:46.286 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/tmp103.ko 2023-11-20T06:26:46.286 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/tmp401.ko 2023-11-20T06:26:46.287 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/tmp421.ko 2023-11-20T06:26:46.287 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/via-cputemp.ko 2023-11-20T06:26:46.287 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 41945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/via686a.ko 2023-11-20T06:26:46.287 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 52457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/vt1211.ko 2023-11-20T06:26:46.287 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 51545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/vt8231.ko 2023-11-20T06:26:46.287 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 57449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83627ehf.ko 2023-11-20T06:26:46.287 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 78873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83627hf.ko 2023-11-20T06:26:46.287 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 71345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83781d.ko 2023-11-20T06:26:46.287 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 63225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83791d.ko 2023-11-20T06:26:46.287 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 71321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83792d.ko 2023-11-20T06:26:46.287 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 101473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83793.ko 2023-11-20T06:26:46.288 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 119505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83795.ko 2023-11-20T06:26:46.288 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83l785ts.ko 2023-11-20T06:26:46.288 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 35625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83l786ng.ko 2023-11-20T06:26:46.288 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-20T06:26:46.288 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-20T06:26:46.288 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/ 2023-11-20T06:26:46.288 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/algos/ 2023-11-20T06:26:46.288 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-20T06:26:46.288 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-20T06:26:46.288 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/ 2023-11-20T06:26:46.288 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-20T06:26:46.288 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-20T06:26:46.288 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-20T06:26:46.289 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-20T06:26:46.289 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-20T06:26:46.289 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-20T06:26:46.289 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-20T06:26:46.289 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 6929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-20T06:26:46.289 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-20T06:26:46.289 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 50201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-20T06:26:46.289 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-20T06:26:46.289 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-20T06:26:46.289 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-20T06:26:46.289 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-20T06:26:46.289 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-20T06:26:46.290 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 62817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-20T06:26:46.290 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-20T06:26:46.290 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 47889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-20T06:26:46.290 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-20T06:26:46.290 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-20T06:26:46.290 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-20T06:26:46.290 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-20T06:26:46.290 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-20T06:26:46.290 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-20T06:26:46.290 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 47241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-20T06:26:46.290 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-20T06:26:46.290 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-20T06:26:46.290 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-20T06:26:46.291 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-20T06:26:46.291 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-20T06:26:46.291 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-20T06:26:46.291 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-20T06:26:46.291 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-20T06:26:46.292 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-20T06:26:46.292 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-20T06:26:46.292 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-20T06:26:46.293 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 47657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-20T06:26:46.293 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/i2c-mux.ko 2023-11-20T06:26:46.293 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/i2c-smbus.ko 2023-11-20T06:26:46.293 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/i2c-stub.ko 2023-11-20T06:26:46.293 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/muxes/ 2023-11-20T06:26:46.293 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-20T06:26:46.293 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-20T06:26:46.293 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-20T06:26:46.293 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ 2023-11-20T06:26:46.293 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/ 2023-11-20T06:26:46.293 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 273609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-20T06:26:46.293 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 879969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/ib_core.ko 2023-11-20T06:26:46.294 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 69273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-20T06:26:46.294 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 324217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-20T06:26:46.294 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 97985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-20T06:26:46.294 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 282273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-20T06:26:46.294 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 66201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-20T06:26:46.294 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/ 2023-11-20T06:26:46.294 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-20T06:26:46.294 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 493073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-20T06:26:46.294 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mlx4/ 2023-11-20T06:26:46.294 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 419737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-20T06:26:46.294 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mlx5/ 2023-11-20T06:26:46.295 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 739025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-20T06:26:46.295 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mthca/ 2023-11-20T06:26:46.295 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 296625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-20T06:26:46.295 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-20T06:26:46.295 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 153697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-20T06:26:46.295 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/usnic/ 2023-11-20T06:26:46.295 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 168969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-20T06:26:46.295 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/ 2023-11-20T06:26:46.295 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-20T06:26:46.295 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 263081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-20T06:26:46.295 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/iser/ 2023-11-20T06:26:46.295 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 100241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-20T06:26:46.295 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/isert/ 2023-11-20T06:26:46.296 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 111425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-20T06:26:46.296 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/srp/ 2023-11-20T06:26:46.296 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 128753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-20T06:26:46.296 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/srpt/ 2023-11-20T06:26:46.296 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 129529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-20T06:26:46.296 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/ 2023-11-20T06:26:46.296 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/evbug.ko 2023-11-20T06:26:46.296 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/ff-memless.ko 2023-11-20T06:26:46.296 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/gameport/ 2023-11-20T06:26:46.296 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-20T06:26:46.296 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-20T06:26:46.296 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 41241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/gameport/gameport.ko 2023-11-20T06:26:46.296 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 41801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/joydev.ko 2023-11-20T06:26:46.296 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/ 2023-11-20T06:26:46.297 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-20T06:26:46.297 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-20T06:26:46.297 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-20T06:26:46.297 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-20T06:26:46.297 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 36665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-20T06:26:46.297 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-20T06:26:46.297 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-20T06:26:46.297 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/lm8323.ko 2023-11-20T06:26:46.297 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/lm8333.ko 2023-11-20T06:26:46.297 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-20T06:26:46.297 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-20T06:26:46.297 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-20T06:26:46.298 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-20T06:26:46.298 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-20T06:26:46.298 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-20T06:26:46.298 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/qt1070.ko 2023-11-20T06:26:46.298 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/qt2160.ko 2023-11-20T06:26:46.298 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-20T06:26:46.298 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/stowaway.ko 2023-11-20T06:26:46.298 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-20T06:26:46.298 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-20T06:26:46.298 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-20T06:26:46.298 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-20T06:26:46.298 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-20T06:26:46.299 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/matrix-keymap.ko 2023-11-20T06:26:46.299 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/ 2023-11-20T06:26:46.299 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/appletouch.ko 2023-11-20T06:26:46.299 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/bcm5974.ko 2023-11-20T06:26:46.299 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 123681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/cyapatp.ko 2023-11-20T06:26:46.299 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 89449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-20T06:26:46.299 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-20T06:26:46.299 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 335929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/psmouse.ko 2023-11-20T06:26:46.299 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/sermouse.ko 2023-11-20T06:26:46.299 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-20T06:26:46.299 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-20T06:26:46.299 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-20T06:26:46.300 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/rmi4/ 2023-11-20T06:26:46.300 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 109873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-20T06:26:46.300 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/ 2023-11-20T06:26:46.300 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/altera_ps2.ko 2023-11-20T06:26:46.300 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/arc_ps2.ko 2023-11-20T06:26:46.300 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/ct82c710.ko 2023-11-20T06:26:46.300 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-20T06:26:46.300 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/parkbd.ko 2023-11-20T06:26:46.300 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/pcips2.ko 2023-11-20T06:26:46.300 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/ps2mult.ko 2023-11-20T06:26:46.300 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/serio_raw.ko 2023-11-20T06:26:46.300 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/serport.ko 2023-11-20T06:26:46.300 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/sparse-keymap.ko 2023-11-20T06:26:46.301 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/iommu/ 2023-11-20T06:26:46.301 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/iommu/amd/ 2023-11-20T06:26:46.301 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 39289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-20T06:26:46.301 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/ 2023-11-20T06:26:46.301 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-88pm860x.ko 2023-11-20T06:26:46.301 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-adp5520.ko 2023-11-20T06:26:46.301 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 59753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-bd2802.ko 2023-11-20T06:26:46.301 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-blinkm.ko 2023-11-20T06:26:46.301 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-da903x.ko 2023-11-20T06:26:46.301 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-da9052.ko 2023-11-20T06:26:46.301 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-gpio.ko 2023-11-20T06:26:46.301 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lm3530.ko 2023-11-20T06:26:46.302 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lm3533.ko 2023-11-20T06:26:46.302 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lm355x.ko 2023-11-20T06:26:46.302 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lm3642.ko 2023-11-20T06:26:46.302 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lp3944.ko 2023-11-20T06:26:46.302 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lp8788.ko 2023-11-20T06:26:46.302 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-max8997.ko 2023-11-20T06:26:46.302 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-mc13783.ko 2023-11-20T06:26:46.302 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-20T06:26:46.302 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-pca9532.ko 2023-11-20T06:26:46.302 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-pca955x.ko 2023-11-20T06:26:46.302 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-pca963x.ko 2023-11-20T06:26:46.302 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-ss4200.ko 2023-11-20T06:26:46.302 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-tca6507.ko 2023-11-20T06:26:46.303 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-20T06:26:46.303 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-wm8350.ko 2023-11-20T06:26:46.303 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ 2023-11-20T06:26:46.303 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-20T06:26:46.303 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-20T06:26:46.303 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-20T06:26:46.303 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-20T06:26:46.303 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-20T06:26:46.303 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-20T06:26:46.303 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-20T06:26:46.303 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-20T06:26:46.303 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/ 2023-11-20T06:26:46.304 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/bcache/ 2023-11-20T06:26:46.304 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 654969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/bcache/bcache.ko 2023-11-20T06:26:46.304 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 40577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-bio-prison.ko 2023-11-20T06:26:46.304 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 89601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-bufio.ko 2023-11-20T06:26:46.304 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 47529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-cache-smq.ko 2023-11-20T06:26:46.304 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 156009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-cache.ko 2023-11-20T06:26:46.304 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 106897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-crypt.ko 2023-11-20T06:26:46.304 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-delay.ko 2023-11-20T06:26:46.304 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 53857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-era.ko 2023-11-20T06:26:46.304 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-flakey.ko 2023-11-20T06:26:46.304 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 41529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-log-userspace.ko 2023-11-20T06:26:46.304 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 32737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-log.ko 2023-11-20T06:26:46.304 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 49545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-mirror.ko 2023-11-20T06:26:46.305 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 78033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-multipath.ko 2023-11-20T06:26:46.305 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-queue-length.ko 2023-11-20T06:26:46.305 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 70825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-raid.ko 2023-11-20T06:26:46.305 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 36297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-region-hash.ko 2023-11-20T06:26:46.305 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-round-robin.ko 2023-11-20T06:26:46.305 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-service-time.ko 2023-11-20T06:26:46.305 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 109529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-snapshot.ko 2023-11-20T06:26:46.305 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-switch.ko 2023-11-20T06:26:46.305 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 181865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-thin-pool.ko 2023-11-20T06:26:46.305 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 51737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-verity.ko 2023-11-20T06:26:46.305 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-zero.ko 2023-11-20T06:26:46.305 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/faulty.ko 2023-11-20T06:26:46.306 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/linear.ko 2023-11-20T06:26:46.306 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 32417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/multipath.ko 2023-11-20T06:26:46.306 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/persistent-data/ 2023-11-20T06:26:46.306 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 199937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-20T06:26:46.306 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 37337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/raid0.ko 2023-11-20T06:26:46.306 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 113073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/raid1.ko 2023-11-20T06:26:46.306 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 158681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/raid10.ko 2023-11-20T06:26:46.306 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 395721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/raid456.ko 2023-11-20T06:26:46.306 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/ 2023-11-20T06:26:46.306 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/ 2023-11-20T06:26:46.306 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 178137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptbase.ko 2023-11-20T06:26:46.306 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 63385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptctl.ko 2023-11-20T06:26:46.306 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 44665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptfc.ko 2023-11-20T06:26:46.307 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 37225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptlan.ko 2023-11-20T06:26:46.307 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 123321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptsas.ko 2023-11-20T06:26:46.307 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 79041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptscsih.ko 2023-11-20T06:26:46.307 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 53017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptspi.ko 2023-11-20T06:26:46.307 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/ 2023-11-20T06:26:46.307 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/88pm800.ko 2023-11-20T06:26:46.307 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/88pm805.ko 2023-11-20T06:26:46.307 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/88pm80x.ko 2023-11-20T06:26:46.307 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/arizona-i2c.ko 2023-11-20T06:26:46.307 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 123721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/arizona.ko 2023-11-20T06:26:46.307 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/bcm590xx.ko 2023-11-20T06:26:46.307 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-20T06:26:46.308 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/dln2.ko 2023-11-20T06:26:46.308 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/janz-cmodio.ko 2023-11-20T06:26:46.308 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 53585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/kempld-core.ko 2023-11-20T06:26:46.308 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/lm3533-core.ko 2023-11-20T06:26:46.308 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-20T06:26:46.308 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/lp3943.ko 2023-11-20T06:26:46.308 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 54569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/lpc_ich.ko 2023-11-20T06:26:46.308 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/lpc_sch.ko 2023-11-20T06:26:46.308 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/max8907.ko 2023-11-20T06:26:46.308 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-20T06:26:46.308 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-20T06:26:46.308 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/menf21bmc.ko 2023-11-20T06:26:46.309 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-20T06:26:46.309 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-20T06:26:46.309 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/pcf50633.ko 2023-11-20T06:26:46.309 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-20T06:26:46.309 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/retu-mfd.ko 2023-11-20T06:26:46.309 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 80425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/si476x-core.ko 2023-11-20T06:26:46.309 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 48457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/sm501.ko 2023-11-20T06:26:46.309 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-20T06:26:46.309 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 51137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/tps65010.ko 2023-11-20T06:26:46.309 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/tps6507x.ko 2023-11-20T06:26:46.309 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/viperboard.ko 2023-11-20T06:26:46.310 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/vx855.ko 2023-11-20T06:26:46.310 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/wl1273-core.ko 2023-11-20T06:26:46.310 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 44345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/wm8994.ko 2023-11-20T06:26:46.310 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ 2023-11-20T06:26:46.310 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-20T06:26:46.310 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 48489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ad525x_dpot.ko 2023-11-20T06:26:46.310 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/altera-stapl/ 2023-11-20T06:26:46.310 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 46585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-20T06:26:46.310 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/apds9802als.ko 2023-11-20T06:26:46.310 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 36729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/apds990x.ko 2023-11-20T06:26:46.310 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 45593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/bh1770glc.ko 2023-11-20T06:26:46.310 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/c2port/ 2023-11-20T06:26:46.311 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-20T06:26:46.311 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 35281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/c2port/core.ko 2023-11-20T06:26:46.311 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/cb710/ 2023-11-20T06:26:46.311 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/cb710/cb710.ko 2023-11-20T06:26:46.311 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ds1682.ko 2023-11-20T06:26:46.311 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/dummy-irq.ko 2023-11-20T06:26:46.311 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/echo/ 2023-11-20T06:26:46.311 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/echo/echo.ko 2023-11-20T06:26:46.311 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/eeprom/ 2023-11-20T06:26:46.311 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 37849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/eeprom/at24.ko 2023-11-20T06:26:46.311 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-20T06:26:46.311 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-20T06:26:46.312 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/eeprom/max6875.ko 2023-11-20T06:26:46.312 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/enclosure.ko 2023-11-20T06:26:46.312 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/genwqe/ 2023-11-20T06:26:46.312 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 152201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-20T06:26:46.312 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/hmc6352.ko 2023-11-20T06:26:46.312 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 31257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/hpilo.ko 2023-11-20T06:26:46.312 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ibmasm/ 2023-11-20T06:26:46.312 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 72129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-20T06:26:46.312 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ics932s401.ko 2023-11-20T06:26:46.312 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/isl29003.ko 2023-11-20T06:26:46.312 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/isl29020.ko 2023-11-20T06:26:46.313 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/lis3lv02d/ 2023-11-20T06:26:46.313 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 42513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-20T06:26:46.313 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-20T06:26:46.313 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/mei/ 2023-11-20T06:26:46.313 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 125209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/mei/mei-me.ko 2023-11-20T06:26:46.313 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 56521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/mei/mei-txe.ko 2023-11-20T06:26:46.313 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 310113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/mei/mei.ko 2023-11-20T06:26:46.313 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 31329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/phantom.ko 2023-11-20T06:26:46.313 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ti-st/ 2023-11-20T06:26:46.313 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 74265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-20T06:26:46.313 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/tifm_7xx1.ko 2023-11-20T06:26:46.313 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/tifm_core.ko 2023-11-20T06:26:46.314 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/tsl2550.ko 2023-11-20T06:26:46.314 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 48697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/vmw_balloon.ko 2023-11-20T06:26:46.314 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/vmw_vmci/ 2023-11-20T06:26:46.314 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 183609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-20T06:26:46.314 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ 2023-11-20T06:26:46.314 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/bonding/ 2023-11-20T06:26:46.314 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 490129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/bonding/bonding.ko 2023-11-20T06:26:46.314 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/ 2023-11-20T06:26:46.314 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/b53/ 2023-11-20T06:26:46.314 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 106033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-20T06:26:46.314 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 40417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-20T06:26:46.314 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-20T06:26:46.314 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-20T06:26:46.315 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 453737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-20T06:26:46.315 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dummy.ko 2023-11-20T06:26:46.315 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/eql.ko 2023-11-20T06:26:46.315 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/ 2023-11-20T06:26:46.315 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/3com/ 2023-11-20T06:26:46.315 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 45785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-20T06:26:46.315 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 42105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-20T06:26:46.315 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 130553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-20T06:26:46.315 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 68849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-20T06:26:46.315 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/8390/ 2023-11-20T06:26:46.315 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 37649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-20T06:26:46.315 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 59689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-20T06:26:46.315 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-20T06:26:46.316 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 99049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-20T06:26:46.316 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/adaptec/ 2023-11-20T06:26:46.316 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 54521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-20T06:26:46.316 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/agere/ 2023-11-20T06:26:46.316 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 69137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-20T06:26:46.316 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/alteon/ 2023-11-20T06:26:46.316 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 59585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-20T06:26:46.316 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/altera/ 2023-11-20T06:26:46.316 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 41409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-20T06:26:46.316 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/amd/ 2023-11-20T06:26:46.316 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 54609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-20T06:26:46.316 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 49289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-20T06:26:46.317 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 87297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-20T06:26:46.317 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/ 2023-11-20T06:26:46.317 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-20T06:26:46.317 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 97337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-20T06:26:46.317 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-20T06:26:46.317 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 104673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-20T06:26:46.317 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-20T06:26:46.317 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 90257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-20T06:26:46.317 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-20T06:26:46.317 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 81569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-20T06:26:46.317 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 69729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-20T06:26:46.317 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/ 2023-11-20T06:26:46.317 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 78401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-20T06:26:46.318 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 176761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-20T06:26:46.318 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-20T06:26:46.318 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 1421497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-20T06:26:46.318 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 128569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-20T06:26:46.318 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-20T06:26:46.318 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 132089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-20T06:26:46.318 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 312081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-20T06:26:46.376 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/brocade/ 2023-11-20T06:26:46.376 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-20T06:26:46.376 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 323513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-20T06:26:46.377 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/ 2023-11-20T06:26:46.377 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-20T06:26:46.377 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 193497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-20T06:26:46.377 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-20T06:26:46.377 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 347417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-20T06:26:46.377 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-20T06:26:46.377 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 1044497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-20T06:26:46.377 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-20T06:26:46.377 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 166193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-20T06:26:46.377 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-20T06:26:46.378 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-20T06:26:46.378 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/cisco/ 2023-11-20T06:26:46.378 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-20T06:26:46.378 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 204345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-20T06:26:46.378 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/ 2023-11-20T06:26:46.378 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-20T06:26:46.378 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 69449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-20T06:26:46.378 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 61489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-20T06:26:46.378 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 141225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-20T06:26:46.378 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 51497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-20T06:26:46.378 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 62817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-20T06:26:46.379 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 31369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-20T06:26:46.379 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dlink/ 2023-11-20T06:26:46.379 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 60873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-20T06:26:46.379 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 62833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-20T06:26:46.379 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 45721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dnet.ko 2023-11-20T06:26:46.379 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-20T06:26:46.379 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/emulex/ 2023-11-20T06:26:46.379 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-20T06:26:46.379 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 281137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-20T06:26:46.379 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 49457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/ethoc.ko 2023-11-20T06:26:46.379 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 51737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/fealnx.ko 2023-11-20T06:26:46.379 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/fujitsu/ 2023-11-20T06:26:46.380 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 45345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-20T06:26:46.380 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/ 2023-11-20T06:26:46.380 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 90465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-20T06:26:46.380 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-20T06:26:46.380 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 295577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-20T06:26:46.380 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-20T06:26:46.380 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 584497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-20T06:26:46.380 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-20T06:26:46.380 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 246209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-20T06:26:46.380 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-20T06:26:46.380 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 925825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-20T06:26:46.381 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-20T06:26:46.381 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 302937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-20T06:26:46.381 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/igb/ 2023-11-20T06:26:46.381 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 514641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-20T06:26:46.381 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-20T06:26:46.381 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 93593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-20T06:26:46.381 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-20T06:26:46.381 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 734305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-20T06:26:46.381 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-20T06:26:46.381 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 151769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-20T06:26:46.381 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 86921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/jme.ko 2023-11-20T06:26:46.381 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/marvell/ 2023-11-20T06:26:46.382 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-20T06:26:46.382 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 102289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-20T06:26:46.382 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 122649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-20T06:26:46.382 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/ 2023-11-20T06:26:46.382 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-20T06:26:46.382 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 727601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-20T06:26:46.382 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 278937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-20T06:26:46.382 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-20T06:26:46.382 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-20T06:26:46.382 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 1113681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-20T06:26:46.382 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/micrel/ 2023-11-20T06:26:46.383 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 53041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-20T06:26:46.383 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 40993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-20T06:26:46.383 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-20T06:26:46.383 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 95665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-20T06:26:46.383 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/myricom/ 2023-11-20T06:26:46.383 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-20T06:26:46.383 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 108649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-20T06:26:46.383 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/natsemi/ 2023-11-20T06:26:46.383 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 73441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-20T06:26:46.383 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 47777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-20T06:26:46.383 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/neterion/ 2023-11-20T06:26:46.383 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 150905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-20T06:26:46.383 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/nvidia/ 2023-11-20T06:26:46.384 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 136721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-20T06:26:46.384 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/packetengines/ 2023-11-20T06:26:46.384 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 50481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-20T06:26:46.384 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 43145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-20T06:26:46.384 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/ 2023-11-20T06:26:46.384 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-20T06:26:46.384 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 227897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-20T06:26:46.384 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 87081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-20T06:26:46.384 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-20T06:26:46.384 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 672049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-20T06:26:46.384 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/rdc/ 2023-11-20T06:26:46.384 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 43017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-20T06:26:46.385 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/realtek/ 2023-11-20T06:26:46.385 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 67385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-20T06:26:46.385 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 83985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-20T06:26:46.385 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-20T06:26:46.385 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 189801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-20T06:26:46.385 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/samsung/ 2023-11-20T06:26:46.385 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-20T06:26:46.385 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 104241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-20T06:26:46.385 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sfc/ 2023-11-20T06:26:46.385 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 1052497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-20T06:26:46.385 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/silan/ 2023-11-20T06:26:46.385 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 47097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-20T06:26:46.386 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sis/ 2023-11-20T06:26:46.386 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 54817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-20T06:26:46.386 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 63337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-20T06:26:46.386 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/smsc/ 2023-11-20T06:26:46.386 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 61537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-20T06:26:46.386 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 67193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-20T06:26:46.386 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 73409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-20T06:26:46.386 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 68177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-20T06:26:46.386 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/ 2023-11-20T06:26:46.386 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-20T06:26:46.386 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-20T06:26:46.386 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 39905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-20T06:26:46.387 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-20T06:26:46.387 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 487025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-20T06:26:46.387 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sun/ 2023-11-20T06:26:46.387 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 103337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-20T06:26:46.387 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 166097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-20T06:26:46.387 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 66329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-20T06:26:46.387 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 78801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-20T06:26:46.387 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/tehuti/ 2023-11-20T06:26:46.387 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 50057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-20T06:26:46.387 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/ti/ 2023-11-20T06:26:46.387 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 86529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-20T06:26:46.387 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/via/ 2023-11-20T06:26:46.388 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 80273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-20T06:26:46.388 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 83633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-20T06:26:46.388 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/wiznet/ 2023-11-20T06:26:46.388 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 46241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-20T06:26:46.388 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-20T06:26:46.388 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/xircom/ 2023-11-20T06:26:46.388 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 59993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-20T06:26:46.388 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/fddi/ 2023-11-20T06:26:46.388 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 41001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/fddi/defxx.ko 2023-11-20T06:26:46.388 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/fddi/skfp/ 2023-11-20T06:26:46.388 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 216985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-20T06:26:46.389 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 77345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/geneve.ko 2023-11-20T06:26:46.389 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/hyperv/ 2023-11-20T06:26:46.389 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 235521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-20T06:26:46.389 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ieee802154/ 2023-11-20T06:26:46.389 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-20T06:26:46.389 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ifb.ko 2023-11-20T06:26:46.389 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ipvlan/ 2023-11-20T06:26:46.389 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 83769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-20T06:26:46.389 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 62145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/macvlan.ko 2023-11-20T06:26:46.389 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/macvtap.ko 2023-11-20T06:26:46.389 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio/ 2023-11-20T06:26:46.390 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-20T06:26:46.390 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-20T06:26:46.390 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-20T06:26:46.390 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-20T06:26:46.390 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio.ko 2023-11-20T06:26:46.390 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mii.ko 2023-11-20T06:26:46.390 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 43953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/netconsole.ko 2023-11-20T06:26:46.390 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/nlmon.ko 2023-11-20T06:26:46.390 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/pcs/ 2023-11-20T06:26:46.390 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-20T06:26:46.390 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 38977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-20T06:26:46.390 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/ 2023-11-20T06:26:46.390 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/amd.ko 2023-11-20T06:26:46.391 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 50033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-20T06:26:46.391 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 44721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-20T06:26:46.391 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/bcm87xx.ko 2023-11-20T06:26:46.391 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 42241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/broadcom.ko 2023-11-20T06:26:46.391 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/cicada.ko 2023-11-20T06:26:46.391 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/davicom.ko 2023-11-20T06:26:46.391 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/et1011c.ko 2023-11-20T06:26:46.391 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/icplus.ko 2023-11-20T06:26:46.391 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/lxt.ko 2023-11-20T06:26:46.391 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 82049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/marvell.ko 2023-11-20T06:26:46.391 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 76113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/micrel.ko 2023-11-20T06:26:46.391 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/national.ko 2023-11-20T06:26:46.392 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 97857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/phylink.ko 2023-11-20T06:26:46.392 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/qsemi.ko 2023-11-20T06:26:46.392 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 50065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/realtek.ko 2023-11-20T06:26:46.392 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/smsc.ko 2023-11-20T06:26:46.392 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/ste10Xp.ko 2023-11-20T06:26:46.392 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/vitesse.ko 2023-11-20T06:26:46.392 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/plip/ 2023-11-20T06:26:46.392 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 43505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/plip/plip.ko 2023-11-20T06:26:46.392 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/ 2023-11-20T06:26:46.392 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-20T06:26:46.392 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/ppp_async.ko 2023-11-20T06:26:46.392 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-20T06:26:46.393 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-20T06:26:46.393 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-20T06:26:46.393 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 42545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/pppoe.ko 2023-11-20T06:26:46.393 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/pppox.ko 2023-11-20T06:26:46.393 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 32689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/pptp.ko 2023-11-20T06:26:46.393 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/sb1000.ko 2023-11-20T06:26:46.393 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/slip/ 2023-11-20T06:26:46.393 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 42465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/slip/slip.ko 2023-11-20T06:26:46.393 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/sungem_phy.ko 2023-11-20T06:26:46.393 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 64449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/tap.ko 2023-11-20T06:26:46.393 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/ 2023-11-20T06:26:46.393 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 106169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team.ko 2023-11-20T06:26:46.394 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-20T06:26:46.394 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-20T06:26:46.394 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-20T06:26:46.394 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team_mode_random.ko 2023-11-20T06:26:46.394 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-20T06:26:46.394 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 87017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/veth.ko 2023-11-20T06:26:46.394 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/vmxnet3/ 2023-11-20T06:26:46.394 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 144297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-20T06:26:46.394 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/vxlan/ 2023-11-20T06:26:46.394 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 297329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/vxlan/vxlan.ko 2023-11-20T06:26:46.394 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/xen-netback/ 2023-11-20T06:26:46.395 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 144585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-20T06:26:46.395 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ntb/ 2023-11-20T06:26:46.395 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ntb/ntb.ko 2023-11-20T06:26:46.395 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/nvme/ 2023-11-20T06:26:46.395 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/nvme/host/ 2023-11-20T06:26:46.395 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 265121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/nvme/host/nvme-core.ko 2023-11-20T06:26:46.395 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 102209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/nvme/host/nvme.ko 2023-11-20T06:26:46.395 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/parport/ 2023-11-20T06:26:46.395 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 133841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/parport/parport.ko 2023-11-20T06:26:46.395 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/parport/parport_cs.ko 2023-11-20T06:26:46.395 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 84465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/parport/parport_pc.ko 2023-11-20T06:26:46.395 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/parport/parport_serial.ko 2023-11-20T06:26:46.395 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/ 2023-11-20T06:26:46.396 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/hotplug/ 2023-11-20T06:26:46.396 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-20T06:26:46.396 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-20T06:26:46.396 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-20T06:26:46.396 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/pci-stub.ko 2023-11-20T06:26:46.396 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 46465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/xen-pcifront.ko 2023-11-20T06:26:46.396 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/ 2023-11-20T06:26:46.396 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/i82092.ko 2023-11-20T06:26:46.396 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 145809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/pcmcia.ko 2023-11-20T06:26:46.396 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 62137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-20T06:26:46.396 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-20T06:26:46.397 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/pd6729.ko 2023-11-20T06:26:46.397 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 112889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-20T06:26:46.397 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/phy/ 2023-11-20T06:26:46.397 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/phy/broadcom/ 2023-11-20T06:26:46.397 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-20T06:26:46.397 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/phy/samsung/ 2023-11-20T06:26:46.397 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-20T06:26:46.397 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pinctrl/ 2023-11-20T06:26:46.397 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pinctrl/intel/ 2023-11-20T06:26:46.397 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 70153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-20T06:26:46.397 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/ 2023-11-20T06:26:46.397 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/ 2023-11-20T06:26:46.398 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 50889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-20T06:26:46.398 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-20T06:26:46.398 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-20T06:26:46.398 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-20T06:26:46.398 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-20T06:26:46.398 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-20T06:26:46.398 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-20T06:26:46.398 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/ 2023-11-20T06:26:46.398 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 67097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-20T06:26:46.398 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 39145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/acerhdf.ko 2023-11-20T06:26:46.398 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 37025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-20T06:26:46.399 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 59665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-20T06:26:46.399 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 31161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-20T06:26:46.399 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 127441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-20T06:26:46.399 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 36849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-20T06:26:46.399 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 49121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-20T06:26:46.399 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-20T06:26:46.399 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 40265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-20T06:26:46.399 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-20T06:26:46.399 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 36593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/hdaps.ko 2023-11-20T06:26:46.399 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-20T06:26:46.399 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/intel/ 2023-11-20T06:26:46.399 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-20T06:26:46.400 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-20T06:26:46.400 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 43497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/intel_ips.ko 2023-11-20T06:26:46.400 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-20T06:26:46.400 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-20T06:26:46.400 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-20T06:26:46.400 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 42329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-20T06:26:46.400 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-20T06:26:46.400 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-20T06:26:46.400 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-20T06:26:46.400 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-20T06:26:46.400 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-20T06:26:46.400 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 57569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/wmi.ko 2023-11-20T06:26:46.400 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/ 2023-11-20T06:26:46.401 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/ 2023-11-20T06:26:46.401 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-20T06:26:46.401 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-20T06:26:46.401 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 55057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-20T06:26:46.401 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 54081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-20T06:26:46.401 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-20T06:26:46.401 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-20T06:26:46.401 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/da9030_battery.ko 2023-11-20T06:26:46.401 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/da9052-battery.ko 2023-11-20T06:26:46.401 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-20T06:26:46.401 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-20T06:26:46.401 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-20T06:26:46.402 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-20T06:26:46.402 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/gpio-charger.ko 2023-11-20T06:26:46.402 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-20T06:26:46.402 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-20T06:26:46.402 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/max14577_charger.ko 2023-11-20T06:26:46.402 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/max17040_battery.ko 2023-11-20T06:26:46.402 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/max17042_battery.ko 2023-11-20T06:26:46.402 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/max8903_charger.ko 2023-11-20T06:26:46.402 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/max8925_power.ko 2023-11-20T06:26:46.402 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-20T06:26:46.402 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 38009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/sbs-battery.ko 2023-11-20T06:26:46.403 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/test_power.ko 2023-11-20T06:26:46.403 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-20T06:26:46.403 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-20T06:26:46.403 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/wm831x_power.ko 2023-11-20T06:26:46.403 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/wm8350_power.ko 2023-11-20T06:26:46.403 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/powercap/ 2023-11-20T06:26:46.403 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 57729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-20T06:26:46.403 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-20T06:26:46.403 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/ 2023-11-20T06:26:46.403 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/clients/ 2023-11-20T06:26:46.403 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-20T06:26:46.403 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-20T06:26:46.404 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/clients/pps_parport.ko 2023-11-20T06:26:46.404 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 41873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/pps_core.ko 2023-11-20T06:26:46.404 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ptp/ 2023-11-20T06:26:46.404 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 66385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ptp/ptp.ko 2023-11-20T06:26:46.404 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ptp/ptp_kvm.ko 2023-11-20T06:26:46.404 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/ 2023-11-20T06:26:46.404 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-20T06:26:46.404 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-20T06:26:46.404 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-20T06:26:46.404 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-da9052.ko 2023-11-20T06:26:46.404 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-da9055.ko 2023-11-20T06:26:46.404 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-da9063.ko 2023-11-20T06:26:46.404 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-20T06:26:46.405 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 68577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-20T06:26:46.405 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-20T06:26:46.405 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-20T06:26:46.405 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-20T06:26:46.405 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-20T06:26:46.405 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-20T06:26:46.405 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-20T06:26:46.405 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-20T06:26:46.405 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-em3027.ko 2023-11-20T06:26:46.405 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-20T06:26:46.405 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-20T06:26:46.405 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 35969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-20T06:26:46.406 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-20T06:26:46.406 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 38097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-20T06:26:46.406 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-20T06:26:46.406 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-20T06:26:46.406 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-20T06:26:46.406 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-max6900.ko 2023-11-20T06:26:46.406 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-max8907.ko 2023-11-20T06:26:46.406 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-max8925.ko 2023-11-20T06:26:46.406 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-max8997.ko 2023-11-20T06:26:46.406 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-max8998.ko 2023-11-20T06:26:46.406 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-20T06:26:46.407 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-20T06:26:46.407 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-palmas.ko 2023-11-20T06:26:46.407 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 46633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-20T06:26:46.407 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-20T06:26:46.407 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-20T06:26:46.407 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-20T06:26:46.407 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-20T06:26:46.407 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-20T06:26:46.407 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-20T06:26:46.407 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-20T06:26:46.407 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-20T06:26:46.407 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-20T06:26:46.408 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-20T06:26:46.408 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-20T06:26:46.408 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-20T06:26:46.408 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-20T06:26:46.408 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-20T06:26:46.408 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-20T06:26:46.408 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-20T06:26:46.408 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-20T06:26:46.408 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-x1205.ko 2023-11-20T06:26:46.408 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ 2023-11-20T06:26:46.408 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 77617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/3w-9xxx.ko 2023-11-20T06:26:46.408 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 57665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/3w-sas.ko 2023-11-20T06:26:46.408 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 55105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/3w-xxxx.ko 2023-11-20T06:26:46.409 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 135185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/BusLogic.ko 2023-11-20T06:26:46.409 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/a100u2w.ko 2023-11-20T06:26:46.409 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aacraid/ 2023-11-20T06:26:46.409 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 272305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-20T06:26:46.409 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 100617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/advansys.ko 2023-11-20T06:26:46.409 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aic7xxx/ 2023-11-20T06:26:46.409 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 356201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-20T06:26:46.409 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 295801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-20T06:26:46.409 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aic94xx/ 2023-11-20T06:26:46.409 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 189185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-20T06:26:46.409 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/am53c974.ko 2023-11-20T06:26:46.409 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/arcmsr/ 2023-11-20T06:26:46.410 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 106881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-20T06:26:46.410 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 38185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/atp870u.ko 2023-11-20T06:26:46.410 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/be2iscsi/ 2023-11-20T06:26:46.410 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 246985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-20T06:26:46.410 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bfa/ 2023-11-20T06:26:46.410 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 1171945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bfa/bfa.ko 2023-11-20T06:26:46.410 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bnx2fc/ 2023-11-20T06:26:46.410 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 237273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-20T06:26:46.410 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bnx2i/ 2023-11-20T06:26:46.410 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 115369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-20T06:26:46.410 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 40585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ch.ko 2023-11-20T06:26:46.410 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/csiostor/ 2023-11-20T06:26:46.411 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 308921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-20T06:26:46.411 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/ 2023-11-20T06:26:46.411 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-20T06:26:46.411 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 76145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-20T06:26:46.411 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-20T06:26:46.411 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 101449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-20T06:26:46.411 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 146689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-20T06:26:46.411 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 75553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/dc395x.ko 2023-11-20T06:26:46.411 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 38073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/dmx3191d.ko 2023-11-20T06:26:46.411 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/esas2r/ 2023-11-20T06:26:46.411 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 212425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-20T06:26:46.411 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 60505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/esp_scsi.ko 2023-11-20T06:26:46.412 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fcoe/ 2023-11-20T06:26:46.412 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 78209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-20T06:26:46.412 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 158505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-20T06:26:46.412 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fdomain.ko 2023-11-20T06:26:46.412 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fnic/ 2023-11-20T06:26:46.412 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 263489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fnic/fnic.ko 2023-11-20T06:26:46.412 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 201817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/hpsa.ko 2023-11-20T06:26:46.412 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 51209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/hptiop.ko 2023-11-20T06:26:46.412 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 49041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/hv_storvsc.ko 2023-11-20T06:26:46.412 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 35337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/imm.ko 2023-11-20T06:26:46.412 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 44057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/initio.ko 2023-11-20T06:26:46.412 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 266537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ipr.ko 2023-11-20T06:26:46.413 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 101881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ips.ko 2023-11-20T06:26:46.413 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/isci/ 2023-11-20T06:26:46.413 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 317153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/isci/isci.ko 2023-11-20T06:26:46.413 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-20T06:26:46.413 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 52961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-20T06:26:46.413 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libfc/ 2023-11-20T06:26:46.413 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 314865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libfc/libfc.ko 2023-11-20T06:26:46.413 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 145585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libiscsi.ko 2023-11-20T06:26:46.413 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 53521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-20T06:26:46.413 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libsas/ 2023-11-20T06:26:46.413 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 216665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libsas/libsas.ko 2023-11-20T06:26:46.413 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/lpfc/ 2023-11-20T06:26:46.413 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 2197249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-20T06:26:46.414 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/megaraid/ 2023-11-20T06:26:46.414 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 73569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-20T06:26:46.414 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-20T06:26:46.414 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 310617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-20T06:26:46.414 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 84721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/megaraid.ko 2023-11-20T06:26:46.414 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/mpt3sas/ 2023-11-20T06:26:46.414 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 659825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-20T06:26:46.414 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/mvsas/ 2023-11-20T06:26:46.414 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 119561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-20T06:26:46.414 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 78129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/mvumi.ko 2023-11-20T06:26:46.414 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pcmcia/ 2023-11-20T06:26:46.414 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 81625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-20T06:26:46.415 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-20T06:26:46.415 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-20T06:26:46.415 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-20T06:26:46.415 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pm8001/ 2023-11-20T06:26:46.415 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 364105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-20T06:26:46.415 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 123617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pmcraid.ko 2023-11-20T06:26:46.415 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ppa.ko 2023-11-20T06:26:46.415 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 55361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla1280.ko 2023-11-20T06:26:46.415 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla2xxx/ 2023-11-20T06:26:46.415 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 1876689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-20T06:26:46.415 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 85289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-20T06:26:46.415 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla4xxx/ 2023-11-20T06:26:46.416 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 559033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-20T06:26:46.416 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qlogicfas408.ko 2023-11-20T06:26:46.416 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/raid_class.ko 2023-11-20T06:26:46.416 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 238761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_debug.ko 2023-11-20T06:26:46.416 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 173937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-20T06:26:46.416 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 279313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-20T06:26:46.416 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 97729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-20T06:26:46.416 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 73881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-20T06:26:46.416 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 44993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-20T06:26:46.416 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ses.ko 2023-11-20T06:26:46.416 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 115889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/st.ko 2023-11-20T06:26:46.416 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 46825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/stex.ko 2023-11-20T06:26:46.416 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-20T06:26:46.417 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 162121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-20T06:26:46.417 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 42297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/virtio_scsi.ko 2023-11-20T06:26:46.417 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 50321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-20T06:26:46.417 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 39961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/wd719x.ko 2023-11-20T06:26:46.417 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 50025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/xen-scsifront.ko 2023-11-20T06:26:46.417 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ssb/ 2023-11-20T06:26:46.417 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 129441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ssb/ssb.ko 2023-11-20T06:26:46.417 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/ 2023-11-20T06:26:46.417 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/iscsi/ 2023-11-20T06:26:46.417 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 736601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-20T06:26:46.417 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/loopback/ 2023-11-20T06:26:46.417 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 49985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-20T06:26:46.418 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 39713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/target_core_file.ko 2023-11-20T06:26:46.418 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 43025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/target_core_iblock.ko 2023-11-20T06:26:46.418 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 930257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/target_core_mod.ko 2023-11-20T06:26:46.418 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 44305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/target_core_pscsi.ko 2023-11-20T06:26:46.418 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 122521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/target_core_user.ko 2023-11-20T06:26:46.418 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/tcm_fc/ 2023-11-20T06:26:46.418 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 75593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-20T06:26:46.418 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/ 2023-11-20T06:26:46.418 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/ 2023-11-20T06:26:46.418 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-20T06:26:46.418 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-20T06:26:46.419 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-20T06:26:46.419 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-20T06:26:46.419 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-20T06:26:46.419 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-20T06:26:46.419 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-20T06:26:46.419 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-20T06:26:46.419 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-20T06:26:46.419 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-20T06:26:46.419 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-20T06:26:46.419 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-20T06:26:46.419 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 37065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-20T06:26:46.419 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-20T06:26:46.419 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-20T06:26:46.420 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-20T06:26:46.420 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-20T06:26:46.420 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/ 2023-11-20T06:26:46.420 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/ipwireless/ 2023-11-20T06:26:46.420 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 78425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-20T06:26:46.420 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 57865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/moxa.ko 2023-11-20T06:26:46.420 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 50953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/mxser.ko 2023-11-20T06:26:46.420 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 108601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/n_gsm.ko 2023-11-20T06:26:46.420 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 31961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/n_hdlc.ko 2023-11-20T06:26:46.420 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 67929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/nozomi.ko 2023-11-20T06:26:46.420 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/ 2023-11-20T06:26:46.420 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/8250/ 2023-11-20T06:26:46.421 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 35753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-20T06:26:46.421 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 59497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-20T06:26:46.421 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-20T06:26:46.421 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/altera_uart.ko 2023-11-20T06:26:46.421 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/arc_uart.ko 2023-11-20T06:26:46.421 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 72425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-20T06:26:46.421 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/jsm/ 2023-11-20T06:26:46.421 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 103073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-20T06:26:46.421 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/rp2.ko 2023-11-20T06:26:46.421 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 52817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-20T06:26:46.421 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/ 2023-11-20T06:26:46.421 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/core/ 2023-11-20T06:26:46.422 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 531265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-20T06:26:46.422 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/host/ 2023-11-20T06:26:46.422 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-20T06:26:46.422 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-20T06:26:46.422 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/ 2023-11-20T06:26:46.422 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 44513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio.ko 2023-11-20T06:26:46.422 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_aec.ko 2023-11-20T06:26:46.422 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_cif.ko 2023-11-20T06:26:46.422 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-20T06:26:46.422 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_mf624.ko 2023-11-20T06:26:46.422 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_netx.ko 2023-11-20T06:26:46.423 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_pci_generic.ko 2023-11-20T06:26:46.423 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-20T06:26:46.423 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_sercos3.ko 2023-11-20T06:26:46.423 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/ 2023-11-20T06:26:46.423 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/c67x00/ 2023-11-20T06:26:46.423 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 73297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-20T06:26:46.423 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/chipidea/ 2023-11-20T06:26:46.423 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 144377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-20T06:26:46.423 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-20T06:26:46.423 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-20T06:26:46.423 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-20T06:26:46.423 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/class/ 2023-11-20T06:26:46.424 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 87089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/class/cdc-acm.ko 2023-11-20T06:26:46.424 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 51345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-20T06:26:46.424 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 47305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/class/usblp.ko 2023-11-20T06:26:46.424 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 89857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/class/usbtmc.ko 2023-11-20T06:26:46.424 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/common/ 2023-11-20T06:26:46.424 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/common/ulpi.ko 2023-11-20T06:26:46.424 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc2/ 2023-11-20T06:26:46.424 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-20T06:26:46.424 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc3/ 2023-11-20T06:26:46.424 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-20T06:26:46.424 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-20T06:26:46.424 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 448505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-20T06:26:46.425 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/ 2023-11-20T06:26:46.425 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/ 2023-11-20T06:26:46.425 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 60177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-20T06:26:46.425 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 51881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-20T06:26:46.425 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-20T06:26:46.425 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 42449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-20T06:26:46.425 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-20T06:26:46.425 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 36513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-20T06:26:46.425 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 92489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-20T06:26:46.425 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 51049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-20T06:26:46.425 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 122081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-20T06:26:46.425 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 57681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-20T06:26:46.426 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-20T06:26:46.426 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 31265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-20T06:26:46.426 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 57729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-20T06:26:46.426 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 85609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-20T06:26:46.426 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-20T06:26:46.426 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 58113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-20T06:26:46.426 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 67337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-20T06:26:46.426 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/ 2023-11-20T06:26:46.426 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-20T06:26:46.426 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-20T06:26:46.426 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-20T06:26:46.426 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-20T06:26:46.427 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-20T06:26:46.427 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-20T06:26:46.427 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-20T06:26:46.427 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-20T06:26:46.427 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 32073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-20T06:26:46.427 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-20T06:26:46.427 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-20T06:26:46.427 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-20T06:26:46.427 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 62185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-20T06:26:46.427 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-20T06:26:46.427 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 161225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-20T06:26:46.427 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/ 2023-11-20T06:26:46.427 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-20T06:26:46.428 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-20T06:26:46.428 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 157681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-20T06:26:46.428 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 36089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-20T06:26:46.428 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 52721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-20T06:26:46.428 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 69705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-20T06:26:46.428 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 56033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-20T06:26:46.428 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 76057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-20T06:26:46.428 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 75073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-20T06:26:46.428 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 73169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-20T06:26:46.428 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 65809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-20T06:26:46.428 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 66097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-20T06:26:46.429 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 81505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-20T06:26:46.429 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 156073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-20T06:26:46.429 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/ 2023-11-20T06:26:46.429 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-20T06:26:46.429 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 80113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-20T06:26:46.429 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 87353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-20T06:26:46.429 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 78873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-20T06:26:46.429 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 51329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-20T06:26:46.429 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/sl811_cs.ko 2023-11-20T06:26:46.429 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-20T06:26:46.429 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-20T06:26:46.429 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/image/ 2023-11-20T06:26:46.430 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/image/mdc800.ko 2023-11-20T06:26:46.430 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/image/microtek.ko 2023-11-20T06:26:46.430 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/ 2023-11-20T06:26:46.430 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 41721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/adutux.ko 2023-11-20T06:26:46.430 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/appledisplay.ko 2023-11-20T06:26:46.430 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-20T06:26:46.430 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/cytherm.ko 2023-11-20T06:26:46.430 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/ehset.ko 2023-11-20T06:26:46.430 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/emi26.ko 2023-11-20T06:26:46.430 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/emi62.ko 2023-11-20T06:26:46.430 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/ezusb.ko 2023-11-20T06:26:46.430 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/idmouse.ko 2023-11-20T06:26:46.431 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 36553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/iowarrior.ko 2023-11-20T06:26:46.431 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-20T06:26:46.431 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 36529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/ldusb.ko 2023-11-20T06:26:46.431 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 36265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/legousbtower.ko 2023-11-20T06:26:46.431 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/lvstest.ko 2023-11-20T06:26:46.431 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/sisusbvga/ 2023-11-20T06:26:46.431 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 64841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-20T06:26:46.431 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-20T06:26:46.431 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/usb3503.ko 2023-11-20T06:26:46.431 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/usblcd.ko 2023-11-20T06:26:46.431 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-20T06:26:46.431 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 70809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/usbtest.ko 2023-11-20T06:26:46.432 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 41905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/uss720.ko 2023-11-20T06:26:46.432 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/yurex.ko 2023-11-20T06:26:46.432 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/mon/ 2023-11-20T06:26:46.432 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 72953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/mon/usbmon.ko 2023-11-20T06:26:46.432 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/musb/ 2023-11-20T06:26:46.432 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 301697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-20T06:26:46.432 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/phy/ 2023-11-20T06:26:46.432 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/phy/phy-generic.ko 2023-11-20T06:26:46.432 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-20T06:26:46.432 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-20T06:26:46.432 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-20T06:26:46.432 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ 2023-11-20T06:26:46.433 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/aircable.ko 2023-11-20T06:26:46.433 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ark3116.ko 2023-11-20T06:26:46.433 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-20T06:26:46.433 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 38105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ch341.ko 2023-11-20T06:26:46.433 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 70257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/cp210x.ko 2023-11-20T06:26:46.433 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 31057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/cyberjack.ko 2023-11-20T06:26:46.433 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 58217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-20T06:26:46.433 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 49817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-20T06:26:46.433 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/empeg.ko 2023-11-20T06:26:46.433 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 44273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/f81232.ko 2023-11-20T06:26:46.433 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 175137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-20T06:26:46.433 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 53113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-20T06:26:46.434 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 137081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-20T06:26:46.434 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 124833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/io_ti.ko 2023-11-20T06:26:46.434 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 67769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ipaq.ko 2023-11-20T06:26:46.434 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ipw.ko 2023-11-20T06:26:46.434 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ir-usb.ko 2023-11-20T06:26:46.434 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 58233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-20T06:26:46.434 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 107521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/keyspan.ko 2023-11-20T06:26:46.434 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 35617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-20T06:26:46.434 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-20T06:26:46.434 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-20T06:26:46.434 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 32953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/mct_u232.ko 2023-11-20T06:26:46.434 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/metro-usb.ko 2023-11-20T06:26:46.435 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 66449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/mos7720.ko 2023-11-20T06:26:46.435 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 78217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/mos7840.ko 2023-11-20T06:26:46.435 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 56337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/mxuport.ko 2023-11-20T06:26:46.435 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/navman.ko 2023-11-20T06:26:46.435 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/omninet.ko 2023-11-20T06:26:46.435 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/opticon.ko 2023-11-20T06:26:46.435 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 191137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/option.ko 2023-11-20T06:26:46.435 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 39073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/oti6858.ko 2023-11-20T06:26:46.435 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 54353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/pl2303.ko 2023-11-20T06:26:46.435 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/qcaux.ko 2023-11-20T06:26:46.435 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 37825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/qcserial.ko 2023-11-20T06:26:46.435 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/quatech2.ko 2023-11-20T06:26:46.436 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/safe_serial.ko 2023-11-20T06:26:46.436 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 51625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/sierra.ko 2023-11-20T06:26:46.436 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-20T06:26:46.436 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ssu100.ko 2023-11-20T06:26:46.436 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/symbolserial.ko 2023-11-20T06:26:46.436 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 61489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-20T06:26:46.436 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-20T06:26:46.436 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/usb_debug.ko 2023-11-20T06:26:46.436 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-20T06:26:46.436 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 125609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/usbserial.ko 2023-11-20T06:26:46.436 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/visor.ko 2023-11-20T06:26:46.436 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 37409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/whiteheat.ko 2023-11-20T06:26:46.437 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-20T06:26:46.437 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-20T06:26:46.437 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ 2023-11-20T06:26:46.437 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 52913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/uas.ko 2023-11-20T06:26:46.437 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-20T06:26:46.437 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-20T06:26:46.437 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-20T06:26:46.437 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-20T06:26:46.437 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-20T06:26:46.437 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-20T06:26:46.437 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-20T06:26:46.437 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-karma.ko 2023-11-20T06:26:46.438 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-20T06:26:46.438 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-20T06:26:46.438 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-20T06:26:46.438 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-20T06:26:46.438 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 35337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-20T06:26:46.438 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 179969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/usb-storage.ko 2023-11-20T06:26:46.438 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/usbip/ 2023-11-20T06:26:46.438 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 67481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-20T06:26:46.438 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 72177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-20T06:26:46.438 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 107001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-20T06:26:46.438 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/ 2023-11-20T06:26:46.438 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/pci/ 2023-11-20T06:26:46.439 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 154297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-20T06:26:46.439 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-20T06:26:46.439 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 108737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/vfio.ko 2023-11-20T06:26:46.439 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 77609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-20T06:26:46.439 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vhost/ 2023-11-20T06:26:46.439 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 113785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vhost/vhost.ko 2023-11-20T06:26:46.439 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-20T06:26:46.439 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 58089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vhost/vhost_net.ko 2023-11-20T06:26:46.439 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 89249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vhost/vhost_scsi.ko 2023-11-20T06:26:46.439 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/ 2023-11-20T06:26:46.439 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/ 2023-11-20T06:26:46.439 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-20T06:26:46.440 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-20T06:26:46.440 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-20T06:26:46.440 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 32609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-20T06:26:46.440 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 39993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-20T06:26:46.440 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/apple_bl.ko 2023-11-20T06:26:46.440 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-20T06:26:46.440 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/bd6107.ko 2023-11-20T06:26:46.440 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-20T06:26:46.440 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-20T06:26:46.440 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-20T06:26:46.440 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-20T06:26:46.440 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/lcd.ko 2023-11-20T06:26:46.441 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-20T06:26:46.441 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-20T06:26:46.441 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-20T06:26:46.441 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-20T06:26:46.441 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-20T06:26:46.441 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-20T06:26:46.441 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-20T06:26:46.441 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-20T06:26:46.441 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/ 2023-11-20T06:26:46.441 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/masters/ 2023-11-20T06:26:46.441 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/masters/ds2482.ko 2023-11-20T06:26:46.441 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 38985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/masters/ds2490.ko 2023-11-20T06:26:46.442 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-20T06:26:46.442 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-20T06:26:46.442 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/ 2023-11-20T06:26:46.442 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-20T06:26:46.442 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-20T06:26:46.442 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-20T06:26:46.442 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-20T06:26:46.442 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-20T06:26:46.442 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-20T06:26:46.442 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-20T06:26:46.442 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-20T06:26:46.442 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-20T06:26:46.443 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-20T06:26:46.443 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 56425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-20T06:26:46.443 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 102673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/wire.ko 2023-11-20T06:26:46.443 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/ 2023-11-20T06:26:46.443 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/acquirewdt.ko 2023-11-20T06:26:46.443 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/advantechwdt.ko 2023-11-20T06:26:46.443 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-20T06:26:46.443 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-20T06:26:46.443 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-20T06:26:46.443 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-20T06:26:46.443 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-20T06:26:46.443 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-20T06:26:46.444 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/dw_wdt.ko 2023-11-20T06:26:46.444 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-20T06:26:46.444 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-20T06:26:46.444 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/hpwdt.ko 2023-11-20T06:26:46.444 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/i6300esb.ko 2023-11-20T06:26:46.444 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-20T06:26:46.444 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-20T06:26:46.444 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/ib700wdt.ko 2023-11-20T06:26:46.444 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/ibmasr.ko 2023-11-20T06:26:46.444 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-20T06:26:46.444 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-20T06:26:46.444 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/it87_wdt.ko 2023-11-20T06:26:46.445 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-20T06:26:46.445 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/machzwd.ko 2023-11-20T06:26:46.445 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-20T06:26:46.445 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-20T06:26:46.445 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/nv_tco.ko 2023-11-20T06:26:46.445 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-20T06:26:46.445 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-20T06:26:46.445 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 38657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-20T06:26:46.445 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 31825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-20T06:26:46.446 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/retu_wdt.ko 2023-11-20T06:26:46.446 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-20T06:26:46.446 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-20T06:26:46.446 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-20T06:26:46.446 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-20T06:26:46.446 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-20T06:26:46.446 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-20T06:26:46.446 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/softdog.ko 2023-11-20T06:26:46.446 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-20T06:26:46.446 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-20T06:26:46.446 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/via_wdt.ko 2023-11-20T06:26:46.446 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-20T06:26:46.447 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-20T06:26:46.447 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-20T06:26:46.447 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-20T06:26:46.447 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/wdt_pci.ko 2023-11-20T06:26:46.447 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-20T06:26:46.447 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-20T06:26:46.447 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/xen_wdt.ko 2023-11-20T06:26:46.447 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/ 2023-11-20T06:26:46.447 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-evtchn.ko 2023-11-20T06:26:46.447 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-gntalloc.ko 2023-11-20T06:26:46.447 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 47865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-gntdev.ko 2023-11-20T06:26:46.447 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-pciback/ 2023-11-20T06:26:46.448 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 176377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-20T06:26:46.448 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 40121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-privcmd.ko 2023-11-20T06:26:46.448 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 71249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-scsiback.ko 2023-11-20T06:26:46.448 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xenfs/ 2023-11-20T06:26:46.448 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-20T06:26:46.448 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ 2023-11-20T06:26:46.448 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/9p/ 2023-11-20T06:26:46.448 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 166425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/9p/9p.ko 2023-11-20T06:26:46.448 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/adfs/ 2023-11-20T06:26:46.448 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 61073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/adfs/adfs.ko 2023-11-20T06:26:46.448 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/affs/ 2023-11-20T06:26:46.448 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 163593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/affs/affs.ko 2023-11-20T06:26:46.449 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/afs/ 2023-11-20T06:26:46.449 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 932817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/afs/kafs.ko 2023-11-20T06:26:46.449 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/autofs/ 2023-11-20T06:26:46.449 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 101057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/autofs/autofs4.ko 2023-11-20T06:26:46.449 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/befs/ 2023-11-20T06:26:46.449 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 64545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/befs/befs.ko 2023-11-20T06:26:46.449 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/bfs/ 2023-11-20T06:26:46.449 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 41257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/bfs/bfs.ko 2023-11-20T06:26:46.449 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/binfmt_misc.ko 2023-11-20T06:26:46.449 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/btrfs/ 2023-11-20T06:26:46.449 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 3402729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/btrfs/btrfs.ko 2023-11-20T06:26:46.450 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/cachefiles/ 2023-11-20T06:26:46.450 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 306009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/cachefiles/cachefiles.ko 2023-11-20T06:26:46.450 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ceph/ 2023-11-20T06:26:46.450 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 1332449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ceph/ceph.ko 2023-11-20T06:26:46.450 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/coda/ 2023-11-20T06:26:46.450 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 100801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/coda/coda.ko 2023-11-20T06:26:46.450 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/configfs/ 2023-11-20T06:26:46.450 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 108393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/configfs/configfs.ko 2023-11-20T06:26:46.450 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/cramfs/ 2023-11-20T06:26:46.450 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 29625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/cramfs/cramfs.ko 2023-11-20T06:26:46.450 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/dlm/ 2023-11-20T06:26:46.450 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 642513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/dlm/dlm.ko 2023-11-20T06:26:46.451 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/efs/ 2023-11-20T06:26:46.451 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 36649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/efs/efs.ko 2023-11-20T06:26:46.451 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/f2fs/ 2023-11-20T06:26:46.451 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 1505025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/f2fs/f2fs.ko 2023-11-20T06:26:46.451 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fat/ 2023-11-20T06:26:46.451 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fat/msdos.ko 2023-11-20T06:26:46.451 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/freevxfs/ 2023-11-20T06:26:46.451 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 42545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/freevxfs/freevxfs.ko 2023-11-20T06:26:46.451 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fscache/ 2023-11-20T06:26:46.451 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 226481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fscache/fscache.ko 2023-11-20T06:26:46.451 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fuse/ 2023-11-20T06:26:46.452 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fuse/cuse.ko 2023-11-20T06:26:46.452 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/gfs2/ 2023-11-20T06:26:46.452 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 1231529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/gfs2/gfs2.ko 2023-11-20T06:26:46.452 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hfs/ 2023-11-20T06:26:46.452 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 141209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hfs/hfs.ko 2023-11-20T06:26:46.452 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hfsplus/ 2023-11-20T06:26:46.452 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 222817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hfsplus/hfsplus.ko 2023-11-20T06:26:46.493 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hpfs/ 2023-11-20T06:26:46.493 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 192329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hpfs/hpfs.ko 2023-11-20T06:26:46.493 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/isofs/ 2023-11-20T06:26:46.493 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 74065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/isofs/isofs.ko 2023-11-20T06:26:46.493 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/jfs/ 2023-11-20T06:26:46.493 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 419497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/jfs/jfs.ko 2023-11-20T06:26:46.493 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/lockd/ 2023-11-20T06:26:46.493 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 280313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/lockd/lockd.ko 2023-11-20T06:26:46.493 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/minix/ 2023-11-20T06:26:46.493 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 89193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/minix/minix.ko 2023-11-20T06:26:46.494 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/netfs/ 2023-11-20T06:26:46.494 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 124649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/netfs/netfs.ko 2023-11-20T06:26:46.494 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/ 2023-11-20T06:26:46.494 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/blocklayout/ 2023-11-20T06:26:46.494 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 81449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-20T06:26:46.494 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/filelayout/ 2023-11-20T06:26:46.494 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 59449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-20T06:26:46.494 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/flexfilelayout/ 2023-11-20T06:26:46.494 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 117465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-20T06:26:46.494 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 1055721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/nfs.ko 2023-11-20T06:26:46.494 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 66441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/nfsv2.ko 2023-11-20T06:26:46.494 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 120177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/nfsv3.ko 2023-11-20T06:26:46.495 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 2042137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/nfsv4.ko 2023-11-20T06:26:46.495 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs_common/ 2023-11-20T06:26:46.495 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs_common/grace.ko 2023-11-20T06:26:46.495 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs_common/nfs_acl.ko 2023-11-20T06:26:46.495 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfsd/ 2023-11-20T06:26:46.495 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 1516873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfsd/nfsd.ko 2023-11-20T06:26:46.495 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nilfs2/ 2023-11-20T06:26:46.495 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 592833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nilfs2/nilfs2.ko 2023-11-20T06:26:46.495 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/ 2023-11-20T06:26:46.495 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-celtic.ko 2023-11-20T06:26:46.495 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-centeuro.ko 2023-11-20T06:26:46.495 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-croatian.ko 2023-11-20T06:26:46.495 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-cyrillic.ko 2023-11-20T06:26:46.496 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-gaelic.ko 2023-11-20T06:26:46.496 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-greek.ko 2023-11-20T06:26:46.496 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-iceland.ko 2023-11-20T06:26:46.496 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-inuit.ko 2023-11-20T06:26:46.496 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-roman.ko 2023-11-20T06:26:46.496 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-romanian.ko 2023-11-20T06:26:46.496 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-turkish.ko 2023-11-20T06:26:46.496 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_ascii.ko 2023-11-20T06:26:46.496 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp1250.ko 2023-11-20T06:26:46.496 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp1251.ko 2023-11-20T06:26:46.496 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp1255.ko 2023-11-20T06:26:46.496 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp737.ko 2023-11-20T06:26:46.496 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp775.ko 2023-11-20T06:26:46.497 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp850.ko 2023-11-20T06:26:46.497 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp852.ko 2023-11-20T06:26:46.497 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp855.ko 2023-11-20T06:26:46.497 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp857.ko 2023-11-20T06:26:46.497 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp860.ko 2023-11-20T06:26:46.497 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp861.ko 2023-11-20T06:26:46.497 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp862.ko 2023-11-20T06:26:46.497 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp863.ko 2023-11-20T06:26:46.497 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp864.ko 2023-11-20T06:26:46.497 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp865.ko 2023-11-20T06:26:46.497 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp866.ko 2023-11-20T06:26:46.497 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp869.ko 2023-11-20T06:26:46.498 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp874.ko 2023-11-20T06:26:46.498 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 94137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp932.ko 2023-11-20T06:26:46.498 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 142673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp936.ko 2023-11-20T06:26:46.498 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 165745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp949.ko 2023-11-20T06:26:46.498 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 118121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp950.ko 2023-11-20T06:26:46.498 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_euc-jp.ko 2023-11-20T06:26:46.498 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-1.ko 2023-11-20T06:26:46.498 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-13.ko 2023-11-20T06:26:46.498 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-14.ko 2023-11-20T06:26:46.498 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-15.ko 2023-11-20T06:26:46.498 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-2.ko 2023-11-20T06:26:46.498 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-3.ko 2023-11-20T06:26:46.499 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-4.ko 2023-11-20T06:26:46.499 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-5.ko 2023-11-20T06:26:46.499 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-6.ko 2023-11-20T06:26:46.499 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-7.ko 2023-11-20T06:26:46.499 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-9.ko 2023-11-20T06:26:46.499 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_koi8-r.ko 2023-11-20T06:26:46.499 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_koi8-ru.ko 2023-11-20T06:26:46.499 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_koi8-u.ko 2023-11-20T06:26:46.499 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-20T06:26:46.499 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_utf8.ko 2023-11-20T06:26:46.499 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ntfs/ 2023-11-20T06:26:46.500 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 219417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ntfs/ntfs.ko 2023-11-20T06:26:46.500 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/ 2023-11-20T06:26:46.500 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/cluster/ 2023-11-20T06:26:46.500 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 244409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-20T06:26:46.500 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/dlm/ 2023-11-20T06:26:46.500 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 440737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-20T06:26:46.500 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/dlmfs/ 2023-11-20T06:26:46.500 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 54049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-20T06:26:46.500 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 2592433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/ocfs2.ko 2023-11-20T06:26:46.500 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-20T06:26:46.500 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 31729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-20T06:26:46.500 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 35897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-20T06:26:46.500 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/omfs/ 2023-11-20T06:26:46.501 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 53433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/omfs/omfs.ko 2023-11-20T06:26:46.501 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/overlayfs/ 2023-11-20T06:26:46.501 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 352161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/overlayfs/overlay.ko 2023-11-20T06:26:46.501 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/pstore/ 2023-11-20T06:26:46.501 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 54809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/pstore/ramoops.ko 2023-11-20T06:26:46.501 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/qnx4/ 2023-11-20T06:26:46.501 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/qnx4/qnx4.ko 2023-11-20T06:26:46.501 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/qnx6/ 2023-11-20T06:26:46.501 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 46689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/qnx6/qnx6.ko 2023-11-20T06:26:46.501 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/quota/ 2023-11-20T06:26:46.501 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/quota/quota_tree.ko 2023-11-20T06:26:46.501 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/quota/quota_v1.ko 2023-11-20T06:26:46.502 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/quota/quota_v2.ko 2023-11-20T06:26:46.502 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/reiserfs/ 2023-11-20T06:26:46.502 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 532673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/reiserfs/reiserfs.ko 2023-11-20T06:26:46.502 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/romfs/ 2023-11-20T06:26:46.502 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/romfs/romfs.ko 2023-11-20T06:26:46.502 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/ 2023-11-20T06:26:46.502 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/client/ 2023-11-20T06:26:46.502 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 2668401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/client/cifs.ko 2023-11-20T06:26:46.502 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/common/ 2023-11-20T06:26:46.502 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/common/cifs_arc4.ko 2023-11-20T06:26:46.502 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/common/cifs_md4.ko 2023-11-20T06:26:46.502 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/squashfs/ 2023-11-20T06:26:46.503 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 134641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/squashfs/squashfs.ko 2023-11-20T06:26:46.503 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/sysv/ 2023-11-20T06:26:46.503 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 90721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/sysv/sysv.ko 2023-11-20T06:26:46.503 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/udf/ 2023-11-20T06:26:46.503 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 247737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/udf/udf.ko 2023-11-20T06:26:46.503 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ufs/ 2023-11-20T06:26:46.503 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 162497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ufs/ufs.ko 2023-11-20T06:26:46.503 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/xfs/ 2023-11-20T06:26:46.503 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 4011017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/xfs/xfs.ko 2023-11-20T06:26:46.503 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/ 2023-11-20T06:26:46.503 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/locking/ 2023-11-20T06:26:46.504 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 75489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/locking/locktorture.ko 2023-11-20T06:26:46.504 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/time/ 2023-11-20T06:26:46.504 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/time/test_udelay.ko 2023-11-20T06:26:46.504 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 60553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/torture.ko 2023-11-20T06:26:46.504 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/ 2023-11-20T06:26:46.504 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 6833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crc-itu-t.ko 2023-11-20T06:26:46.504 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 6529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crc7.ko 2023-11-20T06:26:46.504 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crc8.ko 2023-11-20T06:26:46.504 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crypto/ 2023-11-20T06:26:46.504 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crypto/libarc4.ko 2023-11-20T06:26:46.504 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 37081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crypto/libdes.ko 2023-11-20T06:26:46.504 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/interval_tree_test.ko 2023-11-20T06:26:46.505 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/libcrc32c.ko 2023-11-20T06:26:46.505 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/lru_cache.ko 2023-11-20T06:26:46.505 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/lz4/ 2023-11-20T06:26:46.505 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/lz4/lz4_compress.ko 2023-11-20T06:26:46.505 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/lz4/lz4hc_compress.ko 2023-11-20T06:26:46.505 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/math/ 2023-11-20T06:26:46.505 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 6617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/math/cordic.ko 2023-11-20T06:26:46.505 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/memory-notifier-error-inject.ko 2023-11-20T06:26:46.505 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/notifier-error-inject.ko 2023-11-20T06:26:46.505 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/percpu_test.ko 2023-11-20T06:26:46.505 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/pm-notifier-error-inject.ko 2023-11-20T06:26:46.506 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/raid6/ 2023-11-20T06:26:46.506 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 143433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/raid6/raid6_pq.ko 2023-11-20T06:26:46.506 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/rbtree_test.ko 2023-11-20T06:26:46.506 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/reed_solomon/ 2023-11-20T06:26:46.506 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-20T06:26:46.506 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 38841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test-kstrtox.ko 2023-11-20T06:26:46.506 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test-string_helpers.ko 2023-11-20T06:26:46.506 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 4760425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test_bpf.ko 2023-11-20T06:26:46.506 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 49089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test_firmware.ko 2023-11-20T06:26:46.506 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 6369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test_module.ko 2023-11-20T06:26:46.506 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test_user_copy.ko 2023-11-20T06:26:46.507 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/ts_bm.ko 2023-11-20T06:26:46.507 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/ts_fsm.ko 2023-11-20T06:26:46.507 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/ts_kmp.ko 2023-11-20T06:26:46.507 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/xz/ 2023-11-20T06:26:46.507 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/xz/xz_dec_test.ko 2023-11-20T06:26:46.507 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/mm/ 2023-11-20T06:26:46.507 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/mm/hwpoison-inject.ko 2023-11-20T06:26:46.507 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ 2023-11-20T06:26:46.507 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/ 2023-11-20T06:26:46.507 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 55737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/6lowpan.ko 2023-11-20T06:26:46.507 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_dest.ko 2023-11-20T06:26:46.508 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_fragment.ko 2023-11-20T06:26:46.508 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_hop.ko 2023-11-20T06:26:46.508 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 6985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-20T06:26:46.508 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_mobility.ko 2023-11-20T06:26:46.508 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_routing.ko 2023-11-20T06:26:46.508 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_udp.ko 2023-11-20T06:26:46.508 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/ 2023-11-20T06:26:46.508 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/garp.ko 2023-11-20T06:26:46.508 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/mrp.ko 2023-11-20T06:26:46.508 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/p8022.ko 2023-11-20T06:26:46.508 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/psnap.ko 2023-11-20T06:26:46.508 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/stp.ko 2023-11-20T06:26:46.508 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/8021q/ 2023-11-20T06:26:46.509 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 81737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/8021q/8021q.ko 2023-11-20T06:26:46.509 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/9p/ 2023-11-20T06:26:46.509 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 198337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/9p/9pnet.ko 2023-11-20T06:26:46.509 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 35977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/9p/9pnet_fd.ko 2023-11-20T06:26:46.509 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/9p/9pnet_rdma.ko 2023-11-20T06:26:46.509 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 32337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/9p/9pnet_virtio.ko 2023-11-20T06:26:46.509 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/batman-adv/ 2023-11-20T06:26:46.509 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 649297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/batman-adv/batman-adv.ko 2023-11-20T06:26:46.509 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/ 2023-11-20T06:26:46.509 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 63809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/br_netfilter.ko 2023-11-20T06:26:46.509 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 777689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/bridge.ko 2023-11-20T06:26:46.509 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ 2023-11-20T06:26:46.510 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-20T06:26:46.510 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-20T06:26:46.510 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-20T06:26:46.510 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-20T06:26:46.510 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-20T06:26:46.510 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-20T06:26:46.510 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-20T06:26:46.510 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-20T06:26:46.510 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-20T06:26:46.510 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-20T06:26:46.510 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-20T06:26:46.510 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-20T06:26:46.511 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-20T06:26:46.511 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-20T06:26:46.511 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-20T06:26:46.511 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-20T06:26:46.511 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-20T06:26:46.511 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-20T06:26:46.511 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-20T06:26:46.511 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-20T06:26:46.511 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 55929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebtables.ko 2023-11-20T06:26:46.511 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-20T06:26:46.511 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-20T06:26:46.511 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ceph/ 2023-11-20T06:26:46.512 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 1046833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ceph/libceph.ko 2023-11-20T06:26:46.512 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/core/ 2023-11-20T06:26:46.512 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 125993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/core/pktgen.ko 2023-11-20T06:26:46.512 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dccp/ 2023-11-20T06:26:46.512 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 194209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dccp/dccp.ko 2023-11-20T06:26:46.512 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dccp/dccp_diag.ko 2023-11-20T06:26:46.512 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 57881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dccp/dccp_ipv4.ko 2023-11-20T06:26:46.512 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 60337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dccp/dccp_ipv6.ko 2023-11-20T06:26:46.512 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/ 2023-11-20T06:26:46.512 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 390473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/dsa_core.ko 2023-11-20T06:26:46.512 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/tag_brcm.ko 2023-11-20T06:26:46.512 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/tag_dsa.ko 2023-11-20T06:26:46.513 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/tag_none.ko 2023-11-20T06:26:46.513 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/tag_trailer.ko 2023-11-20T06:26:46.513 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/hsr/ 2023-11-20T06:26:46.513 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 99729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/hsr/hsr.ko 2023-11-20T06:26:46.513 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ieee802154/ 2023-11-20T06:26:46.513 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ieee802154/6lowpan/ 2023-11-20T06:26:46.513 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 45233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-20T06:26:46.513 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 254625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ieee802154/ieee802154.ko 2023-11-20T06:26:46.513 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 47289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-20T06:26:46.513 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ 2023-11-20T06:26:46.513 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ah4.ko 2023-11-20T06:26:46.513 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 38905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/esp4.ko 2023-11-20T06:26:46.514 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 48337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/fou.ko 2023-11-20T06:26:46.514 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/gre.ko 2023-11-20T06:26:46.514 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 48657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/inet_diag.ko 2023-11-20T06:26:46.514 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 60633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ip_gre.ko 2023-11-20T06:26:46.514 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 61225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ip_tunnel.ko 2023-11-20T06:26:46.514 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ip_vti.ko 2023-11-20T06:26:46.514 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ipcomp.ko 2023-11-20T06:26:46.514 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ipip.ko 2023-11-20T06:26:46.514 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ 2023-11-20T06:26:46.514 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 37641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-20T06:26:46.514 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-20T06:26:46.515 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-20T06:26:46.515 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 41609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-20T06:26:46.515 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-20T06:26:46.515 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-20T06:26:46.515 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-20T06:26:46.515 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-20T06:26:46.515 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-20T06:26:46.515 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-20T06:26:46.515 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-20T06:26:46.515 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-20T06:26:46.515 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-20T06:26:46.515 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-20T06:26:46.516 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-20T06:26:46.516 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-20T06:26:46.516 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-20T06:26:46.516 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-20T06:26:46.516 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-20T06:26:46.516 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-20T06:26:46.516 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-20T06:26:46.516 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-20T06:26:46.516 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-20T06:26:46.516 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-20T06:26:46.516 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-20T06:26:46.516 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_bic.ko 2023-11-20T06:26:46.516 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_dctcp.ko 2023-11-20T06:26:46.517 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_diag.ko 2023-11-20T06:26:46.517 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_highspeed.ko 2023-11-20T06:26:46.517 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_htcp.ko 2023-11-20T06:26:46.517 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_hybla.ko 2023-11-20T06:26:46.517 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_illinois.ko 2023-11-20T06:26:46.517 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_lp.ko 2023-11-20T06:26:46.517 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_scalable.ko 2023-11-20T06:26:46.517 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_vegas.ko 2023-11-20T06:26:46.517 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_veno.ko 2023-11-20T06:26:46.517 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_westwood.ko 2023-11-20T06:26:46.517 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_yeah.ko 2023-11-20T06:26:46.517 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tunnel4.ko 2023-11-20T06:26:46.518 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/udp_diag.ko 2023-11-20T06:26:46.518 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 41665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/udp_tunnel.ko 2023-11-20T06:26:46.518 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-20T06:26:46.518 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ 2023-11-20T06:26:46.518 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ah6.ko 2023-11-20T06:26:46.518 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 39537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/esp6.ko 2023-11-20T06:26:46.518 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/fou6.ko 2023-11-20T06:26:46.518 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 80897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ip6_gre.ko 2023-11-20T06:26:46.518 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 93577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ip6_tunnel.ko 2023-11-20T06:26:46.518 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-20T06:26:46.518 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 53273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ip6_vti.ko 2023-11-20T06:26:46.519 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ipcomp6.ko 2023-11-20T06:26:46.519 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/mip6.ko 2023-11-20T06:26:46.519 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ 2023-11-20T06:26:46.519 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 42169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-20T06:26:46.519 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-20T06:26:46.519 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-20T06:26:46.519 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-20T06:26:46.519 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-20T06:26:46.519 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-20T06:26:46.519 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-20T06:26:46.519 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-20T06:26:46.519 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-20T06:26:46.520 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-20T06:26:46.520 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-20T06:26:46.520 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-20T06:26:46.520 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-20T06:26:46.520 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-20T06:26:46.520 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-20T06:26:46.520 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-20T06:26:46.520 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-20T06:26:46.520 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 39113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-20T06:26:46.520 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-20T06:26:46.520 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-20T06:26:46.520 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-20T06:26:46.520 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-20T06:26:46.521 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-20T06:26:46.521 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-20T06:26:46.521 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-20T06:26:46.521 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 74073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/sit.ko 2023-11-20T06:26:46.521 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/tunnel6.ko 2023-11-20T06:26:46.521 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-20T06:26:46.521 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/key/ 2023-11-20T06:26:46.521 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 82833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/key/af_key.ko 2023-11-20T06:26:46.521 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/ 2023-11-20T06:26:46.521 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 125281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_core.ko 2023-11-20T06:26:46.521 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-20T06:26:46.521 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 25953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_eth.ko 2023-11-20T06:26:46.522 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 35569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_ip.ko 2023-11-20T06:26:46.522 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 36713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_ip6.ko 2023-11-20T06:26:46.522 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_netlink.ko 2023-11-20T06:26:46.522 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 53241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_ppp.ko 2023-11-20T06:26:46.522 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/lapb/ 2023-11-20T06:26:46.522 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 47977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/lapb/lapb.ko 2023-11-20T06:26:46.522 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/llc/ 2023-11-20T06:26:46.522 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/llc/llc.ko 2023-11-20T06:26:46.522 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 267913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/llc/llc2.ko 2023-11-20T06:26:46.522 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/mac802154/ 2023-11-20T06:26:46.522 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 290417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/mac802154/mac802154.ko 2023-11-20T06:26:46.522 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/mpls/ 2023-11-20T06:26:46.523 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/mpls/mpls_gso.ko 2023-11-20T06:26:46.523 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ 2023-11-20T06:26:46.523 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ 2023-11-20T06:26:46.523 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 119585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set.ko 2023-11-20T06:26:46.523 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-20T06:26:46.523 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-20T06:26:46.523 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-20T06:26:46.523 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 100297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-20T06:26:46.523 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 101441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-20T06:26:46.523 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 102817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-20T06:26:46.523 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 103417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-20T06:26:46.523 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 112849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-20T06:26:46.523 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 60329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-20T06:26:46.524 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 109593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-20T06:26:46.524 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 113129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-20T06:26:46.524 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 112585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-20T06:26:46.524 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 111585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-20T06:26:46.524 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 114465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-20T06:26:46.524 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-20T06:26:46.524 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ 2023-11-20T06:26:46.524 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 411729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-20T06:26:46.524 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-20T06:26:46.524 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-20T06:26:46.524 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-20T06:26:46.524 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-20T06:26:46.525 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-20T06:26:46.525 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-20T06:26:46.525 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-20T06:26:46.525 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-20T06:26:46.525 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-20T06:26:46.525 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-20T06:26:46.525 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-20T06:26:46.525 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-20T06:26:46.525 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-20T06:26:46.525 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 49257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conncount.ko 2023-11-20T06:26:46.525 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 408257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack.ko 2023-11-20T06:26:46.525 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-20T06:26:46.526 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-20T06:26:46.526 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-20T06:26:46.526 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 118145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-20T06:26:46.526 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-20T06:26:46.526 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-20T06:26:46.526 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 107233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-20T06:26:46.526 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-20T06:26:46.526 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-20T06:26:46.526 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 66641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-20T06:26:46.526 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-20T06:26:46.526 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-20T06:26:46.526 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-20T06:26:46.527 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 89425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_flow_table.ko 2023-11-20T06:26:46.527 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-20T06:26:46.527 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 37129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_log_syslog.ko 2023-11-20T06:26:46.527 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 95353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat.ko 2023-11-20T06:26:46.527 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-20T06:26:46.527 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-20T06:26:46.527 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat_irc.ko 2023-11-20T06:26:46.527 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat_sip.ko 2023-11-20T06:26:46.527 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-20T06:26:46.527 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 44065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-20T06:26:46.527 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 615649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_tables.ko 2023-11-20T06:26:46.527 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 42561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink.ko 2023-11-20T06:26:46.528 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-20T06:26:46.528 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-20T06:26:46.528 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 39785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink_log.ko 2023-11-20T06:26:46.528 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-20T06:26:46.528 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 49377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-20T06:26:46.528 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_chain_nat.ko 2023-11-20T06:26:46.528 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_compat.ko 2023-11-20T06:26:46.528 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 40721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_ct.ko 2023-11-20T06:26:46.528 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-20T06:26:46.528 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_fib.ko 2023-11-20T06:26:46.528 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-20T06:26:46.528 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_hash.ko 2023-11-20T06:26:46.528 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_limit.ko 2023-11-20T06:26:46.529 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_log.ko 2023-11-20T06:26:46.529 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_masq.ko 2023-11-20T06:26:46.529 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_nat.ko 2023-11-20T06:26:46.529 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_numgen.ko 2023-11-20T06:26:46.529 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_osf.ko 2023-11-20T06:26:46.529 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_queue.ko 2023-11-20T06:26:46.529 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_redir.ko 2023-11-20T06:26:46.529 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_reject.ko 2023-11-20T06:26:46.529 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_reject_inet.ko 2023-11-20T06:26:46.529 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_socket.ko 2023-11-20T06:26:46.529 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_synproxy.ko 2023-11-20T06:26:46.529 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_tproxy.ko 2023-11-20T06:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 89313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/x_tables.ko 2023-11-20T06:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_AUDIT.ko 2023-11-20T06:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-20T06:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-20T06:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-20T06:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 18169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_CT.ko 2023-11-20T06:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_DSCP.ko 2023-11-20T06:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_HL.ko 2023-11-20T06:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_HMARK.ko 2023-11-20T06:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 38873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-20T06:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_LED.ko 2023-11-20T06:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_LOG.ko 2023-11-20T06:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-20T06:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_NETMAP.ko 2023-11-20T06:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_NFLOG.ko 2023-11-20T06:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-20T06:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_RATEEST.ko 2023-11-20T06:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-20T06:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 14337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_SECMARK.ko 2023-11-20T06:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-20T06:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-20T06:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_TEE.ko 2023-11-20T06:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_TPROXY.ko 2023-11-20T06:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_TRACE.ko 2023-11-20T06:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_addrtype.ko 2023-11-20T06:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_bpf.ko 2023-11-20T06:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_cgroup.ko 2023-11-20T06:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_cluster.ko 2023-11-20T06:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_comment.ko 2023-11-20T06:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_connbytes.ko 2023-11-20T06:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_connlabel.ko 2023-11-20T06:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_connlimit.ko 2023-11-20T06:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_connmark.ko 2023-11-20T06:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_conntrack.ko 2023-11-20T06:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_cpu.ko 2023-11-20T06:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_dccp.ko 2023-11-20T06:26:46.533 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_devgroup.ko 2023-11-20T06:26:46.533 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_dscp.ko 2023-11-20T06:26:46.533 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_ecn.ko 2023-11-20T06:26:46.533 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_esp.ko 2023-11-20T06:26:46.533 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 43289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_hashlimit.ko 2023-11-20T06:26:46.533 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_helper.ko 2023-11-20T06:26:46.533 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_hl.ko 2023-11-20T06:26:46.533 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_ipcomp.ko 2023-11-20T06:26:46.533 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_iprange.ko 2023-11-20T06:26:46.533 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_ipvs.ko 2023-11-20T06:26:46.533 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_l2tp.ko 2023-11-20T06:26:46.533 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_length.ko 2023-11-20T06:26:46.534 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_limit.ko 2023-11-20T06:26:46.534 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_mac.ko 2023-11-20T06:26:46.534 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_mark.ko 2023-11-20T06:26:46.534 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_multiport.ko 2023-11-20T06:26:46.534 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_nat.ko 2023-11-20T06:26:46.534 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_nfacct.ko 2023-11-20T06:26:46.534 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_osf.ko 2023-11-20T06:26:46.534 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_owner.ko 2023-11-20T06:26:46.534 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_physdev.ko 2023-11-20T06:26:46.534 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_pkttype.ko 2023-11-20T06:26:46.534 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_policy.ko 2023-11-20T06:26:46.534 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_quota.ko 2023-11-20T06:26:46.535 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_rateest.ko 2023-11-20T06:26:46.535 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_realm.ko 2023-11-20T06:26:46.535 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 36433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_recent.ko 2023-11-20T06:26:46.535 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_sctp.ko 2023-11-20T06:26:46.535 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_set.ko 2023-11-20T06:26:46.535 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 16089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_socket.ko 2023-11-20T06:26:46.535 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_state.ko 2023-11-20T06:26:46.535 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_statistic.ko 2023-11-20T06:26:46.535 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_string.ko 2023-11-20T06:26:46.535 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 8553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_tcpmss.ko 2023-11-20T06:26:46.535 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_tcpudp.ko 2023-11-20T06:26:46.535 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_time.ko 2023-11-20T06:26:46.535 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_u32.ko 2023-11-20T06:26:46.536 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netlink/ 2023-11-20T06:26:46.536 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netlink/netlink_diag.ko 2023-11-20T06:26:46.536 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/nsh/ 2023-11-20T06:26:46.536 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 12425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/nsh/nsh.ko 2023-11-20T06:26:46.536 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/openvswitch/ 2023-11-20T06:26:46.536 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 380033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/openvswitch/openvswitch.ko 2023-11-20T06:26:46.536 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/openvswitch/vport-geneve.ko 2023-11-20T06:26:46.536 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/openvswitch/vport-gre.ko 2023-11-20T06:26:46.536 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 11793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/openvswitch/vport-vxlan.ko 2023-11-20T06:26:46.536 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/packet/ 2023-11-20T06:26:46.536 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/packet/af_packet_diag.ko 2023-11-20T06:26:46.536 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/phonet/ 2023-11-20T06:26:46.537 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 110201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/phonet/phonet.ko 2023-11-20T06:26:46.537 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 54721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/phonet/pn_pep.ko 2023-11-20T06:26:46.537 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rds/ 2023-11-20T06:26:46.537 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 251481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rds/rds.ko 2023-11-20T06:26:46.537 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 164937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rds/rds_rdma.ko 2023-11-20T06:26:46.537 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 67377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rds/rds_tcp.ko 2023-11-20T06:26:46.537 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rxrpc/ 2023-11-20T06:26:46.537 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 819657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rxrpc/rxrpc.ko 2023-11-20T06:26:46.537 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/ 2023-11-20T06:26:46.537 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 32241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_csum.ko 2023-11-20T06:26:46.537 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_gact.ko 2023-11-20T06:26:46.537 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_ipt.ko 2023-11-20T06:26:46.538 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_mirred.ko 2023-11-20T06:26:46.538 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_nat.ko 2023-11-20T06:26:46.538 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 43449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_pedit.ko 2023-11-20T06:26:46.538 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 31961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_police.ko 2023-11-20T06:26:46.538 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_simple.ko 2023-11-20T06:26:46.538 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 35297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_skbedit.ko 2023-11-20T06:26:46.538 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 36665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_vlan.ko 2023-11-20T06:26:46.538 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_basic.ko 2023-11-20T06:26:46.538 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_bpf.ko 2023-11-20T06:26:46.538 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_cgroup.ko 2023-11-20T06:26:46.538 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 31401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_flow.ko 2023-11-20T06:26:46.538 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 31769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_fw.ko 2023-11-20T06:26:46.539 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 38425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_route.ko 2023-11-20T06:26:46.539 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 61409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_u32.ko 2023-11-20T06:26:46.539 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_cmp.ko 2023-11-20T06:26:46.539 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 13409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_ipset.ko 2023-11-20T06:26:46.539 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_meta.ko 2023-11-20T06:26:46.539 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_nbyte.ko 2023-11-20T06:26:46.539 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_text.ko 2023-11-20T06:26:46.539 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_u32.ko 2023-11-20T06:26:46.539 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 21649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_choke.ko 2023-11-20T06:26:46.539 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_codel.ko 2023-11-20T06:26:46.539 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 34633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_drr.ko 2023-11-20T06:26:46.539 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 33609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_fq.ko 2023-11-20T06:26:46.539 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 31617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_fq_codel.ko 2023-11-20T06:26:46.540 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 35433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_gred.ko 2023-11-20T06:26:46.540 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 49817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_hfsc.ko 2023-11-20T06:26:46.540 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_hhf.ko 2023-11-20T06:26:46.540 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 66393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_htb.ko 2023-11-20T06:26:46.540 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_ingress.ko 2023-11-20T06:26:46.540 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 30273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_mqprio.ko 2023-11-20T06:26:46.540 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_mqprio_lib.ko 2023-11-20T06:26:46.540 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_multiq.ko 2023-11-20T06:26:46.540 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 36137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_netem.ko 2023-11-20T06:26:46.540 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 27497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_pie.ko 2023-11-20T06:26:46.540 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_plug.ko 2023-11-20T06:26:46.540 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 24729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_prio.ko 2023-11-20T06:26:46.541 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 48729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_qfq.ko 2023-11-20T06:26:46.541 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 32905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_red.ko 2023-11-20T06:26:46.541 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 26881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_sfb.ko 2023-11-20T06:26:46.541 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 31353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_sfq.ko 2023-11-20T06:26:46.541 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_tbf.ko 2023-11-20T06:26:46.541 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 28105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_teql.ko 2023-11-20T06:26:46.541 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sctp/ 2023-11-20T06:26:46.541 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 929745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sctp/sctp.ko 2023-11-20T06:26:46.541 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 19033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sctp/sctp_diag.ko 2023-11-20T06:26:46.541 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/ 2023-11-20T06:26:46.541 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/auth_gss/ 2023-11-20T06:26:46.541 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 336529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-20T06:26:46.542 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 54737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-20T06:26:46.542 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 1520097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/sunrpc.ko 2023-11-20T06:26:46.542 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/xprtrdma/ 2023-11-20T06:26:46.542 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 707657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-20T06:26:46.542 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/tipc/ 2023-11-20T06:26:46.542 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/tipc/diag.ko 2023-11-20T06:26:46.542 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 862665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/tipc/tipc.ko 2023-11-20T06:26:46.542 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/unix/ 2023-11-20T06:26:46.542 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/unix/unix_diag.ko 2023-11-20T06:26:46.542 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/ 2023-11-20T06:26:46.542 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 85409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-20T06:26:46.542 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 68049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-20T06:26:46.543 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 96193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/vsock.ko 2023-11-20T06:26:46.543 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 10705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-20T06:26:46.543 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 17521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-20T06:26:46.543 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/x25/ 2023-11-20T06:26:46.543 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 125177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/x25/x25.ko 2023-11-20T06:26:46.543 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/xfrm/ 2023-11-20T06:26:46.543 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 22657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/xfrm/xfrm_algo.ko 2023-11-20T06:26:46.543 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 20649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-20T06:26:46.543 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 102257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/xfrm/xfrm_user.ko 2023-11-20T06:26:46.543 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/virt/ 2023-11-20T06:26:46.543 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/virt/lib/ 2023-11-20T06:26:46.543 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 15537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/virt/lib/irqbypass.ko 2023-11-20T06:26:46.544 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 640081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.alias 2023-11-20T06:26:46.544 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 624107 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.alias.bin 2023-11-20T06:26:46.544 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 7663 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.builtin 2023-11-20T06:26:46.544 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 23428 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.builtin.alias.bin 2023-11-20T06:26:46.544 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 9821 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.builtin.bin 2023-11-20T06:26:46.544 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 70004 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.builtin.modinfo 2023-11-20T06:26:46.544 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 146313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.dep 2023-11-20T06:26:46.544 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 232548 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.dep.bin 2023-11-20T06:26:46.544 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 210 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.devname 2023-11-20T06:26:46.544 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 72606 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.order 2023-11-20T06:26:46.544 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 879 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.softdep 2023-11-20T06:26:46.544 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 254438 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.symbols 2023-11-20T06:26:46.544 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 309363 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.symbols.bin 2023-11-20T06:26:46.545 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./usr/ 2023-11-20T06:26:46.545 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./usr/share/ 2023-11-20T06:26:46.545 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./usr/share/doc/ 2023-11-20T06:26:46.545 INFO:teuthology.orchestra.run.smithi019.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./usr/share/doc/linux-image-6.6.0-g7678e1afe51c/ 2023-11-20T06:26:46.545 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 171 2023-11-20 01:52 ./usr/share/doc/linux-image-6.6.0-g7678e1afe51c/changelog.Debian.gz 2023-11-20T06:26:46.545 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r-- root/root 691 2023-11-20 01:52 ./usr/share/doc/linux-image-6.6.0-g7678e1afe51c/copyright 2023-11-20T06:26:46.546 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g7678e1afe51c 2023-11-20T06:26:46.546 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g7678e1afe51c 2023-11-20T06:26:46.546 DEBUG:teuthology.orchestra.run.smithi019:> egrep '(submenu|menuentry.*6.6.0-g7678e1afe51c).*{' /boot/grub/grub.cfg 2023-11-20T06:26:46.552 INFO:teuthology.orchestra.run.smithi019.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-20T06:26:46.552 INFO:teuthology.orchestra.run.smithi019.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g7678e1afe51c' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g7678e1afe51c-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-20T06:26:46.553 INFO:teuthology.orchestra.run.smithi019.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g7678e1afe51c (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g7678e1afe51c-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-20T06:26:46.553 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-20T06:26:46.553 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g7678e1afe51c 2023-11-20T06:26:46.553 DEBUG:teuthology.orchestra.run.smithi019:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-20T06:26:46.597 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi019.front.sepia.ceph.com to complete... 2023-11-20T06:26:46.934 INFO:teuthology.orchestra.run.smithi019.stderr:Sourcing file `/etc/default/grub' 2023-11-20T06:26:46.935 INFO:teuthology.orchestra.run.smithi019.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-20T06:26:46.946 INFO:teuthology.orchestra.run.smithi019.stderr:Generating grub configuration file ... 2023-11-20T06:26:47.141 INFO:teuthology.orchestra.run.smithi019.stderr:Found linux image: /boot/vmlinuz-6.6.0-g7678e1afe51c 2023-11-20T06:26:47.147 INFO:teuthology.orchestra.run.smithi019.stderr:Found initrd image: /boot/initrd.img-6.6.0-g7678e1afe51c 2023-11-20T06:26:47.367 INFO:teuthology.orchestra.run.smithi019.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-20T06:26:47.373 INFO:teuthology.orchestra.run.smithi019.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-20T06:26:47.418 INFO:teuthology.orchestra.run.smithi019.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-20T06:26:47.424 INFO:teuthology.orchestra.run.smithi019.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-20T06:26:47.596 INFO:teuthology.orchestra.run.smithi019.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-20T06:26:47.596 INFO:teuthology.orchestra.run.smithi019.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-20T06:26:47.596 INFO:teuthology.orchestra.run.smithi019.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-20T06:26:47.608 INFO:teuthology.orchestra.run.smithi019.stderr:done 2023-11-20T06:27:16.920 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-20T06:27:16.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-11-20T06:27:16.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:27:18.730 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-20T06:27:18.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-11-20T06:27:18.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:27:35.394 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-11-20T06:27:37.186 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-11-20T06:27:44.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-11-20T06:27:44.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:27:46.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-11-20T06:27:46.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:27:47.462 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-11-20T06:27:49.254 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-11-20T06:27:59.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-11-20T06:27:59.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:28:01.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-11-20T06:28:01.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:28:17.890 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-11-20T06:28:32.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-11-20T06:28:32.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:28:33.245 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-11-20T06:28:33.918 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-11-20T06:28:33.918 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-g7678e1afe51c"... 2023-11-20T06:28:33.918 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2023-11-20T06:28:33.966 INFO:teuthology.orchestra.run.smithi190.stdout:6.6.0-g7678e1afe51c 2023-11-20T06:28:33.967 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g7678e1afe51c vs 6.6.0-g7678e1afe51c 2023-11-20T06:28:33.967 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-20T06:28:33.967 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-20T06:28:34.786 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-11-20T06:28:34.967 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-20T06:28:34.968 DEBUG:teuthology.orchestra.run.smithi190:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-20T06:28:35.052 INFO:teuthology.orchestra.run.smithi190.stdout:ttyS1 2023-11-20T06:28:35.102 DEBUG:teuthology.parallel:result is None 2023-11-20T06:28:49.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-11-20T06:28:49.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:28:50.068 DEBUG:teuthology.orchestra.run.smithi019:> true 2023-11-20T06:28:50.715 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-11-20T06:28:50.715 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-g7678e1afe51c"... 2023-11-20T06:28:50.716 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2023-11-20T06:28:50.765 INFO:teuthology.orchestra.run.smithi019.stdout:6.6.0-g7678e1afe51c 2023-11-20T06:28:50.765 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g7678e1afe51c vs 6.6.0-g7678e1afe51c 2023-11-20T06:28:50.765 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-20T06:28:50.765 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-20T06:28:51.766 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-20T06:28:51.767 DEBUG:teuthology.orchestra.run.smithi019:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-20T06:28:51.851 INFO:teuthology.orchestra.run.smithi019.stdout:ttyS1 2023-11-20T06:28:51.904 DEBUG:teuthology.parallel:result is None 2023-11-20T06:28:51.904 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-20T06:28:51.912 INFO:teuthology.task.internal:Creating test directory... 2023-11-20T06:28:51.912 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-20T06:28:51.916 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-20T06:28:51.925 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-20T06:28:51.972 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-20T06:28:52.023 INFO:teuthology.task.internal:Creating archive directory... 2023-11-20T06:28:52.023 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-20T06:28:52.027 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-20T06:28:52.048 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-20T06:28:52.072 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-20T06:28:52.073 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-20T06:28:52.088 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-20T06:28:52.111 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-20T06:28:52.125 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-20T06:28:52.126 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-20T06:28:52.139 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-20T06:28:52.142 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-20T06:28:52.149 INFO:teuthology.task.internal:Configuring sudo... 2023-11-20T06:28:52.149 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-20T06:28:52.172 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-20T06:28:52.207 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-20T06:28:52.217 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-20T06:28:52.218 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-20T06:28:52.236 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-20T06:28:52.258 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-20T06:28:52.293 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-20T06:28:52.346 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:28:52.346 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-20T06:28:52.420 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-20T06:28:52.429 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-20T06:28:52.479 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:28:52.479 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-20T06:28:52.551 DEBUG:teuthology.orchestra.run.smithi019:> sudo service rsyslog restart 2023-11-20T06:28:52.554 DEBUG:teuthology.orchestra.run.smithi190:> sudo service rsyslog restart 2023-11-20T06:28:52.685 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-20T06:28:52.693 INFO:teuthology.task.internal:Starting timer... 2023-11-20T06:28:52.693 INFO:teuthology.run_tasks:Running task pcp... 2023-11-20T06:28:52.726 INFO:teuthology.run_tasks:Running task selinux... 2023-11-20T06:28:52.775 DEBUG:teuthology.task.selinux:Excluding smithi019: OS 'ubuntu' does not support SELinux 2023-11-20T06:28:52.775 DEBUG:teuthology.task.selinux:Excluding smithi190: OS 'ubuntu' does not support SELinux 2023-11-20T06:28:52.775 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-20T06:28:52.775 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-20T06:28:52.776 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-20T06:28:52.776 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-20T06:28:52.823 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-20T06:28:52.828 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-20T06:28:52.954 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-20T06:28:52.969 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-20T06:28:52.970 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi019.front.sepia.ceph.com,smithi190.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-20T06:37:26.300 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi019.front.sepia.ceph.com'), Remote(name='ubuntu@smithi190.front.sepia.ceph.com')] 2023-11-20T06:37:26.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-11-20T06:37:26.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:37:26.381 DEBUG:teuthology.orchestra.run.smithi019:> true 2023-11-20T06:37:26.505 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-11-20T06:37:26.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-11-20T06:37:26.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:37:26.580 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-11-20T06:37:26.689 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-11-20T06:37:26.689 INFO:teuthology.run_tasks:Running task clock... 2023-11-20T06:37:26.698 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-20T06:37:26.699 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-20T06:37:26.699 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-20T06:37:26.703 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-20T06:37:26.703 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-20T06:37:26.740 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:26 ntpd[27914]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-20T06:37:26.740 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:26 ntpd[27914]: Command line: ntpd -gq 2023-11-20T06:37:26.740 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:26 ntpd[27914]: ---------------------------------------------------- 2023-11-20T06:37:26.740 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:26 ntpd[27914]: ntp-4 is maintained by Network Time Foundation, 2023-11-20T06:37:26.740 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:26 ntpd[27914]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-20T06:37:26.740 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:26 ntpd[27914]: corporation. Support and training for ntp-4 are 2023-11-20T06:37:26.740 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:26 ntpd[27914]: available at https://www.nwtime.org/support 2023-11-20T06:37:26.741 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:26 ntpd[27914]: ---------------------------------------------------- 2023-11-20T06:37:26.741 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:26 ntpd[27914]: proto: precision = 0.043 usec (-24) 2023-11-20T06:37:26.741 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:26 ntpd[27914]: basedate set to 2022-02-04 2023-11-20T06:37:26.741 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:26 ntpd[27914]: gps base set to 2022-02-06 (week 2196) 2023-11-20T06:37:26.742 INFO:teuthology.orchestra.run.smithi019.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-20T06:37:26.742 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:26 ntpd[27914]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-20T06:37:26.742 INFO:teuthology.orchestra.run.smithi019.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-20T06:37:26.743 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:26 ntpd[27914]: restrict ::: KOD does nothing without LIMITED. 2023-11-20T06:37:26.743 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:26 ntpd[27914]: Listen and drop on 0 v6wildcard [::]:123 2023-11-20T06:37:26.743 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:26 ntpd[27914]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-20T06:37:26.743 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:26 ntpd[27914]: Listen normally on 2 lo 127.0.0.1:123 2023-11-20T06:37:26.743 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:26 ntpd[27914]: Listen normally on 3 ens1f0 172.21.15.19:123 2023-11-20T06:37:26.744 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:26 ntpd[27914]: Listen normally on 4 lo [::1]:123 2023-11-20T06:37:26.744 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:26 ntpd[27914]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:161e%4]:123 2023-11-20T06:37:26.744 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:26 ntpd[27914]: Listening on routing socket on fd #22 for interface updates 2023-11-20T06:37:26.768 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:26 ntpd[28015]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-20T06:37:26.768 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:26 ntpd[28015]: Command line: ntpd -gq 2023-11-20T06:37:26.768 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:26 ntpd[28015]: ---------------------------------------------------- 2023-11-20T06:37:26.768 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:26 ntpd[28015]: ntp-4 is maintained by Network Time Foundation, 2023-11-20T06:37:26.768 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:26 ntpd[28015]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-20T06:37:26.768 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:26 ntpd[28015]: corporation. Support and training for ntp-4 are 2023-11-20T06:37:26.768 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:26 ntpd[28015]: available at https://www.nwtime.org/support 2023-11-20T06:37:26.769 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:26 ntpd[28015]: ---------------------------------------------------- 2023-11-20T06:37:26.769 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:26 ntpd[28015]: proto: precision = 0.042 usec (-24) 2023-11-20T06:37:26.769 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:26 ntpd[28015]: basedate set to 2022-02-04 2023-11-20T06:37:26.769 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:26 ntpd[28015]: gps base set to 2022-02-06 (week 2196) 2023-11-20T06:37:26.769 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:26 ntpd[28015]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-20T06:37:26.770 INFO:teuthology.orchestra.run.smithi190.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-20T06:37:26.770 INFO:teuthology.orchestra.run.smithi190.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-20T06:37:26.770 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:26 ntpd[28015]: restrict ::: KOD does nothing without LIMITED. 2023-11-20T06:37:26.771 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:26 ntpd[28015]: Listen and drop on 0 v6wildcard [::]:123 2023-11-20T06:37:26.771 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:26 ntpd[28015]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-20T06:37:26.771 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:26 ntpd[28015]: Listen normally on 2 lo 127.0.0.1:123 2023-11-20T06:37:26.771 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:26 ntpd[28015]: Listen normally on 3 enp3s0f1 172.21.15.190:123 2023-11-20T06:37:26.771 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:26 ntpd[28015]: Listen normally on 4 lo [::1]:123 2023-11-20T06:37:26.772 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:26 ntpd[28015]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7763%5]:123 2023-11-20T06:37:26.772 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:26 ntpd[28015]: Listening on routing socket on fd #22 for interface updates 2023-11-20T06:37:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:27 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:27 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:27 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:27 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:27 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:27 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:27 ntpd[27914]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:37:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:27 ntpd[27914]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:37:27.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:27 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:27.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:27 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:27.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:27 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:27.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:27 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:27.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:27 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:27.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:27 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:27.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:27 ntpd[28015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:37:27.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:27 ntpd[28015]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:37:27.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:27 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:27.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:27 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:27.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:27 ntpd[28015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:37:27.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:27 ntpd[28015]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:37:28.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:28 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:28.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:28 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:28.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:28 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:28.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:28 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:28.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:28 ntpd[27914]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:37:28.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:28 ntpd[27914]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:37:28.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:28 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:28.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:28 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:28.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:28 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:28.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:28 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:28.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:28 ntpd[28015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:37:28.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:28 ntpd[28015]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:37:29.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:29 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:29.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:29 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:29.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:29 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:29.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:29 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:29.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:29 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:29.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:29 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:29.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:29 ntpd[27914]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:37:29.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:29 ntpd[27914]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:37:29.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:29 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:29.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:29 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:29.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:29 ntpd[27914]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:37:29.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:29 ntpd[27914]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:37:29.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:29 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:29.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:29 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:29.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:29 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:29.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:29 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:29.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:29 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:29.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:29 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:29.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:29 ntpd[28015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:37:29.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:29 ntpd[28015]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:37:29.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:29 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:29.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:29 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:29.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:29 ntpd[28015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:37:29.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:29 ntpd[28015]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:37:30.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:30 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:30.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:30 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:30.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:30 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:30.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:30 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:30.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:30 ntpd[27914]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:37:30.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:30 ntpd[27914]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:37:30.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:30 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:30.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:30 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:30.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:30 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:30.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:30 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:30.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:30 ntpd[28015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:37:30.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:30 ntpd[28015]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:37:31.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:31 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:31.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:31 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:31.743 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:31 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:31.743 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:31 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:31.743 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:31 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:31.743 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:31 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:31.743 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:31 ntpd[27914]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:37:31.743 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:31 ntpd[27914]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:37:31.743 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:31 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:31.743 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:31 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:31.743 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:31 ntpd[27914]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:37:31.744 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:31 ntpd[27914]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:37:31.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:31 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:31.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:31 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:31.771 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:31 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:31.771 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:31 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:31.771 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:31 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:31.771 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:31 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:31.771 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:31 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:31.771 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:31 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:31.771 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:31 ntpd[28015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:37:31.772 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:31 ntpd[28015]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:37:31.772 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:31 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:31.772 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:31 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:31.772 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:31 ntpd[28015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:37:31.772 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:31 ntpd[28015]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:37:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:32 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:32 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:32 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:32 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:32 ntpd[27914]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:37:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:32 ntpd[27914]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:37:32.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:32 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:32.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:32 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:32.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:32 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:32.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:32 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:32.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:32 ntpd[28015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:37:32.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:32 ntpd[28015]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:37:33.741 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:33 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:33.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:33 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:33.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:33 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:33.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:33 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:33.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:33 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:33.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:33 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:33.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:33 ntpd[27914]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:37:33.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:33 ntpd[27914]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:37:33.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:33 ntpd[27914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:33.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:33 ntpd[27914]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:33.742 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:33 ntpd[27914]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:37:33.743 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:33 ntpd[27914]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:37:33.743 INFO:teuthology.orchestra.run.smithi019.stdout:20 Nov 06:37:33 ntpd[27914]: ntpd: time slew -0.001768 s 2023-11-20T06:37:33.743 INFO:teuthology.orchestra.run.smithi019.stdout:ntpd: time slew -0.001768s 2023-11-20T06:37:33.743 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:33 ntpd[27914]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-20T06:37:33.744 INFO:teuthology.orchestra.run.smithi019.stderr:20 Nov 06:37:33 ntpd[27914]: can't open /var/log/ntpstats/loopstats.20231120: Permission denied 2023-11-20T06:37:33.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:33 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:33.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:33 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:33.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:33 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:33.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:33 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:33.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:33 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:37:33.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:33 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:37:33.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:33 ntpd[28015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:37:33.769 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:33 ntpd[28015]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:37:33.770 INFO:teuthology.orchestra.run.smithi190.stdout:20 Nov 06:37:33 ntpd[28015]: ntpd: time slew -0.001509 s 2023-11-20T06:37:33.770 INFO:teuthology.orchestra.run.smithi190.stdout:ntpd: time slew -0.001509s 2023-11-20T06:37:33.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:33 ntpd[28015]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-20T06:37:33.770 INFO:teuthology.orchestra.run.smithi190.stderr:20 Nov 06:37:33 ntpd[28015]: can't open /var/log/ntpstats/loopstats.20231120: Permission denied 2023-11-20T06:37:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: remote refid st t when poll reach delay offset jitter 2023-11-20T06:37:33.833 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================== 2023-11-20T06:37:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-20T06:37:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-20T06:37:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-20T06:37:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-20T06:37:33.867 INFO:teuthology.orchestra.run.smithi190.stdout: remote refid st t when poll reach delay offset jitter 2023-11-20T06:37:33.867 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================== 2023-11-20T06:37:33.868 INFO:teuthology.orchestra.run.smithi190.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-20T06:37:33.868 INFO:teuthology.orchestra.run.smithi190.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-20T06:37:33.868 INFO:teuthology.orchestra.run.smithi190.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-20T06:37:33.868 INFO:teuthology.orchestra.run.smithi190.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-20T06:37:33.869 INFO:teuthology.run_tasks:Running task install... 2023-11-20T06:37:33.878 DEBUG:teuthology.task.install:project ceph 2023-11-20T06:37:33.878 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'}} 2023-11-20T06:37:33.878 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'} 2023-11-20T06:37:33.878 INFO:teuthology.task.install:Using flavor: default 2023-11-20T06:37:33.884 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-20T06:37:33.884 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-20T06:37:33.885 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-key list | grep Ceph 2023-11-20T06:37:33.885 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-key list | grep Ceph 2023-11-20T06:37:33.995 INFO:teuthology.orchestra.run.smithi019.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-20T06:37:34.014 INFO:teuthology.orchestra.run.smithi190.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-20T06:37:34.049 INFO:teuthology.orchestra.run.smithi019.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-20T06:37:34.049 INFO:teuthology.orchestra.run.smithi019.stdout:uid [ unknown] Ceph.com (release key) 2023-11-20T06:37:34.050 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-20T06:37:34.050 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-20T06:37:34.051 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=895e5adad9a763a0f13587c485b17f1ad3f04528 2023-11-20T06:37:34.072 INFO:teuthology.orchestra.run.smithi190.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-20T06:37:34.072 INFO:teuthology.orchestra.run.smithi190.stdout:uid [ unknown] Ceph.com (release key) 2023-11-20T06:37:34.072 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-20T06:37:34.073 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-20T06:37:34.073 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=895e5adad9a763a0f13587c485b17f1ad3f04528 2023-11-20T06:37:34.298 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default/ 2023-11-20T06:37:34.298 INFO:teuthology.task.install.deb:Package version is 18.0.0-6612-g895e5ada-1jammy 2023-11-20T06:37:34.311 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default/ 2023-11-20T06:37:34.311 INFO:teuthology.task.install.deb:Package version is 18.0.0-6612-g895e5ada-1jammy 2023-11-20T06:37:34.420 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:37:34.420 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-20T06:37:34.440 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get update 2023-11-20T06:37:34.474 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:37:34.474 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-20T06:37:34.495 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get update 2023-11-20T06:37:34.666 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-20T06:37:34.666 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-20T06:37:34.672 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-20T06:37:34.684 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-20T06:37:34.684 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-20T06:37:34.686 INFO:teuthology.orchestra.run.smithi190.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy InRelease 2023-11-20T06:37:34.689 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-20T06:37:34.689 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-20T06:37:34.706 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-20T06:37:34.722 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-20T06:37:34.745 INFO:teuthology.orchestra.run.smithi190.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-20T06:37:34.785 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2023-11-20T06:37:34.800 INFO:teuthology.orchestra.run.smithi019.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy InRelease 2023-11-20T06:37:34.837 INFO:teuthology.orchestra.run.smithi019.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-20T06:37:34.934 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-20T06:37:34.951 INFO:teuthology.orchestra.run.smithi019.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-20T06:37:34.987 INFO:teuthology.orchestra.run.smithi019.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-20T06:37:35.071 INFO:teuthology.orchestra.run.smithi019.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2023-11-20T06:37:35.271 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 28.5 kB in 1s (46.9 kB/s) 2023-11-20T06:37:35.316 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 28.5 kB in 1s (48.1 kB/s) 2023-11-20T06:37:36.203 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2023-11-20T06:37:36.209 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6612-g895e5ada-1jammy cephadm=18.0.0-6612-g895e5ada-1jammy ceph-mds=18.0.0-6612-g895e5ada-1jammy ceph-mgr=18.0.0-6612-g895e5ada-1jammy ceph-common=18.0.0-6612-g895e5ada-1jammy ceph-fuse=18.0.0-6612-g895e5ada-1jammy ceph-test=18.0.0-6612-g895e5ada-1jammy ceph-volume=18.0.0-6612-g895e5ada-1jammy radosgw=18.0.0-6612-g895e5ada-1jammy python3-rados=18.0.0-6612-g895e5ada-1jammy python3-rgw=18.0.0-6612-g895e5ada-1jammy python3-cephfs=18.0.0-6612-g895e5ada-1jammy python3-rbd=18.0.0-6612-g895e5ada-1jammy libcephfs2=18.0.0-6612-g895e5ada-1jammy libcephfs-dev=18.0.0-6612-g895e5ada-1jammy librados2=18.0.0-6612-g895e5ada-1jammy librbd1=18.0.0-6612-g895e5ada-1jammy rbd-fuse=18.0.0-6612-g895e5ada-1jammy python3-cephfs=18.0.0-6612-g895e5ada-1jammy cephfs-shell=18.0.0-6612-g895e5ada-1jammy cephfs-top=18.0.0-6612-g895e5ada-1jammy cephfs-mirror=18.0.0-6612-g895e5ada-1jammy 2023-11-20T06:37:36.277 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2023-11-20T06:37:36.291 DEBUG:teuthology.orchestra.run.smithi019:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6612-g895e5ada-1jammy cephadm=18.0.0-6612-g895e5ada-1jammy ceph-mds=18.0.0-6612-g895e5ada-1jammy ceph-mgr=18.0.0-6612-g895e5ada-1jammy ceph-common=18.0.0-6612-g895e5ada-1jammy ceph-fuse=18.0.0-6612-g895e5ada-1jammy ceph-test=18.0.0-6612-g895e5ada-1jammy ceph-volume=18.0.0-6612-g895e5ada-1jammy radosgw=18.0.0-6612-g895e5ada-1jammy python3-rados=18.0.0-6612-g895e5ada-1jammy python3-rgw=18.0.0-6612-g895e5ada-1jammy python3-cephfs=18.0.0-6612-g895e5ada-1jammy python3-rbd=18.0.0-6612-g895e5ada-1jammy libcephfs2=18.0.0-6612-g895e5ada-1jammy libcephfs-dev=18.0.0-6612-g895e5ada-1jammy librados2=18.0.0-6612-g895e5ada-1jammy librbd1=18.0.0-6612-g895e5ada-1jammy rbd-fuse=18.0.0-6612-g895e5ada-1jammy python3-cephfs=18.0.0-6612-g895e5ada-1jammy cephfs-shell=18.0.0-6612-g895e5ada-1jammy cephfs-top=18.0.0-6612-g895e5ada-1jammy cephfs-mirror=18.0.0-6612-g895e5ada-1jammy 2023-11-20T06:37:36.291 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2023-11-20T06:37:36.374 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2023-11-20T06:37:36.455 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2023-11-20T06:37:36.461 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2023-11-20T06:37:36.545 INFO:teuthology.orchestra.run.smithi019.stdout:Building dependency tree... 2023-11-20T06:37:36.551 INFO:teuthology.orchestra.run.smithi019.stdout:Reading state information... 2023-11-20T06:37:36.607 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2023-11-20T06:37:36.607 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-20T06:37:36.607 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-20T06:37:36.611 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-20T06:37:36.611 INFO:teuthology.orchestra.run.smithi190.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-20T06:37:36.611 INFO:teuthology.orchestra.run.smithi190.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-20T06:37:36.612 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-20T06:37:36.613 INFO:teuthology.orchestra.run.smithi190.stdout:The following additional packages will be installed: 2023-11-20T06:37:36.613 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-20T06:37:36.613 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-20T06:37:36.613 INFO:teuthology.orchestra.run.smithi190.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-11-20T06:37:36.613 INFO:teuthology.orchestra.run.smithi190.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-20T06:37:36.613 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-20T06:37:36.613 INFO:teuthology.orchestra.run.smithi190.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-20T06:37:36.613 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-20T06:37:36.614 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-20T06:37:36.614 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-20T06:37:36.614 INFO:teuthology.orchestra.run.smithi190.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-20T06:37:36.614 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-20T06:37:36.614 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-20T06:37:36.615 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-20T06:37:36.615 INFO:teuthology.orchestra.run.smithi190.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-20T06:37:36.615 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-20T06:37:36.616 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-20T06:37:36.616 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-20T06:37:36.616 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-20T06:37:36.616 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-20T06:37:36.616 INFO:teuthology.orchestra.run.smithi190.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-20T06:37:36.616 INFO:teuthology.orchestra.run.smithi190.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-20T06:37:36.616 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-20T06:37:36.616 INFO:teuthology.orchestra.run.smithi190.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-20T06:37:36.616 INFO:teuthology.orchestra.run.smithi190.stdout:Suggested packages: 2023-11-20T06:37:36.616 INFO:teuthology.orchestra.run.smithi190.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-20T06:37:36.616 INFO:teuthology.orchestra.run.smithi190.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-20T06:37:36.617 INFO:teuthology.orchestra.run.smithi190.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-20T06:37:36.617 INFO:teuthology.orchestra.run.smithi190.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-20T06:37:36.617 INFO:teuthology.orchestra.run.smithi190.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-20T06:37:36.617 INFO:teuthology.orchestra.run.smithi190.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-20T06:37:36.617 INFO:teuthology.orchestra.run.smithi190.stdout: python3-watchdog 2023-11-20T06:37:36.617 INFO:teuthology.orchestra.run.smithi190.stdout:Recommended packages: 2023-11-20T06:37:36.617 INFO:teuthology.orchestra.run.smithi190.stdout: btrfs-tools 2023-11-20T06:37:36.705 INFO:teuthology.orchestra.run.smithi019.stdout:The following packages were automatically installed and are no longer required: 2023-11-20T06:37:36.705 INFO:teuthology.orchestra.run.smithi019.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-20T06:37:36.706 INFO:teuthology.orchestra.run.smithi019.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-20T06:37:36.706 INFO:teuthology.orchestra.run.smithi019.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-20T06:37:36.706 INFO:teuthology.orchestra.run.smithi019.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-20T06:37:36.706 INFO:teuthology.orchestra.run.smithi019.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-20T06:37:36.706 INFO:teuthology.orchestra.run.smithi019.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-20T06:37:36.708 INFO:teuthology.orchestra.run.smithi019.stdout:The following additional packages will be installed: 2023-11-20T06:37:36.708 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-20T06:37:36.708 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-20T06:37:36.708 INFO:teuthology.orchestra.run.smithi019.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-11-20T06:37:36.708 INFO:teuthology.orchestra.run.smithi019.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-20T06:37:36.708 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-20T06:37:36.708 INFO:teuthology.orchestra.run.smithi019.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-20T06:37:36.708 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-20T06:37:36.708 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-20T06:37:36.708 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-20T06:37:36.709 INFO:teuthology.orchestra.run.smithi019.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-20T06:37:36.709 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-20T06:37:36.709 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-20T06:37:36.709 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-20T06:37:36.709 INFO:teuthology.orchestra.run.smithi019.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-20T06:37:36.709 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-20T06:37:36.709 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-20T06:37:36.709 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-20T06:37:36.709 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-20T06:37:36.709 INFO:teuthology.orchestra.run.smithi019.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-20T06:37:36.709 INFO:teuthology.orchestra.run.smithi019.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-20T06:37:36.709 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-20T06:37:36.710 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-20T06:37:36.710 INFO:teuthology.orchestra.run.smithi019.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-20T06:37:36.710 INFO:teuthology.orchestra.run.smithi019.stdout:Suggested packages: 2023-11-20T06:37:36.710 INFO:teuthology.orchestra.run.smithi019.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-20T06:37:36.710 INFO:teuthology.orchestra.run.smithi019.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-20T06:37:36.711 INFO:teuthology.orchestra.run.smithi019.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-20T06:37:36.711 INFO:teuthology.orchestra.run.smithi019.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-20T06:37:36.711 INFO:teuthology.orchestra.run.smithi019.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-20T06:37:36.711 INFO:teuthology.orchestra.run.smithi019.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-20T06:37:36.711 INFO:teuthology.orchestra.run.smithi019.stdout: python3-watchdog 2023-11-20T06:37:36.711 INFO:teuthology.orchestra.run.smithi019.stdout:Recommended packages: 2023-11-20T06:37:36.711 INFO:teuthology.orchestra.run.smithi019.stdout: btrfs-tools 2023-11-20T06:37:36.756 INFO:teuthology.orchestra.run.smithi190.stdout:The following NEW packages will be installed: 2023-11-20T06:37:36.756 INFO:teuthology.orchestra.run.smithi190.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-20T06:37:36.757 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-20T06:37:36.757 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-20T06:37:36.757 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-20T06:37:36.757 INFO:teuthology.orchestra.run.smithi190.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-11-20T06:37:36.757 INFO:teuthology.orchestra.run.smithi190.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-20T06:37:36.757 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-11-20T06:37:36.757 INFO:teuthology.orchestra.run.smithi190.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-11-20T06:37:36.758 INFO:teuthology.orchestra.run.smithi190.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-20T06:37:36.758 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-20T06:37:36.758 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-20T06:37:36.758 INFO:teuthology.orchestra.run.smithi190.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-20T06:37:36.758 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-20T06:37:36.758 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-20T06:37:36.758 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-20T06:37:36.759 INFO:teuthology.orchestra.run.smithi190.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-20T06:37:36.759 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-20T06:37:36.759 INFO:teuthology.orchestra.run.smithi190.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-20T06:37:36.759 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-20T06:37:36.759 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-20T06:37:36.759 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-20T06:37:36.759 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-20T06:37:36.760 INFO:teuthology.orchestra.run.smithi190.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-20T06:37:36.760 INFO:teuthology.orchestra.run.smithi190.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-20T06:37:36.760 INFO:teuthology.orchestra.run.smithi190.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-20T06:37:36.760 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-20T06:37:36.760 INFO:teuthology.orchestra.run.smithi190.stdout: socat xmlstarlet 2023-11-20T06:37:36.828 INFO:teuthology.orchestra.run.smithi190.stdout:0 upgraded, 115 newly installed, 0 to remove and 263 not upgraded. 2023-11-20T06:37:36.828 INFO:teuthology.orchestra.run.smithi190.stdout:Need to get 184 MB of archives. 2023-11-20T06:37:36.828 INFO:teuthology.orchestra.run.smithi190.stdout:After this operation, 825 MB of additional disk space will be used. 2023-11-20T06:37:36.828 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-20T06:37:36.850 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-20T06:37:36.859 INFO:teuthology.orchestra.run.smithi019.stdout:The following NEW packages will be installed: 2023-11-20T06:37:36.860 INFO:teuthology.orchestra.run.smithi019.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-20T06:37:36.860 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-20T06:37:36.860 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-20T06:37:36.860 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-20T06:37:36.860 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-20T06:37:36.862 INFO:teuthology.orchestra.run.smithi019.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-11-20T06:37:36.862 INFO:teuthology.orchestra.run.smithi019.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-20T06:37:36.862 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-11-20T06:37:36.862 INFO:teuthology.orchestra.run.smithi019.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-11-20T06:37:36.862 INFO:teuthology.orchestra.run.smithi019.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-20T06:37:36.862 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-20T06:37:36.862 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-20T06:37:36.862 INFO:teuthology.orchestra.run.smithi019.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-20T06:37:36.862 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-20T06:37:36.862 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-20T06:37:36.862 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-20T06:37:36.863 INFO:teuthology.orchestra.run.smithi019.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-20T06:37:36.863 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-20T06:37:36.863 INFO:teuthology.orchestra.run.smithi019.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-20T06:37:36.863 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-20T06:37:36.863 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-20T06:37:36.863 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-20T06:37:36.863 INFO:teuthology.orchestra.run.smithi019.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-20T06:37:36.863 INFO:teuthology.orchestra.run.smithi019.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-20T06:37:36.863 INFO:teuthology.orchestra.run.smithi019.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-20T06:37:36.863 INFO:teuthology.orchestra.run.smithi019.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-20T06:37:36.863 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-20T06:37:36.863 INFO:teuthology.orchestra.run.smithi019.stdout: socat xmlstarlet 2023-11-20T06:37:36.918 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-11-20T06:37:36.927 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-20T06:37:36.928 INFO:teuthology.orchestra.run.smithi019.stdout:0 upgraded, 115 newly installed, 0 to remove and 263 not upgraded. 2023-11-20T06:37:36.928 INFO:teuthology.orchestra.run.smithi019.stdout:Need to get 184 MB of archives. 2023-11-20T06:37:36.928 INFO:teuthology.orchestra.run.smithi019.stdout:After this operation, 825 MB of additional disk space will be used. 2023-11-20T06:37:36.928 INFO:teuthology.orchestra.run.smithi019.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-20T06:37:36.945 INFO:teuthology.orchestra.run.smithi019.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-20T06:37:36.950 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-20T06:37:36.953 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-20T06:37:36.955 INFO:teuthology.orchestra.run.smithi019.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-20T06:37:36.963 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-20T06:37:36.970 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6612-g895e5ada-1jammy [3,449 kB] 2023-11-20T06:37:36.997 INFO:teuthology.orchestra.run.smithi019.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-11-20T06:37:37.006 INFO:teuthology.orchestra.run.smithi019.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-20T06:37:37.008 INFO:teuthology.orchestra.run.smithi190.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-20T06:37:37.010 INFO:teuthology.orchestra.run.smithi190.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-20T06:37:37.011 INFO:teuthology.orchestra.run.smithi019.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6612-g895e5ada-1jammy [3,449 kB] 2023-11-20T06:37:37.019 INFO:teuthology.orchestra.run.smithi190.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-20T06:37:37.021 INFO:teuthology.orchestra.run.smithi019.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-20T06:37:37.022 INFO:teuthology.orchestra.run.smithi190.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-20T06:37:37.022 INFO:teuthology.orchestra.run.smithi190.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-20T06:37:37.024 INFO:teuthology.orchestra.run.smithi019.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-20T06:37:37.030 INFO:teuthology.orchestra.run.smithi190.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-20T06:37:37.031 INFO:teuthology.orchestra.run.smithi190.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-20T06:37:37.032 INFO:teuthology.orchestra.run.smithi190.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-20T06:37:37.032 INFO:teuthology.orchestra.run.smithi190.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-20T06:37:37.033 INFO:teuthology.orchestra.run.smithi190.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-20T06:37:37.034 INFO:teuthology.orchestra.run.smithi019.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-20T06:37:37.051 INFO:teuthology.orchestra.run.smithi190.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-20T06:37:37.052 INFO:teuthology.orchestra.run.smithi190.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-20T06:37:37.052 INFO:teuthology.orchestra.run.smithi190.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-20T06:37:37.052 INFO:teuthology.orchestra.run.smithi190.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-20T06:37:37.069 INFO:teuthology.orchestra.run.smithi019.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-20T06:37:37.070 INFO:teuthology.orchestra.run.smithi190.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-20T06:37:37.071 INFO:teuthology.orchestra.run.smithi019.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-20T06:37:37.072 INFO:teuthology.orchestra.run.smithi190.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-20T06:37:37.073 INFO:teuthology.orchestra.run.smithi190.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-20T06:37:37.073 INFO:teuthology.orchestra.run.smithi190.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-20T06:37:37.073 INFO:teuthology.orchestra.run.smithi190.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-20T06:37:37.074 INFO:teuthology.orchestra.run.smithi190.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-20T06:37:37.078 INFO:teuthology.orchestra.run.smithi019.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-20T06:37:37.081 INFO:teuthology.orchestra.run.smithi019.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-20T06:37:37.081 INFO:teuthology.orchestra.run.smithi019.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-20T06:37:37.087 INFO:teuthology.orchestra.run.smithi019.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-20T06:37:37.088 INFO:teuthology.orchestra.run.smithi019.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-20T06:37:37.089 INFO:teuthology.orchestra.run.smithi019.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-20T06:37:37.090 INFO:teuthology.orchestra.run.smithi019.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-20T06:37:37.090 INFO:teuthology.orchestra.run.smithi019.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-20T06:37:37.091 INFO:teuthology.orchestra.run.smithi190.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-20T06:37:37.091 INFO:teuthology.orchestra.run.smithi190.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-20T06:37:37.091 INFO:teuthology.orchestra.run.smithi190.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-20T06:37:37.091 INFO:teuthology.orchestra.run.smithi190.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-20T06:37:37.105 INFO:teuthology.orchestra.run.smithi019.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-20T06:37:37.105 INFO:teuthology.orchestra.run.smithi019.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-20T06:37:37.106 INFO:teuthology.orchestra.run.smithi019.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-20T06:37:37.106 INFO:teuthology.orchestra.run.smithi019.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-20T06:37:37.109 INFO:teuthology.orchestra.run.smithi190.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-20T06:37:37.113 INFO:teuthology.orchestra.run.smithi190.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-20T06:37:37.114 INFO:teuthology.orchestra.run.smithi190.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-20T06:37:37.114 INFO:teuthology.orchestra.run.smithi190.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-20T06:37:37.114 INFO:teuthology.orchestra.run.smithi190.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-20T06:37:37.116 INFO:teuthology.orchestra.run.smithi190.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-20T06:37:37.122 INFO:teuthology.orchestra.run.smithi019.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-20T06:37:37.125 INFO:teuthology.orchestra.run.smithi019.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-20T06:37:37.125 INFO:teuthology.orchestra.run.smithi019.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-20T06:37:37.126 INFO:teuthology.orchestra.run.smithi019.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-20T06:37:37.126 INFO:teuthology.orchestra.run.smithi019.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-20T06:37:37.127 INFO:teuthology.orchestra.run.smithi019.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-20T06:37:37.128 INFO:teuthology.orchestra.run.smithi190.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-20T06:37:37.129 INFO:teuthology.orchestra.run.smithi190.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-20T06:37:37.130 INFO:teuthology.orchestra.run.smithi190.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-20T06:37:37.130 INFO:teuthology.orchestra.run.smithi190.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-20T06:37:37.139 INFO:teuthology.orchestra.run.smithi019.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-20T06:37:37.139 INFO:teuthology.orchestra.run.smithi019.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-20T06:37:37.140 INFO:teuthology.orchestra.run.smithi019.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-20T06:37:37.141 INFO:teuthology.orchestra.run.smithi019.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-20T06:37:37.147 INFO:teuthology.orchestra.run.smithi190.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-20T06:37:37.148 INFO:teuthology.orchestra.run.smithi190.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-20T06:37:37.150 INFO:teuthology.orchestra.run.smithi190.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-20T06:37:37.155 INFO:teuthology.orchestra.run.smithi019.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-20T06:37:37.159 INFO:teuthology.orchestra.run.smithi019.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-20T06:37:37.160 INFO:teuthology.orchestra.run.smithi019.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-20T06:37:37.160 INFO:teuthology.orchestra.run.smithi019.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-20T06:37:37.161 INFO:teuthology.orchestra.run.smithi019.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-20T06:37:37.162 INFO:teuthology.orchestra.run.smithi019.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-20T06:37:37.172 INFO:teuthology.orchestra.run.smithi019.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-20T06:37:37.173 INFO:teuthology.orchestra.run.smithi019.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-20T06:37:37.174 INFO:teuthology.orchestra.run.smithi019.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-20T06:37:37.174 INFO:teuthology.orchestra.run.smithi019.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-20T06:37:37.189 INFO:teuthology.orchestra.run.smithi019.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-20T06:37:37.189 INFO:teuthology.orchestra.run.smithi019.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-20T06:37:37.191 INFO:teuthology.orchestra.run.smithi019.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-20T06:37:37.198 INFO:teuthology.orchestra.run.smithi190.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-20T06:37:37.198 INFO:teuthology.orchestra.run.smithi190.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-20T06:37:37.199 INFO:teuthology.orchestra.run.smithi190.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-20T06:37:37.200 INFO:teuthology.orchestra.run.smithi190.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-20T06:37:37.201 INFO:teuthology.orchestra.run.smithi190.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-20T06:37:37.202 INFO:teuthology.orchestra.run.smithi190.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-20T06:37:37.221 INFO:teuthology.orchestra.run.smithi190.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-20T06:37:37.222 INFO:teuthology.orchestra.run.smithi190.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-20T06:37:37.222 INFO:teuthology.orchestra.run.smithi190.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-20T06:37:37.227 INFO:teuthology.orchestra.run.smithi190.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6612-g895e5ada-1jammy [3,130 kB] 2023-11-20T06:37:37.238 INFO:teuthology.orchestra.run.smithi019.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-20T06:37:37.239 INFO:teuthology.orchestra.run.smithi019.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-20T06:37:37.240 INFO:teuthology.orchestra.run.smithi019.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-20T06:37:37.241 INFO:teuthology.orchestra.run.smithi019.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-20T06:37:37.241 INFO:teuthology.orchestra.run.smithi019.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-20T06:37:37.242 INFO:teuthology.orchestra.run.smithi019.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-20T06:37:37.258 INFO:teuthology.orchestra.run.smithi190.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-20T06:37:37.259 INFO:teuthology.orchestra.run.smithi190.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-20T06:37:37.259 INFO:teuthology.orchestra.run.smithi190.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-20T06:37:37.259 INFO:teuthology.orchestra.run.smithi190.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-20T06:37:37.259 INFO:teuthology.orchestra.run.smithi190.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-20T06:37:37.259 INFO:teuthology.orchestra.run.smithi190.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-20T06:37:37.261 INFO:teuthology.orchestra.run.smithi019.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-20T06:37:37.263 INFO:teuthology.orchestra.run.smithi019.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-20T06:37:37.263 INFO:teuthology.orchestra.run.smithi019.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-20T06:37:37.275 INFO:teuthology.orchestra.run.smithi190.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-20T06:37:37.276 INFO:teuthology.orchestra.run.smithi190.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-20T06:37:37.279 INFO:teuthology.orchestra.run.smithi190.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-20T06:37:37.280 INFO:teuthology.orchestra.run.smithi019.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-20T06:37:37.281 INFO:teuthology.orchestra.run.smithi019.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-20T06:37:37.281 INFO:teuthology.orchestra.run.smithi019.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-20T06:37:37.282 INFO:teuthology.orchestra.run.smithi019.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-20T06:37:37.283 INFO:teuthology.orchestra.run.smithi019.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-20T06:37:37.283 INFO:teuthology.orchestra.run.smithi019.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-20T06:37:37.290 INFO:teuthology.orchestra.run.smithi019.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-20T06:37:37.292 INFO:teuthology.orchestra.run.smithi019.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-20T06:37:37.294 INFO:teuthology.orchestra.run.smithi190.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-20T06:37:37.295 INFO:teuthology.orchestra.run.smithi019.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-20T06:37:37.295 INFO:teuthology.orchestra.run.smithi190.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-20T06:37:37.296 INFO:teuthology.orchestra.run.smithi190.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-20T06:37:37.300 INFO:teuthology.orchestra.run.smithi190.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-20T06:37:37.302 INFO:teuthology.orchestra.run.smithi190.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-20T06:37:37.303 INFO:teuthology.orchestra.run.smithi190.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-20T06:37:37.307 INFO:teuthology.orchestra.run.smithi019.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-20T06:37:37.308 INFO:teuthology.orchestra.run.smithi190.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-20T06:37:37.308 INFO:teuthology.orchestra.run.smithi019.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-20T06:37:37.309 INFO:teuthology.orchestra.run.smithi019.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-20T06:37:37.313 INFO:teuthology.orchestra.run.smithi019.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-20T06:37:37.313 INFO:teuthology.orchestra.run.smithi190.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-20T06:37:37.314 INFO:teuthology.orchestra.run.smithi190.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-20T06:37:37.314 INFO:teuthology.orchestra.run.smithi190.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-20T06:37:37.315 INFO:teuthology.orchestra.run.smithi019.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-20T06:37:37.316 INFO:teuthology.orchestra.run.smithi019.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-20T06:37:37.320 INFO:teuthology.orchestra.run.smithi019.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-20T06:37:37.324 INFO:teuthology.orchestra.run.smithi019.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-20T06:37:37.324 INFO:teuthology.orchestra.run.smithi019.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-20T06:37:37.325 INFO:teuthology.orchestra.run.smithi019.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-20T06:37:37.333 INFO:teuthology.orchestra.run.smithi190.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-20T06:37:37.334 INFO:teuthology.orchestra.run.smithi190.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-20T06:37:37.336 INFO:teuthology.orchestra.run.smithi190.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-20T06:37:37.340 INFO:teuthology.orchestra.run.smithi019.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-20T06:37:37.342 INFO:teuthology.orchestra.run.smithi019.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-20T06:37:37.343 INFO:teuthology.orchestra.run.smithi190.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-20T06:37:37.343 INFO:teuthology.orchestra.run.smithi019.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-20T06:37:37.344 INFO:teuthology.orchestra.run.smithi190.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-20T06:37:37.344 INFO:teuthology.orchestra.run.smithi190.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-20T06:37:37.346 INFO:teuthology.orchestra.run.smithi190.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-20T06:37:37.350 INFO:teuthology.orchestra.run.smithi019.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-20T06:37:37.351 INFO:teuthology.orchestra.run.smithi019.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-20T06:37:37.351 INFO:teuthology.orchestra.run.smithi019.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-20T06:37:37.352 INFO:teuthology.orchestra.run.smithi190.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-20T06:37:37.353 INFO:teuthology.orchestra.run.smithi019.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-20T06:37:37.357 INFO:teuthology.orchestra.run.smithi019.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-20T06:37:37.368 INFO:teuthology.orchestra.run.smithi190.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6612-g895e5ada-1jammy [689 kB] 2023-11-20T06:37:37.384 INFO:teuthology.orchestra.run.smithi019.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6612-g895e5ada-1jammy [3,130 kB] 2023-11-20T06:37:37.406 INFO:teuthology.orchestra.run.smithi190.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6612-g895e5ada-1jammy [356 kB] 2023-11-20T06:37:37.515 INFO:teuthology.orchestra.run.smithi019.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6612-g895e5ada-1jammy [689 kB] 2023-11-20T06:37:37.537 INFO:teuthology.orchestra.run.smithi019.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6612-g895e5ada-1jammy [356 kB] 2023-11-20T06:37:37.562 INFO:teuthology.orchestra.run.smithi190.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6612-g895e5ada-1jammy [32.8 kB] 2023-11-20T06:37:37.562 INFO:teuthology.orchestra.run.smithi019.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6612-g895e5ada-1jammy [32.8 kB] 2023-11-20T06:37:37.576 INFO:teuthology.orchestra.run.smithi019.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6612-g895e5ada-1jammy [180 kB] 2023-11-20T06:37:37.578 INFO:teuthology.orchestra.run.smithi190.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6612-g895e5ada-1jammy [180 kB] 2023-11-20T06:37:37.593 INFO:teuthology.orchestra.run.smithi019.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6612-g895e5ada-1jammy [62.4 kB] 2023-11-20T06:37:37.593 INFO:teuthology.orchestra.run.smithi190.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6612-g895e5ada-1jammy [62.4 kB] 2023-11-20T06:37:37.595 INFO:teuthology.orchestra.run.smithi190.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6612-g895e5ada-1jammy [329 kB] 2023-11-20T06:37:37.595 INFO:teuthology.orchestra.run.smithi019.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6612-g895e5ada-1jammy [329 kB] 2023-11-20T06:37:37.861 INFO:teuthology.orchestra.run.smithi190.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6612-g895e5ada-1jammy [6,215 kB] 2023-11-20T06:37:37.862 INFO:teuthology.orchestra.run.smithi019.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6612-g895e5ada-1jammy [6,215 kB] 2023-11-20T06:37:38.217 INFO:teuthology.orchestra.run.smithi190.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6612-g895e5ada-1jammy [112 kB] 2023-11-20T06:37:38.218 INFO:teuthology.orchestra.run.smithi190.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6612-g895e5ada-1jammy [439 kB] 2023-11-20T06:37:38.235 INFO:teuthology.orchestra.run.smithi190.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6612-g895e5ada-1jammy [22.6 MB] 2023-11-20T06:37:38.343 INFO:teuthology.orchestra.run.smithi019.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6612-g895e5ada-1jammy [112 kB] 2023-11-20T06:37:38.350 INFO:teuthology.orchestra.run.smithi019.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6612-g895e5ada-1jammy [439 kB] 2023-11-20T06:37:38.392 INFO:teuthology.orchestra.run.smithi019.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6612-g895e5ada-1jammy [22.6 MB] 2023-11-20T06:37:39.510 INFO:teuthology.orchestra.run.smithi190.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6612-g895e5ada-1jammy [6,851 kB] 2023-11-20T06:37:39.886 INFO:teuthology.orchestra.run.smithi190.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6612-g895e5ada-1jammy [238 kB] 2023-11-20T06:37:39.902 INFO:teuthology.orchestra.run.smithi190.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6612-g895e5ada-1jammy [128 kB] 2023-11-20T06:37:39.910 INFO:teuthology.orchestra.run.smithi190.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6612-g895e5ada-1jammy [1,497 kB] 2023-11-20T06:37:40.075 INFO:teuthology.orchestra.run.smithi019.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6612-g895e5ada-1jammy [6,851 kB] 2023-11-20T06:37:40.212 INFO:teuthology.orchestra.run.smithi190.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6612-g895e5ada-1jammy [9,861 kB] 2023-11-20T06:37:40.378 INFO:teuthology.orchestra.run.smithi019.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6612-g895e5ada-1jammy [238 kB] 2023-11-20T06:37:40.383 INFO:teuthology.orchestra.run.smithi019.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6612-g895e5ada-1jammy [128 kB] 2023-11-20T06:37:40.424 INFO:teuthology.orchestra.run.smithi019.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6612-g895e5ada-1jammy [1,497 kB] 2023-11-20T06:37:40.518 INFO:teuthology.orchestra.run.smithi019.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6612-g895e5ada-1jammy [9,861 kB] 2023-11-20T06:37:40.781 INFO:teuthology.orchestra.run.smithi190.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6612-g895e5ada-1jammy [31.7 MB] 2023-11-20T06:37:41.274 INFO:teuthology.orchestra.run.smithi019.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6612-g895e5ada-1jammy [31.7 MB] 2023-11-20T06:37:43.407 INFO:teuthology.orchestra.run.smithi190.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6612-g895e5ada-1jammy [14.0 kB] 2023-11-20T06:37:43.407 INFO:teuthology.orchestra.run.smithi190.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6612-g895e5ada-1jammy [839 kB] 2023-11-20T06:37:43.527 INFO:teuthology.orchestra.run.smithi190.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6612-g895e5ada-1jammy [2,146 kB] 2023-11-20T06:37:43.583 INFO:teuthology.orchestra.run.smithi190.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6612-g895e5ada-1jammy [283 kB] 2023-11-20T06:37:43.684 INFO:teuthology.orchestra.run.smithi019.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6612-g895e5ada-1jammy [14.0 kB] 2023-11-20T06:37:43.684 INFO:teuthology.orchestra.run.smithi019.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6612-g895e5ada-1jammy [839 kB] 2023-11-20T06:37:43.705 INFO:teuthology.orchestra.run.smithi019.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6612-g895e5ada-1jammy [2,146 kB] 2023-11-20T06:37:43.747 INFO:teuthology.orchestra.run.smithi190.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6612-g895e5ada-1jammy [138 kB] 2023-11-20T06:37:43.774 INFO:teuthology.orchestra.run.smithi190.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6612-g895e5ada-1jammy [1,906 kB] 2023-11-20T06:37:43.790 INFO:teuthology.orchestra.run.smithi019.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6612-g895e5ada-1jammy [283 kB] 2023-11-20T06:37:43.813 INFO:teuthology.orchestra.run.smithi019.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6612-g895e5ada-1jammy [138 kB] 2023-11-20T06:37:43.818 INFO:teuthology.orchestra.run.smithi019.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6612-g895e5ada-1jammy [1,906 kB] 2023-11-20T06:37:43.919 INFO:teuthology.orchestra.run.smithi190.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6612-g895e5ada-1jammy [8,625 kB] 2023-11-20T06:37:43.929 INFO:teuthology.orchestra.run.smithi019.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6612-g895e5ada-1jammy [8,625 kB] 2023-11-20T06:37:44.442 INFO:teuthology.orchestra.run.smithi019.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6612-g895e5ada-1jammy [14.2 kB] 2023-11-20T06:37:44.452 INFO:teuthology.orchestra.run.smithi019.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6612-g895e5ada-1jammy [47.7 MB] 2023-11-20T06:37:44.519 INFO:teuthology.orchestra.run.smithi190.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6612-g895e5ada-1jammy [14.2 kB] 2023-11-20T06:37:44.519 INFO:teuthology.orchestra.run.smithi190.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6612-g895e5ada-1jammy [47.7 MB] 2023-11-20T06:37:49.978 INFO:teuthology.orchestra.run.smithi190.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6612-g895e5ada-1jammy [120 kB] 2023-11-20T06:37:49.979 INFO:teuthology.orchestra.run.smithi190.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-6612-g895e5ada-1jammy [227 kB] 2023-11-20T06:37:49.981 INFO:teuthology.orchestra.run.smithi190.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-6612-g895e5ada-1jammy [33.9 kB] 2023-11-20T06:37:49.982 INFO:teuthology.orchestra.run.smithi190.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-6612-g895e5ada-1jammy [23.4 kB] 2023-11-20T06:37:49.984 INFO:teuthology.orchestra.run.smithi019.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6612-g895e5ada-1jammy [120 kB] 2023-11-20T06:37:49.985 INFO:teuthology.orchestra.run.smithi019.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-6612-g895e5ada-1jammy [227 kB] 2023-11-20T06:37:49.988 INFO:teuthology.orchestra.run.smithi190.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6612-g895e5ada-1jammy [38.3 kB] 2023-11-20T06:37:49.989 INFO:teuthology.orchestra.run.smithi019.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-6612-g895e5ada-1jammy [33.9 kB] 2023-11-20T06:37:49.990 INFO:teuthology.orchestra.run.smithi019.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-6612-g895e5ada-1jammy [23.4 kB] 2023-11-20T06:37:49.991 INFO:teuthology.orchestra.run.smithi019.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6612-g895e5ada-1jammy [38.3 kB] 2023-11-20T06:37:49.992 INFO:teuthology.orchestra.run.smithi019.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6612-g895e5ada-1jammy [12.3 MB] 2023-11-20T06:37:49.993 INFO:teuthology.orchestra.run.smithi190.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6612-g895e5ada-1jammy [12.3 MB] 2023-11-20T06:37:50.781 INFO:teuthology.orchestra.run.smithi190.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6612-g895e5ada-1jammy [91.6 kB] 2023-11-20T06:37:50.804 INFO:teuthology.orchestra.run.smithi019.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6612-g895e5ada-1jammy [91.6 kB] 2023-11-20T06:37:51.353 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 184 MB in 14s (13.1 MB/s) 2023-11-20T06:37:51.400 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 184 MB in 14s (13.2 MB/s) 2023-11-20T06:37:51.500 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-20T06:37:51.555 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-20T06:37:51.569 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-20T06:37:51.573 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-20T06:37:51.615 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-20T06:37:51.626 INFO:teuthology.orchestra.run.smithi019.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-20T06:37:51.630 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-20T06:37:51.678 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-20T06:37:51.917 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-20T06:37:51.931 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-20T06:37:51.968 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-20T06:37:52.006 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-20T06:37:52.020 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-20T06:37:52.064 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-20T06:37:52.262 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cmd2. 2023-11-20T06:37:52.275 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-20T06:37:52.320 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-20T06:37:52.350 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cmd2. 2023-11-20T06:37:52.364 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-20T06:37:52.400 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-20T06:37:52.673 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libfmt8:amd64. 2023-11-20T06:37:52.686 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-11-20T06:37:52.703 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libfmt8:amd64. 2023-11-20T06:37:52.717 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-11-20T06:37:52.773 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-11-20T06:37:52.787 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-11-20T06:37:53.140 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-20T06:37:53.151 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-20T06:37:53.155 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-20T06:37:53.164 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-20T06:37:53.198 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-20T06:37:53.209 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-20T06:37:53.560 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-20T06:37:53.571 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-20T06:37:53.575 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-20T06:37:53.584 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-20T06:37:53.618 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-20T06:37:53.629 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-20T06:37:53.929 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-20T06:37:53.944 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-20T06:37:53.949 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-20T06:37:53.962 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-20T06:37:53.987 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-20T06:37:54.007 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-20T06:37:54.391 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-20T06:37:54.406 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-20T06:37:54.458 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:37:54.469 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-20T06:37:54.483 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-20T06:37:54.535 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:37:54.930 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-20T06:37:54.944 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-20T06:37:54.988 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:37:55.219 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-20T06:37:55.235 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-20T06:37:55.277 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:37:55.325 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-20T06:37:55.339 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-20T06:37:55.374 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:37:55.597 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-20T06:37:55.612 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-20T06:37:55.647 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:37:55.719 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-20T06:37:55.732 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-20T06:37:55.811 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-20T06:37:55.941 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-20T06:37:55.957 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-20T06:37:56.000 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-20T06:37:56.113 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librados2. 2023-11-20T06:37:56.127 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../011-librados2_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:37:56.338 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librados2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:37:56.357 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package librados2. 2023-11-20T06:37:56.372 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../011-librados2_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:37:56.419 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librados2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:37:56.791 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librbd1. 2023-11-20T06:37:56.804 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../012-librbd1_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:37:56.838 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package librbd1. 2023-11-20T06:37:56.849 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librbd1 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:37:56.854 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../012-librbd1_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:37:56.897 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librbd1 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:37:57.252 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcephfs2. 2023-11-20T06:37:57.265 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:37:57.274 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libcephfs2. 2023-11-20T06:37:57.290 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:37:57.302 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcephfs2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:37:57.324 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libcephfs2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:37:57.579 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rados. 2023-11-20T06:37:57.592 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../014-python3-rados_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:37:57.602 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-rados. 2023-11-20T06:37:57.617 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../014-python3-rados_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:37:57.629 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rados (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:37:57.660 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-rados (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:37:57.924 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-20T06:37:57.937 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:37:57.965 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-ceph-argparse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:37:57.971 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-20T06:37:57.987 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:37:58.029 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-ceph-argparse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:37:58.209 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cephfs. 2023-11-20T06:37:58.222 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:37:58.259 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cephfs (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:37:58.282 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cephfs. 2023-11-20T06:37:58.297 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:37:58.340 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cephfs (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:37:58.578 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-20T06:37:58.592 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:37:58.628 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-ceph-common (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:37:58.676 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-20T06:37:58.691 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:37:58.743 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-ceph-common (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:37:58.956 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-prettytable. 2023-11-20T06:37:58.970 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-11-20T06:37:59.007 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-20T06:37:59.071 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-prettytable. 2023-11-20T06:37:59.086 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-11-20T06:37:59.137 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-20T06:37:59.292 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rbd. 2023-11-20T06:37:59.305 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:37:59.342 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rbd (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:37:59.390 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-rbd. 2023-11-20T06:37:59.405 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:37:59.448 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-rbd (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:37:59.695 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-20T06:37:59.708 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-20T06:37:59.753 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-20T06:37:59.817 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-20T06:37:59.833 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-20T06:37:59.875 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-20T06:38:00.064 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librgw2. 2023-11-20T06:38:00.078 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../021-librgw2_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:00.123 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librgw2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:00.204 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package librgw2. 2023-11-20T06:38:00.219 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../021-librgw2_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:00.262 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librgw2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:00.608 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rgw. 2023-11-20T06:38:00.621 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:00.666 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rgw (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:00.714 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-rgw. 2023-11-20T06:38:00.729 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:00.772 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-rgw (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:00.986 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-20T06:38:00.999 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-20T06:38:01.044 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-20T06:38:01.083 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-20T06:38:01.099 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-20T06:38:01.133 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-20T06:38:01.381 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libradosstriper1. 2023-11-20T06:38:01.393 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:01.428 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libradosstriper1. 2023-11-20T06:38:01.438 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libradosstriper1 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:01.443 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:01.486 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libradosstriper1 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:01.866 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-common. 2023-11-20T06:38:01.880 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../025-ceph-common_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:01.906 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-common. 2023-11-20T06:38:01.921 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../025-ceph-common_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:01.924 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-common (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:01.964 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-common (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:02.980 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-base. 2023-11-20T06:38:02.995 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../026-ceph-base_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:03.040 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-base (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:03.078 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-base. 2023-11-20T06:38:03.093 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../026-ceph-base_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:03.146 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-base (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:03.701 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-20T06:38:03.714 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-20T06:38:03.759 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-20T06:38:03.849 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-20T06:38:03.863 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-20T06:38:03.907 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-20T06:38:04.070 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cheroot. 2023-11-20T06:38:04.083 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-20T06:38:04.128 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-20T06:38:04.151 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cheroot. 2023-11-20T06:38:04.166 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-20T06:38:04.209 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-20T06:38:04.448 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-20T06:38:04.462 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-20T06:38:04.506 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-20T06:38:04.538 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-20T06:38:04.553 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-20T06:38:04.587 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-20T06:38:04.842 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-20T06:38:04.856 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-20T06:38:04.881 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-20T06:38:04.897 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-20T06:38:04.901 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-20T06:38:05.090 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-20T06:38:05.195 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-20T06:38:05.210 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-20T06:38:05.253 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-20T06:38:05.376 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-20T06:38:05.392 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-20T06:38:05.434 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-20T06:38:05.573 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-tempora. 2023-11-20T06:38:05.587 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-11-20T06:38:05.631 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-20T06:38:05.762 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-tempora. 2023-11-20T06:38:05.777 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-11-20T06:38:05.820 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-20T06:38:05.934 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-portend. 2023-11-20T06:38:05.949 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-11-20T06:38:06.017 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-20T06:38:06.090 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-portend. 2023-11-20T06:38:06.105 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-11-20T06:38:06.139 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-20T06:38:06.286 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-20T06:38:06.302 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-20T06:38:06.336 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-20T06:38:06.442 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-20T06:38:06.458 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-20T06:38:06.500 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-20T06:38:06.647 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-20T06:38:06.662 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-20T06:38:06.714 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-20T06:38:06.828 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-20T06:38:06.844 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-20T06:38:06.887 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-20T06:38:07.067 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-natsort. 2023-11-20T06:38:07.085 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-11-20T06:38:07.132 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-20T06:38:07.224 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-natsort. 2023-11-20T06:38:07.241 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-11-20T06:38:07.282 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-20T06:38:07.463 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-logutils. 2023-11-20T06:38:07.477 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-11-20T06:38:07.520 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-20T06:38:07.576 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-logutils. 2023-11-20T06:38:07.592 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-11-20T06:38:07.635 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-20T06:38:07.831 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-20T06:38:07.846 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-20T06:38:07.882 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-20T06:38:07.979 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-20T06:38:07.995 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-20T06:38:08.038 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-20T06:38:08.176 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-mako. 2023-11-20T06:38:08.191 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-20T06:38:08.234 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-20T06:38:08.323 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-mako. 2023-11-20T06:38:08.339 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-20T06:38:08.374 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-20T06:38:08.562 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-20T06:38:08.577 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-20T06:38:08.620 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-20T06:38:08.676 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-20T06:38:08.692 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-20T06:38:08.726 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-20T06:38:08.948 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-20T06:38:08.963 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-20T06:38:09.006 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-20T06:38:09.054 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-20T06:38:09.070 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-20T06:38:09.112 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-20T06:38:09.292 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-webob. 2023-11-20T06:38:09.307 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-20T06:38:09.383 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-20T06:38:09.415 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-webob. 2023-11-20T06:38:09.430 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-20T06:38:09.473 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-20T06:38:09.695 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-waitress. 2023-11-20T06:38:09.717 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-20T06:38:10.356 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-20T06:38:10.451 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-waitress. 2023-11-20T06:38:10.467 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-20T06:38:10.512 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-20T06:38:10.614 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-tempita. 2023-11-20T06:38:10.629 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-20T06:38:10.681 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-20T06:38:10.804 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-tempita. 2023-11-20T06:38:10.819 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-20T06:38:10.862 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-20T06:38:11.017 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-paste. 2023-11-20T06:38:11.032 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-20T06:38:11.075 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-20T06:38:11.148 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-paste. 2023-11-20T06:38:11.164 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-20T06:38:11.206 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-20T06:38:11.362 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-20T06:38:11.376 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-20T06:38:11.411 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-20T06:38:11.551 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-20T06:38:11.567 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-20T06:38:11.609 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-20T06:38:11.714 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-20T06:38:11.729 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-20T06:38:11.772 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-20T06:38:11.896 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-20T06:38:11.911 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-20T06:38:11.954 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-20T06:38:12.076 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-webtest. 2023-11-20T06:38:12.090 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-11-20T06:38:12.133 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-20T06:38:12.240 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-webtest. 2023-11-20T06:38:12.255 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-11-20T06:38:12.298 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-20T06:38:12.411 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pecan. 2023-11-20T06:38:12.426 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-20T06:38:12.461 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-20T06:38:12.609 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pecan. 2023-11-20T06:38:12.624 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-20T06:38:12.692 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-20T06:38:12.791 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-certifi. 2023-11-20T06:38:12.805 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-11-20T06:38:12.841 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-20T06:38:13.033 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-certifi. 2023-11-20T06:38:13.048 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-11-20T06:38:13.091 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-20T06:38:13.185 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-idna. 2023-11-20T06:38:13.200 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-11-20T06:38:13.243 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-20T06:38:13.418 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-idna. 2023-11-20T06:38:13.434 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-11-20T06:38:13.477 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-20T06:38:13.571 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-urllib3. 2023-11-20T06:38:13.586 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-20T06:38:13.629 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-20T06:38:13.780 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-urllib3. 2023-11-20T06:38:13.795 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-20T06:38:13.855 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-20T06:38:13.983 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-requests. 2023-11-20T06:38:13.997 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-20T06:38:14.041 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-20T06:38:14.166 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-requests. 2023-11-20T06:38:14.182 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-20T06:38:14.225 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-20T06:38:14.385 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-20T06:38:14.400 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-20T06:38:14.443 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-20T06:38:14.502 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-20T06:38:14.518 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-20T06:38:14.552 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-20T06:38:14.729 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-20T06:38:14.744 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:38:14.787 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:14.856 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-20T06:38:14.871 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:38:14.914 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:15.151 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-20T06:38:15.165 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:15.201 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:15.444 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-20T06:38:15.459 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:15.502 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:15.503 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-openssl. 2023-11-20T06:38:15.517 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-11-20T06:38:15.561 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-20T06:38:15.805 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-openssl. 2023-11-20T06:38:15.820 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-11-20T06:38:15.863 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-20T06:38:15.906 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr. 2023-11-20T06:38:15.920 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:15.964 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:16.224 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr. 2023-11-20T06:38:16.240 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:16.274 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:16.334 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mon. 2023-11-20T06:38:16.348 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:16.408 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mon (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:16.594 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mon. 2023-11-20T06:38:16.610 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:16.652 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mon (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:17.212 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-osd. 2023-11-20T06:38:17.227 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:17.270 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-osd (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:17.473 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-osd. 2023-11-20T06:38:17.488 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:17.531 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-osd (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:18.574 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph. 2023-11-20T06:38:18.589 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../061-ceph_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:18.632 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:18.709 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph. 2023-11-20T06:38:18.725 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../061-ceph_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:18.759 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:18.977 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-fuse. 2023-11-20T06:38:18.991 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:19.028 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-fuse. 2023-11-20T06:38:19.034 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-fuse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:19.044 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:19.086 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-fuse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:19.421 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mds. 2023-11-20T06:38:19.436 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:19.448 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mds. 2023-11-20T06:38:19.464 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:19.479 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mds (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:19.506 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mds (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:19.824 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephadm. 2023-11-20T06:38:19.839 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../064-cephadm_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:19.882 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephadm (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:19.909 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package cephadm. 2023-11-20T06:38:19.925 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../064-cephadm_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:19.968 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking cephadm (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:20.219 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-20T06:38:20.233 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-20T06:38:20.246 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-20T06:38:20.261 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-20T06:38:20.276 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-20T06:38:20.296 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-20T06:38:20.538 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-20T06:38:20.552 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-20T06:38:20.596 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-20T06:38:20.607 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-20T06:38:20.623 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-20T06:38:20.657 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-20T06:38:21.595 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-babel. 2023-11-20T06:38:21.610 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-20T06:38:21.645 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-20T06:38:21.651 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-babel. 2023-11-20T06:38:21.665 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-20T06:38:21.700 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-20T06:38:21.924 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-jinja2. 2023-11-20T06:38:21.938 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-11-20T06:38:21.998 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-20T06:38:22.278 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jinja2. 2023-11-20T06:38:22.293 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-11-20T06:38:22.319 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-20T06:38:22.334 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:38:22.337 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-20T06:38:22.368 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:22.665 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-20T06:38:22.679 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:38:22.723 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:22.731 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-20T06:38:22.746 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-20T06:38:22.789 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-20T06:38:23.076 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-20T06:38:23.091 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-20T06:38:23.092 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-20T06:38:23.108 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-11-20T06:38:23.135 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-20T06:38:23.166 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-20T06:38:23.469 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-routes. 2023-11-20T06:38:23.470 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-20T06:38:23.485 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-20T06:38:23.485 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-11-20T06:38:23.528 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-20T06:38:23.528 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-20T06:38:23.832 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-routes. 2023-11-20T06:38:23.846 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-20T06:38:23.848 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-20T06:38:23.863 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:38:23.881 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-20T06:38:23.906 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:24.227 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-20T06:38:24.241 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:38:24.285 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:24.326 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-20T06:38:24.341 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-20T06:38:24.384 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-20T06:38:24.696 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-20T06:38:24.710 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-20T06:38:24.754 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-20T06:38:24.880 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-joblib. 2023-11-20T06:38:24.895 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-20T06:38:24.947 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-20T06:38:25.242 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-joblib. 2023-11-20T06:38:25.255 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-20T06:38:25.299 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-20T06:38:25.342 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-20T06:38:25.357 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-20T06:38:25.439 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-20T06:38:25.686 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-20T06:38:25.700 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-20T06:38:25.728 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-sklearn. 2023-11-20T06:38:25.744 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-20T06:38:25.744 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-20T06:38:25.777 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-20T06:38:26.089 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-sklearn. 2023-11-20T06:38:26.103 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-20T06:38:26.164 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-20T06:38:26.487 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-20T06:38:26.502 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:38:26.545 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:26.832 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-20T06:38:26.847 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:38:27.024 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:27.474 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cachetools. 2023-11-20T06:38:27.490 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-11-20T06:38:27.524 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-20T06:38:27.851 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-20T06:38:27.867 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-20T06:38:27.910 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-20T06:38:28.053 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cachetools. 2023-11-20T06:38:28.068 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-11-20T06:38:28.102 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-20T06:38:28.221 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-20T06:38:28.238 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-20T06:38:28.279 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-20T06:38:28.564 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-20T06:38:28.566 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-rsa. 2023-11-20T06:38:28.579 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-20T06:38:28.581 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-11-20T06:38:28.615 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-20T06:38:28.621 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-20T06:38:28.975 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-20T06:38:28.990 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-20T06:38:29.021 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-google-auth. 2023-11-20T06:38:29.033 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-20T06:38:29.037 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-11-20T06:38:29.079 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-20T06:38:29.336 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rsa. 2023-11-20T06:38:29.351 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-11-20T06:38:29.394 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-20T06:38:29.399 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-20T06:38:29.416 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-20T06:38:29.457 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-20T06:38:29.719 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-websocket. 2023-11-20T06:38:29.735 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-11-20T06:38:29.769 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-20T06:38:29.774 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-google-auth. 2023-11-20T06:38:29.789 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-11-20T06:38:29.823 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-20T06:38:30.089 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-20T06:38:30.105 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-20T06:38:30.143 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-20T06:38:30.149 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-20T06:38:30.159 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-20T06:38:30.193 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-20T06:38:30.488 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-websocket. 2023-11-20T06:38:30.503 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-11-20T06:38:30.546 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-20T06:38:30.866 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-20T06:38:30.881 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-20T06:38:30.924 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-20T06:38:31.094 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-20T06:38:31.109 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:38:31.161 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:31.488 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-20T06:38:31.504 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-20T06:38:31.547 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-20T06:38:31.596 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-20T06:38:31.611 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:38:31.679 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:31.875 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-20T06:38:31.891 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-20T06:38:31.933 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-20T06:38:31.998 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-20T06:38:32.012 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-20T06:38:32.056 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-20T06:38:32.178 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package jq. 2023-11-20T06:38:32.193 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-20T06:38:32.236 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-20T06:38:32.376 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-20T06:38:32.390 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-20T06:38:32.426 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-20T06:38:32.513 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package socat. 2023-11-20T06:38:32.529 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-20T06:38:32.563 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-20T06:38:32.679 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package jq. 2023-11-20T06:38:32.693 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-20T06:38:32.737 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-20T06:38:32.834 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package xmlstarlet. 2023-11-20T06:38:32.850 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-20T06:38:32.891 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-20T06:38:33.014 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package socat. 2023-11-20T06:38:33.028 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-20T06:38:33.073 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-20T06:38:33.246 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-test. 2023-11-20T06:38:33.261 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../093-ceph-test_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:33.304 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-test (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:33.359 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package xmlstarlet. 2023-11-20T06:38:33.373 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-20T06:38:33.417 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-20T06:38:33.796 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-test. 2023-11-20T06:38:33.810 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../093-ceph-test_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:33.846 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-test (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:35.083 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-volume. 2023-11-20T06:38:35.099 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:38:35.141 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-volume (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:35.521 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-20T06:38:35.536 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:35.579 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking cephfs-mirror (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:35.700 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-volume. 2023-11-20T06:38:35.717 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:38:35.758 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-volume (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:36.088 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-colorama. 2023-11-20T06:38:36.096 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-20T06:38:36.104 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-11-20T06:38:36.110 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:36.141 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-20T06:38:36.162 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephfs-mirror (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:36.376 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package cephfs-shell. 2023-11-20T06:38:36.392 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:38:36.435 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking cephfs-shell (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:36.474 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-colorama. 2023-11-20T06:38:36.489 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-11-20T06:38:36.532 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-20T06:38:36.688 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package cephfs-top. 2023-11-20T06:38:36.704 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:38:36.745 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking cephfs-top (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:36.826 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephfs-shell. 2023-11-20T06:38:36.842 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:38:36.884 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephfs-shell (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:36.982 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-20T06:38:36.998 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:37.040 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libcephfs-dev (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:37.145 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephfs-top. 2023-11-20T06:38:37.160 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:38:37.204 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephfs-top (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:37.393 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package nvme-cli. 2023-11-20T06:38:37.409 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-20T06:38:37.414 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-20T06:38:37.429 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:37.443 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-20T06:38:37.493 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcephfs-dev (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:37.748 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-20T06:38:37.764 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-20T06:38:37.806 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-20T06:38:37.867 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package nvme-cli. 2023-11-20T06:38:37.883 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-20T06:38:37.925 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-20T06:38:38.210 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-20T06:38:38.226 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-20T06:38:38.268 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-20T06:38:38.281 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-20T06:38:38.296 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-20T06:38:38.340 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-20T06:38:38.596 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pastescript. 2023-11-20T06:38:38.613 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-11-20T06:38:38.654 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-20T06:38:38.766 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-20T06:38:38.781 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-20T06:38:38.850 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-20T06:38:38.974 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pluggy. 2023-11-20T06:38:38.998 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-20T06:38:39.041 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-20T06:38:39.161 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pastescript. 2023-11-20T06:38:39.175 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-11-20T06:38:39.219 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-20T06:38:39.361 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-psutil. 2023-11-20T06:38:39.376 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-20T06:38:39.418 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-20T06:38:39.564 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pluggy. 2023-11-20T06:38:39.578 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-20T06:38:39.622 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-20T06:38:39.780 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-py. 2023-11-20T06:38:39.796 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-11-20T06:38:39.838 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-20T06:38:39.949 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-psutil. 2023-11-20T06:38:39.964 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-20T06:38:39.999 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-20T06:38:40.166 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pygments. 2023-11-20T06:38:40.182 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-20T06:38:40.224 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-20T06:38:40.352 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-py. 2023-11-20T06:38:40.367 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-11-20T06:38:40.411 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-20T06:38:40.712 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-20T06:38:40.727 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-20T06:38:40.738 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pygments. 2023-11-20T06:38:40.753 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-20T06:38:40.770 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-20T06:38:40.797 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-20T06:38:41.064 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-toml. 2023-11-20T06:38:41.081 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-11-20T06:38:41.122 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-20T06:38:41.251 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-20T06:38:41.265 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-20T06:38:41.309 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-20T06:38:41.384 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pytest. 2023-11-20T06:38:41.400 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-20T06:38:41.434 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-20T06:38:41.645 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-toml. 2023-11-20T06:38:41.660 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-11-20T06:38:41.703 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-20T06:38:41.787 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-simplejson. 2023-11-20T06:38:41.804 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-20T06:38:41.870 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-20T06:38:41.989 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pytest. 2023-11-20T06:38:42.003 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-20T06:38:42.047 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-20T06:38:42.148 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-20T06:38:42.164 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-20T06:38:42.215 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-20T06:38:42.684 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-simplejson. 2023-11-20T06:38:42.698 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-20T06:38:42.742 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-20T06:38:42.969 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package radosgw. 2023-11-20T06:38:42.984 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../113-radosgw_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:43.036 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-20T06:38:43.043 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking radosgw (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:43.051 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-20T06:38:43.095 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-20T06:38:43.613 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package rbd-fuse. 2023-11-20T06:38:43.629 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:43.671 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking rbd-fuse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:43.873 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package radosgw. 2023-11-20T06:38:43.888 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../113-radosgw_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:43.931 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking radosgw (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:43.950 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-20T06:38:44.227 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-20T06:38:44.361 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-20T06:38:44.510 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package rbd-fuse. 2023-11-20T06:38:44.524 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:38:44.568 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking rbd-fuse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:44.628 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-20T06:38:44.852 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-20T06:38:45.053 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-20T06:38:45.148 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-20T06:38:45.273 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-20T06:38:45.535 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-20T06:38:45.672 INFO:teuthology.orchestra.run.smithi019.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-20T06:38:45.721 INFO:teuthology.orchestra.run.smithi019.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-20T06:38:45.763 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up cephadm (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:45.933 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-20T06:38:46.333 INFO:teuthology.orchestra.run.smithi019.stdout:Adding system user cephadm....done 2023-11-20T06:38:46.527 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-20T06:38:46.554 INFO:teuthology.orchestra.run.smithi190.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-20T06:38:46.604 INFO:teuthology.orchestra.run.smithi190.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-20T06:38:46.659 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephadm (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:46.812 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-20T06:38:47.088 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-20T06:38:47.214 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-20T06:38:47.489 INFO:teuthology.orchestra.run.smithi190.stdout:Adding system user cephadm....done 2023-11-20T06:38:47.490 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-20T06:38:47.674 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-20T06:38:47.767 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-20T06:38:47.918 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-20T06:38:47.966 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-20T06:38:48.226 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-20T06:38:48.253 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-20T06:38:48.386 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-20T06:38:48.630 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-20T06:38:48.645 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-20T06:38:48.906 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-20T06:38:48.913 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-20T06:38:49.064 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-20T06:38:49.183 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-20T06:38:49.382 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-20T06:38:49.475 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-20T06:38:49.750 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-20T06:38:49.777 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-20T06:38:50.019 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-20T06:38:50.069 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-20T06:38:50.286 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-20T06:38:50.337 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-ceph-argparse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:50.604 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-20T06:38:50.613 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-20T06:38:50.739 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-20T06:38:50.980 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-20T06:38:51.007 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-20T06:38:51.273 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-20T06:38:51.500 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-20T06:38:51.574 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-ceph-argparse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:51.609 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-20T06:38:51.841 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-20T06:38:51.959 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-20T06:38:51.977 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-20T06:38:52.103 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-20T06:38:52.227 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-20T06:38:52.379 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-20T06:38:52.486 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-20T06:38:52.612 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-20T06:38:52.655 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-20T06:38:52.980 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-20T06:38:52.982 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-20T06:38:53.131 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-20T06:38:53.415 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-20T06:38:53.691 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-20T06:38:53.709 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-20T06:38:53.977 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-20T06:38:54.043 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-20T06:38:54.111 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-20T06:38:54.237 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-20T06:38:54.563 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-20T06:38:54.728 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-20T06:38:54.981 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-20T06:38:54.995 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-20T06:38:55.155 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-20T06:38:55.249 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-20T06:38:55.280 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-20T06:38:55.598 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-20T06:38:55.693 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-20T06:38:56.000 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-20T06:38:56.019 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-20T06:38:56.242 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-20T06:38:56.345 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-20T06:38:56.627 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-20T06:38:56.704 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-20T06:38:56.928 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-20T06:38:56.972 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-20T06:38:57.100 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-ceph-common (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:57.246 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-20T06:38:57.418 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-idna (3.3-1) ... 2023-11-20T06:38:57.597 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-20T06:38:57.770 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-20T06:38:58.098 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-20T06:38:58.224 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-ceph-common (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:38:58.543 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-idna (3.3-1) ... 2023-11-20T06:38:58.885 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-20T06:38:59.059 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:38:59.193 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-20T06:38:59.469 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-20T06:38:59.595 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-20T06:38:59.721 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-20T06:39:00.031 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-20T06:39:00.108 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:39:00.216 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-20T06:39:00.324 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-20T06:39:00.476 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-20T06:39:00.591 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:39:00.602 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-20T06:39:00.728 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-20T06:39:00.742 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-11-20T06:39:00.886 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-20T06:39:01.029 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-20T06:39:01.212 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-20T06:39:01.322 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-20T06:39:01.480 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-20T06:39:01.581 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:39:01.707 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-11-20T06:39:01.756 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-20T06:39:01.849 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-20T06:39:02.031 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-20T06:39:02.151 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-20T06:39:02.308 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-20T06:39:02.410 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-20T06:39:02.617 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-20T06:39:02.712 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-20T06:39:02.768 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-20T06:39:02.979 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-20T06:39:03.069 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-20T06:39:03.195 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-20T06:39:03.247 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-20T06:39:03.497 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-20T06:39:03.523 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-20T06:39:03.649 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-20T06:39:03.814 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-20T06:39:03.933 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-20T06:39:04.068 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-20T06:39:04.098 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-20T06:39:04.369 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-20T06:39:04.529 INFO:teuthology.orchestra.run.smithi019.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-20T06:39:04.695 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-20T06:39:04.793 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-20T06:39:04.944 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-20T06:39:04.962 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-20T06:39:05.354 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-20T06:39:05.362 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-20T06:39:05.631 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-20T06:39:05.648 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-20T06:39:05.791 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-20T06:39:05.906 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:39:06.032 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-20T06:39:06.193 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-20T06:39:06.384 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-20T06:39:06.460 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-20T06:39:06.736 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:39:06.826 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-20T06:39:06.863 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-20T06:39:07.127 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-20T06:39:07.206 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-20T06:39:07.278 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-20T06:39:07.514 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-20T06:39:07.563 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-20T06:39:07.790 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-20T06:39:07.848 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-20T06:39:07.925 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-20T06:39:08.132 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-20T06:39:08.201 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-20T06:39:08.478 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-20T06:39:08.525 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-20T06:39:08.762 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-20T06:39:08.810 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-20T06:39:09.149 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-20T06:39:09.179 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-20T06:39:09.305 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librados2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:09.431 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librgw2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:09.473 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-20T06:39:09.651 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:09.760 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libcephfs2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:09.825 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-20T06:39:09.886 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libradosstriper1 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:09.959 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librados2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:10.012 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-20T06:39:10.086 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librgw2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:10.288 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:10.314 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librbd1 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:10.414 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcephfs2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:10.457 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-modules-core (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:10.573 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libradosstriper1 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:10.582 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-fuse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:10.691 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-20T06:39:10.823 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-20T06:39:10.823 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-20T06:39:10.960 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librbd1 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:11.086 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-modules-core (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:11.237 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-fuse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:11.447 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-20T06:39:11.447 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-20T06:39:11.467 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libcephfs-dev (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:11.618 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-rados (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:11.744 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up cephfs-top (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:11.904 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-20T06:39:12.113 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcephfs-dev (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:12.239 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rados (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:12.365 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephfs-top (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:12.482 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-20T06:39:13.258 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-rbd (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:13.367 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up rbd-fuse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:13.485 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-rgw (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:13.611 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cephfs (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:13.737 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up cephfs-shell (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:13.762 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rbd (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:13.863 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-common (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:13.913 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up rbd-fuse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:14.039 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rgw (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:14.165 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cephfs (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:14.291 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephfs-shell (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:14.392 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-common (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:14.484 INFO:teuthology.orchestra.run.smithi019.stdout:Adding group ceph....done 2023-11-20T06:39:14.826 INFO:teuthology.orchestra.run.smithi019.stdout:Adding system user ceph....done 2023-11-20T06:39:14.962 INFO:teuthology.orchestra.run.smithi190.stdout:Adding group ceph....done 2023-11-20T06:39:14.979 INFO:teuthology.orchestra.run.smithi019.stdout:Setting system user ceph properties....done 2023-11-20T06:39:14.999 INFO:teuthology.orchestra.run.smithi019.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-20T06:39:15.152 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-20T06:39:15.329 INFO:teuthology.orchestra.run.smithi190.stdout:Adding system user ceph....done 2023-11-20T06:39:15.507 INFO:teuthology.orchestra.run.smithi190.stdout:Setting system user ceph properties....done 2023-11-20T06:39:15.525 INFO:teuthology.orchestra.run.smithi190.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-20T06:39:15.556 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-20T06:39:15.667 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-20T06:39:16.077 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-20T06:39:16.415 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up cephfs-mirror (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:16.650 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-20T06:39:16.650 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-20T06:39:16.770 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephfs-mirror (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:16.978 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-20T06:39:16.979 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-20T06:39:17.362 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-test (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:17.488 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up radosgw (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:17.654 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-test (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:17.780 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up radosgw (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:18.079 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-20T06:39:18.079 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-20T06:39:18.341 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-20T06:39:18.341 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-20T06:39:18.791 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-base (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:18.990 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-base (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:19.158 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-20T06:39:19.315 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-20T06:39:19.963 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mds (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:19.967 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mds (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:20.190 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-20T06:39:20.190 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-20T06:39:20.235 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-20T06:39:20.235 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-20T06:39:20.801 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:20.895 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:21.023 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-20T06:39:21.023 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-20T06:39:21.115 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-20T06:39:21.115 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-20T06:39:21.686 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-osd (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:21.813 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-osd (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:22.002 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-20T06:39:22.003 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-20T06:39:22.176 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-20T06:39:22.176 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-20T06:39:22.646 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:22.764 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:22.848 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:22.915 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mon (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:22.974 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:23.117 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-20T06:39:23.117 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-20T06:39:23.142 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mon (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:23.378 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-20T06:39:23.379 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-20T06:39:23.767 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-cephadm (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:23.909 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:24.035 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-cephadm (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:24.077 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-dashboard (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:24.178 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:24.220 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-volume (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:24.304 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-dashboard (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:24.455 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-volume (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:39:24.572 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-20T06:39:24.842 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-20T06:39:25.583 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-20T06:39:25.748 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-20T06:39:26.101 INFO:teuthology.orchestra.run.smithi019.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-20T06:39:26.106 DEBUG:teuthology.orchestra.run.smithi019:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-20T06:39:26.184 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2023-11-20T06:39:26.220 INFO:teuthology.orchestra.run.smithi190.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-20T06:39:26.225 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-20T06:39:26.300 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2023-11-20T06:39:26.355 INFO:teuthology.orchestra.run.smithi019.stdout:Building dependency tree... 2023-11-20T06:39:26.356 INFO:teuthology.orchestra.run.smithi019.stdout:Reading state information... 2023-11-20T06:39:26.466 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2023-11-20T06:39:26.467 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2023-11-20T06:39:26.511 INFO:teuthology.orchestra.run.smithi019.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-20T06:39:26.511 INFO:teuthology.orchestra.run.smithi019.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-20T06:39:26.511 INFO:teuthology.orchestra.run.smithi019.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-20T06:39:26.511 INFO:teuthology.orchestra.run.smithi019.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-20T06:39:26.511 INFO:teuthology.orchestra.run.smithi019.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-20T06:39:26.512 INFO:teuthology.orchestra.run.smithi019.stdout:The following packages were automatically installed and are no longer required: 2023-11-20T06:39:26.512 INFO:teuthology.orchestra.run.smithi019.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-20T06:39:26.512 INFO:teuthology.orchestra.run.smithi019.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-20T06:39:26.512 INFO:teuthology.orchestra.run.smithi019.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-20T06:39:26.513 INFO:teuthology.orchestra.run.smithi019.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-20T06:39:26.514 INFO:teuthology.orchestra.run.smithi019.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-20T06:39:26.514 INFO:teuthology.orchestra.run.smithi019.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-20T06:39:26.514 INFO:teuthology.orchestra.run.smithi019.stdout:The following additional packages will be installed: 2023-11-20T06:39:26.514 INFO:teuthology.orchestra.run.smithi019.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-20T06:39:26.514 INFO:teuthology.orchestra.run.smithi019.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-20T06:39:26.515 INFO:teuthology.orchestra.run.smithi019.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-20T06:39:26.515 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-20T06:39:26.515 INFO:teuthology.orchestra.run.smithi019.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-20T06:39:26.516 INFO:teuthology.orchestra.run.smithi019.stdout:Suggested packages: 2023-11-20T06:39:26.516 INFO:teuthology.orchestra.run.smithi019.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-20T06:39:26.516 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-20T06:39:26.516 INFO:teuthology.orchestra.run.smithi019.stdout: libengine-pkcs11-openssl 2023-11-20T06:39:26.565 INFO:teuthology.orchestra.run.smithi019.stdout:The following NEW packages will be installed: 2023-11-20T06:39:26.566 INFO:teuthology.orchestra.run.smithi019.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-20T06:39:26.566 INFO:teuthology.orchestra.run.smithi019.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-20T06:39:26.566 INFO:teuthology.orchestra.run.smithi019.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-20T06:39:26.566 INFO:teuthology.orchestra.run.smithi019.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-20T06:39:26.567 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-20T06:39:26.567 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-20T06:39:26.567 INFO:teuthology.orchestra.run.smithi019.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-20T06:39:26.568 INFO:teuthology.orchestra.run.smithi019.stdout:The following packages will be upgraded: 2023-11-20T06:39:26.568 INFO:teuthology.orchestra.run.smithi019.stdout: libssl3 2023-11-20T06:39:26.615 INFO:teuthology.orchestra.run.smithi190.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-20T06:39:26.616 INFO:teuthology.orchestra.run.smithi190.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-20T06:39:26.616 INFO:teuthology.orchestra.run.smithi190.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-20T06:39:26.616 INFO:teuthology.orchestra.run.smithi190.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-20T06:39:26.616 INFO:teuthology.orchestra.run.smithi190.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-20T06:39:26.616 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2023-11-20T06:39:26.616 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-20T06:39:26.617 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-20T06:39:26.617 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-20T06:39:26.617 INFO:teuthology.orchestra.run.smithi190.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-20T06:39:26.617 INFO:teuthology.orchestra.run.smithi190.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-20T06:39:26.617 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-20T06:39:26.618 INFO:teuthology.orchestra.run.smithi190.stdout:The following additional packages will be installed: 2023-11-20T06:39:26.619 INFO:teuthology.orchestra.run.smithi190.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-20T06:39:26.619 INFO:teuthology.orchestra.run.smithi190.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-20T06:39:26.619 INFO:teuthology.orchestra.run.smithi190.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-20T06:39:26.619 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-20T06:39:26.619 INFO:teuthology.orchestra.run.smithi190.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-20T06:39:26.619 INFO:teuthology.orchestra.run.smithi190.stdout:Suggested packages: 2023-11-20T06:39:26.619 INFO:teuthology.orchestra.run.smithi190.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-20T06:39:26.620 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-20T06:39:26.620 INFO:teuthology.orchestra.run.smithi190.stdout: libengine-pkcs11-openssl 2023-11-20T06:39:26.644 INFO:teuthology.orchestra.run.smithi019.stdout:1 upgraded, 39 newly installed, 0 to remove and 262 not upgraded. 2023-11-20T06:39:26.644 INFO:teuthology.orchestra.run.smithi019.stdout:Need to get 54.6 MB of archives. 2023-11-20T06:39:26.644 INFO:teuthology.orchestra.run.smithi019.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-20T06:39:26.645 INFO:teuthology.orchestra.run.smithi019.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-20T06:39:26.668 INFO:teuthology.orchestra.run.smithi190.stdout:The following NEW packages will be installed: 2023-11-20T06:39:26.668 INFO:teuthology.orchestra.run.smithi190.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-20T06:39:26.668 INFO:teuthology.orchestra.run.smithi190.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-20T06:39:26.669 INFO:teuthology.orchestra.run.smithi190.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-20T06:39:26.669 INFO:teuthology.orchestra.run.smithi190.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-20T06:39:26.669 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-20T06:39:26.670 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-20T06:39:26.670 INFO:teuthology.orchestra.run.smithi190.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-20T06:39:26.670 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages will be upgraded: 2023-11-20T06:39:26.671 INFO:teuthology.orchestra.run.smithi190.stdout: libssl3 2023-11-20T06:39:26.727 INFO:teuthology.orchestra.run.smithi190.stdout:1 upgraded, 39 newly installed, 0 to remove and 262 not upgraded. 2023-11-20T06:39:26.727 INFO:teuthology.orchestra.run.smithi190.stdout:Need to get 54.6 MB of archives. 2023-11-20T06:39:26.727 INFO:teuthology.orchestra.run.smithi190.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-20T06:39:26.728 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-20T06:39:26.745 INFO:teuthology.orchestra.run.smithi019.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-20T06:39:26.802 INFO:teuthology.orchestra.run.smithi019.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-20T06:39:26.814 INFO:teuthology.orchestra.run.smithi019.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-20T06:39:26.815 INFO:teuthology.orchestra.run.smithi019.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-20T06:39:26.817 INFO:teuthology.orchestra.run.smithi019.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-20T06:39:26.818 INFO:teuthology.orchestra.run.smithi019.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-20T06:39:26.818 INFO:teuthology.orchestra.run.smithi019.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-20T06:39:26.820 INFO:teuthology.orchestra.run.smithi019.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-20T06:39:26.820 INFO:teuthology.orchestra.run.smithi019.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-20T06:39:26.821 INFO:teuthology.orchestra.run.smithi019.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-20T06:39:26.821 INFO:teuthology.orchestra.run.smithi019.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-20T06:39:26.829 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-20T06:39:26.838 INFO:teuthology.orchestra.run.smithi019.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-20T06:39:26.883 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-20T06:39:26.891 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-20T06:39:26.891 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-20T06:39:26.893 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-20T06:39:26.894 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-20T06:39:26.895 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-20T06:39:26.896 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-20T06:39:26.897 INFO:teuthology.orchestra.run.smithi190.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-20T06:39:26.897 INFO:teuthology.orchestra.run.smithi190.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-20T06:39:26.902 INFO:teuthology.orchestra.run.smithi190.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-20T06:39:26.914 INFO:teuthology.orchestra.run.smithi190.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-20T06:39:27.056 INFO:teuthology.orchestra.run.smithi019.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-20T06:39:27.058 INFO:teuthology.orchestra.run.smithi019.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-20T06:39:27.058 INFO:teuthology.orchestra.run.smithi019.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-20T06:39:27.061 INFO:teuthology.orchestra.run.smithi019.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-20T06:39:27.061 INFO:teuthology.orchestra.run.smithi019.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-20T06:39:27.066 INFO:teuthology.orchestra.run.smithi019.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-20T06:39:27.067 INFO:teuthology.orchestra.run.smithi019.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-20T06:39:27.075 INFO:teuthology.orchestra.run.smithi019.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-20T06:39:27.075 INFO:teuthology.orchestra.run.smithi019.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-20T06:39:27.097 INFO:teuthology.orchestra.run.smithi019.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-20T06:39:27.097 INFO:teuthology.orchestra.run.smithi019.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-20T06:39:27.107 INFO:teuthology.orchestra.run.smithi019.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-20T06:39:27.122 INFO:teuthology.orchestra.run.smithi190.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-20T06:39:27.124 INFO:teuthology.orchestra.run.smithi190.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-20T06:39:27.125 INFO:teuthology.orchestra.run.smithi190.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-20T06:39:27.127 INFO:teuthology.orchestra.run.smithi190.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-20T06:39:27.128 INFO:teuthology.orchestra.run.smithi190.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-20T06:39:27.128 INFO:teuthology.orchestra.run.smithi019.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-20T06:39:27.132 INFO:teuthology.orchestra.run.smithi019.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-20T06:39:27.132 INFO:teuthology.orchestra.run.smithi190.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-20T06:39:27.132 INFO:teuthology.orchestra.run.smithi019.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-20T06:39:27.133 INFO:teuthology.orchestra.run.smithi019.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-20T06:39:27.133 INFO:teuthology.orchestra.run.smithi019.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-20T06:39:27.134 INFO:teuthology.orchestra.run.smithi190.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-20T06:39:27.141 INFO:teuthology.orchestra.run.smithi190.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-20T06:39:27.141 INFO:teuthology.orchestra.run.smithi190.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-20T06:39:27.145 INFO:teuthology.orchestra.run.smithi019.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-20T06:39:27.147 INFO:teuthology.orchestra.run.smithi019.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-20T06:39:27.162 INFO:teuthology.orchestra.run.smithi190.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-20T06:39:27.162 INFO:teuthology.orchestra.run.smithi190.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-20T06:39:27.172 INFO:teuthology.orchestra.run.smithi190.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-20T06:39:27.192 INFO:teuthology.orchestra.run.smithi190.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-20T06:39:27.195 INFO:teuthology.orchestra.run.smithi190.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-20T06:39:27.196 INFO:teuthology.orchestra.run.smithi190.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-20T06:39:27.197 INFO:teuthology.orchestra.run.smithi190.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-20T06:39:27.197 INFO:teuthology.orchestra.run.smithi190.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-20T06:39:27.208 INFO:teuthology.orchestra.run.smithi190.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-20T06:39:27.210 INFO:teuthology.orchestra.run.smithi190.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-20T06:39:27.294 INFO:teuthology.orchestra.run.smithi019.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-20T06:39:27.294 INFO:teuthology.orchestra.run.smithi019.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-20T06:39:27.295 INFO:teuthology.orchestra.run.smithi019.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-20T06:39:27.295 INFO:teuthology.orchestra.run.smithi019.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-20T06:39:27.296 INFO:teuthology.orchestra.run.smithi019.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-20T06:39:27.296 INFO:teuthology.orchestra.run.smithi019.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-20T06:39:27.308 INFO:teuthology.orchestra.run.smithi019.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-20T06:39:27.309 INFO:teuthology.orchestra.run.smithi019.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-20T06:39:27.352 INFO:teuthology.orchestra.run.smithi190.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-20T06:39:27.352 INFO:teuthology.orchestra.run.smithi190.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-20T06:39:27.352 INFO:teuthology.orchestra.run.smithi190.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-20T06:39:27.353 INFO:teuthology.orchestra.run.smithi190.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-20T06:39:27.353 INFO:teuthology.orchestra.run.smithi190.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-20T06:39:27.353 INFO:teuthology.orchestra.run.smithi190.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-20T06:39:27.366 INFO:teuthology.orchestra.run.smithi190.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-20T06:39:27.366 INFO:teuthology.orchestra.run.smithi190.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-20T06:39:27.702 INFO:teuthology.orchestra.run.smithi019.stdout:Preconfiguring packages ... 2023-11-20T06:39:27.744 INFO:teuthology.orchestra.run.smithi190.stdout:Preconfiguring packages ... 2023-11-20T06:39:27.857 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 54.6 MB in 1s (74.4 MB/s) 2023-11-20T06:39:27.920 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 54.6 MB in 1s (79.3 MB/s) 2023-11-20T06:39:28.032 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package flex. 2023-11-20T06:39:28.104 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package flex. 2023-11-20T06:39:28.108 INFO:teuthology.orchestra.run.smithi019.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139849 files and directories currently installed.) 2023-11-20T06:39:28.112 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-20T06:39:28.155 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-20T06:39:28.176 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139849 files and directories currently installed.) 2023-11-20T06:39:28.180 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-20T06:39:28.219 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-20T06:39:28.717 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-20T06:39:28.894 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-20T06:39:29.182 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-20T06:39:29.295 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-20T06:39:29.359 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-20T06:39:29.790 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-20T06:39:29.836 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package bison. 2023-11-20T06:39:29.912 INFO:teuthology.orchestra.run.smithi019.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139922 files and directories currently installed.) 2023-11-20T06:39:29.916 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-20T06:39:29.964 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-20T06:39:30.359 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package bison. 2023-11-20T06:39:30.414 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-20T06:39:30.429 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-20T06:39:30.431 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139922 files and directories currently installed.) 2023-11-20T06:39:30.435 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-20T06:39:30.473 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-20T06:39:30.487 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-20T06:39:30.767 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package dump. 2023-11-20T06:39:30.783 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-20T06:39:30.818 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking dump (0.4b47-3) ... 2023-11-20T06:39:30.921 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-20T06:39:30.935 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-20T06:39:30.979 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-20T06:39:31.112 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package indent. 2023-11-20T06:39:31.129 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:39:31.171 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-20T06:39:31.315 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package dump. 2023-11-20T06:39:31.329 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-20T06:39:31.374 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking dump (0.4b47-3) ... 2023-11-20T06:39:31.423 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-20T06:39:31.439 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-20T06:39:31.490 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-20T06:39:31.677 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package indent. 2023-11-20T06:39:31.691 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:39:31.736 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-20T06:39:31.819 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-20T06:39:31.835 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-20T06:39:31.877 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-20T06:39:31.988 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-20T06:39:32.002 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-20T06:39:32.046 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-20T06:39:32.104 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-20T06:39:32.120 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-20T06:39:32.162 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-20T06:39:32.399 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-20T06:39:32.414 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-20T06:39:32.449 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-20T06:39:32.499 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-20T06:39:32.515 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-20T06:39:32.557 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-20T06:39:32.660 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-20T06:39:32.675 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-20T06:39:32.718 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-20T06:39:32.818 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-20T06:39:32.834 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-20T06:39:32.876 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-20T06:39:33.080 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-20T06:39:33.095 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-20T06:39:33.137 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libjson-perl. 2023-11-20T06:39:33.138 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-20T06:39:33.153 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-20T06:39:33.187 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-20T06:39:33.390 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-20T06:39:33.406 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-20T06:39:33.449 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-20T06:39:33.465 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-20T06:39:33.481 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-20T06:39:33.523 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-20T06:39:33.718 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libjson-perl. 2023-11-20T06:39:33.733 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-20T06:39:33.776 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-20T06:39:34.139 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-20T06:39:34.154 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-20T06:39:34.222 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-20T06:39:34.876 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-20T06:39:34.892 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-20T06:39:34.951 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-20T06:39:35.212 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-20T06:39:35.228 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-20T06:39:35.270 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-20T06:39:35.556 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-20T06:39:35.572 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-20T06:39:35.606 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-20T06:39:35.616 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-20T06:39:35.632 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-20T06:39:35.674 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-20T06:39:35.885 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-20T06:39:35.900 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-20T06:39:35.917 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-20T06:39:35.933 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-20T06:39:35.968 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-20T06:39:35.975 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-20T06:39:36.287 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-20T06:39:36.303 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-20T06:39:36.320 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-20T06:39:36.336 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-20T06:39:36.346 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-20T06:39:36.378 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-20T06:39:36.715 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-20T06:39:36.722 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-20T06:39:36.731 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-20T06:39:36.738 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:39:36.773 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-20T06:39:36.780 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:39:37.083 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-20T06:39:37.092 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-20T06:39:37.099 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:39:37.108 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-20T06:39:37.141 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-20T06:39:37.142 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-20T06:39:37.461 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-20T06:39:37.477 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:39:37.487 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-20T06:39:37.503 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:39:37.519 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-20T06:39:37.545 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:39:37.763 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-20T06:39:37.779 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-20T06:39:37.821 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-20T06:39:37.881 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-20T06:39:37.897 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:39:37.939 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-20T06:39:38.250 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-20T06:39:38.266 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:39:38.300 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-20T06:39:38.308 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-20T06:39:38.316 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-20T06:39:38.383 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-20T06:39:38.527 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-20T06:39:38.543 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-20T06:39:38.577 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-20T06:39:38.744 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package modemmanager. 2023-11-20T06:39:38.760 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-20T06:39:38.803 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-20T06:39:39.139 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-20T06:39:39.154 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-20T06:39:39.197 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-20T06:39:39.417 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package network-manager. 2023-11-20T06:39:39.433 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-20T06:39:39.483 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-20T06:39:39.575 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package modemmanager. 2023-11-20T06:39:39.590 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-20T06:39:39.641 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-20T06:39:40.116 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ppp. 2023-11-20T06:39:40.135 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-20T06:39:40.304 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package network-manager. 2023-11-20T06:39:40.314 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-20T06:39:40.363 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-20T06:39:40.477 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-20T06:39:40.828 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package pptp-linux. 2023-11-20T06:39:40.843 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-20T06:39:40.886 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-20T06:39:40.988 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ppp. 2023-11-20T06:39:41.004 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-20T06:39:41.139 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-20T06:39:41.154 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-20T06:39:41.214 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-20T06:39:41.329 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-20T06:39:41.508 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-20T06:39:41.524 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-20T06:39:41.567 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking postgresql-client-common (238) ... 2023-11-20T06:39:41.650 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package pptp-linux. 2023-11-20T06:39:41.664 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-20T06:39:41.700 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-20T06:39:41.921 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-20T06:39:41.927 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-20T06:39:41.937 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:39:41.942 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-20T06:39:41.979 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:39:42.004 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-20T06:39:42.314 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-20T06:39:42.328 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-20T06:39:42.372 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-client-common (238) ... 2023-11-20T06:39:42.533 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package postgresql-common. 2023-11-20T06:39:42.549 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-20T06:39:42.611 INFO:teuthology.orchestra.run.smithi019.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-20T06:39:42.641 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking postgresql-common (238) ... 2023-11-20T06:39:42.700 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-20T06:39:42.716 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:39:42.759 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:39:43.116 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package postgresql-14. 2023-11-20T06:39:43.132 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:39:43.177 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:39:43.389 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-common. 2023-11-20T06:39:43.404 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-20T06:39:43.466 INFO:teuthology.orchestra.run.smithi190.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-20T06:39:43.496 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-common (238) ... 2023-11-20T06:39:43.954 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-14. 2023-11-20T06:39:43.970 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:39:44.015 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:39:44.352 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package postgresql. 2023-11-20T06:39:44.367 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-20T06:39:44.412 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking postgresql (14+238) ... 2023-11-20T06:39:44.639 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package postgresql-client. 2023-11-20T06:39:44.654 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-20T06:39:44.697 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking postgresql-client (14+238) ... 2023-11-20T06:39:44.941 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-20T06:39:44.957 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-20T06:39:45.000 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-20T06:39:45.133 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql. 2023-11-20T06:39:45.148 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-20T06:39:45.191 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql (14+238) ... 2023-11-20T06:39:45.260 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package tcl8.6. 2023-11-20T06:39:45.277 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-20T06:39:45.335 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-20T06:39:45.418 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-client. 2023-11-20T06:39:45.433 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-20T06:39:45.468 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-client (14+238) ... 2023-11-20T06:39:45.622 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package tcl. 2023-11-20T06:39:45.638 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-20T06:39:45.685 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-20T06:39:45.721 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-20T06:39:45.735 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-20T06:39:45.779 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-20T06:39:46.033 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package wpasupplicant. 2023-11-20T06:39:46.049 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-20T06:39:46.091 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-20T06:39:46.123 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package tcl8.6. 2023-11-20T06:39:46.138 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-20T06:39:46.181 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-20T06:39:46.420 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-20T06:39:46.436 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-20T06:39:46.450 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package tcl. 2023-11-20T06:39:46.465 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-20T06:39:46.495 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-20T06:39:46.513 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-20T06:39:46.882 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-20T06:39:46.895 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package wpasupplicant. 2023-11-20T06:39:46.898 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-20T06:39:46.910 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-20T06:39:46.949 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-20T06:39:46.953 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-20T06:39:47.234 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up postgresql-client-common (238) ... 2023-11-20T06:39:47.407 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-20T06:39:47.423 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-20T06:39:47.446 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-20T06:39:47.465 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-20T06:39:47.573 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-20T06:39:47.723 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:39:47.841 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-20T06:39:47.843 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-20T06:39:47.860 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-20T06:39:47.910 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-20T06:39:47.942 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-20T06:39:48.068 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:39:48.220 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-client-common (238) ... 2023-11-20T06:39:48.433 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-20T06:39:48.567 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-20T06:39:48.668 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:39:48.802 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-20T06:39:48.929 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-20T06:39:49.054 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:39:49.094 INFO:teuthology.orchestra.run.smithi019.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-20T06:39:49.195 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-20T06:39:49.576 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-20T06:39:49.576 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-20T06:39:50.057 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-20T06:39:50.168 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-20T06:39:50.293 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-20T06:39:50.419 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-20T06:39:50.530 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-20T06:39:50.530 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-20T06:39:50.545 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-20T06:39:50.680 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-20T06:39:50.806 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-20T06:39:50.931 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-20T06:39:51.082 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-20T06:39:51.213 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-20T06:39:51.338 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-20T06:39:51.506 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-20T06:39:51.632 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-20T06:39:51.758 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-20T06:39:51.771 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-20T06:39:51.884 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-20T06:39:51.914 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up dump (0.4b47-3) ... 2023-11-20T06:39:52.002 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-20T06:39:52.009 INFO:teuthology.orchestra.run.smithi019.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-20T06:39:52.074 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-20T06:39:52.225 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-20T06:39:52.350 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-20T06:39:52.460 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-20T06:39:52.586 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-20T06:39:52.676 INFO:teuthology.orchestra.run.smithi019.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-20T06:39:52.690 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-20T06:39:52.737 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-20T06:39:52.841 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up dump (0.4b47-3) ... 2023-11-20T06:39:52.863 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-20T06:39:52.936 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-20T06:39:52.992 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-20T06:39:53.031 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-20T06:39:53.110 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-20T06:39:53.141 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-20T06:39:53.236 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-20T06:39:53.250 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-20T06:39:53.370 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-20T06:39:53.460 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up postgresql-client (14+238) ... 2023-11-20T06:39:53.521 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-20T06:39:53.586 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-20T06:39:53.611 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-20T06:39:53.681 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-20T06:39:53.807 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-20T06:39:54.000 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-20T06:39:54.101 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-20T06:39:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:39:54.178 INFO:teuthology.orchestra.run.smithi019.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-20T06:39:54.178 INFO:teuthology.orchestra.run.smithi019.stdout:which means they are currently configured by ifupdown: 2023-11-20T06:39:54.178 INFO:teuthology.orchestra.run.smithi019.stdout:- ens1f0 2023-11-20T06:39:54.179 INFO:teuthology.orchestra.run.smithi019.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-20T06:39:54.179 INFO:teuthology.orchestra.run.smithi019.stdout:remove their configuration from /etc/network/interfaces. 2023-11-20T06:39:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:39:54.243 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-20T06:39:54.318 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-20T06:39:54.429 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-client (14+238) ... 2023-11-20T06:39:54.554 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-20T06:39:54.735 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-20T06:39:55.119 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:39:55.119 INFO:teuthology.orchestra.run.smithi190.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-20T06:39:55.119 INFO:teuthology.orchestra.run.smithi190.stdout:which means they are currently configured by ifupdown: 2023-11-20T06:39:55.119 INFO:teuthology.orchestra.run.smithi190.stdout:- enp3s0f1 2023-11-20T06:39:55.119 INFO:teuthology.orchestra.run.smithi190.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-20T06:39:55.119 INFO:teuthology.orchestra.run.smithi190.stdout:remove their configuration from /etc/network/interfaces. 2023-11-20T06:39:55.120 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:39:55.157 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-20T06:39:55.252 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-20T06:39:55.631 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-20T06:39:55.905 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-20T06:39:56.033 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-20T06:39:56.056 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-20T06:39:56.166 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-20T06:39:56.267 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up postgresql-common (238) ... 2023-11-20T06:39:56.723 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-20T06:39:56.883 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-20T06:39:57.068 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-20T06:39:57.168 INFO:teuthology.orchestra.run.smithi019.stdout:Adding user postgres to group ssl-cert 2023-11-20T06:39:57.176 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-common (238) ... 2023-11-20T06:39:57.437 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:39:57.438 INFO:teuthology.orchestra.run.smithi019.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-20T06:39:57.711 INFO:teuthology.orchestra.run.smithi019.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-20T06:39:57.711 INFO:teuthology.orchestra.run.smithi019.stdout:Removing obsolete dictionary files: 2023-11-20T06:39:58.218 INFO:teuthology.orchestra.run.smithi190.stdout:Adding user postgres to group ssl-cert 2023-11-20T06:39:58.417 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-20T06:39:58.473 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:39:58.473 INFO:teuthology.orchestra.run.smithi190.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-20T06:39:58.698 INFO:teuthology.orchestra.run.smithi190.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-20T06:39:58.698 INFO:teuthology.orchestra.run.smithi190.stdout:Removing obsolete dictionary files: 2023-11-20T06:39:58.868 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:39:59.230 INFO:teuthology.orchestra.run.smithi019.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-20T06:39:59.251 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-20T06:39:59.303 INFO:teuthology.orchestra.run.smithi019.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-20T06:39:59.303 INFO:teuthology.orchestra.run.smithi019.stdout:This user must also own the server process. 2023-11-20T06:39:59.303 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:39:59.303 INFO:teuthology.orchestra.run.smithi019.stdout:The database cluster will be initialized with locale "en_US". 2023-11-20T06:39:59.303 INFO:teuthology.orchestra.run.smithi019.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-20T06:39:59.303 INFO:teuthology.orchestra.run.smithi019.stdout:The default text search configuration will be set to "english". 2023-11-20T06:39:59.303 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:39:59.303 INFO:teuthology.orchestra.run.smithi019.stdout:Data page checksums are disabled. 2023-11-20T06:39:59.304 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:39:59.304 INFO:teuthology.orchestra.run.smithi019.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-20T06:39:59.304 INFO:teuthology.orchestra.run.smithi019.stdout:creating subdirectories ... ok 2023-11-20T06:39:59.304 INFO:teuthology.orchestra.run.smithi019.stdout:selecting dynamic shared memory implementation ... posix 2023-11-20T06:39:59.330 INFO:teuthology.orchestra.run.smithi019.stdout:selecting default max_connections ... 100 2023-11-20T06:39:59.368 INFO:teuthology.orchestra.run.smithi019.stdout:selecting default shared_buffers ... 128MB 2023-11-20T06:39:59.382 INFO:teuthology.orchestra.run.smithi019.stdout:selecting default time zone ... Etc/UTC 2023-11-20T06:39:59.383 INFO:teuthology.orchestra.run.smithi019.stdout:creating configuration files ... ok 2023-11-20T06:39:59.416 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-20T06:39:59.561 INFO:teuthology.orchestra.run.smithi019.stdout:running bootstrap script ... ok 2023-11-20T06:39:59.886 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:40:00.208 INFO:teuthology.orchestra.run.smithi019.stdout:performing post-bootstrap initialization ... ok 2023-11-20T06:40:00.233 INFO:teuthology.orchestra.run.smithi190.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-20T06:40:00.255 INFO:teuthology.orchestra.run.smithi190.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-20T06:40:00.312 INFO:teuthology.orchestra.run.smithi190.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-20T06:40:00.312 INFO:teuthology.orchestra.run.smithi190.stdout:This user must also own the server process. 2023-11-20T06:40:00.312 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:00.313 INFO:teuthology.orchestra.run.smithi190.stdout:The database cluster will be initialized with locale "en_US". 2023-11-20T06:40:00.313 INFO:teuthology.orchestra.run.smithi190.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-20T06:40:00.313 INFO:teuthology.orchestra.run.smithi190.stdout:The default text search configuration will be set to "english". 2023-11-20T06:40:00.313 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:00.313 INFO:teuthology.orchestra.run.smithi190.stdout:Data page checksums are disabled. 2023-11-20T06:40:00.313 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:00.313 INFO:teuthology.orchestra.run.smithi190.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-20T06:40:00.314 INFO:teuthology.orchestra.run.smithi190.stdout:creating subdirectories ... ok 2023-11-20T06:40:00.314 INFO:teuthology.orchestra.run.smithi190.stdout:selecting dynamic shared memory implementation ... posix 2023-11-20T06:40:00.338 INFO:teuthology.orchestra.run.smithi190.stdout:selecting default max_connections ... 100 2023-11-20T06:40:00.374 INFO:teuthology.orchestra.run.smithi190.stdout:selecting default shared_buffers ... 128MB 2023-11-20T06:40:00.387 INFO:teuthology.orchestra.run.smithi190.stdout:selecting default time zone ... Etc/UTC 2023-11-20T06:40:00.388 INFO:teuthology.orchestra.run.smithi190.stdout:creating configuration files ... ok 2023-11-20T06:40:00.556 INFO:teuthology.orchestra.run.smithi190.stdout:running bootstrap script ... ok 2023-11-20T06:40:00.729 INFO:teuthology.orchestra.run.smithi019.stdout:syncing data to disk ... ok 2023-11-20T06:40:01.165 INFO:teuthology.orchestra.run.smithi190.stdout:performing post-bootstrap initialization ... ok 2023-11-20T06:40:01.262 INFO:teuthology.orchestra.run.smithi019.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-20T06:40:01.702 INFO:teuthology.orchestra.run.smithi190.stdout:syncing data to disk ... ok 2023-11-20T06:40:02.235 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-20T06:40:04.634 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-20T06:40:04.743 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-20T06:40:04.869 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up postgresql (14+238) ... 2023-11-20T06:40:05.028 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-20T06:40:05.163 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-20T06:40:05.176 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-20T06:40:05.302 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-20T06:40:05.428 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql (14+238) ... 2023-11-20T06:40:05.431 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-20T06:40:05.431 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-20T06:40:05.579 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-20T06:40:05.705 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-20T06:40:05.966 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-20T06:40:05.966 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-20T06:40:06.207 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-20T06:40:06.534 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-20T06:40:06.677 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-20T06:40:06.715 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-20T06:40:07.059 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-20T06:40:07.208 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-20T06:40:08.122 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-20T06:40:08.230 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-20T06:40:08.763 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-20T06:40:08.863 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-20T06:40:08.959 INFO:teuthology.orchestra.run.smithi019.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-20T06:40:08.964 DEBUG:teuthology.parallel:result is None 2023-11-20T06:40:09.558 INFO:teuthology.orchestra.run.smithi190.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-20T06:40:09.562 DEBUG:teuthology.parallel:result is None 2023-11-20T06:40:09.562 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=895e5adad9a763a0f13587c485b17f1ad3f04528 2023-11-20T06:40:09.793 DEBUG:teuthology.orchestra.run.smithi019:> dpkg-query -W -f '${Version}' ceph 2023-11-20T06:40:09.816 INFO:teuthology.orchestra.run.smithi019.stdout:18.0.0-6612-g895e5ada-1jammy 2023-11-20T06:40:09.817 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6612-g895e5ada-1jammy 2023-11-20T06:40:09.817 INFO:teuthology.task.install:The correct ceph version 18.0.0-6612-g895e5ada-1jammy is installed. 2023-11-20T06:40:09.817 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=895e5adad9a763a0f13587c485b17f1ad3f04528 2023-11-20T06:40:10.035 DEBUG:teuthology.orchestra.run.smithi190:> dpkg-query -W -f '${Version}' ceph 2023-11-20T06:40:10.057 INFO:teuthology.orchestra.run.smithi190.stdout:18.0.0-6612-g895e5ada-1jammy 2023-11-20T06:40:10.057 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6612-g895e5ada-1jammy 2023-11-20T06:40:10.057 INFO:teuthology.task.install:The correct ceph version 18.0.0-6612-g895e5ada-1jammy is installed. 2023-11-20T06:40:10.058 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-20T06:40:10.058 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:10.058 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-20T06:40:10.081 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:10.081 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-20T06:40:10.124 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-20T06:40:10.124 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:10.125 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/daemon-helper 2023-11-20T06:40:10.146 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-20T06:40:10.207 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:10.208 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/daemon-helper 2023-11-20T06:40:10.227 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-20T06:40:10.287 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-20T06:40:10.287 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:10.287 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-20T06:40:10.309 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-20T06:40:10.375 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:10.375 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-20T06:40:10.395 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-20T06:40:10.459 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-20T06:40:10.459 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:10.459 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/stdin-killer 2023-11-20T06:40:10.481 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-20T06:40:10.543 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:10.543 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/stdin-killer 2023-11-20T06:40:10.565 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-20T06:40:10.626 INFO:teuthology.run_tasks:Running task ceph... 2023-11-20T06:40:10.692 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-20T06:40:10.692 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 777 /var/log/ceph 2023-11-20T06:40:10.696 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 777 /var/log/ceph 2023-11-20T06:40:10.716 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-20T06:40:10.716 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-20T06:40:10.762 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-20T06:40:10.783 INFO:tasks.ceph:Creating extra log directories... 2023-11-20T06:40:10.784 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-20T06:40:10.825 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-20T06:40:10.851 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-20T06:40:10.851 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-20T06:40:10.851 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-20T06:40:10.852 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:10.852 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-20T06:40:10.912 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-20T06:40:11.023 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:11.024 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-20T06:40:11.033 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-20T06:40:11.131 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-20T06:40:11.131 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'inconsistent rstat on inode', 'Error recovering journal'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-20T06:40:11.131 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463035', 'branch': 'wip-57087-3', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7463035', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '7678e1afe51c4ac0c30e2c032e042c836160928a'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-57087-3'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'inconsistent rstat on inode', 'Error recovering journal'], 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-57087-3', 'sha1': 'dc2d87c1fc8f518422f0be9931df0b31dc6a3bad'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9639, 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-57087-3', 'suite_path': '/home/teuthworker/src/github.com_vshankar_ceph_dc2d87c1fc8f518422f0be9931df0b31dc6a3bad/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/vshankar/ceph.git', 'suite_sha1': 'dc2d87c1fc8f518422f0be9931df0b31dc6a3bad', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi019.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEGoUEYvv8Xx4Y3u448+gdyzT3VDVyIvIQ0BBsftBrnQIp3iGuixD10crS4Lqyw3w63VGQkE2rdYq+2T+5uGOGM=', 'smithi190.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBYMWoE2uFuoUOEUElZDU1ZN8xpaiogsPDQMBOGBzoRjhquNJsZno6nE8l9XUVzazdqi3+MVusP36wRDJsfPOfQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '7678e1afe51c4ac0c30e2c032e042c836160928a'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'inconsistent rstat on inode', 'Error recovering journal'], 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-20_06:01:31', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-20T06:40:11.132 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-20T06:40:11.141 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-20T06:40:11.177 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/run/ceph 2023-11-20T06:40:11.197 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/run/ceph 2023-11-20T06:40:11.248 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:11.249 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/scratch_devs of=/dev/stdout 2023-11-20T06:40:11.269 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-20T06:40:11.269 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_1 2023-11-20T06:40:11.320 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-20T06:40:11.320 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-20T06:40:11.320 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 889 Links: 1 2023-11-20T06:40:11.320 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-20T06:40:11.320 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2023-11-20 06:33:52.970321330 +0000 2023-11-20T06:40:11.320 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2023-11-20 06:33:52.570324903 +0000 2023-11-20T06:40:11.321 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2023-11-20 06:33:52.570324903 +0000 2023-11-20T06:40:11.321 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2023-11-20 06:33:52.570324903 +0000 2023-11-20T06:40:11.321 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-20T06:40:11.385 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2023-11-20T06:40:11.386 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2023-11-20T06:40:11.386 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000387228 s, 1.3 MB/s 2023-11-20T06:40:11.386 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-20T06:40:11.438 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_2 2023-11-20T06:40:11.495 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-20T06:40:11.496 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-20T06:40:11.496 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 909 Links: 1 2023-11-20T06:40:11.496 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-20T06:40:11.496 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2023-11-20 06:33:53.238318937 +0000 2023-11-20T06:40:11.496 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2023-11-20 06:33:53.234318972 +0000 2023-11-20T06:40:11.496 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2023-11-20 06:33:53.234318972 +0000 2023-11-20T06:40:11.497 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2023-11-20 06:33:53.234318972 +0000 2023-11-20T06:40:11.497 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-20T06:40:11.558 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2023-11-20T06:40:11.558 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2023-11-20T06:40:11.558 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000368317 s, 1.4 MB/s 2023-11-20T06:40:11.560 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-20T06:40:11.615 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_3 2023-11-20T06:40:11.672 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-20T06:40:11.672 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-20T06:40:11.672 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 925 Links: 1 2023-11-20T06:40:11.672 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-20T06:40:11.672 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2023-11-20 06:33:53.914312899 +0000 2023-11-20T06:40:11.672 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2023-11-20 06:33:53.910312934 +0000 2023-11-20T06:40:11.673 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2023-11-20 06:33:53.910312934 +0000 2023-11-20T06:40:11.673 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2023-11-20 06:33:53.910312934 +0000 2023-11-20T06:40:11.673 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-20T06:40:11.739 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2023-11-20T06:40:11.740 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2023-11-20T06:40:11.740 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000661334 s, 774 kB/s 2023-11-20T06:40:11.741 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-20T06:40:11.794 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_4 2023-11-20T06:40:11.848 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-20T06:40:11.848 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-20T06:40:11.848 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 942 Links: 1 2023-11-20T06:40:11.848 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-20T06:40:11.849 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2023-11-20 06:33:54.938303753 +0000 2023-11-20T06:40:11.849 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2023-11-20 06:33:54.554307182 +0000 2023-11-20T06:40:11.849 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2023-11-20 06:33:54.554307182 +0000 2023-11-20T06:40:11.849 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2023-11-20 06:33:54.554307182 +0000 2023-11-20T06:40:11.849 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-20T06:40:11.911 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2023-11-20T06:40:11.911 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2023-11-20T06:40:11.911 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000384349 s, 1.3 MB/s 2023-11-20T06:40:11.913 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-20T06:40:11.966 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-20T06:40:11.967 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:11.967 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/scratch_devs of=/dev/stdout 2023-11-20T06:40:11.977 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-20T06:40:11.977 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_1 2023-11-20T06:40:12.034 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-20T06:40:12.034 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-20T06:40:12.034 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 892 Links: 1 2023-11-20T06:40:12.035 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-20T06:40:12.035 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-11-20 06:33:45.944398513 +0000 2023-11-20T06:40:12.035 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-11-20 06:33:45.940398548 +0000 2023-11-20T06:40:12.035 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-11-20 06:33:45.940398548 +0000 2023-11-20T06:40:12.035 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2023-11-20 06:33:45.940398548 +0000 2023-11-20T06:40:12.035 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-20T06:40:12.095 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-11-20T06:40:12.096 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-11-20T06:40:12.096 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000380853 s, 1.3 MB/s 2023-11-20T06:40:12.098 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-20T06:40:12.151 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_2 2023-11-20T06:40:12.206 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-20T06:40:12.206 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-20T06:40:12.206 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 906 Links: 1 2023-11-20T06:40:12.206 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-20T06:40:12.206 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-11-20 06:33:46.952389509 +0000 2023-11-20T06:40:12.206 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-11-20 06:33:46.584392796 +0000 2023-11-20T06:40:12.206 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-11-20 06:33:46.584392796 +0000 2023-11-20T06:40:12.206 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2023-11-20 06:33:46.584392796 +0000 2023-11-20T06:40:12.207 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-20T06:40:12.269 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-11-20T06:40:12.269 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-11-20T06:40:12.269 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000383788 s, 1.3 MB/s 2023-11-20T06:40:12.271 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-20T06:40:12.323 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_3 2023-11-20T06:40:12.373 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-20T06:40:12.374 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-20T06:40:12.374 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 926 Links: 1 2023-11-20T06:40:12.374 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-20T06:40:12.374 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-11-20 06:33:47.588383828 +0000 2023-11-20T06:40:12.374 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-11-20 06:33:47.212387187 +0000 2023-11-20T06:40:12.374 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-11-20 06:33:47.212387187 +0000 2023-11-20T06:40:12.374 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2023-11-20 06:33:47.212387187 +0000 2023-11-20T06:40:12.374 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-20T06:40:12.440 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-11-20T06:40:12.440 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-11-20T06:40:12.440 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000401476 s, 1.3 MB/s 2023-11-20T06:40:12.442 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-20T06:40:12.498 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_4 2023-11-20T06:40:12.549 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-20T06:40:12.549 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-20T06:40:12.549 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 943 Links: 1 2023-11-20T06:40:12.549 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-20T06:40:12.549 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-11-20 06:33:48.228378111 +0000 2023-11-20T06:40:12.549 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-11-20 06:33:47.828381684 +0000 2023-11-20T06:40:12.549 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-11-20 06:33:47.828381684 +0000 2023-11-20T06:40:12.550 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2023-11-20 06:33:47.828381684 +0000 2023-11-20T06:40:12.550 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-20T06:40:12.615 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-11-20T06:40:12.615 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-11-20T06:40:12.615 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000383286 s, 1.3 MB/s 2023-11-20T06:40:12.617 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-20T06:40:12.675 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-20T06:40:12.675 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-20T06:40:12.675 INFO:tasks.ceph:Generating config... 2023-11-20T06:40:12.676 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-20T06:40:12.676 INFO:tasks.ceph:[client] debug client = 20 2023-11-20T06:40:12.676 INFO:tasks.ceph:[client] debug ms = 1 2023-11-20T06:40:12.676 INFO:tasks.ceph:[client] pid file = 2023-11-20T06:40:12.676 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-20T06:40:12.677 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-20T06:40:12.677 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-20T06:40:12.677 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-20T06:40:12.677 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-20T06:40:12.677 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-20T06:40:12.677 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-20T06:40:12.677 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-20T06:40:12.677 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-20T06:40:12.677 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-20T06:40:12.677 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-20T06:40:12.677 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-20T06:40:12.677 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-20T06:40:12.678 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-20T06:40:12.678 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-20T06:40:12.678 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-20T06:40:12.678 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-20T06:40:12.678 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-20T06:40:12.678 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-20T06:40:12.678 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-20T06:40:12.678 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-11-20T06:40:12.678 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-11-20T06:40:12.678 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-20T06:40:12.678 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-20T06:40:12.678 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-20T06:40:12.679 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-20T06:40:12.679 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-20T06:40:12.679 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-20T06:40:12.679 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-20T06:40:12.679 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-20T06:40:12.679 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-20T06:40:12.679 INFO:tasks.ceph:Setting up mon.a... 2023-11-20T06:40:12.679 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-20T06:40:12.728 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.keyring 2023-11-20T06:40:12.738 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-20T06:40:12.789 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-20T06:40:12.810 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.19'), ('mon.b', '172.21.15.190'), ('mon.c', '[v2:172.21.15.190:3301,v1:172.21.15.190:6790]')] 2023-11-20T06:40:12.811 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.19,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-20T06:40:12.812 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:12.812 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-20T06:40:12.863 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.19 --add b 172.21.15.190 --addv c '[v2:172.21.15.190:3301,v1:172.21.15.190:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:40:12.959 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:40:12.959 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: generated fsid c7c2bc89-520e-40d6-94f5-74b01db83356 2023-11-20T06:40:12.959 INFO:teuthology.orchestra.run.smithi019.stdout:setting min_mon_release = pacific 2023-11-20T06:40:12.959 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 0 2023-11-20T06:40:12.959 INFO:teuthology.orchestra.run.smithi019.stdout:fsid c7c2bc89-520e-40d6-94f5-74b01db83356 2023-11-20T06:40:12.959 INFO:teuthology.orchestra.run.smithi019.stdout:last_changed 2023-11-20T06:40:12.958892+0000 2023-11-20T06:40:12.959 INFO:teuthology.orchestra.run.smithi019.stdout:created 2023-11-20T06:40:12.958892+0000 2023-11-20T06:40:12.960 INFO:teuthology.orchestra.run.smithi019.stdout:min_mon_release 16 (pacific) 2023-11-20T06:40:12.960 INFO:teuthology.orchestra.run.smithi019.stdout:election_strategy: 1 2023-11-20T06:40:12.960 INFO:teuthology.orchestra.run.smithi019.stdout:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2023-11-20T06:40:12.960 INFO:teuthology.orchestra.run.smithi019.stdout:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2023-11-20T06:40:12.960 INFO:teuthology.orchestra.run.smithi019.stdout:2: [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] mon.c 2023-11-20T06:40:12.960 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-20T06:40:12.965 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-20T06:40:12.974 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c7c2bc89-520e-40d6-94f5-74b01db83356... 2023-11-20T06:40:12.975 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-20T06:40:13.017 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-20T06:40:13.060 INFO:teuthology.orchestra.run.smithi019.stdout:[global] 2023-11-20T06:40:13.060 INFO:teuthology.orchestra.run.smithi019.stdout: chdir = "" 2023-11-20T06:40:13.060 INFO:teuthology.orchestra.run.smithi019.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-20T06:40:13.060 INFO:teuthology.orchestra.run.smithi019.stdout: auth supported = cephx 2023-11-20T06:40:13.060 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.060 INFO:teuthology.orchestra.run.smithi019.stdout: filestore xattr use omap = true 2023-11-20T06:40:13.061 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.061 INFO:teuthology.orchestra.run.smithi019.stdout: mon clock drift allowed = 1.000 2023-11-20T06:40:13.061 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.061 INFO:teuthology.orchestra.run.smithi019.stdout: osd crush chooseleaf type = 0 2023-11-20T06:40:13.061 INFO:teuthology.orchestra.run.smithi019.stdout: auth debug = true 2023-11-20T06:40:13.062 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.062 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on old message = true 2023-11-20T06:40:13.062 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on bug = true 2023-11-20T06:40:13.062 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.062 INFO:teuthology.orchestra.run.smithi019.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-20T06:40:13.062 INFO:teuthology.orchestra.run.smithi019.stdout: mon pg warn max object skew = 0 2023-11-20T06:40:13.062 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.063 INFO:teuthology.orchestra.run.smithi019.stdout: # disable pg_autoscaler by default for new pools 2023-11-20T06:40:13.063 INFO:teuthology.orchestra.run.smithi019.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-20T06:40:13.063 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.063 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default size = 2 2023-11-20T06:40:13.063 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.063 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow primary affinity = true 2023-11-20T06:40:13.063 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow pg remap = true 2023-11-20T06:40:13.064 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on legacy crush tunables = false 2023-11-20T06:40:13.064 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on crush straw calc version zero = false 2023-11-20T06:40:13.064 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on no sortbitwise = false 2023-11-20T06:40:13.064 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on osd down out interval zero = false 2023-11-20T06:40:13.064 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on too few osds = false 2023-11-20T06:40:13.064 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-20T06:40:13.064 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-20T06:40:13.065 INFO:teuthology.orchestra.run.smithi019.stdout: mon_allow_pool_size_one = true 2023-11-20T06:40:13.065 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.065 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-20T06:40:13.065 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.065 INFO:teuthology.orchestra.run.smithi019.stdout: osd default data pool replay window = 5 2023-11-20T06:40:13.065 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.065 INFO:teuthology.orchestra.run.smithi019.stdout: mon allow pool delete = true 2023-11-20T06:40:13.065 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.066 INFO:teuthology.orchestra.run.smithi019.stdout: mon cluster log file level = debug 2023-11-20T06:40:13.066 INFO:teuthology.orchestra.run.smithi019.stdout: debug asserts on shutdown = true 2023-11-20T06:40:13.066 INFO:teuthology.orchestra.run.smithi019.stdout: mon health detail to clog = false 2023-11-20T06:40:13.066 INFO:teuthology.orchestra.run.smithi019.stdout: mon host = "172.21.15.19,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2023-11-20T06:40:13.066 INFO:teuthology.orchestra.run.smithi019.stdout: fsid = c7c2bc89-520e-40d6-94f5-74b01db83356 2023-11-20T06:40:13.066 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.067 INFO:teuthology.orchestra.run.smithi019.stdout:[osd] 2023-11-20T06:40:13.067 INFO:teuthology.orchestra.run.smithi019.stdout: osd journal size = 100 2023-11-20T06:40:13.067 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.067 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub load threshold = 5.0 2023-11-20T06:40:13.067 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub max interval = 600 2023-11-20T06:40:13.067 INFO:teuthology.orchestra.run.smithi019.stdout: osd mclock profile = high_recovery_ops 2023-11-20T06:40:13.067 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.068 INFO:teuthology.orchestra.run.smithi019.stdout: osd recover clone overlap = true 2023-11-20T06:40:13.068 INFO:teuthology.orchestra.run.smithi019.stdout: osd recovery max chunk = 1048576 2023-11-20T06:40:13.068 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.068 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug shutdown = true 2023-11-20T06:40:13.068 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug op order = true 2023-11-20T06:40:13.068 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug verify stray on activate = true 2023-11-20T06:40:13.068 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.069 INFO:teuthology.orchestra.run.smithi019.stdout: osd open classes on start = true 2023-11-20T06:40:13.069 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug pg log writeout = true 2023-11-20T06:40:13.069 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.069 INFO:teuthology.orchestra.run.smithi019.stdout: osd deep scrub update digest min age = 30 2023-11-20T06:40:13.069 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.069 INFO:teuthology.orchestra.run.smithi019.stdout: osd map max advance = 10 2023-11-20T06:40:13.069 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.070 INFO:teuthology.orchestra.run.smithi019.stdout: journal zero on create = true 2023-11-20T06:40:13.070 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.070 INFO:teuthology.orchestra.run.smithi019.stdout: filestore ondisk finisher threads = 3 2023-11-20T06:40:13.070 INFO:teuthology.orchestra.run.smithi019.stdout: filestore apply finisher threads = 3 2023-11-20T06:40:13.070 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.070 INFO:teuthology.orchestra.run.smithi019.stdout: bdev debug aio = true 2023-11-20T06:40:13.070 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug misdirected ops = true 2023-11-20T06:40:13.071 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore block size = 96636764160 2023-11-20T06:40:13.071 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore fsck on mount = True 2023-11-20T06:40:13.071 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluefs = 20 2023-11-20T06:40:13.071 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluestore = 20 2023-11-20T06:40:13.071 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2023-11-20T06:40:13.071 INFO:teuthology.orchestra.run.smithi019.stdout: debug osd = 20 2023-11-20T06:40:13.071 INFO:teuthology.orchestra.run.smithi019.stdout: debug rocksdb = 10 2023-11-20T06:40:13.071 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd backfillfull_ratio = 0.85 2023-11-20T06:40:13.072 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd full ratio = 0.9 2023-11-20T06:40:13.072 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd nearfull ratio = 0.8 2023-11-20T06:40:13.072 INFO:teuthology.orchestra.run.smithi019.stdout: osd failsafe full ratio = 0.95 2023-11-20T06:40:13.072 INFO:teuthology.orchestra.run.smithi019.stdout: osd objectstore = bluestore 2023-11-20T06:40:13.072 INFO:teuthology.orchestra.run.smithi019.stdout: osd op complaint time = 180 2023-11-20T06:40:13.072 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.072 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr] 2023-11-20T06:40:13.073 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2023-11-20T06:40:13.073 INFO:teuthology.orchestra.run.smithi019.stdout: debug mgr = 20 2023-11-20T06:40:13.073 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2023-11-20T06:40:13.073 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2023-11-20T06:40:13.073 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2023-11-20T06:40:13.073 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2023-11-20T06:40:13.073 INFO:teuthology.orchestra.run.smithi019.stdout: mgr/telemetry/nag = false 2023-11-20T06:40:13.074 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.074 INFO:teuthology.orchestra.run.smithi019.stdout:[mon] 2023-11-20T06:40:13.074 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2023-11-20T06:40:13.074 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2023-11-20T06:40:13.074 INFO:teuthology.orchestra.run.smithi019.stdout: debug paxos = 20 2023-11-20T06:40:13.074 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2023-11-20T06:40:13.075 INFO:teuthology.orchestra.run.smithi019.stdout: mon data avail warn = 5 2023-11-20T06:40:13.075 INFO:teuthology.orchestra.run.smithi019.stdout: mon mgr mkfs grace = 240 2023-11-20T06:40:13.075 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2023-11-20T06:40:13.075 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd reporter subtree level = osd 2023-11-20T06:40:13.075 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd prime pg temp = true 2023-11-20T06:40:13.075 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2023-11-20T06:40:13.075 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.076 INFO:teuthology.orchestra.run.smithi019.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-20T06:40:13.076 INFO:teuthology.orchestra.run.smithi019.stdout: auth mon ticket ttl = 660 # 11m 2023-11-20T06:40:13.076 INFO:teuthology.orchestra.run.smithi019.stdout: auth service ticket ttl = 240 # 4m 2023-11-20T06:40:13.076 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.076 INFO:teuthology.orchestra.run.smithi019.stdout: # don't complain about insecure global_id in the test suite 2023-11-20T06:40:13.076 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-20T06:40:13.077 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-20T06:40:13.077 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.077 INFO:teuthology.orchestra.run.smithi019.stdout: # 1m isn't quite enough 2023-11-20T06:40:13.077 INFO:teuthology.orchestra.run.smithi019.stdout: mon_down_mkfs_grace = 2m 2023-11-20T06:40:13.077 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.077 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_filestore_osds = false 2023-11-20T06:40:13.077 INFO:teuthology.orchestra.run.smithi019.stdout: mon op complaint time = 120 2023-11-20T06:40:13.078 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:13.078 INFO:teuthology.orchestra.run.smithi019.stdout:[client] 2023-11-20T06:40:13.078 INFO:teuthology.orchestra.run.smithi019.stdout: rgw cache enabled = true 2023-11-20T06:40:13.078 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable ops log = true 2023-11-20T06:40:13.078 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable usage log = true 2023-11-20T06:40:13.078 INFO:teuthology.orchestra.run.smithi019.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-20T06:40:13.078 INFO:teuthology.orchestra.run.smithi019.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-20T06:40:13.079 INFO:teuthology.orchestra.run.smithi019.stdout: client mount timeout = 600 2023-11-20T06:40:13.079 INFO:teuthology.orchestra.run.smithi019.stdout: debug client = 20 2023-11-20T06:40:13.079 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2023-11-20T06:40:13.079 INFO:teuthology.orchestra.run.smithi019.stdout: pid file = "" 2023-11-20T06:40:13.079 INFO:teuthology.orchestra.run.smithi019.stdout: rados mon op timeout = 900 2023-11-20T06:40:13.079 INFO:teuthology.orchestra.run.smithi019.stdout: rados osd op timeout = 900 2023-11-20T06:40:13.079 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.a] 2023-11-20T06:40:13.080 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.b] 2023-11-20T06:40:13.080 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.c] 2023-11-20T06:40:13.080 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a] 2023-11-20T06:40:13.080 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.c] 2023-11-20T06:40:13.080 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.b] 2023-11-20T06:40:13.080 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.d] 2023-11-20T06:40:13.080 INFO:teuthology.orchestra.run.smithi019.stdout:[mds] 2023-11-20T06:40:13.081 INFO:teuthology.orchestra.run.smithi019.stdout: debug mds = 20 2023-11-20T06:40:13.081 INFO:teuthology.orchestra.run.smithi019.stdout: debug mds balancer = 20 2023-11-20T06:40:13.081 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2023-11-20T06:40:13.081 INFO:teuthology.orchestra.run.smithi019.stdout: mds debug frag = True 2023-11-20T06:40:13.081 INFO:teuthology.orchestra.run.smithi019.stdout: mds debug scatterstat = True 2023-11-20T06:40:13.081 INFO:teuthology.orchestra.run.smithi019.stdout: mds op complaint time = 180 2023-11-20T06:40:13.081 INFO:teuthology.orchestra.run.smithi019.stdout: mds verify scatter = True 2023-11-20T06:40:13.081 INFO:teuthology.orchestra.run.smithi019.stdout: osd op complaint time = 180 2023-11-20T06:40:13.082 INFO:teuthology.orchestra.run.smithi019.stdout: rados mon op timeout = 900 2023-11-20T06:40:13.082 INFO:teuthology.orchestra.run.smithi019.stdout: rados osd op timeout = 900 2023-11-20T06:40:13.083 INFO:teuthology.orchestra.run.smithi190.stdout:[global] 2023-11-20T06:40:13.083 INFO:teuthology.orchestra.run.smithi190.stdout: chdir = "" 2023-11-20T06:40:13.084 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-20T06:40:13.084 INFO:teuthology.orchestra.run.smithi190.stdout: auth supported = cephx 2023-11-20T06:40:13.084 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.084 INFO:teuthology.orchestra.run.smithi190.stdout: filestore xattr use omap = true 2023-11-20T06:40:13.084 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.084 INFO:teuthology.orchestra.run.smithi190.stdout: mon clock drift allowed = 1.000 2023-11-20T06:40:13.084 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.085 INFO:teuthology.orchestra.run.smithi190.stdout: osd crush chooseleaf type = 0 2023-11-20T06:40:13.085 INFO:teuthology.orchestra.run.smithi190.stdout: auth debug = true 2023-11-20T06:40:13.085 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.085 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on old message = true 2023-11-20T06:40:13.085 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on bug = true 2023-11-20T06:40:13.085 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.085 INFO:teuthology.orchestra.run.smithi190.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-20T06:40:13.085 INFO:teuthology.orchestra.run.smithi190.stdout: mon pg warn max object skew = 0 2023-11-20T06:40:13.086 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.086 INFO:teuthology.orchestra.run.smithi190.stdout: # disable pg_autoscaler by default for new pools 2023-11-20T06:40:13.086 INFO:teuthology.orchestra.run.smithi190.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-20T06:40:13.086 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.086 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default size = 2 2023-11-20T06:40:13.086 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.086 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow primary affinity = true 2023-11-20T06:40:13.086 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow pg remap = true 2023-11-20T06:40:13.087 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on legacy crush tunables = false 2023-11-20T06:40:13.087 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on crush straw calc version zero = false 2023-11-20T06:40:13.087 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on no sortbitwise = false 2023-11-20T06:40:13.087 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on osd down out interval zero = false 2023-11-20T06:40:13.087 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on too few osds = false 2023-11-20T06:40:13.087 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-20T06:40:13.088 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-20T06:40:13.088 INFO:teuthology.orchestra.run.smithi190.stdout: mon_allow_pool_size_one = true 2023-11-20T06:40:13.088 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.088 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-20T06:40:13.088 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.088 INFO:teuthology.orchestra.run.smithi190.stdout: osd default data pool replay window = 5 2023-11-20T06:40:13.088 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.089 INFO:teuthology.orchestra.run.smithi190.stdout: mon allow pool delete = true 2023-11-20T06:40:13.089 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.089 INFO:teuthology.orchestra.run.smithi190.stdout: mon cluster log file level = debug 2023-11-20T06:40:13.089 INFO:teuthology.orchestra.run.smithi190.stdout: debug asserts on shutdown = true 2023-11-20T06:40:13.089 INFO:teuthology.orchestra.run.smithi190.stdout: mon health detail to clog = false 2023-11-20T06:40:13.089 INFO:teuthology.orchestra.run.smithi190.stdout: mon host = "172.21.15.19,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2023-11-20T06:40:13.090 INFO:teuthology.orchestra.run.smithi190.stdout: fsid = c7c2bc89-520e-40d6-94f5-74b01db83356 2023-11-20T06:40:13.090 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.090 INFO:teuthology.orchestra.run.smithi190.stdout:[osd] 2023-11-20T06:40:13.090 INFO:teuthology.orchestra.run.smithi190.stdout: osd journal size = 100 2023-11-20T06:40:13.090 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.090 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub load threshold = 5.0 2023-11-20T06:40:13.091 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub max interval = 600 2023-11-20T06:40:13.091 INFO:teuthology.orchestra.run.smithi190.stdout: osd mclock profile = high_recovery_ops 2023-11-20T06:40:13.091 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.091 INFO:teuthology.orchestra.run.smithi190.stdout: osd recover clone overlap = true 2023-11-20T06:40:13.091 INFO:teuthology.orchestra.run.smithi190.stdout: osd recovery max chunk = 1048576 2023-11-20T06:40:13.091 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.091 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug shutdown = true 2023-11-20T06:40:13.092 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug op order = true 2023-11-20T06:40:13.092 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug verify stray on activate = true 2023-11-20T06:40:13.092 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.092 INFO:teuthology.orchestra.run.smithi190.stdout: osd open classes on start = true 2023-11-20T06:40:13.092 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug pg log writeout = true 2023-11-20T06:40:13.092 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.093 INFO:teuthology.orchestra.run.smithi190.stdout: osd deep scrub update digest min age = 30 2023-11-20T06:40:13.093 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.093 INFO:teuthology.orchestra.run.smithi190.stdout: osd map max advance = 10 2023-11-20T06:40:13.093 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.093 INFO:teuthology.orchestra.run.smithi190.stdout: journal zero on create = true 2023-11-20T06:40:13.093 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.093 INFO:teuthology.orchestra.run.smithi190.stdout: filestore ondisk finisher threads = 3 2023-11-20T06:40:13.094 INFO:teuthology.orchestra.run.smithi190.stdout: filestore apply finisher threads = 3 2023-11-20T06:40:13.094 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.094 INFO:teuthology.orchestra.run.smithi190.stdout: bdev debug aio = true 2023-11-20T06:40:13.094 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug misdirected ops = true 2023-11-20T06:40:13.094 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore block size = 96636764160 2023-11-20T06:40:13.094 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore fsck on mount = True 2023-11-20T06:40:13.094 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluefs = 20 2023-11-20T06:40:13.095 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluestore = 20 2023-11-20T06:40:13.095 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-11-20T06:40:13.095 INFO:teuthology.orchestra.run.smithi190.stdout: debug osd = 20 2023-11-20T06:40:13.095 INFO:teuthology.orchestra.run.smithi190.stdout: debug rocksdb = 10 2023-11-20T06:40:13.095 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd backfillfull_ratio = 0.85 2023-11-20T06:40:13.095 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd full ratio = 0.9 2023-11-20T06:40:13.095 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd nearfull ratio = 0.8 2023-11-20T06:40:13.096 INFO:teuthology.orchestra.run.smithi190.stdout: osd failsafe full ratio = 0.95 2023-11-20T06:40:13.096 INFO:teuthology.orchestra.run.smithi190.stdout: osd objectstore = bluestore 2023-11-20T06:40:13.096 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2023-11-20T06:40:13.096 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.096 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr] 2023-11-20T06:40:13.096 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-11-20T06:40:13.097 INFO:teuthology.orchestra.run.smithi190.stdout: debug mgr = 20 2023-11-20T06:40:13.097 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2023-11-20T06:40:13.097 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2023-11-20T06:40:13.097 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2023-11-20T06:40:13.097 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2023-11-20T06:40:13.097 INFO:teuthology.orchestra.run.smithi190.stdout: mgr/telemetry/nag = false 2023-11-20T06:40:13.097 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.098 INFO:teuthology.orchestra.run.smithi190.stdout:[mon] 2023-11-20T06:40:13.098 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-11-20T06:40:13.098 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2023-11-20T06:40:13.098 INFO:teuthology.orchestra.run.smithi190.stdout: debug paxos = 20 2023-11-20T06:40:13.098 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2023-11-20T06:40:13.098 INFO:teuthology.orchestra.run.smithi190.stdout: mon data avail warn = 5 2023-11-20T06:40:13.098 INFO:teuthology.orchestra.run.smithi190.stdout: mon mgr mkfs grace = 240 2023-11-20T06:40:13.099 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2023-11-20T06:40:13.099 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd reporter subtree level = osd 2023-11-20T06:40:13.099 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd prime pg temp = true 2023-11-20T06:40:13.099 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2023-11-20T06:40:13.099 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.099 INFO:teuthology.orchestra.run.smithi190.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-20T06:40:13.099 INFO:teuthology.orchestra.run.smithi190.stdout: auth mon ticket ttl = 660 # 11m 2023-11-20T06:40:13.100 INFO:teuthology.orchestra.run.smithi190.stdout: auth service ticket ttl = 240 # 4m 2023-11-20T06:40:13.100 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.100 INFO:teuthology.orchestra.run.smithi190.stdout: # don't complain about insecure global_id in the test suite 2023-11-20T06:40:13.100 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-20T06:40:13.100 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-20T06:40:13.100 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.101 INFO:teuthology.orchestra.run.smithi190.stdout: # 1m isn't quite enough 2023-11-20T06:40:13.101 INFO:teuthology.orchestra.run.smithi190.stdout: mon_down_mkfs_grace = 2m 2023-11-20T06:40:13.101 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.101 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_filestore_osds = false 2023-11-20T06:40:13.101 INFO:teuthology.orchestra.run.smithi190.stdout: mon op complaint time = 120 2023-11-20T06:40:13.101 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-20T06:40:13.102 INFO:teuthology.orchestra.run.smithi190.stdout:[client] 2023-11-20T06:40:13.102 INFO:teuthology.orchestra.run.smithi190.stdout: rgw cache enabled = true 2023-11-20T06:40:13.102 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable ops log = true 2023-11-20T06:40:13.102 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable usage log = true 2023-11-20T06:40:13.102 INFO:teuthology.orchestra.run.smithi190.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-20T06:40:13.102 INFO:teuthology.orchestra.run.smithi190.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-20T06:40:13.103 INFO:teuthology.orchestra.run.smithi190.stdout: client mount timeout = 600 2023-11-20T06:40:13.103 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2023-11-20T06:40:13.103 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-11-20T06:40:13.103 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = "" 2023-11-20T06:40:13.103 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2023-11-20T06:40:13.103 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2023-11-20T06:40:13.103 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.a] 2023-11-20T06:40:13.104 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.b] 2023-11-20T06:40:13.104 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.c] 2023-11-20T06:40:13.104 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2023-11-20T06:40:13.104 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.c] 2023-11-20T06:40:13.104 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2023-11-20T06:40:13.104 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.d] 2023-11-20T06:40:13.104 INFO:teuthology.orchestra.run.smithi190.stdout:[mds] 2023-11-20T06:40:13.104 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds = 20 2023-11-20T06:40:13.105 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds balancer = 20 2023-11-20T06:40:13.105 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-11-20T06:40:13.105 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug frag = True 2023-11-20T06:40:13.105 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug scatterstat = True 2023-11-20T06:40:13.105 INFO:teuthology.orchestra.run.smithi190.stdout: mds op complaint time = 180 2023-11-20T06:40:13.105 INFO:teuthology.orchestra.run.smithi190.stdout: mds verify scatter = True 2023-11-20T06:40:13.105 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2023-11-20T06:40:13.106 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2023-11-20T06:40:13.106 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2023-11-20T06:40:13.106 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-20T06:40:13.106 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-20T06:40:13.185 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-20T06:40:13.185 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:13.185 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-20T06:40:13.194 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:13.194 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-20T06:40:13.242 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi019.front.sepia.ceph.com 2023-11-20T06:40:13.243 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:13.243 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-20T06:40:13.243 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-20T06:40:13.319 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:13.319 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:40:13.375 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi190.front.sepia.ceph.com 2023-11-20T06:40:13.375 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:13.375 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-20T06:40:13.375 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-20T06:40:13.411 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:13.411 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:40:13.461 INFO:tasks.ceph:Setting up mon nodes... 2023-11-20T06:40:13.461 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-20T06:40:13.461 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-20T06:40:13.519 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-20T06:40:13.524 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-20T06:40:13.584 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-20T06:40:13.603 INFO:tasks.ceph:Setting up mds nodes... 2023-11-20T06:40:13.604 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-20T06:40:13.662 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-20T06:40:13.667 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-20T06:40:13.687 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-20T06:40:13.788 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-20T06:40:13.792 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-20T06:40:13.813 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-20T06:40:13.873 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-20T06:40:13.878 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-20T06:40:13.899 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-20T06:40:13.996 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-20T06:40:14.000 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-20T06:40:14.020 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-20T06:40:14.020 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-20T06:40:14.065 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-20T06:40:14.082 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-20T06:40:14.166 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-20T06:40:14.183 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-20T06:40:14.226 INFO:teuthology.orchestra.run.smithi190.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-20T06:40:14.243 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-20T06:40:14.326 INFO:teuthology.orchestra.run.smithi190.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-20T06:40:14.343 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-20T06:40:14.343 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-20T06:40:14.344 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-20T06:40:14.364 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-20T06:40:14.364 INFO:tasks.ceph:role: osd.0 2023-11-20T06:40:14.364 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com 2023-11-20T06:40:14.364 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-20T06:40:14.433 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-20T06:40:14.434 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-20T06:40:14.434 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-20T06:40:14.434 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-20T06:40:14.434 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-20T06:40:14.434 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2023-11-20T06:40:14.434 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-20T06:40:14.434 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-20T06:40:14.434 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-20T06:40:14.434 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-20T06:40:14.904 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2023-11-20T06:40:14.907 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2023-11-20T06:40:14.907 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-20T06:40:15.032 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-20T06:40:15.049 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: /sbin/restorecon: command not found 2023-11-20T06:40:15.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:40:15.050 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-20T06:40:15.110 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-20T06:40:15.110 INFO:tasks.ceph:role: osd.1 2023-11-20T06:40:15.110 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com 2023-11-20T06:40:15.111 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-20T06:40:15.182 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-20T06:40:15.182 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-20T06:40:15.182 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-20T06:40:15.182 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-20T06:40:15.182 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-20T06:40:15.182 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2023-11-20T06:40:15.183 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-20T06:40:15.183 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-20T06:40:15.183 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-20T06:40:15.183 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-20T06:40:15.619 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2023-11-20T06:40:15.622 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2023-11-20T06:40:15.622 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-20T06:40:15.694 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-20T06:40:15.751 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: /sbin/restorecon: command not found 2023-11-20T06:40:15.752 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:40:15.753 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-20T06:40:15.815 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-20T06:40:15.815 INFO:tasks.ceph:role: osd.2 2023-11-20T06:40:15.815 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com 2023-11-20T06:40:15.815 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-20T06:40:15.888 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-20T06:40:15.888 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-20T06:40:15.888 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-20T06:40:15.888 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-20T06:40:15.888 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-20T06:40:15.888 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2023-11-20T06:40:15.888 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-20T06:40:15.888 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-20T06:40:15.888 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-20T06:40:15.888 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-20T06:40:16.357 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2023-11-20T06:40:16.359 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2023-11-20T06:40:16.360 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-20T06:40:16.483 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-20T06:40:16.501 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: /sbin/restorecon: command not found 2023-11-20T06:40:16.502 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:40:16.502 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-20T06:40:16.571 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-20T06:40:16.571 INFO:tasks.ceph:role: osd.3 2023-11-20T06:40:16.572 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com 2023-11-20T06:40:16.572 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-20T06:40:16.643 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-20T06:40:16.644 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-20T06:40:16.644 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-20T06:40:16.644 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-20T06:40:16.644 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-20T06:40:16.644 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2023-11-20T06:40:16.644 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-20T06:40:16.644 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-20T06:40:16.644 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-20T06:40:16.644 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-20T06:40:17.136 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2023-11-20T06:40:17.138 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2023-11-20T06:40:17.139 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-20T06:40:17.299 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-20T06:40:17.318 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: /sbin/restorecon: command not found 2023-11-20T06:40:17.318 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:40:17.319 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:40:17.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:17.544+0000 7fbbb6b15640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-20T06:40:17.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:17.544+0000 7fbbb6b15640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-20T06:40:17.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:17.544+0000 7fbbb6b15640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-20T06:40:17.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:17.544+0000 7fbbb6b15640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-20T06:40:17.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:17.544+0000 7fbbb6b15640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-20T06:40:17.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:17.548+0000 7fbbb6b15640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-20T06:40:20.531 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-20T06:40:20.553 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:40:20.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:20.648+0000 7fadcdb31640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-20T06:40:20.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:20.648+0000 7fadcdb31640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-20T06:40:20.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:20.648+0000 7fadcdb31640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-20T06:40:20.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:20.648+0000 7fadcdb31640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-20T06:40:20.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:20.648+0000 7fadcdb31640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-20T06:40:20.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:20.648+0000 7fadcdb31640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-20T06:40:23.634 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-20T06:40:23.656 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:40:23.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:23.756+0000 7f5e77aba640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-20T06:40:23.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:23.756+0000 7f5e77aba640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-20T06:40:23.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:23.756+0000 7f5e77aba640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-20T06:40:23.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:23.756+0000 7f5e77aba640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-20T06:40:23.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:23.756+0000 7f5e77aba640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-20T06:40:23.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:23.756+0000 7f5e77aba640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-20T06:40:26.745 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-20T06:40:26.766 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:40:26.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:26.856+0000 7f9c0373a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-20T06:40:26.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:26.856+0000 7f9c0373a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-20T06:40:26.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:26.856+0000 7f9c0373a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-20T06:40:26.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:26.856+0000 7f9c0373a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-20T06:40:26.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:26.856+0000 7f9c0373a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-20T06:40:26.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:26.860+0000 7f9c0373a640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-20T06:40:29.845 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-20T06:40:29.866 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-20T06:40:29.889 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-20T06:40:29.889 INFO:tasks.ceph:role: osd.4 2023-11-20T06:40:29.889 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com 2023-11-20T06:40:29.889 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-20T06:40:29.960 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-20T06:40:29.961 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-20T06:40:29.961 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-20T06:40:29.961 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-20T06:40:29.961 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-20T06:40:29.961 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2023-11-20T06:40:29.961 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-20T06:40:29.961 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-20T06:40:29.961 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-20T06:40:29.961 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-20T06:40:30.427 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2023-11-20T06:40:30.430 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2023-11-20T06:40:30.431 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-20T06:40:30.541 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-20T06:40:30.558 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2023-11-20T06:40:30.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:40:30.560 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-20T06:40:30.624 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-20T06:40:30.625 INFO:tasks.ceph:role: osd.5 2023-11-20T06:40:30.625 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com 2023-11-20T06:40:30.625 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-20T06:40:30.696 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-20T06:40:30.696 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-20T06:40:30.696 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-20T06:40:30.696 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-20T06:40:30.696 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-20T06:40:30.696 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2023-11-20T06:40:30.696 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-20T06:40:30.697 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-20T06:40:30.697 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-20T06:40:30.697 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-20T06:40:31.189 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2023-11-20T06:40:31.192 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2023-11-20T06:40:31.192 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-20T06:40:31.354 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-20T06:40:31.372 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2023-11-20T06:40:31.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:40:31.374 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-20T06:40:31.437 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-20T06:40:31.437 INFO:tasks.ceph:role: osd.6 2023-11-20T06:40:31.437 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com 2023-11-20T06:40:31.438 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-20T06:40:31.508 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-20T06:40:31.508 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-20T06:40:31.508 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-20T06:40:31.508 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-20T06:40:31.508 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-20T06:40:31.508 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2023-11-20T06:40:31.508 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-20T06:40:31.508 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-20T06:40:31.509 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-20T06:40:31.509 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-20T06:40:31.989 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2023-11-20T06:40:31.991 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2023-11-20T06:40:31.992 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-20T06:40:32.117 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-20T06:40:32.135 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2023-11-20T06:40:32.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:40:32.136 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-20T06:40:32.200 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-20T06:40:32.200 INFO:tasks.ceph:role: osd.7 2023-11-20T06:40:32.200 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com 2023-11-20T06:40:32.201 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-20T06:40:32.272 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-20T06:40:32.272 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-20T06:40:32.273 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-20T06:40:32.273 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-20T06:40:32.273 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-20T06:40:32.273 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2023-11-20T06:40:32.273 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-20T06:40:32.273 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-20T06:40:32.273 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-20T06:40:32.273 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-20T06:40:32.726 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2023-11-20T06:40:32.729 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2023-11-20T06:40:32.729 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-20T06:40:32.842 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-20T06:40:32.860 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2023-11-20T06:40:32.860 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:40:32.861 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:40:32.993 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:32.993+0000 7f53c764a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-20T06:40:32.999 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:32.997+0000 7f53c764a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-20T06:40:32.999 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:32.997+0000 7f53c764a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-20T06:40:32.999 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:32.997+0000 7f53c764a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-20T06:40:32.999 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:32.997+0000 7f53c764a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-20T06:40:33.007 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:33.005+0000 7f53c764a640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-20T06:40:36.000 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-20T06:40:36.021 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:40:36.118 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:36.117+0000 7fe96642b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-20T06:40:36.119 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:36.117+0000 7fe96642b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-20T06:40:36.119 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:36.117+0000 7fe96642b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-20T06:40:36.119 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:36.117+0000 7fe96642b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-20T06:40:36.119 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:36.117+0000 7fe96642b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-20T06:40:36.120 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:36.121+0000 7fe96642b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-20T06:40:39.115 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-20T06:40:39.138 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:40:39.260 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:39.261+0000 7fee07d96640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-20T06:40:39.261 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:39.261+0000 7fee07d96640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-20T06:40:39.261 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:39.261+0000 7fee07d96640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-20T06:40:39.261 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:39.261+0000 7fee07d96640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-20T06:40:39.261 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:39.261+0000 7fee07d96640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-20T06:40:39.262 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:39.261+0000 7fee07d96640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-20T06:40:41.134 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T06:40:41.137 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T06:40:42.266 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-20T06:40:42.287 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:40:42.389 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:42.389+0000 7f374c73c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-20T06:40:42.390 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:42.389+0000 7f374c73c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-20T06:40:42.390 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:42.389+0000 7f374c73c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-20T06:40:42.390 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:42.389+0000 7f374c73c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-20T06:40:42.390 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:42.389+0000 7f374c73c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-20T06:40:42.391 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:42.389+0000 7f374c73c640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-20T06:40:45.387 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-20T06:40:45.409 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-20T06:40:45.409 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:45.409 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-20T06:40:45.433 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:45.433 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-20T06:40:45.496 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:45.496 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-20T06:40:45.560 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:45.561 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-20T06:40:45.628 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:45.628 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-20T06:40:45.692 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:45.692 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-20T06:40:45.756 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:45.756 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-20T06:40:45.819 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:45.819 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-20T06:40:45.841 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:45.841 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-20T06:40:45.904 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:45.904 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-20T06:40:45.968 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:45.968 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-20T06:40:46.032 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:46.032 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-20T06:40:46.095 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:46.095 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-20T06:40:46.159 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:46.160 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-20T06:40:46.224 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:46.224 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-20T06:40:46.234 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:46.234 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-20T06:40:46.287 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:46.287 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-20T06:40:46.296 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:46.296 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-20T06:40:46.352 INFO:tasks.ceph:Adding keys to all mons... 2023-11-20T06:40:46.352 DEBUG:teuthology.orchestra.run.smithi019:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-20T06:40:46.355 DEBUG:teuthology.orchestra.run.smithi190:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-20T06:40:46.399 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.y] 2023-11-20T06:40:46.399 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBN/1plCGv2HhAAjXKC/5InCTajc8lLun1ZKw== 2023-11-20T06:40:46.399 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a] 2023-11-20T06:40:46.399 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBN/1plueJ2JxAA1X+0m4LIEBxejFKNsHBvuA== 2023-11-20T06:40:46.400 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.c] 2023-11-20T06:40:46.400 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBN/1plCeb0LhAAVK2F02vjEZTukNnOvWqlPA== 2023-11-20T06:40:46.400 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.0] 2023-11-20T06:40:46.400 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBR/1plCymhIBAAWMlBu5HYWxv2RuFqtfKPnw== 2023-11-20T06:40:46.400 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.1] 2023-11-20T06:40:46.400 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBU/1plnk3UJhAA+g1Q4vJdakeTDrYPrLcmig== 2023-11-20T06:40:46.400 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.2] 2023-11-20T06:40:46.400 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBX/1pl6Q5JLRAA0rzlDYDhlwzhMvVk3YiWCQ== 2023-11-20T06:40:46.400 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.3] 2023-11-20T06:40:46.400 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBa/1plSMFaMxAAKB8Dj4GGh0+yS2JJLHEf6A== 2023-11-20T06:40:46.400 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.x] 2023-11-20T06:40:46.400 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBN/1pl3o4WIxAA/1d+cqWNjC8GwzVnwnoeuQ== 2023-11-20T06:40:46.400 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.b] 2023-11-20T06:40:46.401 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBN/1plUvpZNBAAH8Us2YdQ+wKZ6Zx3RepF0A== 2023-11-20T06:40:46.401 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.d] 2023-11-20T06:40:46.401 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBO/1pl7jgOABAAHQ0Uw7cQcMqNXmqZmA76kw== 2023-11-20T06:40:46.401 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.4] 2023-11-20T06:40:46.401 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBg/1plmDOAOxAAcjeT1uoNzSpk8v2TfRwkog== 2023-11-20T06:40:46.401 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.5] 2023-11-20T06:40:46.401 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBk/1plVAhXBxAAyUwk8TFLwAQ4lDP+g+FDzQ== 2023-11-20T06:40:46.401 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.6] 2023-11-20T06:40:46.401 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBn/1plow3PDxAAOPPnYvVKsDK1xR1bf0XGgg== 2023-11-20T06:40:46.401 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.7] 2023-11-20T06:40:46.401 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBq/1plW+t6FxAAOY9kXfQfuLWck5NI4EOawg== 2023-11-20T06:40:46.401 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2023-11-20T06:40:46.401 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBO/1plZE3cAxAAVTNRIC9TJrQlm6hYSU1RUQ== 2023-11-20T06:40:46.401 INFO:teuthology.orchestra.run.smithi019.stdout:[client.2] 2023-11-20T06:40:46.401 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBO/1plHl/iCRAA5TXRL4Fg8jMssjCtWrGIhg== 2023-11-20T06:40:46.402 INFO:teuthology.orchestra.run.smithi019.stdout:[client.1] 2023-11-20T06:40:46.402 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBO/1pl/ULKDRAAOW/ALrb8aYEzr1gginMraw== 2023-11-20T06:40:46.402 INFO:teuthology.orchestra.run.smithi019.stdout:[client.3] 2023-11-20T06:40:46.402 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBO/1plOKnBExAAPBj7JsuOWsmXJq82KGBLNQ== 2023-11-20T06:40:46.413 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.y] 2023-11-20T06:40:46.414 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBN/1plCGv2HhAAjXKC/5InCTajc8lLun1ZKw== 2023-11-20T06:40:46.414 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2023-11-20T06:40:46.414 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBN/1plueJ2JxAA1X+0m4LIEBxejFKNsHBvuA== 2023-11-20T06:40:46.414 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.c] 2023-11-20T06:40:46.414 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBN/1plCeb0LhAAVK2F02vjEZTukNnOvWqlPA== 2023-11-20T06:40:46.414 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.0] 2023-11-20T06:40:46.414 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBR/1plCymhIBAAWMlBu5HYWxv2RuFqtfKPnw== 2023-11-20T06:40:46.414 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.1] 2023-11-20T06:40:46.414 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBU/1plnk3UJhAA+g1Q4vJdakeTDrYPrLcmig== 2023-11-20T06:40:46.414 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.2] 2023-11-20T06:40:46.414 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBX/1pl6Q5JLRAA0rzlDYDhlwzhMvVk3YiWCQ== 2023-11-20T06:40:46.414 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.3] 2023-11-20T06:40:46.414 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBa/1plSMFaMxAAKB8Dj4GGh0+yS2JJLHEf6A== 2023-11-20T06:40:46.415 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.x] 2023-11-20T06:40:46.415 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBN/1pl3o4WIxAA/1d+cqWNjC8GwzVnwnoeuQ== 2023-11-20T06:40:46.415 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2023-11-20T06:40:46.415 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBN/1plUvpZNBAAH8Us2YdQ+wKZ6Zx3RepF0A== 2023-11-20T06:40:46.415 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.d] 2023-11-20T06:40:46.415 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBO/1pl7jgOABAAHQ0Uw7cQcMqNXmqZmA76kw== 2023-11-20T06:40:46.415 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.4] 2023-11-20T06:40:46.415 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBg/1plmDOAOxAAcjeT1uoNzSpk8v2TfRwkog== 2023-11-20T06:40:46.415 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.5] 2023-11-20T06:40:46.415 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBk/1plVAhXBxAAyUwk8TFLwAQ4lDP+g+FDzQ== 2023-11-20T06:40:46.415 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.6] 2023-11-20T06:40:46.415 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBn/1plow3PDxAAOPPnYvVKsDK1xR1bf0XGgg== 2023-11-20T06:40:46.415 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.7] 2023-11-20T06:40:46.415 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBq/1plW+t6FxAAOY9kXfQfuLWck5NI4EOawg== 2023-11-20T06:40:46.416 INFO:teuthology.orchestra.run.smithi190.stdout:[client.0] 2023-11-20T06:40:46.416 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBO/1plZE3cAxAAVTNRIC9TJrQlm6hYSU1RUQ== 2023-11-20T06:40:46.416 INFO:teuthology.orchestra.run.smithi190.stdout:[client.2] 2023-11-20T06:40:46.416 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBO/1plHl/iCRAA5TXRL4Fg8jMssjCtWrGIhg== 2023-11-20T06:40:46.416 INFO:teuthology.orchestra.run.smithi190.stdout:[client.1] 2023-11-20T06:40:46.416 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBO/1pl/ULKDRAAOW/ALrb8aYEzr1gginMraw== 2023-11-20T06:40:46.416 INFO:teuthology.orchestra.run.smithi190.stdout:[client.3] 2023-11-20T06:40:46.416 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBO/1plOKnBExAAPBj7JsuOWsmXJq82KGBLNQ== 2023-11-20T06:40:46.417 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-20T06:40:46.454 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-20T06:40:46.515 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-20T06:40:46.519 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-20T06:40:46.577 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-20T06:40:46.581 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-20T06:40:46.637 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T06:40:46.641 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T06:40:46.694 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T06:40:46.698 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T06:40:46.751 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T06:40:46.755 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T06:40:46.808 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T06:40:46.812 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T06:40:46.866 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-20T06:40:46.869 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-20T06:40:46.923 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-20T06:40:46.926 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-20T06:40:46.983 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-20T06:40:46.986 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-20T06:40:47.043 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T06:40:47.046 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T06:40:47.100 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T06:40:47.103 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T06:40:47.157 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T06:40:47.160 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T06:40:47.214 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T06:40:47.217 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T06:40:47.272 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-20T06:40:47.275 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-20T06:40:47.333 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-20T06:40:47.336 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-20T06:40:47.393 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-20T06:40:47.397 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-20T06:40:47.454 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-20T06:40:47.457 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-20T06:40:47.515 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-20T06:40:47.515 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-20T06:40:47.536 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-20T06:40:47.654 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-20T06:40:47.676 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-20T06:40:47.696 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-20T06:40:47.813 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-20T06:40:47.833 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-20T06:40:47.895 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-20T06:40:48.007 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-20T06:40:48.027 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:40:48.031 DEBUG:teuthology.orchestra.run.smithi190:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:40:48.079 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-20T06:40:48.079 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-20T06:40:48.079 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-20T06:40:48.082 INFO:tasks.ceph.mon.a:Started 2023-11-20T06:40:48.082 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-20T06:40:48.082 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-20T06:40:48.126 INFO:tasks.ceph.mon.b:Started 2023-11-20T06:40:48.126 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-20T06:40:48.126 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-20T06:40:48.129 INFO:tasks.ceph.mon.c:Started 2023-11-20T06:40:48.130 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-20T06:40:48.130 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-20T06:40:48.130 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-20T06:40:48.133 INFO:tasks.ceph.mgr.y:Started 2023-11-20T06:40:48.133 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-20T06:40:48.134 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-20T06:40:48.137 INFO:tasks.ceph.mgr.x:Started 2023-11-20T06:40:48.137 INFO:tasks.ceph:Setting crush tunables to default 2023-11-20T06:40:48.138 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd crush tunables default 2023-11-20T06:40:48.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.276+0000 7f0ffa209640 1 Processor -- start 2023-11-20T06:40:48.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.276+0000 7f0ffa209640 1 -- start start 2023-11-20T06:40:48.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.276+0000 7f0ffa209640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0ff406a5a0 0x7f0ff406e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:48.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.276+0000 7f0ffa209640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ff40b3f00 0x7f0ff40c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:48.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.276+0000 7f0ffa209640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff40b4370 con 0x7f0ff4159900 2023-11-20T06:40:48.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.276+0000 7f0ffa209640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff40cd740 con 0x7f0ff406a5a0 2023-11-20T06:40:48.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.276+0000 7f0ffa209640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40b4600 con 0x7f0ff40b3f00 2023-11-20T06:40:48.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.280+0000 7f0ff3fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ff40b3f00 0x7f0ff40c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:48.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.280+0000 7f0ff2ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0ff406a5a0 0x7f0ff406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:48.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.280+0000 7f0ff3fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ff40b3f00 0x7f0ff40c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:58972/0 (socket says 172.21.15.19:58972) 2023-11-20T06:40:48.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.280+0000 7f0ff3fff640 1 -- 172.21.15.19:0/819904673 learned_addr learned my addr 172.21.15.19:0/819904673 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:40:48.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.280+0000 7f0ff3fff640 1 -- 172.21.15.19:0/819904673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ff40b3f00 msgr2=0x7f0ff40c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-20T06:40:48.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.280+0000 7f0ff2ffd640 1 -- 172.21.15.19:0/819904673 >> v2:172.21.15.190:3300/0 conn(0x7f0ff406a5a0 msgr2=0x7f0ff406e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-20T06:40:48.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.280+0000 7f0ff3fff640 1 -- 172.21.15.19:0/819904673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ff40b3f00 msgr2=0x7f0ff40c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-20T06:40:48.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.280+0000 7f0ff2ffd640 1 -- 172.21.15.19:0/819904673 >> v2:172.21.15.190:3300/0 conn(0x7f0ff406a5a0 msgr2=0x7f0ff406e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-20T06:40:48.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.280+0000 7f0ff2ffd640 1 --2- 172.21.15.19:0/819904673 >> v2:172.21.15.190:3300/0 conn(0x7f0ff406a5a0 0x7f0ff406e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-20T06:40:48.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.280+0000 7f0ff3fff640 1 --2- 172.21.15.19:0/819904673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ff40b3f00 0x7f0ff40c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-20T06:40:48.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.280+0000 7f0ff2ffd640 1 --2- 172.21.15.19:0/819904673 >> v2:172.21.15.190:3300/0 conn(0x7f0ff406a5a0 0x7f0ff406e260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-20T06:40:48.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.280+0000 7f0ff3fff640 1 --2- 172.21.15.19:0/819904673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ff40b3f00 0x7f0ff40c9b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-20T06:40:48.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.444+0000 7f0ff27fc640 1 -- 172.21.15.19:0/819904673 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2918830187 0 0) 0x7f0ff40b4370 con 0x7f0ff4159900 2023-11-20T06:40:48.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.444+0000 7f0ff27fc640 1 -- 172.21.15.19:0/819904673 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fdc003530 con 0x7f0ff4159900 2023-11-20T06:40:48.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.444+0000 7f0ff27fc640 1 -- 172.21.15.19:0/819904673 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1352405124 0 0) 0x7f0fdc003530 con 0x7f0ff4159900 2023-11-20T06:40:48.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.444+0000 7f0ff27fc640 1 -- 172.21.15.19:0/819904673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ff40b3f00 msgr2=0x7f0ff40c9b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-20T06:40:48.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.444+0000 7f0ff27fc640 1 --2- 172.21.15.19:0/819904673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ff40b3f00 0x7f0ff40c9b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:48.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.444+0000 7f0ff27fc640 1 -- 172.21.15.19:0/819904673 >> v2:172.21.15.190:3300/0 conn(0x7f0ff406a5a0 msgr2=0x7f0ff406e260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-20T06:40:48.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.444+0000 7f0ff27fc640 1 --2- 172.21.15.19:0/819904673 >> v2:172.21.15.190:3300/0 conn(0x7f0ff406a5a0 0x7f0ff406e260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:48.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.444+0000 7f0ff27fc640 1 -- 172.21.15.19:0/819904673 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff40c8dd0 con 0x7f0ff4159900 2023-11-20T06:40:48.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.444+0000 7f0ff27fc640 1 -- 172.21.15.19:0/819904673 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7f0fe4001680 con 0x7f0ff4159900 2023-11-20T06:40:48.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.444+0000 7f0ff27fc640 1 -- 172.21.15.19:0/819904673 >> v1:172.21.15.19:6789/0 conn(0x7f0ff4159900 legacy=0x7f0ff4069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:48.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.444+0000 7f0ff27fc640 1 --2- 172.21.15.19:0/819904673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ff40b3f00 0x7f0fdc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:48.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.444+0000 7f0ff27fc640 1 --2- 172.21.15.19:0/819904673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fdc003fb0 0x7f0fdc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:48.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.444+0000 7f0ff27fc640 1 --2- 172.21.15.19:0/819904673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fdc004d10 0x7f0fdc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:48.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.444+0000 7f0ff27fc640 1 -- 172.21.15.19:0/819904673 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40cd740 con 0x7f0fdc004d10 2023-11-20T06:40:48.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.444+0000 7f0ff27fc640 1 -- 172.21.15.19:0/819904673 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40b4600 con 0x7f0fdc003fb0 2023-11-20T06:40:48.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.444+0000 7f0ff27fc640 1 -- 172.21.15.19:0/819904673 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc00ba90 con 0x7f0ff40b3f00 2023-11-20T06:40:48.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.444+0000 7f0ff37fe640 1 --2- 172.21.15.19:0/819904673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ff40b3f00 0x7f0fdc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:48.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.444+0000 7f0ff3fff640 1 --2- 172.21.15.19:0/819904673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fdc004d10 0x7f0fdc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:48.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.448+0000 7f0ff2ffd640 1 --2- 172.21.15.19:0/819904673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fdc003fb0 0x7f0fdc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.448+0000 7f0ff37fe640 1 -- 172.21.15.19:0/819904673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fdc003fb0 msgr2=0x7f0fdc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:40:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.448+0000 7f0ff37fe640 1 --2- 172.21.15.19:0/819904673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fdc003fb0 0x7f0fdc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.448+0000 7f0ff37fe640 1 -- 172.21.15.19:0/819904673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fdc004d10 msgr2=0x7f0fdc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:40:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.448+0000 7f0ff37fe640 1 --2- 172.21.15.19:0/819904673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fdc004d10 0x7f0fdc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.448+0000 7f0ff37fe640 1 -- 172.21.15.19:0/819904673 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc003530 con 0x7f0ff40b3f00 2023-11-20T06:40:48.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.448+0000 7f0ff37fe640 1 --2- 172.21.15.19:0/819904673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ff40b3f00 0x7f0fdc003980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400c110 tx=0x7f0fe401cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f73edc3922e0a339 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:48.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.448+0000 7f0ff27fc640 1 -- 172.21.15.19:0/819904673 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe40a5a80 con 0x7f0ff40b3f00 2023-11-20T06:40:48.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.448+0000 7f0ff27fc640 1 -- 172.21.15.19:0/819904673 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe40a5c00 con 0x7f0ff40b3f00 2023-11-20T06:40:48.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.452+0000 7f0ff27fc640 1 -- 172.21.15.19:0/819904673 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe40ad440 con 0x7f0ff40b3f00 2023-11-20T06:40:48.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.452+0000 7f0ffa209640 1 -- 172.21.15.19:0/819904673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ff40b3f00 msgr2=0x7f0fdc003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:48.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.452+0000 7f0ffa209640 1 --2- 172.21.15.19:0/819904673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ff40b3f00 0x7f0fdc003980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400c110 tx=0x7f0fe401cb80 comp rx=0 tx=0).stop 2023-11-20T06:40:48.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.452+0000 7f0ff3fff640 1 -- 172.21.15.19:0/819904673 reap_dead start 2023-11-20T06:40:48.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.452+0000 7f0ffa209640 1 -- 172.21.15.19:0/819904673 shutdown_connections 2023-11-20T06:40:48.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.452+0000 7f0ffa209640 1 -- 172.21.15.19:0/819904673 >> 172.21.15.19:0/819904673 conn(0x7f0ff40b0da0 msgr2=0x7f0ff40ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:48.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.452+0000 7f0ffa209640 1 -- 172.21.15.19:0/819904673 shutdown_connections 2023-11-20T06:40:48.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.452+0000 7f0ffa209640 1 -- 172.21.15.19:0/819904673 wait complete. 2023-11-20T06:40:48.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.452+0000 7f0ffa209640 1 Processor -- start 2023-11-20T06:40:48.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.452+0000 7f0ffa209640 1 -- start start 2023-11-20T06:40:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0ffa209640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ff40b3f00 0x7f0ff40b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0ffa209640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ff40c4710 0x7f0ff41f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0ffa209640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ff40c7fe0 0x7f0ff40c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0ffa209640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40c7bc0 con 0x7f0ff40c7fe0 2023-11-20T06:40:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0ffa209640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff415cb30 con 0x7f0ff40b3f00 2023-11-20T06:40:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0ffa209640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40b34d0 con 0x7f0ff40c4710 2023-11-20T06:40:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0ff37fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ff40b3f00 0x7f0ff40b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0ff3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ff40c7fe0 0x7f0ff40c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0ff37fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ff40b3f00 0x7f0ff40b2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:36946/0 (socket says 172.21.15.19:36946) 2023-11-20T06:40:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0ff37fe640 1 -- 172.21.15.19:0/3683145696 learned_addr learned my addr 172.21.15.19:0/3683145696 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:40:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0ff2ffd640 1 --2- 172.21.15.19:0/3683145696 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ff40c4710 0x7f0ff41f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0ff37fe640 1 -- 172.21.15.19:0/3683145696 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ff40c4710 msgr2=0x7f0ff41f7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0ff37fe640 1 --2- 172.21.15.19:0/3683145696 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ff40c4710 0x7f0ff41f7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0ff37fe640 1 -- 172.21.15.19:0/3683145696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ff40c7fe0 msgr2=0x7f0ff40c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0ff37fe640 1 --2- 172.21.15.19:0/3683145696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ff40c7fe0 0x7f0ff40c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0ff37fe640 1 -- 172.21.15.19:0/3683145696 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff40c7500 con 0x7f0ff40b3f00 2023-11-20T06:40:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0ff37fe640 1 --2- 172.21.15.19:0/3683145696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ff40b3f00 0x7f0ff40b2e80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0fe401c9b0 tx=0x7f0fdc005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:48.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0fdbfff640 1 -- 172.21.15.19:0/3683145696 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4003600 con 0x7f0ff40b3f00 2023-11-20T06:40:48.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0fdbfff640 1 -- 172.21.15.19:0/3683145696 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe4003780 con 0x7f0ff40b3f00 2023-11-20T06:40:48.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0ffa209640 1 -- 172.21.15.19:0/3683145696 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff415cb30 con 0x7f0ff40b3f00 2023-11-20T06:40:48.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0fdbfff640 1 -- 172.21.15.19:0/3683145696 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4003b30 con 0x7f0ff40b3f00 2023-11-20T06:40:48.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0ffa209640 1 -- 172.21.15.19:0/3683145696 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff41f81a0 con 0x7f0ff40b3f00 2023-11-20T06:40:48.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0fdbfff640 1 -- 172.21.15.19:0/3683145696 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0fe40b4040 con 0x7f0ff40b3f00 2023-11-20T06:40:48.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0fdbfff640 1 -- 172.21.15.19:0/3683145696 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0fe40b6410 con 0x7f0ff40b3f00 2023-11-20T06:40:48.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.456+0000 7f0ffa209640 1 -- 172.21.15.19:0/3683145696 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff40c7e30 con 0x7f0ff40b3f00 2023-11-20T06:40:48.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.464+0000 7f0fdbfff640 1 -- 172.21.15.19:0/3683145696 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f0fe40c3060 con 0x7f0ff40b3f00 2023-11-20T06:40:48.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.528+0000 7f0ffa209640 1 -- 172.21.15.19:0/3683145696 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f0ff404e170 con 0x7f0ff40b3f00 2023-11-20T06:40:48.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.532+0000 7f0fdbfff640 1 -- 172.21.15.19:0/3683145696 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0fe40b2070 con 0x7f0ff40b3f00 2023-11-20T06:40:48.539 INFO:teuthology.orchestra.run.smithi019.stderr:adjusted tunables profile to default 2023-11-20T06:40:48.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.536+0000 7f0ffa209640 1 -- 172.21.15.19:0/3683145696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ff40b3f00 msgr2=0x7f0ff40b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:48.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.536+0000 7f0ffa209640 1 --2- 172.21.15.19:0/3683145696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ff40b3f00 0x7f0ff40b2e80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0fe401c9b0 tx=0x7f0fdc005800 comp rx=0 tx=0).stop 2023-11-20T06:40:48.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.536+0000 7f0ffa209640 1 -- 172.21.15.19:0/3683145696 shutdown_connections 2023-11-20T06:40:48.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.536+0000 7f0ffa209640 1 --2- 172.21.15.19:0/3683145696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ff40c7fe0 0x7f0ff40c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:48.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.536+0000 7f0ffa209640 1 --2- 172.21.15.19:0/3683145696 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ff40c4710 0x7f0ff41f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:48.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.536+0000 7f0ffa209640 1 --2- 172.21.15.19:0/3683145696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ff40b3f00 0x7f0ff40b2e80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:48.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.536+0000 7f0ffa209640 1 -- 172.21.15.19:0/3683145696 >> 172.21.15.19:0/3683145696 conn(0x7f0ff40b0da0 msgr2=0x7f0ff40ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:48.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.536+0000 7f0ffa209640 1 -- 172.21.15.19:0/3683145696 shutdown_connections 2023-11-20T06:40:48.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:48.536+0000 7f0ffa209640 1 -- 172.21.15.19:0/3683145696 wait complete. 2023-11-20T06:40:48.560 INFO:tasks.ceph:check_enable_crimson: False 2023-11-20T06:40:48.560 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-20T06:40:48.560 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:48.560 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-20T06:40:48.581 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:48.581 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-20T06:40:48.644 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:48.640+0000 7f9228f77180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-20T06:40:48.647 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:48.647 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-20T06:40:48.680 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:48.681+0000 7fd78dd3f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-20T06:40:48.711 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:40:48.711 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-20T06:40:48.775 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:48.775 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-20T06:40:48.795 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:48.795 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-20T06:40:48.859 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:48.859 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-20T06:40:48.923 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:40:48.923 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-20T06:40:48.987 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 97480584-2afe-494f-8b44-72f6c2894d22 0 2023-11-20T06:40:49.162 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.161+0000 7f006679d640 1 Processor -- start 2023-11-20T06:40:49.162 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.161+0000 7f006679d640 1 -- start start 2023-11-20T06:40:49.163 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.161+0000 7f006679d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f006015cba0 0x7f00600d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.161+0000 7f006679d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f00600b84e0 0x7f00600cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.161+0000 7f006679d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00600d1670 con 0x7f00600d0040 2023-11-20T06:40:49.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.161+0000 7f006679d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00600d1460 con 0x7f006015cba0 2023-11-20T06:40:49.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.161+0000 7f006679d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00600d04b0 con 0x7f00600b84e0 2023-11-20T06:40:49.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.161+0000 7f005f7fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f00600b84e0 0x7f00600cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.161+0000 7f005f7fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f00600b84e0 0x7f00600cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:50934/0 (socket says 172.21.15.190:50934) 2023-11-20T06:40:49.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.161+0000 7f005f7fe640 1 -- 172.21.15.190:0/3255121596 learned_addr learned my addr 172.21.15.190:0/3255121596 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-20T06:40:49.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.161+0000 7f0064d3a640 1 --1- 172.21.15.190:0/3255121596 >> v1:172.21.15.190:6789/0 conn(0x7f00600d0040 0x7f00600d2ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:51644/0 (socket says 172.21.15.190:51644) 2023-11-20T06:40:49.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.165+0000 7f005ffff640 1 --2- 172.21.15.190:0/3255121596 >> v2:172.21.15.19:3300/0 conn(0x7f006015cba0 0x7f00600d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.165 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.165+0000 7f005f7fe640 1 -- 172.21.15.190:0/3255121596 >> v2:172.21.15.19:3300/0 conn(0x7f006015cba0 msgr2=0x7f00600d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:40:49.165 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.165+0000 7f005f7fe640 1 --2- 172.21.15.190:0/3255121596 >> v2:172.21.15.19:3300/0 conn(0x7f006015cba0 0x7f00600d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.165 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.165+0000 7f005f7fe640 1 -- 172.21.15.190:0/3255121596 >> v1:172.21.15.190:6789/0 conn(0x7f00600d0040 legacy=0x7f00600d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:49.165 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.165+0000 7f005f7fe640 1 -- 172.21.15.190:0/3255121596 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00600d1950 con 0x7f00600b84e0 2023-11-20T06:40:49.165 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.165+0000 7f005effd640 1 -- 172.21.15.190:0/3255121596 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606336959 0 0) 0x7f00600d1670 con 0x7f00600d0040 2023-11-20T06:40:49.167 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.165+0000 7f005f7fe640 1 --2- 172.21.15.190:0/3255121596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00600b84e0 0x7f00600cfb00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f00600cf2f0 tx=0x7f005401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6632b7e77f01cef server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:49.167 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.165+0000 7f005effd640 1 -- 172.21.15.190:0/3255121596 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00540a8050 con 0x7f00600b84e0 2023-11-20T06:40:49.167 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.165+0000 7f005effd640 1 -- 172.21.15.190:0/3255121596 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00540ac5f0 con 0x7f00600b84e0 2023-11-20T06:40:49.167 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.165+0000 7f005effd640 1 -- 172.21.15.190:0/3255121596 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00540ac980 con 0x7f00600b84e0 2023-11-20T06:40:49.168 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f006679d640 1 -- 172.21.15.190:0/3255121596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00600b84e0 msgr2=0x7f00600cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:49.168 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f006679d640 1 --2- 172.21.15.190:0/3255121596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00600b84e0 0x7f00600cfb00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f00600cf2f0 tx=0x7f005401c470 comp rx=0 tx=0).stop 2023-11-20T06:40:49.168 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f006679d640 1 -- 172.21.15.190:0/3255121596 shutdown_connections 2023-11-20T06:40:49.169 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f006679d640 1 --2- 172.21.15.190:0/3255121596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00600b84e0 0x7f00600cfb00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.169 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f006679d640 1 --2- 172.21.15.190:0/3255121596 >> v2:172.21.15.19:3300/0 conn(0x7f006015cba0 0x7f00600d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.169 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f006679d640 1 -- 172.21.15.190:0/3255121596 >> 172.21.15.190:0/3255121596 conn(0x7f00600719c0 msgr2=0x7f0060071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:49.169 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f006679d640 1 -- 172.21.15.190:0/3255121596 shutdown_connections 2023-11-20T06:40:49.169 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f006679d640 1 -- 172.21.15.190:0/3255121596 wait complete. 2023-11-20T06:40:49.169 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f006679d640 1 Processor -- start 2023-11-20T06:40:49.170 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f006679d640 1 -- start start 2023-11-20T06:40:49.171 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f006679d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00600b84e0 0x7f0060157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.171 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f006679d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00600d0040 0x7f00600c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.171 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f006679d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f006015cba0 0x7f00600c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.171 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f006679d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0060153ac0 con 0x7f006015cba0 2023-11-20T06:40:49.171 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f006679d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00600c7230 con 0x7f00600b84e0 2023-11-20T06:40:49.172 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f006679d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0060153500 con 0x7f00600d0040 2023-11-20T06:40:49.172 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f005f7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00600d0040 0x7f00600c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.172 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f005ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00600b84e0 0x7f0060157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.172 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f005ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00600b84e0 0x7f0060157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:50948/0 (socket says 172.21.15.190:50948) 2023-11-20T06:40:49.172 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f005f7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00600d0040 0x7f00600c9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:32900/0 (socket says 172.21.15.190:32900) 2023-11-20T06:40:49.172 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f005ffff640 1 -- 172.21.15.190:0/2807125118 learned_addr learned my addr 172.21.15.190:0/2807125118 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-20T06:40:49.172 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.169+0000 7f0064d3a640 1 --2- 172.21.15.190:0/2807125118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f006015cba0 0x7f00600c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.174 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.173+0000 7f005ffff640 1 -- 172.21.15.190:0/2807125118 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00600d0040 msgr2=0x7f00600c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:49.174 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.173+0000 7f005ffff640 1 --2- 172.21.15.190:0/2807125118 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00600d0040 0x7f00600c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.174 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.173+0000 7f005ffff640 1 -- 172.21.15.190:0/2807125118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f006015cba0 msgr2=0x7f00600c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:49.174 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.173+0000 7f005ffff640 1 --2- 172.21.15.190:0/2807125118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f006015cba0 0x7f00600c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.174 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.173+0000 7f005ffff640 1 -- 172.21.15.190:0/2807125118 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00540094d0 con 0x7f00600b84e0 2023-11-20T06:40:49.174 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.173+0000 7f005f7fe640 1 --2- 172.21.15.190:0/2807125118 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00600d0040 0x7f00600c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:40:49.174 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.173+0000 7f005ffff640 1 --2- 172.21.15.190:0/2807125118 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00600b84e0 0x7f0060157e90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f005000e8a0 tx=0x7f005000eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:49.174 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.173+0000 7f005cff9640 1 -- 172.21.15.190:0/2807125118 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0050009510 con 0x7f00600b84e0 2023-11-20T06:40:49.174 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.173+0000 7f005cff9640 1 -- 172.21.15.190:0/2807125118 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005000c940 con 0x7f00600b84e0 2023-11-20T06:40:49.175 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.173+0000 7f006679d640 1 -- 172.21.15.190:0/2807125118 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00601537e0 con 0x7f00600b84e0 2023-11-20T06:40:49.175 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.173+0000 7f005cff9640 1 -- 172.21.15.190:0/2807125118 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005000ccb0 con 0x7f00600b84e0 2023-11-20T06:40:49.175 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.173+0000 7f006679d640 1 -- 172.21.15.190:0/2807125118 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0060152dc0 con 0x7f00600b84e0 2023-11-20T06:40:49.175 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.173+0000 7f005cff9640 1 -- 172.21.15.190:0/2807125118 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0050005ca0 con 0x7f00600b84e0 2023-11-20T06:40:49.175 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.173+0000 7f005cff9640 1 -- 172.21.15.190:0/2807125118 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f00500137b0 con 0x7f00600b84e0 2023-11-20T06:40:49.175 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.173+0000 7f006679d640 1 -- 172.21.15.190:0/2807125118 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00600c7090 con 0x7f00600b84e0 2023-11-20T06:40:49.175 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.177+0000 7f005cff9640 1 -- 172.21.15.190:0/2807125118 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f00600c7090 con 0x7f00600b84e0 2023-11-20T06:40:49.217 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:49.212+0000 7f9228f77180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-20T06:40:49.223 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:49.225+0000 7fd78dd3f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-20T06:40:49.241 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.241+0000 7f006679d640 1 -- 172.21.15.190:0/2807125118 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "97480584-2afe-494f-8b44-72f6c2894d22", "id": 0} v 0) v1 -- 0x7f006004e170 con 0x7f00600b84e0 2023-11-20T06:40:49.246 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.245+0000 7f005cff9640 1 -- 172.21.15.190:0/2807125118 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "97480584-2afe-494f-8b44-72f6c2894d22", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0050021060 con 0x7f00600b84e0 2023-11-20T06:40:49.246 INFO:teuthology.orchestra.run.smithi190.stdout:0 2023-11-20T06:40:49.247 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.245+0000 7f006679d640 1 -- 172.21.15.190:0/2807125118 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00600b84e0 msgr2=0x7f0060157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:49.247 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.245+0000 7f006679d640 1 --2- 172.21.15.190:0/2807125118 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00600b84e0 0x7f0060157e90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f005000e8a0 tx=0x7f005000eca0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.248 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.245+0000 7f006679d640 1 -- 172.21.15.190:0/2807125118 shutdown_connections 2023-11-20T06:40:49.248 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.245+0000 7f006679d640 1 --2- 172.21.15.190:0/2807125118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f006015cba0 0x7f00600c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.248 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.245+0000 7f006679d640 1 --2- 172.21.15.190:0/2807125118 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00600d0040 0x7f00600c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.248 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.245+0000 7f006679d640 1 --2- 172.21.15.190:0/2807125118 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00600b84e0 0x7f0060157e90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.248 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.245+0000 7f006679d640 1 -- 172.21.15.190:0/2807125118 >> 172.21.15.190:0/2807125118 conn(0x7f00600719c0 msgr2=0x7f0060072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:49.248 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.249+0000 7f006679d640 1 -- 172.21.15.190:0/2807125118 shutdown_connections 2023-11-20T06:40:49.248 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.249+0000 7f006679d640 1 -- 172.21.15.190:0/2807125118 wait complete. 2023-11-20T06:40:49.266 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new c5914a79-b0fc-46eb-a106-10473dac1449 1 2023-11-20T06:40:49.404 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.405+0000 7fdd02b80640 1 Processor -- start 2023-11-20T06:40:49.404 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.405+0000 7fdd02b80640 1 -- start start 2023-11-20T06:40:49.406 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.405+0000 7fdd02b80640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdcfc15cc30 0x7fdcfc0b8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.406 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.405+0000 7fdd02b80640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdcfc0cd840 0x7fdcfc0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.406 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.405+0000 7fdd02b80640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcfc15d010 con 0x7fdcfc0d0f90 2023-11-20T06:40:49.406 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.405+0000 7fdd02b80640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcfc0b74d0 con 0x7fdcfc15cc30 2023-11-20T06:40:49.406 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.405+0000 7fdd02b80640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcfc0b77b0 con 0x7fdcfc0cd840 2023-11-20T06:40:49.406 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.405+0000 7fdcfbfff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdcfc0cd840 0x7fdcfc0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.406 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.405+0000 7fdcfbfff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdcfc0cd840 0x7fdcfc0cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:50954/0 (socket says 172.21.15.190:50954) 2023-11-20T06:40:49.406 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.405+0000 7fdcfbfff640 1 -- 172.21.15.190:0/3598316110 learned_addr learned my addr 172.21.15.190:0/3598316110 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-20T06:40:49.406 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.405+0000 7fdd0091c640 1 --2- 172.21.15.190:0/3598316110 >> v2:172.21.15.19:3300/0 conn(0x7fdcfc15cc30 0x7fdcfc0b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.407 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.405+0000 7fdcfbfff640 1 -- 172.21.15.190:0/3598316110 >> v2:172.21.15.19:3300/0 conn(0x7fdcfc15cc30 msgr2=0x7fdcfc0b8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:40:49.407 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.405+0000 7fdcfbfff640 1 --2- 172.21.15.190:0/3598316110 >> v2:172.21.15.19:3300/0 conn(0x7fdcfc15cc30 0x7fdcfc0b8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.407 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.405+0000 7fdcfbfff640 1 -- 172.21.15.190:0/3598316110 >> v1:172.21.15.19:6789/0 conn(0x7fdcfc0d0f90 legacy=0x7fdcfc0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:49.407 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.405+0000 7fdcfb7fe640 1 -- 172.21.15.190:0/3598316110 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1259828553 0 0) 0x7fdcfc15d010 con 0x7fdcfc0d0f90 2023-11-20T06:40:49.408 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.405+0000 7fdcfbfff640 1 -- 172.21.15.190:0/3598316110 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc0b7a90 con 0x7fdcfc0cd840 2023-11-20T06:40:49.411 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.409+0000 7fdcfbfff640 1 --2- 172.21.15.190:0/3598316110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcfc0cd840 0x7fdcfc0cdc80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0cf430 tx=0x7fdce801ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ebc55ebe2694d75 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:49.411 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.409+0000 7fdcfb7fe640 1 -- 172.21.15.190:0/3598316110 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce80a89f0 con 0x7fdcfc0cd840 2023-11-20T06:40:49.411 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.409+0000 7fdcfb7fe640 1 -- 172.21.15.190:0/3598316110 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce80a8b50 con 0x7fdcfc0cd840 2023-11-20T06:40:49.411 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.409+0000 7fdcfb7fe640 1 -- 172.21.15.190:0/3598316110 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce80b0440 con 0x7fdcfc0cd840 2023-11-20T06:40:49.412 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdd02b80640 1 -- 172.21.15.190:0/3598316110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcfc0cd840 msgr2=0x7fdcfc0cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:49.412 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdd02b80640 1 --2- 172.21.15.190:0/3598316110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcfc0cd840 0x7fdcfc0cdc80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0cf430 tx=0x7fdce801ecf0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.413 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdd02b80640 1 -- 172.21.15.190:0/3598316110 shutdown_connections 2023-11-20T06:40:49.413 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdd02b80640 1 --2- 172.21.15.190:0/3598316110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcfc0cd840 0x7fdcfc0cdc80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.413 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdd02b80640 1 --2- 172.21.15.190:0/3598316110 >> v2:172.21.15.19:3300/0 conn(0x7fdcfc15cc30 0x7fdcfc0b8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.413 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdd02b80640 1 -- 172.21.15.190:0/3598316110 >> 172.21.15.190:0/3598316110 conn(0x7fdcfc06b750 msgr2=0x7fdcfc06bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:49.413 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdd02b80640 1 -- 172.21.15.190:0/3598316110 shutdown_connections 2023-11-20T06:40:49.413 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdd02b80640 1 -- 172.21.15.190:0/3598316110 wait complete. 2023-11-20T06:40:49.414 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdd02b80640 1 Processor -- start 2023-11-20T06:40:49.414 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdd02b80640 1 -- start start 2023-11-20T06:40:49.415 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdd02b80640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcfc0cd840 0x7fdcfc14aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.415 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdd02b80640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcfc0d0f90 0x7fdcfc153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.416 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdd02b80640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcfc15cc30 0x7fdcfc154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.416 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdd02b80640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc0cc350 con 0x7fdcfc0d0f90 2023-11-20T06:40:49.416 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdd02b80640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc0cbec0 con 0x7fdcfc15cc30 2023-11-20T06:40:49.416 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdd02b80640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc0b5f90 con 0x7fdcfc0cd840 2023-11-20T06:40:49.416 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdd0091c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcfc0cd840 0x7fdcfc14aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.416 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdd0091c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcfc0cd840 0x7fdcfc14aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:32914/0 (socket says 172.21.15.190:32914) 2023-11-20T06:40:49.416 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdd0091c640 1 -- 172.21.15.190:0/691594525 learned_addr learned my addr 172.21.15.190:0/691594525 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-20T06:40:49.416 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdd0111d640 1 --2- 172.21.15.190:0/691594525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcfc15cc30 0x7fdcfc154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.416 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.413+0000 7fdcfbfff640 1 --2- 172.21.15.190:0/691594525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcfc0d0f90 0x7fdcfc153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.417 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.417+0000 7fdd0091c640 1 -- 172.21.15.190:0/691594525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcfc15cc30 msgr2=0x7fdcfc154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:49.417 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.417+0000 7fdd0091c640 1 --2- 172.21.15.190:0/691594525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcfc15cc30 0x7fdcfc154320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.418 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.417+0000 7fdd0091c640 1 -- 172.21.15.190:0/691594525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcfc0d0f90 msgr2=0x7fdcfc153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:49.418 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.417+0000 7fdd0091c640 1 --2- 172.21.15.190:0/691594525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcfc0d0f90 0x7fdcfc153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.418 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.417+0000 7fdd0091c640 1 -- 172.21.15.190:0/691594525 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce80094d0 con 0x7fdcfc0cd840 2023-11-20T06:40:49.418 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.417+0000 7fdd0091c640 1 --2- 172.21.15.190:0/691594525 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcfc0cd840 0x7fdcfc14aff0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000e8a0 tx=0x7fdcf000eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:49.418 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.417+0000 7fdcf97fa640 1 -- 172.21.15.190:0/691594525 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0009510 con 0x7fdcfc0cd840 2023-11-20T06:40:49.418 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.417+0000 7fdcf97fa640 1 -- 172.21.15.190:0/691594525 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf000c940 con 0x7fdcfc0cd840 2023-11-20T06:40:49.418 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.417+0000 7fdd02b80640 1 -- 172.21.15.190:0/691594525 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcfc0b6270 con 0x7fdcfc0cd840 2023-11-20T06:40:49.418 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.417+0000 7fdcf97fa640 1 -- 172.21.15.190:0/691594525 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf000ccb0 con 0x7fdcfc0cd840 2023-11-20T06:40:49.418 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.417+0000 7fdd02b80640 1 -- 172.21.15.190:0/691594525 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcfc0cc8c0 con 0x7fdcfc0cd840 2023-11-20T06:40:49.418 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.417+0000 7fdcf97fa640 1 -- 172.21.15.190:0/691594525 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdcf0005ca0 con 0x7fdcfc0cd840 2023-11-20T06:40:49.418 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.417+0000 7fdcf97fa640 1 -- 172.21.15.190:0/691594525 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fdcf0013820 con 0x7fdcfc0cd840 2023-11-20T06:40:49.419 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.417+0000 7fdd02b80640 1 -- 172.21.15.190:0/691594525 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcfc0cb980 con 0x7fdcfc0cd840 2023-11-20T06:40:49.428 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.429+0000 7fdcf97fa640 1 -- 172.21.15.190:0/691594525 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fdcf0021060 con 0x7fdcfc0cd840 2023-11-20T06:40:49.430 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:49.424+0000 7f9228f77180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-20T06:40:49.434 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:49.433+0000 7fd78dd3f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-20T06:40:49.496 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.497+0000 7fdd02b80640 1 -- 172.21.15.190:0/691594525 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c5914a79-b0fc-46eb-a106-10473dac1449", "id": 1} v 0) v1 -- 0x7fdcfc067230 con 0x7fdcfc0cd840 2023-11-20T06:40:49.504 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.505+0000 7fdcf97fa640 1 -- 172.21.15.190:0/691594525 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c5914a79-b0fc-46eb-a106-10473dac1449", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdcf0017070 con 0x7fdcfc0cd840 2023-11-20T06:40:49.504 INFO:teuthology.orchestra.run.smithi190.stdout:1 2023-11-20T06:40:49.505 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.505+0000 7fdd02b80640 1 -- 172.21.15.190:0/691594525 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcfc0cd840 msgr2=0x7fdcfc14aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:49.505 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.505+0000 7fdd02b80640 1 --2- 172.21.15.190:0/691594525 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcfc0cd840 0x7fdcfc14aff0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000e8a0 tx=0x7fdcf000eca0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.505 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.505+0000 7fdd02b80640 1 -- 172.21.15.190:0/691594525 shutdown_connections 2023-11-20T06:40:49.505 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.505+0000 7fdd02b80640 1 --2- 172.21.15.190:0/691594525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcfc15cc30 0x7fdcfc154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.506 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.505+0000 7fdd02b80640 1 --2- 172.21.15.190:0/691594525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcfc0d0f90 0x7fdcfc153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.506 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.505+0000 7fdd02b80640 1 --2- 172.21.15.190:0/691594525 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcfc0cd840 0x7fdcfc14aff0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.506 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.505+0000 7fdd02b80640 1 -- 172.21.15.190:0/691594525 >> 172.21.15.190:0/691594525 conn(0x7fdcfc06b750 msgr2=0x7fdcfc15b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:49.506 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.505+0000 7fdd02b80640 1 -- 172.21.15.190:0/691594525 shutdown_connections 2023-11-20T06:40:49.506 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.505+0000 7fdd02b80640 1 -- 172.21.15.190:0/691594525 wait complete. 2023-11-20T06:40:49.523 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new b3a547ad-a724-457a-9dea-69d8d6b0fa7d 2 2023-11-20T06:40:49.659 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.657+0000 7f547a79d640 1 Processor -- start 2023-11-20T06:40:49.659 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.657+0000 7f547a79d640 1 -- start start 2023-11-20T06:40:49.661 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.661+0000 7f547a79d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f547415cba0 0x7f54740d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.661 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.661+0000 7f547a79d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f54740b84e0 0x7f54740cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.661 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.661+0000 7f547a79d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f54740d0040 0x7f54740d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.661 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.661+0000 7f547a79d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54740d1460 con 0x7f54740b84e0 2023-11-20T06:40:49.661 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.661+0000 7f547a79d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54740d04b0 con 0x7f54740d0040 2023-11-20T06:40:49.661 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.661+0000 7f547a79d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54740d1670 con 0x7f547415cba0 2023-11-20T06:40:49.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.661+0000 7f5473fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f547415cba0 0x7f54740d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.661+0000 7f5478d3a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f54740d0040 0x7f54740d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.661+0000 7f5473fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f547415cba0 0x7f54740d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:32920/0 (socket says 172.21.15.190:32920) 2023-11-20T06:40:49.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.661+0000 7f5473fff640 1 -- 172.21.15.190:0/4155665269 learned_addr learned my addr 172.21.15.190:0/4155665269 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-20T06:40:49.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.661+0000 7f54737fe640 1 --2- 172.21.15.190:0/4155665269 >> v2:172.21.15.19:3300/0 conn(0x7f54740b84e0 0x7f54740cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.661+0000 7f5473fff640 1 -- 172.21.15.190:0/4155665269 >> v2:172.21.15.190:3300/0 conn(0x7f54740d0040 msgr2=0x7f54740d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:40:49.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.661+0000 7f5473fff640 1 --2- 172.21.15.190:0/4155665269 >> v2:172.21.15.190:3300/0 conn(0x7f54740d0040 0x7f54740d2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.661+0000 7f5473fff640 1 -- 172.21.15.190:0/4155665269 >> v2:172.21.15.19:3300/0 conn(0x7f54740b84e0 msgr2=0x7f54740cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:40:49.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.661+0000 7f5473fff640 1 --2- 172.21.15.190:0/4155665269 >> v2:172.21.15.19:3300/0 conn(0x7f54740b84e0 0x7f54740cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.661+0000 7f5473fff640 1 -- 172.21.15.190:0/4155665269 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54740d1950 con 0x7f547415cba0 2023-11-20T06:40:49.664 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.665+0000 7f5473fff640 1 --2- 172.21.15.190:0/4155665269 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f547415cba0 0x7f54740d0f20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f54740cf040 tx=0x7f546401c240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41fc0e6c8e3efb25 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:49.664 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.665+0000 7f5472ffd640 1 -- 172.21.15.190:0/4155665269 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54640ab600 con 0x7f547415cba0 2023-11-20T06:40:49.664 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.665+0000 7f5472ffd640 1 -- 172.21.15.190:0/4155665269 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54640a7050 con 0x7f547415cba0 2023-11-20T06:40:49.664 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.665+0000 7f5472ffd640 1 -- 172.21.15.190:0/4155665269 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54640ab980 con 0x7f547415cba0 2023-11-20T06:40:49.665 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.665+0000 7f547a79d640 1 -- 172.21.15.190:0/4155665269 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f547415cba0 msgr2=0x7f54740d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:49.665 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.665+0000 7f547a79d640 1 --2- 172.21.15.190:0/4155665269 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f547415cba0 0x7f54740d0f20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f54740cf040 tx=0x7f546401c240 comp rx=0 tx=0).stop 2023-11-20T06:40:49.665 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.665+0000 7f547a79d640 1 -- 172.21.15.190:0/4155665269 shutdown_connections 2023-11-20T06:40:49.665 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.665+0000 7f547a79d640 1 --2- 172.21.15.190:0/4155665269 >> v2:172.21.15.190:3300/0 conn(0x7f54740d0040 0x7f54740d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.665+0000 7f547a79d640 1 --2- 172.21.15.190:0/4155665269 >> v2:172.21.15.19:3300/0 conn(0x7f54740b84e0 0x7f54740cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.665+0000 7f547a79d640 1 --2- 172.21.15.190:0/4155665269 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f547415cba0 0x7f54740d0f20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.665+0000 7f547a79d640 1 -- 172.21.15.190:0/4155665269 >> 172.21.15.190:0/4155665269 conn(0x7f54740719c0 msgr2=0x7f5474071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:49.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.665+0000 7f547a79d640 1 -- 172.21.15.190:0/4155665269 shutdown_connections 2023-11-20T06:40:49.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.665+0000 7f547a79d640 1 -- 172.21.15.190:0/4155665269 wait complete. 2023-11-20T06:40:49.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.665+0000 7f547a79d640 1 Processor -- start 2023-11-20T06:40:49.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.665+0000 7f547a79d640 1 -- start start 2023-11-20T06:40:49.669 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f547a79d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54740b84e0 0x7f54740c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.669 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f547a79d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54740d0040 0x7f547414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.669 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f547a79d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f547415cba0 0x7f5474151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.669 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f547a79d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54740c7740 con 0x7f54740b84e0 2023-11-20T06:40:49.669 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f547a79d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54740c6d70 con 0x7f54740d0040 2023-11-20T06:40:49.670 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f547a79d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54741501b0 con 0x7f547415cba0 2023-11-20T06:40:49.670 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f54737fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54740d0040 0x7f547414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.670 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f5478d3a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f547415cba0 0x7f5474151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.670 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f5478d3a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f547415cba0 0x7f5474151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:32928/0 (socket says 172.21.15.190:32928) 2023-11-20T06:40:49.670 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f54737fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54740d0040 0x7f547414f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:50986/0 (socket says 172.21.15.190:50986) 2023-11-20T06:40:49.670 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f5478d3a640 1 -- 172.21.15.190:0/3210559230 learned_addr learned my addr 172.21.15.190:0/3210559230 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-20T06:40:49.670 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f5473fff640 1 --2- 172.21.15.190:0/3210559230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54740b84e0 0x7f54740c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.670 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f5478d3a640 1 -- 172.21.15.190:0/3210559230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54740d0040 msgr2=0x7f547414f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:49.670 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f5478d3a640 1 --2- 172.21.15.190:0/3210559230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54740d0040 0x7f547414f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.670 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f5478d3a640 1 -- 172.21.15.190:0/3210559230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54740b84e0 msgr2=0x7f54740c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:49.670 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f5478d3a640 1 --2- 172.21.15.190:0/3210559230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54740b84e0 0x7f54740c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f5478d3a640 1 -- 172.21.15.190:0/3210559230 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54640094d0 con 0x7f547415cba0 2023-11-20T06:40:49.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f5473fff640 1 --2- 172.21.15.190:0/3210559230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54740b84e0 0x7f54740c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:40:49.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f5478d3a640 1 --2- 172.21.15.190:0/3210559230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f547415cba0 0x7f5474151b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f546c009dd0 tx=0x7f546c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:49.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f5470ff9640 1 -- 172.21.15.190:0/3210559230 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c014480 con 0x7f547415cba0 2023-11-20T06:40:49.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f5470ff9640 1 -- 172.21.15.190:0/3210559230 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546c00f040 con 0x7f547415cba0 2023-11-20T06:40:49.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f547a79d640 1 -- 172.21.15.190:0/3210559230 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547415f460 con 0x7f547415cba0 2023-11-20T06:40:49.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f5470ff9640 1 -- 172.21.15.190:0/3210559230 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c014840 con 0x7f547415cba0 2023-11-20T06:40:49.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f547a79d640 1 -- 172.21.15.190:0/3210559230 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54740c6720 con 0x7f547415cba0 2023-11-20T06:40:49.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f5470ff9640 1 -- 172.21.15.190:0/3210559230 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f546c014ca0 con 0x7f547415cba0 2023-11-20T06:40:49.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f5470ff9640 1 -- 172.21.15.190:0/3210559230 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f546c01d820 con 0x7f547415cba0 2023-11-20T06:40:49.672 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.669+0000 7f547a79d640 1 -- 172.21.15.190:0/3210559230 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f547404e170 con 0x7f547415cba0 2023-11-20T06:40:49.673 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.673+0000 7f5470ff9640 1 -- 172.21.15.190:0/3210559230 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f546c03bb40 con 0x7f547415cba0 2023-11-20T06:40:49.738 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.737+0000 7f547a79d640 1 -- 172.21.15.190:0/3210559230 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b3a547ad-a724-457a-9dea-69d8d6b0fa7d", "id": 2} v 0) v1 -- 0x7f54740c6eb0 con 0x7f547415cba0 2023-11-20T06:40:49.746 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.745+0000 7f5470ff9640 1 -- 172.21.15.190:0/3210559230 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b3a547ad-a724-457a-9dea-69d8d6b0fa7d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f546c02a070 con 0x7f547415cba0 2023-11-20T06:40:49.746 INFO:teuthology.orchestra.run.smithi190.stdout:2 2023-11-20T06:40:49.747 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.745+0000 7f547a79d640 1 -- 172.21.15.190:0/3210559230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f547415cba0 msgr2=0x7f5474151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:49.747 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.745+0000 7f547a79d640 1 --2- 172.21.15.190:0/3210559230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f547415cba0 0x7f5474151b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f546c009dd0 tx=0x7f546c00c490 comp rx=0 tx=0).stop 2023-11-20T06:40:49.747 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.745+0000 7f547a79d640 1 -- 172.21.15.190:0/3210559230 shutdown_connections 2023-11-20T06:40:49.747 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.745+0000 7f547a79d640 1 --2- 172.21.15.190:0/3210559230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f547415cba0 0x7f5474151b80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.747 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.745+0000 7f547a79d640 1 --2- 172.21.15.190:0/3210559230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54740d0040 0x7f547414f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.747 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.745+0000 7f547a79d640 1 --2- 172.21.15.190:0/3210559230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54740b84e0 0x7f54740c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.748 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.745+0000 7f547a79d640 1 -- 172.21.15.190:0/3210559230 >> 172.21.15.190:0/3210559230 conn(0x7f54740719c0 msgr2=0x7f547415abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:49.748 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.745+0000 7f547a79d640 1 -- 172.21.15.190:0/3210559230 shutdown_connections 2023-11-20T06:40:49.748 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.745+0000 7f547a79d640 1 -- 172.21.15.190:0/3210559230 wait complete. 2023-11-20T06:40:49.765 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 072d00a3-5b2e-42ca-8504-d7e40a8f2848 3 2023-11-20T06:40:49.901 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.901+0000 7f4504cd6640 1 Processor -- start 2023-11-20T06:40:49.901 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.901+0000 7f4504cd6640 1 -- start start 2023-11-20T06:40:49.903 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.901+0000 7f4504cd6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f450015cc30 0x7f45000b8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.903 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.901+0000 7f4504cd6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45000cd840 0x7f45000cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.903 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.901+0000 7f4504cd6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450015d010 con 0x7f45000d0f90 2023-11-20T06:40:49.903 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.901+0000 7f4504cd6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45000b74d0 con 0x7f450015cc30 2023-11-20T06:40:49.903 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.901+0000 7f4504cd6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45000b77b0 con 0x7f45000cd840 2023-11-20T06:40:49.904 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.901+0000 7f44fdd9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45000cd840 0x7f45000cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.904 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.901+0000 7f44fe59c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f450015cc30 0x7f45000b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.904 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.901+0000 7f44fdd9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45000cd840 0x7f45000cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:32938/0 (socket says 172.21.15.190:32938) 2023-11-20T06:40:49.904 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.901+0000 7f44fdd9b640 1 -- 172.21.15.190:0/3867360829 learned_addr learned my addr 172.21.15.190:0/3867360829 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-20T06:40:49.904 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.901+0000 7f44fe59c640 1 -- 172.21.15.190:0/3867360829 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45000cd840 msgr2=0x7f45000cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:40:49.904 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.901+0000 7f44fe59c640 1 --2- 172.21.15.190:0/3867360829 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45000cd840 0x7f45000cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.904 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.901+0000 7f44fe59c640 1 -- 172.21.15.190:0/3867360829 >> v1:172.21.15.19:6789/0 conn(0x7f45000d0f90 legacy=0x7f45000d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:49.904 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.901+0000 7f44fe59c640 1 -- 172.21.15.190:0/3867360829 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45000b7a90 con 0x7f450015cc30 2023-11-20T06:40:49.904 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.901+0000 7f44fdd9b640 1 --2- 172.21.15.190:0/3867360829 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45000cd840 0x7f45000cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:40:49.906 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.905+0000 7f44fe59c640 1 --2- 172.21.15.190:0/3867360829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f450015cc30 0x7f45000b8780 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f44f00097c0 tx=0x7f44f001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95828ede06db4b13 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:49.907 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.905+0000 7f44fd59a640 1 -- 172.21.15.190:0/3867360829 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f00a8970 con 0x7f450015cc30 2023-11-20T06:40:49.907 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.905+0000 7f44fd59a640 1 -- 172.21.15.190:0/3867360829 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f00a8ad0 con 0x7f450015cc30 2023-11-20T06:40:49.907 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.905+0000 7f44fd59a640 1 -- 172.21.15.190:0/3867360829 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f00a8e60 con 0x7f450015cc30 2023-11-20T06:40:49.908 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.905+0000 7f4504cd6640 1 -- 172.21.15.190:0/3867360829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f450015cc30 msgr2=0x7f45000b8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:49.908 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.905+0000 7f4504cd6640 1 --2- 172.21.15.190:0/3867360829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f450015cc30 0x7f45000b8780 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f44f00097c0 tx=0x7f44f001ec70 comp rx=0 tx=0).stop 2023-11-20T06:40:49.908 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.905+0000 7f4504cd6640 1 -- 172.21.15.190:0/3867360829 shutdown_connections 2023-11-20T06:40:49.908 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.905+0000 7f4504cd6640 1 --2- 172.21.15.190:0/3867360829 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45000cd840 0x7f45000cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.908 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.905+0000 7f4504cd6640 1 --2- 172.21.15.190:0/3867360829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f450015cc30 0x7f45000b8780 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.908 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.905+0000 7f4504cd6640 1 -- 172.21.15.190:0/3867360829 >> 172.21.15.190:0/3867360829 conn(0x7f450006b750 msgr2=0x7f450006bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:49.908 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.905+0000 7f4504cd6640 1 -- 172.21.15.190:0/3867360829 shutdown_connections 2023-11-20T06:40:49.908 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.905+0000 7f4504cd6640 1 -- 172.21.15.190:0/3867360829 wait complete. 2023-11-20T06:40:49.909 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.909+0000 7f4504cd6640 1 Processor -- start 2023-11-20T06:40:49.909 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.909+0000 7f4504cd6640 1 -- start start 2023-11-20T06:40:49.911 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.909+0000 7f4504cd6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45000cd840 0x7f45000cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.911 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.909+0000 7f4504cd6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45000d0f90 0x7f45000cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.911 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.909+0000 7f4504cd6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f450015cc30 0x7f45000cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:49.911 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.909+0000 7f4504cd6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45000cbba0 con 0x7f450015cc30 2023-11-20T06:40:49.911 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.909+0000 7f4504cd6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45001f21d0 con 0x7f45000d0f90 2023-11-20T06:40:49.911 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.909+0000 7f4504cd6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45001f64d0 con 0x7f45000cd840 2023-11-20T06:40:49.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.909+0000 7f44fdd9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45000d0f90 0x7f45000cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.909+0000 7f44fe59c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45000cd840 0x7f45000cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.909+0000 7f44fdd9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45000d0f90 0x7f45000cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:51008/0 (socket says 172.21.15.190:51008) 2023-11-20T06:40:49.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.909+0000 7f44fe59c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45000cd840 0x7f45000cc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:32942/0 (socket says 172.21.15.190:32942) 2023-11-20T06:40:49.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.909+0000 7f44fdd9b640 1 -- 172.21.15.190:0/1995736568 learned_addr learned my addr 172.21.15.190:0/1995736568 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-20T06:40:49.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.909+0000 7f44fed9d640 1 --2- 172.21.15.190:0/1995736568 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f450015cc30 0x7f45000cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:49.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.909+0000 7f44fe59c640 1 -- 172.21.15.190:0/1995736568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45000d0f90 msgr2=0x7f45000cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:49.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.909+0000 7f44fe59c640 1 --2- 172.21.15.190:0/1995736568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45000d0f90 0x7f45000cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.909+0000 7f44fe59c640 1 -- 172.21.15.190:0/1995736568 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f450015cc30 msgr2=0x7f45000cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:49.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.909+0000 7f44fe59c640 1 --2- 172.21.15.190:0/1995736568 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f450015cc30 0x7f45000cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.909+0000 7f44fe59c640 1 -- 172.21.15.190:0/1995736568 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f40094d0 con 0x7f45000cd840 2023-11-20T06:40:49.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.909+0000 7f44fe59c640 1 --2- 172.21.15.190:0/1995736568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45000cd840 0x7f45000cc120 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f44f00af000 tx=0x7f44f001ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:49.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.913+0000 7f44eeffd640 1 -- 172.21.15.190:0/1995736568 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f00bd070 con 0x7f45000cd840 2023-11-20T06:40:49.914 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.913+0000 7f44eeffd640 1 -- 172.21.15.190:0/1995736568 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f00b0bd0 con 0x7f45000cd840 2023-11-20T06:40:49.914 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.913+0000 7f44eeffd640 1 -- 172.21.15.190:0/1995736568 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f00b9430 con 0x7f45000cd840 2023-11-20T06:40:49.914 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.913+0000 7f4504cd6640 1 -- 172.21.15.190:0/1995736568 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f0009420 con 0x7f45000cd840 2023-11-20T06:40:49.914 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.913+0000 7f4504cd6640 1 -- 172.21.15.190:0/1995736568 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45001f2730 con 0x7f45000cd840 2023-11-20T06:40:49.914 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.913+0000 7f44eeffd640 1 -- 172.21.15.190:0/1995736568 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f44f00b7040 con 0x7f45000cd840 2023-11-20T06:40:49.914 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.913+0000 7f44eeffd640 1 -- 172.21.15.190:0/1995736568 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f44f00b9d20 con 0x7f45000cd840 2023-11-20T06:40:49.914 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.913+0000 7f4504cd6640 1 -- 172.21.15.190:0/1995736568 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4500067230 con 0x7f45000cd840 2023-11-20T06:40:49.915 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.913+0000 7f44eeffd640 1 -- 172.21.15.190:0/1995736568 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f44f00b5070 con 0x7f45000cd840 2023-11-20T06:40:49.980 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.981+0000 7f4504cd6640 1 -- 172.21.15.190:0/1995736568 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "072d00a3-5b2e-42ca-8504-d7e40a8f2848", "id": 3} v 0) v1 -- 0x7f4500159a30 con 0x7f45000cd840 2023-11-20T06:40:49.987 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.985+0000 7f44eeffd640 1 -- 172.21.15.190:0/1995736568 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "072d00a3-5b2e-42ca-8504-d7e40a8f2848", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f44f00b9890 con 0x7f45000cd840 2023-11-20T06:40:49.987 INFO:teuthology.orchestra.run.smithi190.stdout:3 2023-11-20T06:40:49.988 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.989+0000 7f4504cd6640 1 -- 172.21.15.190:0/1995736568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45000cd840 msgr2=0x7f45000cc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:49.988 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.989+0000 7f4504cd6640 1 --2- 172.21.15.190:0/1995736568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45000cd840 0x7f45000cc120 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f44f00af000 tx=0x7f44f001ba10 comp rx=0 tx=0).stop 2023-11-20T06:40:49.988 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.989+0000 7f4504cd6640 1 -- 172.21.15.190:0/1995736568 shutdown_connections 2023-11-20T06:40:49.988 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.989+0000 7f4504cd6640 1 --2- 172.21.15.190:0/1995736568 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f450015cc30 0x7f45000cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.988 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.989+0000 7f4504cd6640 1 --2- 172.21.15.190:0/1995736568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45000d0f90 0x7f45000cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.989 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.989+0000 7f4504cd6640 1 --2- 172.21.15.190:0/1995736568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45000cd840 0x7f45000cc120 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:49.989 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.989+0000 7f4504cd6640 1 -- 172.21.15.190:0/1995736568 >> 172.21.15.190:0/1995736568 conn(0x7f450006b750 msgr2=0x7f450015bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:49.989 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.989+0000 7f4504cd6640 1 -- 172.21.15.190:0/1995736568 shutdown_connections 2023-11-20T06:40:49.989 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:49.989+0000 7f4504cd6640 1 -- 172.21.15.190:0/1995736568 wait complete. 2023-11-20T06:40:50.007 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 1834e008-6cfa-45d9-a0df-ed43bd276011 4 2023-11-20T06:40:50.084 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:50.080+0000 7f9228f77180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-20T06:40:50.099 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:50.097+0000 7fd78dd3f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-20T06:40:50.144 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.145+0000 7f6a55bd3640 1 Processor -- start 2023-11-20T06:40:50.145 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.145+0000 7f6a55bd3640 1 -- start start 2023-11-20T06:40:50.146 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.145+0000 7f6a55bd3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a5015cba0 0x7f6a500d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:50.147 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.145+0000 7f6a55bd3640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6a500d0210 0x7f6a500b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:50.147 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.145+0000 7f6a55bd3640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a500d1670 con 0x7f6a500b84e0 2023-11-20T06:40:50.147 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.145+0000 7f6a55bd3640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a500d1460 con 0x7f6a500d0210 2023-11-20T06:40:50.147 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.145+0000 7f6a55bd3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a500d1950 con 0x7f6a5015cba0 2023-11-20T06:40:50.147 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.145+0000 7f6a4f7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a5015cba0 0x7f6a500d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:50.147 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.145+0000 7f6a4f7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a5015cba0 0x7f6a500d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:32948/0 (socket says 172.21.15.190:32948) 2023-11-20T06:40:50.147 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.145+0000 7f6a4ffff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6a500d0210 0x7f6a500b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:50.147 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.145+0000 7f6a4f7fe640 1 -- 172.21.15.190:0/1559481648 learned_addr learned my addr 172.21.15.190:0/1559481648 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-20T06:40:50.147 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.145+0000 7f6a4f7fe640 1 -- 172.21.15.190:0/1559481648 >> v2:172.21.15.190:3300/0 conn(0x7f6a500d0210 msgr2=0x7f6a500b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:40:50.147 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.145+0000 7f6a4f7fe640 1 --2- 172.21.15.190:0/1559481648 >> v2:172.21.15.190:3300/0 conn(0x7f6a500d0210 0x7f6a500b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.147 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.145+0000 7f6a4f7fe640 1 -- 172.21.15.190:0/1559481648 >> v1:172.21.15.19:6789/0 conn(0x7f6a500b84e0 legacy=0x7f6a500cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.148 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.145+0000 7f6a4f7fe640 1 -- 172.21.15.190:0/1559481648 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a500d1c30 con 0x7f6a5015cba0 2023-11-20T06:40:50.150 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.149+0000 7f6a4f7fe640 1 --2- 172.21.15.190:0/1559481648 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a5015cba0 0x7f6a500d0f20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009870 tx=0x7f6a4001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f6bb9f6354d46a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:50.150 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.149+0000 7f6a4e7fc640 1 -- 172.21.15.190:0/1559481648 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a400a9400 con 0x7f6a5015cba0 2023-11-20T06:40:50.150 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.149+0000 7f6a4e7fc640 1 -- 172.21.15.190:0/1559481648 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a400a9560 con 0x7f6a5015cba0 2023-11-20T06:40:50.150 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.149+0000 7f6a4e7fc640 1 -- 172.21.15.190:0/1559481648 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a400a98f0 con 0x7f6a5015cba0 2023-11-20T06:40:50.151 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:50.144+0000 7f9228f77180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-20T06:40:50.151 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.149+0000 7f6a55bd3640 1 -- 172.21.15.190:0/1559481648 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a5015cba0 msgr2=0x7f6a500d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.152 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.149+0000 7f6a55bd3640 1 --2- 172.21.15.190:0/1559481648 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a5015cba0 0x7f6a500d0f20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009870 tx=0x7f6a4001c540 comp rx=0 tx=0).stop 2023-11-20T06:40:50.152 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.149+0000 7f6a55bd3640 1 -- 172.21.15.190:0/1559481648 shutdown_connections 2023-11-20T06:40:50.152 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.149+0000 7f6a55bd3640 1 --2- 172.21.15.190:0/1559481648 >> v2:172.21.15.190:3300/0 conn(0x7f6a500d0210 0x7f6a500b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.152 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.149+0000 7f6a55bd3640 1 --2- 172.21.15.190:0/1559481648 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a5015cba0 0x7f6a500d0f20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.152 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.149+0000 7f6a55bd3640 1 -- 172.21.15.190:0/1559481648 >> 172.21.15.190:0/1559481648 conn(0x7f6a500719c0 msgr2=0x7f6a50071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:50.152 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.149+0000 7f6a55bd3640 1 -- 172.21.15.190:0/1559481648 shutdown_connections 2023-11-20T06:40:50.152 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.149+0000 7f6a55bd3640 1 -- 172.21.15.190:0/1559481648 wait complete. 2023-11-20T06:40:50.153 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a55bd3640 1 Processor -- start 2023-11-20T06:40:50.153 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a55bd3640 1 -- start start 2023-11-20T06:40:50.154 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a55bd3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a500b84e0 0x7f6a5014fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:50.154 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a55bd3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a500d0210 0x7f6a50152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:50.154 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a55bd3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a5015cba0 0x7f6a5006b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:50.155 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a55bd3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5015fe30 con 0x7f6a500b84e0 2023-11-20T06:40:50.155 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a55bd3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a50160110 con 0x7f6a500d0210 2023-11-20T06:40:50.155 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a55bd3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a500c7290 con 0x7f6a5015cba0 2023-11-20T06:40:50.155 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a4effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a500d0210 0x7f6a50152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:50.155 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a4ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a5015cba0 0x7f6a5006b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:50.155 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a4f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a500b84e0 0x7f6a5014fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:50.155 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a4ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a5015cba0 0x7f6a5006b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:32954/0 (socket says 172.21.15.190:32954) 2023-11-20T06:40:50.155 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a4ffff640 1 -- 172.21.15.190:0/1252134906 learned_addr learned my addr 172.21.15.190:0/1252134906 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-20T06:40:50.157 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a4ffff640 1 -- 172.21.15.190:0/1252134906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a500d0210 msgr2=0x7f6a50152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.157 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a4ffff640 1 --2- 172.21.15.190:0/1252134906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a500d0210 0x7f6a50152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.157 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a4ffff640 1 -- 172.21.15.190:0/1252134906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a500b84e0 msgr2=0x7f6a5014fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.157 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a4ffff640 1 --2- 172.21.15.190:0/1252134906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a500b84e0 0x7f6a5014fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.157 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a4ffff640 1 -- 172.21.15.190:0/1252134906 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a400094d0 con 0x7f6a5015cba0 2023-11-20T06:40:50.157 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a4ffff640 1 --2- 172.21.15.190:0/1252134906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a5015cba0 0x7f6a5006b550 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800efc0 tx=0x7f6a4800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:50.157 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a37fff640 1 -- 172.21.15.190:0/1252134906 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48014480 con 0x7f6a5015cba0 2023-11-20T06:40:50.157 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a37fff640 1 -- 172.21.15.190:0/1252134906 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4800f040 con 0x7f6a5015cba0 2023-11-20T06:40:50.157 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a55bd3640 1 -- 172.21.15.190:0/1252134906 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a500c7570 con 0x7f6a5015cba0 2023-11-20T06:40:50.158 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.153+0000 7f6a37fff640 1 -- 172.21.15.190:0/1252134906 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48014820 con 0x7f6a5015cba0 2023-11-20T06:40:50.158 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.157+0000 7f6a55bd3640 1 -- 172.21.15.190:0/1252134906 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5006ba90 con 0x7f6a5015cba0 2023-11-20T06:40:50.158 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.157+0000 7f6a37fff640 1 -- 172.21.15.190:0/1252134906 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6a48014c80 con 0x7f6a5015cba0 2023-11-20T06:40:50.158 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.157+0000 7f6a37fff640 1 -- 172.21.15.190:0/1252134906 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f6a480133e0 con 0x7f6a5015cba0 2023-11-20T06:40:50.158 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.157+0000 7f6a55bd3640 1 -- 172.21.15.190:0/1252134906 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5004e170 con 0x7f6a5015cba0 2023-11-20T06:40:50.158 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.157+0000 7f6a37fff640 1 -- 172.21.15.190:0/1252134906 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f6a48018020 con 0x7f6a5015cba0 2023-11-20T06:40:50.165 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:50.165+0000 7fd78dd3f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-20T06:40:50.214 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:50.208+0000 7f9228f77180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-20T06:40:50.224 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.225+0000 7f6a55bd3640 1 -- 172.21.15.190:0/1252134906 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1834e008-6cfa-45d9-a0df-ed43bd276011", "id": 4} v 0) v1 -- 0x7f6a50073000 con 0x7f6a5015cba0 2023-11-20T06:40:50.226 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:50.225+0000 7fd78dd3f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-20T06:40:50.231 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.229+0000 7f6a37fff640 1 -- 172.21.15.190:0/1252134906 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1834e008-6cfa-45d9-a0df-ed43bd276011", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6a4801d400 con 0x7f6a5015cba0 2023-11-20T06:40:50.231 INFO:teuthology.orchestra.run.smithi190.stdout:4 2023-11-20T06:40:50.233 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.233+0000 7f6a55bd3640 1 -- 172.21.15.190:0/1252134906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a5015cba0 msgr2=0x7f6a5006b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.233 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.233+0000 7f6a55bd3640 1 --2- 172.21.15.190:0/1252134906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a5015cba0 0x7f6a5006b550 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800efc0 tx=0x7f6a4800c490 comp rx=0 tx=0).stop 2023-11-20T06:40:50.233 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.233+0000 7f6a55bd3640 1 -- 172.21.15.190:0/1252134906 shutdown_connections 2023-11-20T06:40:50.233 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.233+0000 7f6a55bd3640 1 --2- 172.21.15.190:0/1252134906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a5015cba0 0x7f6a5006b550 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.233 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.233+0000 7f6a55bd3640 1 --2- 172.21.15.190:0/1252134906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a500d0210 0x7f6a50152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.233 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.233+0000 7f6a55bd3640 1 --2- 172.21.15.190:0/1252134906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a500b84e0 0x7f6a5014fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.233 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.233+0000 7f6a55bd3640 1 -- 172.21.15.190:0/1252134906 >> 172.21.15.190:0/1252134906 conn(0x7f6a500719c0 msgr2=0x7f6a50152e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:50.233 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.233+0000 7f6a55bd3640 1 -- 172.21.15.190:0/1252134906 shutdown_connections 2023-11-20T06:40:50.233 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.233+0000 7f6a55bd3640 1 -- 172.21.15.190:0/1252134906 wait complete. 2023-11-20T06:40:50.251 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 9dcdc181-77c4-4878-996d-78ff7d5299c0 5 2023-11-20T06:40:50.308 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:50.304+0000 7f9228f77180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-20T06:40:50.318 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:50.317+0000 7fd78dd3f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-20T06:40:50.371 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:50.368+0000 7f9228f77180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-20T06:40:50.379 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:50.377+0000 7fd78dd3f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-20T06:40:50.387 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.385+0000 7f958571d640 1 Processor -- start 2023-11-20T06:40:50.388 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.385+0000 7f958571d640 1 -- start start 2023-11-20T06:40:50.389 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.389+0000 7f958571d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95800d0210 0x7f95800d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:50.389 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.389+0000 7f958571d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f95800b84e0 0x7f95800b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:50.389 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.389+0000 7f958571d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95800d1670 con 0x7f958015cba0 2023-11-20T06:40:50.389 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.389+0000 7f958571d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95800d1460 con 0x7f95800b84e0 2023-11-20T06:40:50.390 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.389+0000 7f958571d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95800d1950 con 0x7f95800d0210 2023-11-20T06:40:50.390 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.389+0000 7f957e7fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95800d0210 0x7f95800d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:50.390 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.389+0000 7f957f7fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f95800b84e0 0x7f95800b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:50.390 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.389+0000 7f957e7fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95800d0210 0x7f95800d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:32968/0 (socket says 172.21.15.190:32968) 2023-11-20T06:40:50.390 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.389+0000 7f957e7fc640 1 -- 172.21.15.190:0/2762003481 learned_addr learned my addr 172.21.15.190:0/2762003481 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-20T06:40:50.391 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.389+0000 7f957f7fe640 1 -- 172.21.15.190:0/2762003481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95800d0210 msgr2=0x7f95800d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:40:50.391 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.389+0000 7f957f7fe640 1 --2- 172.21.15.190:0/2762003481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95800d0210 0x7f95800d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.391 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.389+0000 7f957f7fe640 1 -- 172.21.15.190:0/2762003481 >> v1:172.21.15.19:6789/0 conn(0x7f958015cba0 legacy=0x7f95800cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.391 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.389+0000 7f957f7fe640 1 -- 172.21.15.190:0/2762003481 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95800d1c30 con 0x7f95800b84e0 2023-11-20T06:40:50.391 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.389+0000 7f957e7fc640 1 --2- 172.21.15.190:0/2762003481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95800d0210 0x7f95800d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:40:50.392 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.393+0000 7f957f7fe640 1 --2- 172.21.15.190:0/2762003481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95800b84e0 0x7f95800b5cf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9578009d90 tx=0x7f957801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3934b6c102c254c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:50.393 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.393+0000 7f957dffb640 1 -- 172.21.15.190:0/2762003481 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95780a5a10 con 0x7f95800b84e0 2023-11-20T06:40:50.393 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.393+0000 7f957dffb640 1 -- 172.21.15.190:0/2762003481 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95780a5b70 con 0x7f95800b84e0 2023-11-20T06:40:50.393 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.393+0000 7f957dffb640 1 -- 172.21.15.190:0/2762003481 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95780ad440 con 0x7f95800b84e0 2023-11-20T06:40:50.393 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.393+0000 7f958571d640 1 -- 172.21.15.190:0/2762003481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95800b84e0 msgr2=0x7f95800b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.394 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.393+0000 7f958571d640 1 --2- 172.21.15.190:0/2762003481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95800b84e0 0x7f95800b5cf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9578009d90 tx=0x7f957801c950 comp rx=0 tx=0).stop 2023-11-20T06:40:50.394 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.393+0000 7f958571d640 1 -- 172.21.15.190:0/2762003481 shutdown_connections 2023-11-20T06:40:50.394 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.393+0000 7f958571d640 1 --2- 172.21.15.190:0/2762003481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95800b84e0 0x7f95800b5cf0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.394 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.393+0000 7f958571d640 1 --2- 172.21.15.190:0/2762003481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95800d0210 0x7f95800d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.394 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.393+0000 7f958571d640 1 -- 172.21.15.190:0/2762003481 >> 172.21.15.190:0/2762003481 conn(0x7f95800719c0 msgr2=0x7f9580071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:50.394 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.393+0000 7f958571d640 1 -- 172.21.15.190:0/2762003481 shutdown_connections 2023-11-20T06:40:50.394 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.393+0000 7f958571d640 1 -- 172.21.15.190:0/2762003481 wait complete. 2023-11-20T06:40:50.395 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.393+0000 7f958571d640 1 Processor -- start 2023-11-20T06:40:50.395 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.393+0000 7f958571d640 1 -- start start 2023-11-20T06:40:50.396 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f958571d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95800b84e0 0x7f958015d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:50.397 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f958571d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95800d0210 0x7f958015d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:50.397 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f958571d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f958015cba0 0x7f95800c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:50.397 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f958571d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958015c450 con 0x7f95800d0210 2023-11-20T06:40:50.397 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f958571d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958015be90 con 0x7f95800b84e0 2023-11-20T06:40:50.397 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f958571d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958015c170 con 0x7f958015cba0 2023-11-20T06:40:50.397 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f957effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95800b84e0 0x7f958015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:50.397 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f957f7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f958015cba0 0x7f95800c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:50.397 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f957effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95800b84e0 0x7f958015d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:51042/0 (socket says 172.21.15.190:51042) 2023-11-20T06:40:50.397 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f957effd640 1 -- 172.21.15.190:0/2405108162 learned_addr learned my addr 172.21.15.190:0/2405108162 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-20T06:40:50.397 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f957e7fc640 1 --2- 172.21.15.190:0/2405108162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95800d0210 0x7f958015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:50.399 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f957effd640 1 -- 172.21.15.190:0/2405108162 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f958015cba0 msgr2=0x7f95800c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.399 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f957effd640 1 --2- 172.21.15.190:0/2405108162 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f958015cba0 0x7f95800c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.399 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f957effd640 1 -- 172.21.15.190:0/2405108162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95800d0210 msgr2=0x7f958015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.399 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f957effd640 1 --2- 172.21.15.190:0/2405108162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95800d0210 0x7f958015d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.399 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f957effd640 1 -- 172.21.15.190:0/2405108162 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95740094d0 con 0x7f95800b84e0 2023-11-20T06:40:50.399 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f957effd640 1 --2- 172.21.15.190:0/2405108162 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95800b84e0 0x7f958015d320 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f957000c3c0 tx=0x7f957000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:50.399 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f95677fe640 1 -- 172.21.15.190:0/2405108162 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95700052d0 con 0x7f95800b84e0 2023-11-20T06:40:50.399 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f95677fe640 1 -- 172.21.15.190:0/2405108162 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9570005430 con 0x7f95800b84e0 2023-11-20T06:40:50.399 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f958571d640 1 -- 172.21.15.190:0/2405108162 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9578009a70 con 0x7f95800b84e0 2023-11-20T06:40:50.399 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f95677fe640 1 -- 172.21.15.190:0/2405108162 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9570003840 con 0x7f95800b84e0 2023-11-20T06:40:50.400 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f958571d640 1 -- 172.21.15.190:0/2405108162 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9580153b40 con 0x7f95800b84e0 2023-11-20T06:40:50.400 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f95677fe640 1 -- 172.21.15.190:0/2405108162 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9570003ca0 con 0x7f95800b84e0 2023-11-20T06:40:50.400 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f95677fe640 1 -- 172.21.15.190:0/2405108162 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f9570011b10 con 0x7f95800b84e0 2023-11-20T06:40:50.400 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.397+0000 7f958571d640 1 -- 172.21.15.190:0/2405108162 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95801536c0 con 0x7f95800b84e0 2023-11-20T06:40:50.401 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.401+0000 7f95677fe640 1 -- 172.21.15.190:0/2405108162 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f95801536c0 con 0x7f95800b84e0 2023-11-20T06:40:50.465 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:50.460+0000 7f9228f77180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-20T06:40:50.468 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.469+0000 7f958571d640 1 -- 172.21.15.190:0/2405108162 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9dcdc181-77c4-4878-996d-78ff7d5299c0", "id": 5} v 0) v1 -- 0x7f958004e170 con 0x7f95800b84e0 2023-11-20T06:40:50.473 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:50.473+0000 7fd78dd3f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-20T06:40:50.475 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.473+0000 7f95677fe640 1 -- 172.21.15.190:0/2405108162 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9dcdc181-77c4-4878-996d-78ff7d5299c0", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9570021060 con 0x7f95800b84e0 2023-11-20T06:40:50.475 INFO:teuthology.orchestra.run.smithi190.stdout:5 2023-11-20T06:40:50.477 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.477+0000 7f958571d640 1 -- 172.21.15.190:0/2405108162 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95800b84e0 msgr2=0x7f958015d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.477 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.477+0000 7f958571d640 1 --2- 172.21.15.190:0/2405108162 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95800b84e0 0x7f958015d320 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f957000c3c0 tx=0x7f957000c880 comp rx=0 tx=0).stop 2023-11-20T06:40:50.477 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.477+0000 7f958571d640 1 -- 172.21.15.190:0/2405108162 shutdown_connections 2023-11-20T06:40:50.477 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.477+0000 7f958571d640 1 --2- 172.21.15.190:0/2405108162 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f958015cba0 0x7f95800c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.477 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.477+0000 7f958571d640 1 --2- 172.21.15.190:0/2405108162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95800d0210 0x7f958015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.477 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.477+0000 7f958571d640 1 --2- 172.21.15.190:0/2405108162 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95800b84e0 0x7f958015d320 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.477 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.477+0000 7f958571d640 1 -- 172.21.15.190:0/2405108162 >> 172.21.15.190:0/2405108162 conn(0x7f95800719c0 msgr2=0x7f9580154690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:50.477 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.477+0000 7f958571d640 1 -- 172.21.15.190:0/2405108162 shutdown_connections 2023-11-20T06:40:50.477 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.477+0000 7f958571d640 1 -- 172.21.15.190:0/2405108162 wait complete. 2023-11-20T06:40:50.495 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 679fc5c8-5792-4679-8dc9-c568ce54cf23 6 2023-11-20T06:40:50.529 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:50.524+0000 7f9228f77180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-20T06:40:50.536 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:50.537+0000 7fd78dd3f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-20T06:40:50.631 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.629+0000 7fe19f09e640 1 Processor -- start 2023-11-20T06:40:50.631 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.629+0000 7fe19f09e640 1 -- start start 2023-11-20T06:40:50.633 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.633+0000 7fe19f09e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe19815cba0 0x7fe1980d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:50.633 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.633+0000 7fe19f09e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1980d0210 0x7fe1980b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:50.633 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.633+0000 7fe19f09e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1980d1670 con 0x7fe1980b84e0 2023-11-20T06:40:50.633 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.633+0000 7fe19f09e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1980d1460 con 0x7fe19815cba0 2023-11-20T06:40:50.633 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.633+0000 7fe19f09e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1980d1950 con 0x7fe1980d0210 2023-11-20T06:40:50.634 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.633+0000 7fe19ce3a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe19815cba0 0x7fe1980d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:50.634 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.633+0000 7fe19d63b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1980d0210 0x7fe1980b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:50.634 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.633+0000 7fe19ce3a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe19815cba0 0x7fe1980d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:51056/0 (socket says 172.21.15.190:51056) 2023-11-20T06:40:50.634 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.633+0000 7fe19ce3a640 1 -- 172.21.15.190:0/1816859065 learned_addr learned my addr 172.21.15.190:0/1816859065 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-20T06:40:50.634 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.633+0000 7fe19d63b640 1 -- 172.21.15.190:0/1816859065 >> v2:172.21.15.190:3300/0 conn(0x7fe19815cba0 msgr2=0x7fe1980d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:40:50.634 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.633+0000 7fe19d63b640 1 --2- 172.21.15.190:0/1816859065 >> v2:172.21.15.190:3300/0 conn(0x7fe19815cba0 0x7fe1980d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.634 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.633+0000 7fe19d63b640 1 -- 172.21.15.190:0/1816859065 >> v1:172.21.15.19:6789/0 conn(0x7fe1980b84e0 legacy=0x7fe1980cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.634 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.633+0000 7fe19d63b640 1 -- 172.21.15.190:0/1816859065 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1980d1c30 con 0x7fe1980d0210 2023-11-20T06:40:50.634 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.633+0000 7fe19ce3a640 1 --2- 172.21.15.190:0/1816859065 >> v2:172.21.15.190:3300/0 conn(0x7fe19815cba0 0x7fe1980d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:40:50.636 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.637+0000 7fe19d63b640 1 --2- 172.21.15.190:0/1816859065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1980d0210 0x7fe1980b5cf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe190009d90 tx=0x7fe19001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d122e1094d405042 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:50.636 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.637+0000 7fe1977fe640 1 -- 172.21.15.190:0/1816859065 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1900a5a10 con 0x7fe1980d0210 2023-11-20T06:40:50.636 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.637+0000 7fe1977fe640 1 -- 172.21.15.190:0/1816859065 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1900a5b70 con 0x7fe1980d0210 2023-11-20T06:40:50.637 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.637+0000 7fe1977fe640 1 -- 172.21.15.190:0/1816859065 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1900ad440 con 0x7fe1980d0210 2023-11-20T06:40:50.637 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.637+0000 7fe19f09e640 1 -- 172.21.15.190:0/1816859065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1980d0210 msgr2=0x7fe1980b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.637 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.637+0000 7fe19f09e640 1 --2- 172.21.15.190:0/1816859065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1980d0210 0x7fe1980b5cf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe190009d90 tx=0x7fe19001c950 comp rx=0 tx=0).stop 2023-11-20T06:40:50.638 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.637+0000 7fe19f09e640 1 -- 172.21.15.190:0/1816859065 shutdown_connections 2023-11-20T06:40:50.638 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.637+0000 7fe19f09e640 1 --2- 172.21.15.190:0/1816859065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1980d0210 0x7fe1980b5cf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.638 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.637+0000 7fe19f09e640 1 --2- 172.21.15.190:0/1816859065 >> v2:172.21.15.190:3300/0 conn(0x7fe19815cba0 0x7fe1980d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.638 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.637+0000 7fe19f09e640 1 -- 172.21.15.190:0/1816859065 >> 172.21.15.190:0/1816859065 conn(0x7fe1980719c0 msgr2=0x7fe198071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:50.638 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.637+0000 7fe19f09e640 1 -- 172.21.15.190:0/1816859065 shutdown_connections 2023-11-20T06:40:50.638 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.637+0000 7fe19f09e640 1 -- 172.21.15.190:0/1816859065 wait complete. 2023-11-20T06:40:50.639 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.637+0000 7fe19f09e640 1 Processor -- start 2023-11-20T06:40:50.639 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.637+0000 7fe19f09e640 1 -- start start 2023-11-20T06:40:50.640 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe19f09e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1980b84e0 0x7fe1981503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:50.640 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe19f09e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1980d0210 0x7fe1980c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:50.641 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe19f09e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe19815cba0 0x7fe1981f8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:50.641 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe19f09e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1981508f0 con 0x7fe1980b84e0 2023-11-20T06:40:50.641 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe19f09e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19814ff20 con 0x7fe19815cba0 2023-11-20T06:40:50.641 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe19f09e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19814f310 con 0x7fe1980d0210 2023-11-20T06:40:50.641 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe19d63b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe19815cba0 0x7fe1981f8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:50.641 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe19ce3a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1980b84e0 0x7fe1981503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:50.641 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe197fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1980d0210 0x7fe1980c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:50.641 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe19ce3a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1980b84e0 0x7fe1981503b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.190:48560/0 (socket says 172.21.15.190:48560) 2023-11-20T06:40:50.641 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe19d63b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe19815cba0 0x7fe1981f8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:51060/0 (socket says 172.21.15.190:51060) 2023-11-20T06:40:50.641 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe19ce3a640 1 -- 172.21.15.190:0/3942346682 learned_addr learned my addr 172.21.15.190:0/3942346682 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-20T06:40:50.643 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe197fff640 1 -- 172.21.15.190:0/3942346682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe19815cba0 msgr2=0x7fe1981f8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.643 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe197fff640 1 --2- 172.21.15.190:0/3942346682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe19815cba0 0x7fe1981f8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.643 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe197fff640 1 -- 172.21.15.190:0/3942346682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1980b84e0 msgr2=0x7fe1981503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.643 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe197fff640 1 --2- 172.21.15.190:0/3942346682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1980b84e0 0x7fe1981503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.643 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe197fff640 1 -- 172.21.15.190:0/3942346682 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c0094d0 con 0x7fe1980d0210 2023-11-20T06:40:50.643 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe19d63b640 1 --2- 172.21.15.190:0/3942346682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe19815cba0 0x7fe1981f8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:40:50.643 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe19ce3a640 1 --2- 172.21.15.190:0/3942346682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1980b84e0 0x7fe1981503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:40:50.644 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe197fff640 1 --2- 172.21.15.190:0/3942346682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1980d0210 0x7fe1980c7ea0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe18400c390 tx=0x7fe18400c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:50.644 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe1957fa640 1 -- 172.21.15.190:0/3942346682 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1840052d0 con 0x7fe1980d0210 2023-11-20T06:40:50.644 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe1957fa640 1 -- 172.21.15.190:0/3942346682 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe184005430 con 0x7fe1980d0210 2023-11-20T06:40:50.644 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe19f09e640 1 -- 172.21.15.190:0/3942346682 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe190009a70 con 0x7fe1980d0210 2023-11-20T06:40:50.644 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe1957fa640 1 -- 172.21.15.190:0/3942346682 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe184003840 con 0x7fe1980d0210 2023-11-20T06:40:50.644 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe19f09e640 1 -- 172.21.15.190:0/3942346682 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19814f8d0 con 0x7fe1980d0210 2023-11-20T06:40:50.644 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe1957fa640 1 -- 172.21.15.190:0/3942346682 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe184003ca0 con 0x7fe1980d0210 2023-11-20T06:40:50.644 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe1957fa640 1 -- 172.21.15.190:0/3942346682 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fe184011e00 con 0x7fe1980d0210 2023-11-20T06:40:50.644 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.641+0000 7fe19f09e640 1 -- 172.21.15.190:0/3942346682 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19804e170 con 0x7fe1980d0210 2023-11-20T06:40:50.646 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.645+0000 7fe1957fa640 1 -- 172.21.15.190:0/3942346682 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe184017070 con 0x7fe1980d0210 2023-11-20T06:40:50.693 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:50.688+0000 7f9228f77180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-20T06:40:50.699 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:50.697+0000 7fd78dd3f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-20T06:40:50.712 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.713+0000 7fe19f09e640 1 -- 172.21.15.190:0/3942346682 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "679fc5c8-5792-4679-8dc9-c568ce54cf23", "id": 6} v 0) v1 -- 0x7fe19806bdb0 con 0x7fe1980d0210 2023-11-20T06:40:50.717 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.717+0000 7fe1957fa640 1 -- 172.21.15.190:0/3942346682 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "679fc5c8-5792-4679-8dc9-c568ce54cf23", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe1840115f0 con 0x7fe1980d0210 2023-11-20T06:40:50.718 INFO:teuthology.orchestra.run.smithi190.stdout:6 2023-11-20T06:40:50.719 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.717+0000 7fe19f09e640 1 -- 172.21.15.190:0/3942346682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1980d0210 msgr2=0x7fe1980c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.719 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.717+0000 7fe19f09e640 1 --2- 172.21.15.190:0/3942346682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1980d0210 0x7fe1980c7ea0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe18400c390 tx=0x7fe18400c850 comp rx=0 tx=0).stop 2023-11-20T06:40:50.719 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.717+0000 7fe19f09e640 1 -- 172.21.15.190:0/3942346682 shutdown_connections 2023-11-20T06:40:50.719 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.717+0000 7fe19f09e640 1 --2- 172.21.15.190:0/3942346682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe19815cba0 0x7fe1981f8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.719 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.717+0000 7fe19f09e640 1 --2- 172.21.15.190:0/3942346682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1980d0210 0x7fe1980c7ea0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.719 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.717+0000 7fe19f09e640 1 --2- 172.21.15.190:0/3942346682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1980b84e0 0x7fe1981503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.719 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.717+0000 7fe19f09e640 1 -- 172.21.15.190:0/3942346682 >> 172.21.15.190:0/3942346682 conn(0x7fe1980719c0 msgr2=0x7fe198154090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:50.720 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.717+0000 7fe19f09e640 1 -- 172.21.15.190:0/3942346682 shutdown_connections 2023-11-20T06:40:50.720 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.717+0000 7fe19f09e640 1 -- 172.21.15.190:0/3942346682 wait complete. 2023-11-20T06:40:50.738 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new aef7c06f-03d1-4d3c-b0a1-a17a0024137a 7 2023-11-20T06:40:50.766 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:50.760+0000 7f9228f77180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-20T06:40:50.770 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:50.769+0000 7fd78dd3f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-20T06:40:50.905 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.905+0000 7f3393dab640 1 Processor -- start 2023-11-20T06:40:50.905 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.905+0000 7f3393dab640 1 -- start start 2023-11-20T06:40:50.907 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.905+0000 7f3393dab640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f338c0b84e0 0x7f338c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:50.907 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.905+0000 7f3393dab640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f338c0d1670 con 0x7f338c15cba0 2023-11-20T06:40:50.907 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.905+0000 7f3393dab640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f338c0d1950 con 0x7f338c0d0210 2023-11-20T06:40:50.907 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.905+0000 7f3393dab640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338c0d1460 con 0x7f338c0b84e0 2023-11-20T06:40:50.907 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.905+0000 7f3391346640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f338c0d0210 0x7f338c0b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:51650/0 (socket says 172.21.15.190:51650) 2023-11-20T06:40:50.907 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.905+0000 7f3392348640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f338c0b84e0 0x7f338c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:50.907 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.905+0000 7f3391346640 1 -- 172.21.15.190:0/3559282606 learned_addr learned my addr 172.21.15.190:0/3559282606 (peer_addr_for_me v1:172.21.15.190:0/0) 2023-11-20T06:40:50.908 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.905+0000 7f3390b45640 1 -- 172.21.15.190:0/3559282606 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948525132 0 0) 0x7f338c0d1950 con 0x7f338c0d0210 2023-11-20T06:40:50.908 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.905+0000 7f3392348640 1 -- 172.21.15.190:0/3559282606 >> v1:172.21.15.190:6789/0 conn(0x7f338c0d0210 legacy=0x7f338c0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.908 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.905+0000 7f3392348640 1 -- 172.21.15.190:0/3559282606 >> v1:172.21.15.19:6789/0 conn(0x7f338c15cba0 legacy=0x7f338c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.908 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.905+0000 7f3392348640 1 -- 172.21.15.190:0/3559282606 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c0d1c30 con 0x7f338c0b84e0 2023-11-20T06:40:50.910 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.909+0000 7f3392348640 1 --2- 172.21.15.190:0/3559282606 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f338c0b84e0 0x7f338c0d0f20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3384009dc0 tx=0x7f338401c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=591b6d5acae48f4e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:50.911 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.909+0000 7f3390b45640 1 -- 172.21.15.190:0/3559282606 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33840a5840 con 0x7f338c0b84e0 2023-11-20T06:40:50.911 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.909+0000 7f3390b45640 1 -- 172.21.15.190:0/3559282606 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33840a59a0 con 0x7f338c0b84e0 2023-11-20T06:40:50.911 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.909+0000 7f3390b45640 1 -- 172.21.15.190:0/3559282606 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33840a5d30 con 0x7f338c0b84e0 2023-11-20T06:40:50.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.909+0000 7f3393dab640 1 -- 172.21.15.190:0/3559282606 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f338c0b84e0 msgr2=0x7f338c0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.909+0000 7f3393dab640 1 --2- 172.21.15.190:0/3559282606 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f338c0b84e0 0x7f338c0d0f20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3384009dc0 tx=0x7f338401c800 comp rx=0 tx=0).stop 2023-11-20T06:40:50.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.909+0000 7f3393dab640 1 -- 172.21.15.190:0/3559282606 shutdown_connections 2023-11-20T06:40:50.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.909+0000 7f3393dab640 1 --2- 172.21.15.190:0/3559282606 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f338c0b84e0 0x7f338c0d0f20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.909+0000 7f3393dab640 1 -- 172.21.15.190:0/3559282606 >> 172.21.15.190:0/3559282606 conn(0x7f338c0719c0 msgr2=0x7f338c071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:50.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.909+0000 7f3393dab640 1 -- 172.21.15.190:0/3559282606 shutdown_connections 2023-11-20T06:40:50.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.909+0000 7f3393dab640 1 -- 172.21.15.190:0/3559282606 wait complete. 2023-11-20T06:40:50.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3393dab640 1 Processor -- start 2023-11-20T06:40:50.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3393dab640 1 -- start start 2023-11-20T06:40:50.916 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3393dab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f338c0b84e0 0x7f338c0c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:50.916 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3393dab640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f338c0d0210 0x7f338c14a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:50.916 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3393dab640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f338c15cba0 0x7f338c152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:50.916 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3393dab640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c0c81a0 con 0x7f338c0b84e0 2023-11-20T06:40:50.916 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3393dab640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c152050 con 0x7f338c15cba0 2023-11-20T06:40:50.916 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3393dab640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338c150ff0 con 0x7f338c0d0210 2023-11-20T06:40:50.916 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3391346640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f338c0d0210 0x7f338c14a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:50.916 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3392348640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f338c15cba0 0x7f338c152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:50.917 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3391346640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f338c0d0210 0x7f338c14a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:33010/0 (socket says 172.21.15.190:33010) 2023-11-20T06:40:50.917 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3391346640 1 -- 172.21.15.190:0/2148708252 learned_addr learned my addr 172.21.15.190:0/2148708252 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-20T06:40:50.917 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3392348640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f338c15cba0 0x7f338c152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:51074/0 (socket says 172.21.15.190:51074) 2023-11-20T06:40:50.917 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3391b47640 1 --2- 172.21.15.190:0/2148708252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f338c0b84e0 0x7f338c0c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:50.917 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3391346640 1 -- 172.21.15.190:0/2148708252 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f338c15cba0 msgr2=0x7f338c152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.917 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3391346640 1 --2- 172.21.15.190:0/2148708252 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f338c15cba0 0x7f338c152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.917 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3391346640 1 -- 172.21.15.190:0/2148708252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f338c0b84e0 msgr2=0x7f338c0c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.917 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3391346640 1 --2- 172.21.15.190:0/2148708252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f338c0b84e0 0x7f338c0c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.917 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3391346640 1 -- 172.21.15.190:0/2148708252 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3384009a70 con 0x7f338c0d0210 2023-11-20T06:40:50.917 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3391346640 1 --2- 172.21.15.190:0/2148708252 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f338c0d0210 0x7f338c14a630 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f337c00c480 tx=0x7f337c00c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:50.917 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f33827fc640 1 -- 172.21.15.190:0/2148708252 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c0074e0 con 0x7f338c0d0210 2023-11-20T06:40:50.917 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f33827fc640 1 -- 172.21.15.190:0/2148708252 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337c007640 con 0x7f338c0d0210 2023-11-20T06:40:50.918 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3393dab640 1 -- 172.21.15.190:0/2148708252 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338c1512f0 con 0x7f338c0d0210 2023-11-20T06:40:50.918 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f33827fc640 1 -- 172.21.15.190:0/2148708252 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c004a10 con 0x7f338c0d0210 2023-11-20T06:40:50.918 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.913+0000 7f3393dab640 1 -- 172.21.15.190:0/2148708252 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338c151b30 con 0x7f338c0d0210 2023-11-20T06:40:50.918 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.917+0000 7f33827fc640 1 -- 172.21.15.190:0/2148708252 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f337c01d440 con 0x7f338c0d0210 2023-11-20T06:40:50.918 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.917+0000 7f33827fc640 1 -- 172.21.15.190:0/2148708252 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f337c01dd50 con 0x7f338c0d0210 2023-11-20T06:40:50.918 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.917+0000 7f3393dab640 1 -- 172.21.15.190:0/2148708252 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338c151d20 con 0x7f338c0d0210 2023-11-20T06:40:50.918 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.917+0000 7f33827fc640 1 -- 172.21.15.190:0/2148708252 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f337c018070 con 0x7f338c0d0210 2023-11-20T06:40:50.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.985+0000 7f3393dab640 1 -- 172.21.15.190:0/2148708252 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "aef7c06f-03d1-4d3c-b0a1-a17a0024137a", "id": 7} v 0) v1 -- 0x7f338c04e170 con 0x7f338c0d0210 2023-11-20T06:40:50.988 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.989+0000 7f33827fc640 1 -- 172.21.15.190:0/2148708252 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aef7c06f-03d1-4d3c-b0a1-a17a0024137a", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f337c01d7c0 con 0x7f338c0d0210 2023-11-20T06:40:50.989 INFO:teuthology.orchestra.run.smithi190.stdout:7 2023-11-20T06:40:50.990 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.989+0000 7f3393dab640 1 -- 172.21.15.190:0/2148708252 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f338c0d0210 msgr2=0x7f338c14a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:50.990 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.989+0000 7f3393dab640 1 --2- 172.21.15.190:0/2148708252 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f338c0d0210 0x7f338c14a630 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f337c00c480 tx=0x7f337c00c940 comp rx=0 tx=0).stop 2023-11-20T06:40:50.990 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.989+0000 7f3393dab640 1 -- 172.21.15.190:0/2148708252 shutdown_connections 2023-11-20T06:40:50.990 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.989+0000 7f3393dab640 1 --2- 172.21.15.190:0/2148708252 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f338c15cba0 0x7f338c152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.990 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.989+0000 7f3393dab640 1 --2- 172.21.15.190:0/2148708252 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f338c0d0210 0x7f338c14a630 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.990 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.989+0000 7f3393dab640 1 --2- 172.21.15.190:0/2148708252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f338c0b84e0 0x7f338c0c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:50.990 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.989+0000 7f3393dab640 1 -- 172.21.15.190:0/2148708252 >> 172.21.15.190:0/2148708252 conn(0x7f338c0719c0 msgr2=0x7f338c153a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:50.990 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.989+0000 7f3393dab640 1 -- 172.21.15.190:0/2148708252 shutdown_connections 2023-11-20T06:40:50.991 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:40:50.989+0000 7f3393dab640 1 -- 172.21.15.190:0/2148708252 wait complete. 2023-11-20T06:40:51.007 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-20T06:40:51.007 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-20T06:40:51.011 INFO:tasks.ceph.osd.0:Started 2023-11-20T06:40:51.011 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-20T06:40:51.011 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-20T06:40:51.014 INFO:tasks.ceph.osd.1:Started 2023-11-20T06:40:51.014 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-20T06:40:51.014 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-20T06:40:51.018 INFO:tasks.ceph.osd.2:Started 2023-11-20T06:40:51.018 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-20T06:40:51.018 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-20T06:40:51.023 INFO:tasks.ceph.osd.3:Started 2023-11-20T06:40:51.023 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-20T06:40:51.023 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-20T06:40:51.026 INFO:tasks.ceph.osd.4:Started 2023-11-20T06:40:51.026 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-20T06:40:51.029 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-20T06:40:51.032 INFO:tasks.ceph.osd.5:Started 2023-11-20T06:40:51.032 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-20T06:40:51.032 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-20T06:40:51.035 INFO:tasks.ceph.osd.6:Started 2023-11-20T06:40:51.036 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-20T06:40:51.036 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-20T06:40:51.040 INFO:tasks.ceph.osd.7:Started 2023-11-20T06:40:51.041 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:40:51.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.236+0000 7fd971817640 1 Processor -- start 2023-11-20T06:40:51.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.236+0000 7fd971817640 1 -- start start 2023-11-20T06:40:51.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.236+0000 7fd971817640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd96c0d3010 0x7fd96c0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:51.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.236+0000 7fd971817640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96c0ce770 con 0x7fd96c15cb90 2023-11-20T06:40:51.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.236+0000 7fd971817640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96c0d0600 con 0x7fd96c0d15d0 2023-11-20T06:40:51.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.236+0000 7fd971817640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c0c6450 con 0x7fd96c0d3010 2023-11-20T06:40:51.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.236+0000 7fd96b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd96c0d3010 0x7fd96c0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:51.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.236+0000 7fd96b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd96c0d3010 0x7fd96c0cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52214/0 (socket says 172.21.15.19:52214) 2023-11-20T06:40:51.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.236+0000 7fd96b7fe640 1 -- 172.21.15.19:0/3887229202 learned_addr learned my addr 172.21.15.19:0/3887229202 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:40:51.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.236+0000 7fd96b7fe640 1 -- 172.21.15.19:0/3887229202 >> v1:172.21.15.190:6789/0 conn(0x7fd96c0d15d0 legacy=0x7fd96c0c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:40:51.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.236+0000 7fd96b7fe640 1 -- 172.21.15.19:0/3887229202 >> v1:172.21.15.19:6789/0 conn(0x7fd96c15cb90 legacy=0x7fd96c0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:51.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.236+0000 7fd96b7fe640 1 -- 172.21.15.19:0/3887229202 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c0d08a0 con 0x7fd96c0d3010 2023-11-20T06:40:51.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.240+0000 7fd96b7fe640 1 --2- 172.21.15.19:0/3887229202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd96c0d3010 0x7fd96c0cfb10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd964009e50 tx=0x7fd96401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa984599bba4670c server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:51.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.240+0000 7fd96a7fc640 1 -- 172.21.15.19:0/3887229202 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9640a57d0 con 0x7fd96c0d3010 2023-11-20T06:40:51.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.240+0000 7fd96a7fc640 1 -- 172.21.15.19:0/3887229202 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9640a5930 con 0x7fd96c0d3010 2023-11-20T06:40:51.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.240+0000 7fd96a7fc640 1 -- 172.21.15.19:0/3887229202 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9640a5cc0 con 0x7fd96c0d3010 2023-11-20T06:40:51.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.240+0000 7fd971817640 1 -- 172.21.15.19:0/3887229202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd96c0d3010 msgr2=0x7fd96c0cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:51.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.240+0000 7fd971817640 1 --2- 172.21.15.19:0/3887229202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd96c0d3010 0x7fd96c0cfb10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd964009e50 tx=0x7fd96401c910 comp rx=0 tx=0).stop 2023-11-20T06:40:51.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.240+0000 7fd971817640 1 -- 172.21.15.19:0/3887229202 shutdown_connections 2023-11-20T06:40:51.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.240+0000 7fd971817640 1 --2- 172.21.15.19:0/3887229202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd96c0d3010 0x7fd96c0cfb10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:51.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.240+0000 7fd971817640 1 -- 172.21.15.19:0/3887229202 >> 172.21.15.19:0/3887229202 conn(0x7fd96c09bc50 msgr2=0x7fd96c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:51.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.240+0000 7fd971817640 1 -- 172.21.15.19:0/3887229202 shutdown_connections 2023-11-20T06:40:51.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.240+0000 7fd971817640 1 -- 172.21.15.19:0/3887229202 wait complete. 2023-11-20T06:40:51.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd971817640 1 Processor -- start 2023-11-20T06:40:51.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd971817640 1 -- start start 2023-11-20T06:40:51.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd971817640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd96c0d15d0 0x7fd96c1539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd971817640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd96c0d3010 0x7fd96c1f7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd971817640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd96c15cb90 0x7fd96c1f5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd971817640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c1f4e80 con 0x7fd96c15cb90 2023-11-20T06:40:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd971817640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c1f8820 con 0x7fd96c0d15d0 2023-11-20T06:40:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd971817640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c1f8b00 con 0x7fd96c0d3010 2023-11-20T06:40:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd96b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd96c15cb90 0x7fd96c1f5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd96b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd96c15cb90 0x7fd96c1f5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52216/0 (socket says 172.21.15.19:52216) 2023-11-20T06:40:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd96b7fe640 1 -- 172.21.15.19:0/1193760468 learned_addr learned my addr 172.21.15.19:0/1193760468 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:40:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd96affd640 1 --2- 172.21.15.19:0/1193760468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd96c0d15d0 0x7fd96c1539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd963fff640 1 --2- 172.21.15.19:0/1193760468 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd96c0d3010 0x7fd96c1f7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd96b7fe640 1 -- 172.21.15.19:0/1193760468 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd96c0d3010 msgr2=0x7fd96c1f7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:51.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd96b7fe640 1 --2- 172.21.15.19:0/1193760468 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd96c0d3010 0x7fd96c1f7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:51.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd96b7fe640 1 -- 172.21.15.19:0/1193760468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd96c0d15d0 msgr2=0x7fd96c1539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:51.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd96b7fe640 1 --2- 172.21.15.19:0/1193760468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd96c0d15d0 0x7fd96c1539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:51.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd96b7fe640 1 -- 172.21.15.19:0/1193760468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd964009b30 con 0x7fd96c15cb90 2023-11-20T06:40:51.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd96b7fe640 1 --2- 172.21.15.19:0/1193760468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd96c15cb90 0x7fd96c1f5310 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd9640af040 tx=0x7fd9640196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:51.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd968ff9640 1 -- 172.21.15.19:0/1193760468 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9640b8670 con 0x7fd96c15cb90 2023-11-20T06:40:51.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd968ff9640 1 -- 172.21.15.19:0/1193760468 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9640b87d0 con 0x7fd96c15cb90 2023-11-20T06:40:51.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd971817640 1 -- 172.21.15.19:0/1193760468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96c1f4b10 con 0x7fd96c15cb90 2023-11-20T06:40:51.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd968ff9640 1 -- 172.21.15.19:0/1193760468 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9640b8b80 con 0x7fd96c15cb90 2023-11-20T06:40:51.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd971817640 1 -- 172.21.15.19:0/1193760468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96c1f8de0 con 0x7fd96c15cb90 2023-11-20T06:40:51.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd968ff9640 1 -- 172.21.15.19:0/1193760468 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd9640c1400 con 0x7fd96c15cb90 2023-11-20T06:40:51.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd968ff9640 1 -- 172.21.15.19:0/1193760468 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd9640c1d80 con 0x7fd96c15cb90 2023-11-20T06:40:51.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.244+0000 7fd971817640 1 -- 172.21.15.19:0/1193760468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96c074010 con 0x7fd96c15cb90 2023-11-20T06:40:51.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.260+0000 7fd968ff9640 1 -- 172.21.15.19:0/1193760468 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fd9640bc020 con 0x7fd96c15cb90 2023-11-20T06:40:51.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.316+0000 7fd971817640 1 -- 172.21.15.19:0/1193760468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd96c1f4fc0 con 0x7fd96c15cb90 2023-11-20T06:40:51.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.320+0000 7fd968ff9640 1 -- 172.21.15.19:0/1193760468 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd9640c1760 con 0x7fd96c15cb90 2023-11-20T06:40:51.323 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:40:51.323 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":10,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:40:50.984686+0000","last_up_change":"0.000000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:40:51.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.320+0000 7fd971817640 1 -- 172.21.15.19:0/1193760468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd96c15cb90 msgr2=0x7fd96c1f5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:51.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.320+0000 7fd971817640 1 --2- 172.21.15.19:0/1193760468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd96c15cb90 0x7fd96c1f5310 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd9640af040 tx=0x7fd9640196b0 comp rx=0 tx=0).stop 2023-11-20T06:40:51.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.320+0000 7fd971817640 1 -- 172.21.15.19:0/1193760468 shutdown_connections 2023-11-20T06:40:51.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.320+0000 7fd971817640 1 --2- 172.21.15.19:0/1193760468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd96c15cb90 0x7fd96c1f5310 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:51.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.320+0000 7fd971817640 1 --2- 172.21.15.19:0/1193760468 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd96c0d3010 0x7fd96c1f7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:51.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.320+0000 7fd971817640 1 --2- 172.21.15.19:0/1193760468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd96c0d15d0 0x7fd96c1539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:51.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.320+0000 7fd971817640 1 -- 172.21.15.19:0/1193760468 >> 172.21.15.19:0/1193760468 conn(0x7fd96c09bc50 msgr2=0x7fd96c0c6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:51.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.320+0000 7fd971817640 1 -- 172.21.15.19:0/1193760468 shutdown_connections 2023-11-20T06:40:51.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:40:51.320+0000 7fd971817640 1 -- 172.21.15.19:0/1193760468 wait complete. 2023-11-20T06:40:51.343 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-20T06:40:51.343 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-20T06:40:51.459 INFO:tasks.ceph.mgr.x.smithi190.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-20T06:40:51.459 INFO:tasks.ceph.mgr.x.smithi190.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-20T06:40:51.459 INFO:tasks.ceph.mgr.x.smithi190.stderr: from numpy import show_config as show_numpy_config 2023-11-20T06:40:51.473 INFO:tasks.ceph.mgr.y.smithi019.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-20T06:40:51.473 INFO:tasks.ceph.mgr.y.smithi019.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-20T06:40:51.474 INFO:tasks.ceph.mgr.y.smithi019.stderr: from numpy import show_config as show_numpy_config 2023-11-20T06:40:51.514 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:51.513+0000 7fd78dd3f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-20T06:40:51.526 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:51.520+0000 7f9228f77180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-20T06:40:51.649 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:51.649+0000 7fd78dd3f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-20T06:40:51.672 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:51.668+0000 7f9228f77180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-20T06:40:51.692 INFO:tasks.ceph.osd.1.smithi019.stderr:2023-11-20T06:40:51.688+0000 7ff0ea3fd640 -1 Falling back to public interface 2023-11-20T06:40:51.700 INFO:tasks.ceph.osd.2.smithi019.stderr:2023-11-20T06:40:51.696+0000 7f2a3dc2b640 -1 Falling back to public interface 2023-11-20T06:40:51.720 INFO:tasks.ceph.osd.0.smithi019.stderr:2023-11-20T06:40:51.716+0000 7eff34eba640 -1 Falling back to public interface 2023-11-20T06:40:51.733 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-11-20T06:40:51.733+0000 7fc1cdaa6640 -1 Falling back to public interface 2023-11-20T06:40:51.741 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-11-20T06:40:51.741+0000 7f3a48ea4640 -1 Falling back to public interface 2023-11-20T06:40:51.753 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-11-20T06:40:51.753+0000 7f0b66c2f640 -1 Falling back to public interface 2023-11-20T06:40:51.756 INFO:tasks.ceph.osd.3.smithi019.stderr:2023-11-20T06:40:51.752+0000 7f5cd1c95640 -1 Falling back to public interface 2023-11-20T06:40:51.769 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-11-20T06:40:51.769+0000 7fbce79a9640 -1 Falling back to public interface 2023-11-20T06:40:51.820 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:51.821+0000 7fd78dd3f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-20T06:40:51.850 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:51.844+0000 7f9228f77180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-20T06:40:51.892 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:51.893+0000 7fd78dd3f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-20T06:40:51.927 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:51.924+0000 7f9228f77180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-20T06:40:52.028 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:52.029+0000 7fd78dd3f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-20T06:40:52.073 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:52.068+0000 7f9228f77180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-20T06:40:52.148 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-20T06:40:52.283 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.276+0000 7f79ab668640 1 Processor -- start 2023-11-20T06:40:52.283 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.280+0000 7f79ab668640 1 -- start start 2023-11-20T06:40:52.284 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.280+0000 7f79ab668640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79a415ce40 0x7f79a40ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:52.284 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.280+0000 7f79ab668640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f79a40ce540 0x7f79a40d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:52.284 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.280+0000 7f79ab668640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a40cfd50 con 0x7f79a415ca60 2023-11-20T06:40:52.285 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.280+0000 7f79ab668640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a40ce9b0 con 0x7f79a40ce540 2023-11-20T06:40:52.285 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.280+0000 7f79ab668640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a40d0030 con 0x7f79a415ce40 2023-11-20T06:40:52.285 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.280+0000 7f79a9c05640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f79a40ce540 0x7f79a40d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:52.285 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.280+0000 7f79a9c05640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f79a40ce540 0x7f79a40d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51644/0 (socket says 172.21.15.19:51644) 2023-11-20T06:40:52.285 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.280+0000 7f79a9c05640 1 -- 172.21.15.19:0/516051645 learned_addr learned my addr 172.21.15.19:0/516051645 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:40:52.285 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.280+0000 7f79a8c03640 1 --2- 172.21.15.19:0/516051645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79a415ce40 0x7f79a40ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:52.285 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.280+0000 7f79a9c05640 1 -- 172.21.15.19:0/516051645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79a415ce40 msgr2=0x7f79a40ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:40:52.285 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.280+0000 7f79a9c05640 1 --2- 172.21.15.19:0/516051645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79a415ce40 0x7f79a40ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:52.286 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.280+0000 7f79a9c05640 1 -- 172.21.15.19:0/516051645 >> v1:172.21.15.19:6789/0 conn(0x7f79a415ca60 legacy=0x7f79a406b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:52.286 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.280+0000 7f79a9c05640 1 -- 172.21.15.19:0/516051645 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a40cd520 con 0x7f79a40ce540 2023-11-20T06:40:52.287 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.284+0000 7f79a9c05640 1 --2- 172.21.15.19:0/516051645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79a40ce540 0x7f79a40d0f60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f799c009e50 tx=0x7f799c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7e0e343db86b56 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:52.288 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.284+0000 7f799bfff640 1 -- 172.21.15.19:0/516051645 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c0a57c0 con 0x7f79a40ce540 2023-11-20T06:40:52.288 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.284+0000 7f799bfff640 1 -- 172.21.15.19:0/516051645 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c0a5920 con 0x7f79a40ce540 2023-11-20T06:40:52.288 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.284+0000 7f799bfff640 1 -- 172.21.15.19:0/516051645 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c0a5cb0 con 0x7f79a40ce540 2023-11-20T06:40:52.289 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.284+0000 7f79ab668640 1 -- 172.21.15.19:0/516051645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79a40ce540 msgr2=0x7f79a40d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:52.289 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.284+0000 7f79ab668640 1 --2- 172.21.15.19:0/516051645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79a40ce540 0x7f79a40d0f60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f799c009e50 tx=0x7f799c01c9e0 comp rx=0 tx=0).stop 2023-11-20T06:40:52.289 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.284+0000 7f79ab668640 1 -- 172.21.15.19:0/516051645 shutdown_connections 2023-11-20T06:40:52.289 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.284+0000 7f79ab668640 1 --2- 172.21.15.19:0/516051645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79a40ce540 0x7f79a40d0f60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:52.289 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.284+0000 7f79ab668640 1 --2- 172.21.15.19:0/516051645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79a415ce40 0x7f79a40ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:52.289 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.284+0000 7f79ab668640 1 -- 172.21.15.19:0/516051645 >> 172.21.15.19:0/516051645 conn(0x7f79a408c350 msgr2=0x7f79a409bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:52.289 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.284+0000 7f79ab668640 1 -- 172.21.15.19:0/516051645 shutdown_connections 2023-11-20T06:40:52.289 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.284+0000 7f79ab668640 1 -- 172.21.15.19:0/516051645 wait complete. 2023-11-20T06:40:52.290 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.284+0000 7f79ab668640 1 Processor -- start 2023-11-20T06:40:52.291 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.284+0000 7f79ab668640 1 -- start start 2023-11-20T06:40:52.293 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f79ab668640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79a40ce540 0x7f79a40ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:52.293 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f79ab668640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79a415ca60 0x7f79a415fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:52.293 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f79ab668640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79a415ce40 0x7f79a4155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:52.293 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f79ab668640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a4160190 con 0x7f79a40ce540 2023-11-20T06:40:52.293 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f79ab668640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a40caa40 con 0x7f79a415ca60 2023-11-20T06:40:52.293 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f79ab668640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a40cad20 con 0x7f79a415ce40 2023-11-20T06:40:52.294 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f79a9404640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79a40ce540 0x7f79a40ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:52.294 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f79a9404640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79a40ce540 0x7f79a40ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51660/0 (socket says 172.21.15.19:51660) 2023-11-20T06:40:52.294 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f79a9404640 1 -- 172.21.15.19:0/1479732225 learned_addr learned my addr 172.21.15.19:0/1479732225 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:40:52.294 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f79a9c05640 1 --2- 172.21.15.19:0/1479732225 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79a415ce40 0x7f79a4155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:52.294 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f79a8c03640 1 --2- 172.21.15.19:0/1479732225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79a415ca60 0x7f79a415fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:52.294 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f79a9404640 1 -- 172.21.15.19:0/1479732225 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79a415ce40 msgr2=0x7f79a4155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:52.294 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f79a9404640 1 --2- 172.21.15.19:0/1479732225 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79a415ce40 0x7f79a4155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:52.294 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f79a9404640 1 -- 172.21.15.19:0/1479732225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79a415ca60 msgr2=0x7f79a415fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:52.294 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f79a9404640 1 --2- 172.21.15.19:0/1479732225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79a415ca60 0x7f79a415fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:52.294 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f79a9404640 1 -- 172.21.15.19:0/1479732225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c009b30 con 0x7f79a40ce540 2023-11-20T06:40:52.294 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f79a9404640 1 --2- 172.21.15.19:0/1479732225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79a40ce540 0x7f79a40ca460 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f79a000c430 tx=0x7f79a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:52.295 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f7999ffb640 1 -- 172.21.15.19:0/1479732225 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a0011790 con 0x7f79a40ce540 2023-11-20T06:40:52.295 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f7999ffb640 1 -- 172.21.15.19:0/1479732225 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a00118f0 con 0x7f79a40ce540 2023-11-20T06:40:52.295 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f7999ffb640 1 -- 172.21.15.19:0/1479732225 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a0011d20 con 0x7f79a40ce540 2023-11-20T06:40:52.295 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f79ab668640 1 -- 172.21.15.19:0/1479732225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a40cb000 con 0x7f79a40ce540 2023-11-20T06:40:52.295 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f7999ffb640 1 -- 172.21.15.19:0/1479732225 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f79a001c760 con 0x7f79a40ce540 2023-11-20T06:40:52.295 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f79ab668640 1 -- 172.21.15.19:0/1479732225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a40cb5c0 con 0x7f79a40ce540 2023-11-20T06:40:52.295 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f7999ffb640 1 -- 172.21.15.19:0/1479732225 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f79a001ca10 con 0x7f79a40ce540 2023-11-20T06:40:52.295 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.288+0000 7f79ab668640 1 -- 172.21.15.19:0/1479732225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a40cb7b0 con 0x7f79a40ce540 2023-11-20T06:40:52.297 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.292+0000 7f7999ffb640 1 -- 172.21.15.19:0/1479732225 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f79a0012740 con 0x7f79a40ce540 2023-11-20T06:40:52.356 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.352+0000 7f79ab668640 1 -- 172.21.15.19:0/1479732225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79a404e170 con 0x7f79a40ce540 2023-11-20T06:40:52.356 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.352+0000 7f7999ffb640 1 -- 172.21.15.19:0/1479732225 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f79a002b090 con 0x7f79a40ce540 2023-11-20T06:40:52.356 INFO:teuthology.misc.health.smithi019.stdout: 2023-11-20T06:40:52.357 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":10,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:40:50.984686+0000","last_up_change":"0.000000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:40:52.357 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.352+0000 7f79ab668640 1 -- 172.21.15.19:0/1479732225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79a40ce540 msgr2=0x7f79a40ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:52.358 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.352+0000 7f79ab668640 1 --2- 172.21.15.19:0/1479732225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79a40ce540 0x7f79a40ca460 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f79a000c430 tx=0x7f79a000c8f0 comp rx=0 tx=0).stop 2023-11-20T06:40:52.358 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.352+0000 7f79ab668640 1 -- 172.21.15.19:0/1479732225 shutdown_connections 2023-11-20T06:40:52.358 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.352+0000 7f79ab668640 1 --2- 172.21.15.19:0/1479732225 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79a415ce40 0x7f79a4155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:52.358 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.352+0000 7f79ab668640 1 --2- 172.21.15.19:0/1479732225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79a415ca60 0x7f79a415fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:52.358 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.352+0000 7f79ab668640 1 --2- 172.21.15.19:0/1479732225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79a40ce540 0x7f79a40ca460 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:52.358 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.352+0000 7f79ab668640 1 -- 172.21.15.19:0/1479732225 >> 172.21.15.19:0/1479732225 conn(0x7f79a408c350 msgr2=0x7f79a40af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:52.358 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.352+0000 7f79ab668640 1 -- 172.21.15.19:0/1479732225 shutdown_connections 2023-11-20T06:40:52.358 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:52.352+0000 7f79ab668640 1 -- 172.21.15.19:0/1479732225 wait complete. 2023-11-20T06:40:52.375 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-20T06:40:52.705 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:52.705+0000 7fd78dd3f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-20T06:40:52.787 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:52.784+0000 7f9228f77180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-20T06:40:52.791 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:52.789+0000 7fd78dd3f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-20T06:40:52.879 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:52.876+0000 7f9228f77180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-20T06:40:52.980 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:52.981+0000 7fd78dd3f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-20T06:40:53.065 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:53.065+0000 7fd78dd3f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-20T06:40:53.079 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:53.076+0000 7f9228f77180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-20T06:40:53.169 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:53.164+0000 7f9228f77180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-20T06:40:53.391 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:53.389+0000 7fd78dd3f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-20T06:40:53.459 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:53.457+0000 7fd78dd3f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-20T06:40:53.524 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:53.520+0000 7f9228f77180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-20T06:40:53.595 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-11-20T06:40:53.592+0000 7f9228f77180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-20T06:40:54.485 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:54.488+0000 7fd7354b0640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-20T06:40:54.487 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-20T06:40:54.488+0000 7fd7354b0640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-20T06:40:55.526 INFO:tasks.ceph.osd.1.smithi019.stderr:2023-11-20T06:40:55.520+0000 7ff0ea3fd640 -1 osd.1 0 log_to_monitors true 2023-11-20T06:40:55.632 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-11-20T06:40:55.632+0000 7f3a48ea4640 -1 osd.4 0 log_to_monitors true 2023-11-20T06:40:55.637 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-11-20T06:40:55.640+0000 7fbce79a9640 -1 osd.6 0 log_to_monitors true 2023-11-20T06:40:55.670 INFO:tasks.ceph.osd.0.smithi019.stderr:2023-11-20T06:40:55.664+0000 7eff34eba640 -1 osd.0 0 log_to_monitors true 2023-11-20T06:40:55.681 INFO:tasks.ceph.osd.2.smithi019.stderr:2023-11-20T06:40:55.676+0000 7f2a3dc2b640 -1 osd.2 0 log_to_monitors true 2023-11-20T06:40:55.702 INFO:tasks.ceph.osd.3.smithi019.stderr:2023-11-20T06:40:55.696+0000 7f5cd1c95640 -1 osd.3 0 log_to_monitors true 2023-11-20T06:40:55.724 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-11-20T06:40:55.724+0000 7fc1cdaa6640 -1 osd.7 0 log_to_monitors true 2023-11-20T06:40:55.777 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-11-20T06:40:55.780+0000 7f0b66c2f640 -1 osd.5 0 log_to_monitors true 2023-11-20T06:40:59.181 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-20T06:40:59.403 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.396+0000 7f977d93e640 1 Processor -- start 2023-11-20T06:40:59.404 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.400+0000 7f977d93e640 1 -- start start 2023-11-20T06:40:59.405 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.400+0000 7f977d93e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f977815ca60 0x7f977806b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:59.405 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.400+0000 7f977d93e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f977806b980 0x7f97780ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:59.405 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.400+0000 7f977d93e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97780cfd50 con 0x7f977815ce40 2023-11-20T06:40:59.405 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.400+0000 7f977d93e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97780d0030 con 0x7f977806b980 2023-11-20T06:40:59.405 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.400+0000 7f977d93e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97780cd520 con 0x7f977815ca60 2023-11-20T06:40:59.407 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.404+0000 7f9776ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f977815ca60 0x7f977806b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:59.407 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.404+0000 7f9776ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f977815ca60 0x7f977806b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:46680/0 (socket says 172.21.15.19:46680) 2023-11-20T06:40:59.407 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.404+0000 7f9776ffd640 1 -- 172.21.15.19:0/3838595168 learned_addr learned my addr 172.21.15.19:0/3838595168 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:40:59.408 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.404+0000 7f97767fc640 1 --2- 172.21.15.19:0/3838595168 >> v2:172.21.15.190:3300/0 conn(0x7f977806b980 0x7f97780ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:59.408 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.404+0000 7f9776ffd640 1 -- 172.21.15.19:0/3838595168 >> v2:172.21.15.190:3300/0 conn(0x7f977806b980 msgr2=0x7f97780ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:40:59.408 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.404+0000 7f9776ffd640 1 --2- 172.21.15.19:0/3838595168 >> v2:172.21.15.190:3300/0 conn(0x7f977806b980 0x7f97780ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:59.408 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.404+0000 7f9776ffd640 1 -- 172.21.15.19:0/3838595168 >> v1:172.21.15.190:6789/0 conn(0x7f977815ce40 legacy=0x7f97780d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:59.409 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.404+0000 7f9776ffd640 1 -- 172.21.15.19:0/3838595168 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97780cd800 con 0x7f977815ca60 2023-11-20T06:40:59.416 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.412+0000 7f9776ffd640 1 --2- 172.21.15.19:0/3838595168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f977815ca60 0x7f977806b440 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9768006fd0 tx=0x7f976801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4805eeeddb2846d server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:59.418 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.412+0000 7f9775ffb640 1 -- 172.21.15.19:0/3838595168 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97680aa670 con 0x7f977815ca60 2023-11-20T06:40:59.418 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.412+0000 7f9775ffb640 1 -- 172.21.15.19:0/3838595168 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97680aa7d0 con 0x7f977815ca60 2023-11-20T06:40:59.418 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.412+0000 7f9775ffb640 1 -- 172.21.15.19:0/3838595168 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97680aa670 con 0x7f977815ca60 2023-11-20T06:40:59.420 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.416+0000 7f977d93e640 1 -- 172.21.15.19:0/3838595168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f977815ca60 msgr2=0x7f977806b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:59.420 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.416+0000 7f977d93e640 1 --2- 172.21.15.19:0/3838595168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f977815ca60 0x7f977806b440 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9768006fd0 tx=0x7f976801c530 comp rx=0 tx=0).stop 2023-11-20T06:40:59.420 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.416+0000 7f977d93e640 1 -- 172.21.15.19:0/3838595168 shutdown_connections 2023-11-20T06:40:59.420 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.416+0000 7f977d93e640 1 --2- 172.21.15.19:0/3838595168 >> v2:172.21.15.190:3300/0 conn(0x7f977806b980 0x7f97780ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:59.421 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.416+0000 7f977d93e640 1 --2- 172.21.15.19:0/3838595168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f977815ca60 0x7f977806b440 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:59.421 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.416+0000 7f977d93e640 1 -- 172.21.15.19:0/3838595168 >> 172.21.15.19:0/3838595168 conn(0x7f977808c350 msgr2=0x7f977809bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:59.421 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.416+0000 7f977d93e640 1 -- 172.21.15.19:0/3838595168 shutdown_connections 2023-11-20T06:40:59.422 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.416+0000 7f977d93e640 1 -- 172.21.15.19:0/3838595168 wait complete. 2023-11-20T06:40:59.423 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.420+0000 7f977d93e640 1 Processor -- start 2023-11-20T06:40:59.424 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.420+0000 7f977d93e640 1 -- start start 2023-11-20T06:40:59.425 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.420+0000 7f977d93e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f977806b980 0x7f97781f9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:59.426 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.420+0000 7f977d93e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f977815ca60 0x7f977815b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:59.427 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.420+0000 7f977d93e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f977815ce40 0x7f9778158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:59.427 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.420+0000 7f977d93e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977815c430 con 0x7f977815ce40 2023-11-20T06:40:59.427 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.420+0000 7f977d93e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97781f8fc0 con 0x7f977806b980 2023-11-20T06:40:59.427 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.420+0000 7f977d93e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977815be70 con 0x7f977815ca60 2023-11-20T06:40:59.427 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.420+0000 7f97777fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f977815ce40 0x7f9778158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:59.427 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.420+0000 7f97777fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f977815ce40 0x7f9778158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51694/0 (socket says 172.21.15.19:51694) 2023-11-20T06:40:59.428 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.420+0000 7f97777fe640 1 -- 172.21.15.19:0/3062573104 learned_addr learned my addr 172.21.15.19:0/3062573104 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:40:59.428 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.420+0000 7f97767fc640 1 --2- 172.21.15.19:0/3062573104 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f977815ca60 0x7f977815b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:59.428 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.424+0000 7f97777fe640 1 -- 172.21.15.19:0/3062573104 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f977815ca60 msgr2=0x7f977815b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:59.428 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.424+0000 7f97777fe640 1 --2- 172.21.15.19:0/3062573104 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f977815ca60 0x7f977815b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:59.428 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.424+0000 7f97777fe640 1 -- 172.21.15.19:0/3062573104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f977806b980 msgr2=0x7f97781f9780 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-20T06:40:59.428 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.424+0000 7f97777fe640 1 --2- 172.21.15.19:0/3062573104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f977806b980 0x7f97781f9780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:59.428 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.424+0000 7f97777fe640 1 -- 172.21.15.19:0/3062573104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9768009480 con 0x7f977815ce40 2023-11-20T06:40:59.429 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.424+0000 7f97777fe640 1 --2- 172.21.15.19:0/3062573104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f977815ce40 0x7f9778158140 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f977000c730 tx=0x7f977000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:59.429 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.424+0000 7f975ffff640 1 -- 172.21.15.19:0/3062573104 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9770003b80 con 0x7f977815ce40 2023-11-20T06:40:59.429 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.424+0000 7f975ffff640 1 -- 172.21.15.19:0/3062573104 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9770003ce0 con 0x7f977815ce40 2023-11-20T06:40:59.429 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.424+0000 7f975ffff640 1 -- 172.21.15.19:0/3062573104 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977000aa30 con 0x7f977815ce40 2023-11-20T06:40:59.429 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.424+0000 7f977d93e640 1 -- 172.21.15.19:0/3062573104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977815c150 con 0x7f977815ce40 2023-11-20T06:40:59.429 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.424+0000 7f977d93e640 1 -- 172.21.15.19:0/3062573104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97781f9cc0 con 0x7f977815ce40 2023-11-20T06:40:59.430 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.424+0000 7f977d93e640 1 -- 172.21.15.19:0/3062573104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97781f94a0 con 0x7f977815ce40 2023-11-20T06:40:59.434 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.428+0000 7f975ffff640 1 -- 172.21.15.19:0/3062573104 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 85794+0+0 (secure 0 0 0) 0x7f9770039070 con 0x7f977815ce40 2023-11-20T06:40:59.434 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.428+0000 7f975ffff640 1 --2- 172.21.15.19:0/3062573104 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f97640664e0 0x7f97640689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:40:59.434 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.428+0000 7f975ffff640 1 -- 172.21.15.19:0/3062573104 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f97700834b0 con 0x7f977815ce40 2023-11-20T06:40:59.434 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.428+0000 7f9776ffd640 1 --2- 172.21.15.19:0/3062573104 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f97640664e0 0x7f97640689a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:40:59.435 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.432+0000 7f9776ffd640 1 --2- 172.21.15.19:0/3062573104 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f97640664e0 0x7f97640689a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f97680ae000 tx=0x7f97680a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:40:59.443 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.440+0000 7f975ffff640 1 -- 172.21.15.19:0/3062573104 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9770051810 con 0x7f977815ce40 2023-11-20T06:40:59.753 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.748+0000 7f977d93e640 1 -- 172.21.15.19:0/3062573104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97781f94a0 con 0x7f977815ce40 2023-11-20T06:40:59.755 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.752+0000 7f975ffff640 1 -- 172.21.15.19:0/3062573104 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f97781f94a0 con 0x7f977815ce40 2023-11-20T06:40:59.757 INFO:teuthology.misc.health.smithi019.stdout: 2023-11-20T06:40:59.757 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":12,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:40:57.489538+0000","last_up_change":"0.000000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:40:59.760 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.756+0000 7f977d93e640 1 -- 172.21.15.19:0/3062573104 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f97640664e0 msgr2=0x7f97640689a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:59.760 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.756+0000 7f977d93e640 1 --2- 172.21.15.19:0/3062573104 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f97640664e0 0x7f97640689a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f97680ae000 tx=0x7f97680a7000 comp rx=0 tx=0).stop 2023-11-20T06:40:59.760 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.756+0000 7f977d93e640 1 -- 172.21.15.19:0/3062573104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f977815ce40 msgr2=0x7f9778158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:40:59.760 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.756+0000 7f977d93e640 1 --2- 172.21.15.19:0/3062573104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f977815ce40 0x7f9778158140 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f977000c730 tx=0x7f977000cbf0 comp rx=0 tx=0).stop 2023-11-20T06:40:59.761 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.756+0000 7f977d93e640 1 -- 172.21.15.19:0/3062573104 shutdown_connections 2023-11-20T06:40:59.761 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.756+0000 7f977d93e640 1 --2- 172.21.15.19:0/3062573104 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f97640664e0 0x7f97640689a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:59.761 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.756+0000 7f977d93e640 1 --2- 172.21.15.19:0/3062573104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f977815ce40 0x7f9778158140 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:59.761 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.756+0000 7f977d93e640 1 --2- 172.21.15.19:0/3062573104 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f977815ca60 0x7f977815b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:59.761 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.756+0000 7f977d93e640 1 --2- 172.21.15.19:0/3062573104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f977806b980 0x7f97781f9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:40:59.761 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.756+0000 7f977d93e640 1 -- 172.21.15.19:0/3062573104 >> 172.21.15.19:0/3062573104 conn(0x7f977808c350 msgr2=0x7f97780afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:40:59.761 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.756+0000 7f977d93e640 1 -- 172.21.15.19:0/3062573104 shutdown_connections 2023-11-20T06:40:59.762 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:40:59.756+0000 7f977d93e640 1 -- 172.21.15.19:0/3062573104 wait complete. 2023-11-20T06:40:59.798 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-20T06:40:59.932 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-11-20T06:40:59.932+0000 7fc1c9a4e640 -1 osd.7 0 waiting for initial osdmap 2023-11-20T06:40:59.951 INFO:tasks.ceph.osd.2.smithi019.stderr:2023-11-20T06:40:59.948+0000 7f2a3919d640 -1 osd.2 0 waiting for initial osdmap 2023-11-20T06:40:59.956 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-11-20T06:40:59.956+0000 7fbce3951640 -1 osd.6 0 waiting for initial osdmap 2023-11-20T06:40:59.958 INFO:tasks.ceph.osd.0.smithi019.stderr:2023-11-20T06:40:59.952+0000 7eff30e64640 -1 osd.0 0 waiting for initial osdmap 2023-11-20T06:40:59.968 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-11-20T06:40:59.968+0000 7f3a44e4c640 -1 osd.4 0 waiting for initial osdmap 2023-11-20T06:40:59.975 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-11-20T06:40:59.976+0000 7fc1c1883640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-20T06:40:59.989 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-11-20T06:40:59.992+0000 7fbcdb786640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-20T06:40:59.993 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-11-20T06:40:59.996+0000 7f3a3cc81640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-20T06:40:59.999 INFO:tasks.ceph.osd.0.smithi019.stderr:2023-11-20T06:40:59.996+0000 7eff28c99640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-20T06:41:00.011 INFO:tasks.ceph.osd.2.smithi019.stderr:2023-11-20T06:41:00.008+0000 7f2a30fd2640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-20T06:41:00.044 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-11-20T06:41:00.043+0000 7f0b62bd9640 -1 osd.5 0 waiting for initial osdmap 2023-11-20T06:41:00.089 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-11-20T06:41:00.091+0000 7f0b5aa0e640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-20T06:41:00.101 INFO:tasks.ceph.osd.1.smithi019.stderr:2023-11-20T06:41:00.096+0000 7ff0e63a7640 -1 osd.1 0 waiting for initial osdmap 2023-11-20T06:41:00.123 INFO:tasks.ceph.osd.1.smithi019.stderr:2023-11-20T06:41:00.120+0000 7ff0de1dc640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-20T06:41:00.162 INFO:tasks.ceph.osd.3.smithi019.stderr:2023-11-20T06:41:00.156+0000 7f5cce453640 -1 osd.3 0 waiting for initial osdmap 2023-11-20T06:41:00.195 INFO:tasks.ceph.osd.3.smithi019.stderr:2023-11-20T06:41:00.192+0000 7f5cc5a74640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-20T06:41:06.603 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-20T06:41:06.747 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.740+0000 7f74ba11d640 1 Processor -- start 2023-11-20T06:41:06.747 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.744+0000 7f74ba11d640 1 -- start start 2023-11-20T06:41:06.749 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.744+0000 7f74ba11d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74b40b0680 0x7f74b40b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:06.749 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.744+0000 7f74ba11d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f74b40cbb80 0x7f74b40b1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:06.749 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.744+0000 7f74ba11d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b40710e0 con 0x7f74b415a880 2023-11-20T06:41:06.749 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.744+0000 7f74ba11d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b40ca5d0 con 0x7f74b40cbb80 2023-11-20T06:41:06.749 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.744+0000 7f74ba11d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b40ca8b0 con 0x7f74b40b0680 2023-11-20T06:41:06.750 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.744+0000 7f74b3fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f74b40cbb80 0x7f74b40b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:06.750 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.744+0000 7f74b3fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f74b40cbb80 0x7f74b40b1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41810/0 (socket says 172.21.15.19:41810) 2023-11-20T06:41:06.750 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.744+0000 7f74b3fff640 1 -- 172.21.15.19:0/3902181192 learned_addr learned my addr 172.21.15.19:0/3902181192 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:06.750 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.744+0000 7f74b37fe640 1 --1- 172.21.15.19:0/3902181192 >> v1:172.21.15.19:6789/0 conn(0x7f74b415a880 0x7f74b40aff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54342/0 (socket says 172.21.15.19:54342) 2023-11-20T06:41:06.750 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.744+0000 7f74b2ffd640 1 --2- 172.21.15.19:0/3902181192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74b40b0680 0x7f74b40b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:06.750 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.744+0000 7f74b3fff640 1 -- 172.21.15.19:0/3902181192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74b40b0680 msgr2=0x7f74b40b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:06.750 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.744+0000 7f74b3fff640 1 --2- 172.21.15.19:0/3902181192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74b40b0680 0x7f74b40b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:06.750 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.744+0000 7f74b3fff640 1 -- 172.21.15.19:0/3902181192 >> v1:172.21.15.19:6789/0 conn(0x7f74b415a880 legacy=0x7f74b40aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:06.751 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.744+0000 7f74b3fff640 1 -- 172.21.15.19:0/3902181192 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b40cb0a0 con 0x7f74b40cbb80 2023-11-20T06:41:06.751 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.744+0000 7f74b27fc640 1 -- 172.21.15.19:0/3902181192 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2915885903 0 0) 0x7f74a4001120 con 0x7f74b415a880 2023-11-20T06:41:06.751 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.744+0000 7f74b2ffd640 1 --2- 172.21.15.19:0/3902181192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74b40b0680 0x7f74b40b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:06.751 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.748+0000 7f74b3fff640 1 --2- 172.21.15.19:0/3902181192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74b40cbb80 0x7f74b40b1860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009e50 tx=0x7f74ac01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ae0d43f51a4b9b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:06.752 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.748+0000 7f74b27fc640 1 -- 172.21.15.19:0/3902181192 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac0a58a0 con 0x7f74b40cbb80 2023-11-20T06:41:06.753 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.748+0000 7f74b27fc640 1 -- 172.21.15.19:0/3902181192 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac0a5a00 con 0x7f74b40cbb80 2023-11-20T06:41:06.753 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.748+0000 7f74b27fc640 1 -- 172.21.15.19:0/3902181192 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac0a5d90 con 0x7f74b40cbb80 2023-11-20T06:41:06.753 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.748+0000 7f74ba11d640 1 -- 172.21.15.19:0/3902181192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74b40cbb80 msgr2=0x7f74b40b1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:06.753 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.748+0000 7f74ba11d640 1 --2- 172.21.15.19:0/3902181192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74b40cbb80 0x7f74b40b1860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009e50 tx=0x7f74ac01c9e0 comp rx=0 tx=0).stop 2023-11-20T06:41:06.753 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.748+0000 7f74ba11d640 1 -- 172.21.15.19:0/3902181192 shutdown_connections 2023-11-20T06:41:06.753 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.748+0000 7f74ba11d640 1 --2- 172.21.15.19:0/3902181192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74b40cbb80 0x7f74b40b1860 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:06.753 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.748+0000 7f74ba11d640 1 --2- 172.21.15.19:0/3902181192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74b40b0680 0x7f74b40b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:06.754 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.748+0000 7f74ba11d640 1 -- 172.21.15.19:0/3902181192 >> 172.21.15.19:0/3902181192 conn(0x7f74b406c1b0 msgr2=0x7f74b406c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:06.754 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.748+0000 7f74ba11d640 1 -- 172.21.15.19:0/3902181192 shutdown_connections 2023-11-20T06:41:06.754 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.748+0000 7f74ba11d640 1 -- 172.21.15.19:0/3902181192 wait complete. 2023-11-20T06:41:06.754 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.748+0000 7f74ba11d640 1 Processor -- start 2023-11-20T06:41:06.754 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.748+0000 7f74ba11d640 1 -- start start 2023-11-20T06:41:06.757 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74ba11d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74b40b0680 0x7f74b415af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:06.757 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74ba11d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74b40cbb80 0x7f74b414fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:06.757 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74ba11d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74b415a880 0x7f74b41506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:06.757 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74ba11d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b41570d0 con 0x7f74b40b0680 2023-11-20T06:41:06.757 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74ba11d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b40cc1d0 con 0x7f74b415a880 2023-11-20T06:41:06.757 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74ba11d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b4156df0 con 0x7f74b40cbb80 2023-11-20T06:41:06.757 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74b37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74b40b0680 0x7f74b415af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:06.757 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74b37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74b40b0680 0x7f74b415af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41820/0 (socket says 172.21.15.19:41820) 2023-11-20T06:41:06.757 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74b37fe640 1 -- 172.21.15.19:0/3243728915 learned_addr learned my addr 172.21.15.19:0/3243728915 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:06.758 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74b3fff640 1 --2- 172.21.15.19:0/3243728915 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74b415a880 0x7f74b41506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:06.758 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74b2ffd640 1 --2- 172.21.15.19:0/3243728915 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74b40cbb80 0x7f74b414fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:06.758 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74b37fe640 1 -- 172.21.15.19:0/3243728915 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74b40cbb80 msgr2=0x7f74b414fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:06.758 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74b37fe640 1 --2- 172.21.15.19:0/3243728915 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74b40cbb80 0x7f74b414fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:06.758 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74b37fe640 1 -- 172.21.15.19:0/3243728915 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74b415a880 msgr2=0x7f74b41506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:06.758 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74b37fe640 1 --2- 172.21.15.19:0/3243728915 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74b415a880 0x7f74b41506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:06.758 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74b37fe640 1 -- 172.21.15.19:0/3243728915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac009b30 con 0x7f74b40b0680 2023-11-20T06:41:06.758 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74b3fff640 1 --2- 172.21.15.19:0/3243728915 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74b415a880 0x7f74b41506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:06.758 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74b37fe640 1 --2- 172.21.15.19:0/3243728915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74b40b0680 0x7f74b415af60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f74a400c480 tx=0x7f74a400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:06.758 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f749bfff640 1 -- 172.21.15.19:0/3243728915 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a40074e0 con 0x7f74b40b0680 2023-11-20T06:41:06.758 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f749bfff640 1 -- 172.21.15.19:0/3243728915 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a4007660 con 0x7f74b40b0680 2023-11-20T06:41:06.759 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74ba11d640 1 -- 172.21.15.19:0/3243728915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b40cc470 con 0x7f74b40b0680 2023-11-20T06:41:06.759 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f749bfff640 1 -- 172.21.15.19:0/3243728915 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4004a30 con 0x7f74b40b0680 2023-11-20T06:41:06.759 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74ba11d640 1 -- 172.21.15.19:0/3243728915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b4156a80 con 0x7f74b40b0680 2023-11-20T06:41:06.759 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.752+0000 7f74ba11d640 1 -- 172.21.15.19:0/3243728915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b404e170 con 0x7f74b40b0680 2023-11-20T06:41:06.759 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.756+0000 7f749bfff640 1 -- 172.21.15.19:0/3243728915 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f74a4004b90 con 0x7f74b40b0680 2023-11-20T06:41:06.760 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.756+0000 7f749bfff640 1 --2- 172.21.15.19:0/3243728915 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f74a00664a0 0x7f74a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:06.760 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.756+0000 7f749bfff640 1 -- 172.21.15.19:0/3243728915 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f74a4082ed0 con 0x7f74b40b0680 2023-11-20T06:41:06.760 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.756+0000 7f74b2ffd640 1 --2- 172.21.15.19:0/3243728915 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f74a00664a0 0x7f74a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:06.761 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.756+0000 7f74b2ffd640 1 --2- 172.21.15.19:0/3243728915 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f74a00664a0 0x7f74a0068960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f74b40c8a80 tx=0x7f74a8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:06.764 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.760+0000 7f749bfff640 1 -- 172.21.15.19:0/3243728915 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f74a4054120 con 0x7f74b40b0680 2023-11-20T06:41:06.924 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.920+0000 7f74ba11d640 1 -- 172.21.15.19:0/3243728915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74b40710e0 con 0x7f74b40b0680 2023-11-20T06:41:06.925 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.920+0000 7f749bfff640 1 -- 172.21.15.19:0/3243728915 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12838 (secure 0 0 0) 0x7f74b40710e0 con 0x7f74b40b0680 2023-11-20T06:41:06.925 INFO:teuthology.misc.health.smithi019.stdout: 2023-11-20T06:41:06.925 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":16,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:04.194716+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:41:06.927 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.920+0000 7f74ba11d640 1 -- 172.21.15.19:0/3243728915 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f74a00664a0 msgr2=0x7f74a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:06.927 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.920+0000 7f74ba11d640 1 --2- 172.21.15.19:0/3243728915 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f74a00664a0 0x7f74a0068960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f74b40c8a80 tx=0x7f74a8008040 comp rx=0 tx=0).stop 2023-11-20T06:41:06.927 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.920+0000 7f74ba11d640 1 -- 172.21.15.19:0/3243728915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74b40b0680 msgr2=0x7f74b415af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:06.927 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.920+0000 7f74ba11d640 1 --2- 172.21.15.19:0/3243728915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74b40b0680 0x7f74b415af60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f74a400c480 tx=0x7f74a400c940 comp rx=0 tx=0).stop 2023-11-20T06:41:06.927 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.924+0000 7f74ba11d640 1 -- 172.21.15.19:0/3243728915 shutdown_connections 2023-11-20T06:41:06.927 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.924+0000 7f74ba11d640 1 --2- 172.21.15.19:0/3243728915 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f74a00664a0 0x7f74a0068960 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:06.927 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.924+0000 7f74ba11d640 1 --2- 172.21.15.19:0/3243728915 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74b415a880 0x7f74b41506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:06.928 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.924+0000 7f74ba11d640 1 --2- 172.21.15.19:0/3243728915 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74b40cbb80 0x7f74b414fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:06.928 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.924+0000 7f74ba11d640 1 --2- 172.21.15.19:0/3243728915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74b40b0680 0x7f74b415af60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:06.928 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.924+0000 7f74ba11d640 1 -- 172.21.15.19:0/3243728915 >> 172.21.15.19:0/3243728915 conn(0x7f74b406c1b0 msgr2=0x7f74b406c590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:06.928 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.924+0000 7f74ba11d640 1 -- 172.21.15.19:0/3243728915 shutdown_connections 2023-11-20T06:41:06.928 INFO:teuthology.misc.health.smithi019.stderr:2023-11-20T06:41:06.924+0000 7f74ba11d640 1 -- 172.21.15.19:0/3243728915 wait complete. 2023-11-20T06:41:06.945 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-20T06:41:06.945 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-20T06:41:06.945 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-20T06:41:06.945 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-20T06:41:06.949 INFO:tasks.ceph.mds.a:Started 2023-11-20T06:41:06.949 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-20T06:41:06.949 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-20T06:41:06.952 INFO:tasks.ceph.mds.c:Started 2023-11-20T06:41:06.953 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-20T06:41:06.953 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-20T06:41:06.957 INFO:tasks.ceph.mds.b:Started 2023-11-20T06:41:06.957 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-20T06:41:06.957 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-20T06:41:06.960 INFO:tasks.ceph.mds.d:Started 2023-11-20T06:41:06.961 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-20T06:41:06.961 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:41:07.045 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2023-11-20T06:41:07.048 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2023-11-20T06:41:07.071 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2023-11-20T06:41:07.072 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2023-11-20T06:41:07.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.104+0000 7fc124dc5640 1 Processor -- start 2023-11-20T06:41:07.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.104+0000 7fc124dc5640 1 -- start start 2023-11-20T06:41:07.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.108+0000 7fc124dc5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc1200d3010 0x7fc1200cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:07.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.108+0000 7fc124dc5640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1200ce770 con 0x7fc12015cb90 2023-11-20T06:41:07.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.108+0000 7fc124dc5640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1200d0600 con 0x7fc1200d15d0 2023-11-20T06:41:07.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.108+0000 7fc124dc5640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1200c6450 con 0x7fc1200d3010 2023-11-20T06:41:07.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.108+0000 7fc11e59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc12015cb90 0x7fc1200d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54366/0 (socket says 172.21.15.19:54366) 2023-11-20T06:41:07.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.108+0000 7fc11e59c640 1 -- 172.21.15.19:0/1273293341 learned_addr learned my addr 172.21.15.19:0/1273293341 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:07.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.108+0000 7fc11ed9d640 1 --2- 172.21.15.19:0/1273293341 >> v2:172.21.15.19:3300/0 conn(0x7fc1200d3010 0x7fc1200cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:07.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.108+0000 7fc11d59a640 1 -- 172.21.15.19:0/1273293341 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822676727 0 0) 0x7fc1200ce770 con 0x7fc12015cb90 2023-11-20T06:41:07.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.108+0000 7fc11ed9d640 1 -- 172.21.15.19:0/1273293341 >> v1:172.21.15.190:6789/0 conn(0x7fc1200d15d0 legacy=0x7fc1200c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:07.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.108+0000 7fc11ed9d640 1 -- 172.21.15.19:0/1273293341 >> v1:172.21.15.19:6789/0 conn(0x7fc12015cb90 legacy=0x7fc1200d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:07.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.108+0000 7fc11ed9d640 1 -- 172.21.15.19:0/1273293341 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1200d08a0 con 0x7fc1200d3010 2023-11-20T06:41:07.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.108+0000 7fc11ed9d640 1 --2- 172.21.15.19:0/1273293341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1200d3010 0x7fc1200cfb10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc118009d90 tx=0x7fc11801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b9f6c3dd07f68b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:07.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.108+0000 7fc11d59a640 1 -- 172.21.15.19:0/1273293341 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1180a5910 con 0x7fc1200d3010 2023-11-20T06:41:07.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.108+0000 7fc11d59a640 1 -- 172.21.15.19:0/1273293341 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1180a5a70 con 0x7fc1200d3010 2023-11-20T06:41:07.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.112+0000 7fc11d59a640 1 -- 172.21.15.19:0/1273293341 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1180a5e00 con 0x7fc1200d3010 2023-11-20T06:41:07.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.112+0000 7fc124dc5640 1 -- 172.21.15.19:0/1273293341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1200d3010 msgr2=0x7fc1200cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:07.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.112+0000 7fc124dc5640 1 --2- 172.21.15.19:0/1273293341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1200d3010 0x7fc1200cfb10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc118009d90 tx=0x7fc11801c850 comp rx=0 tx=0).stop 2023-11-20T06:41:07.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.112+0000 7fc124dc5640 1 -- 172.21.15.19:0/1273293341 shutdown_connections 2023-11-20T06:41:07.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.112+0000 7fc124dc5640 1 --2- 172.21.15.19:0/1273293341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1200d3010 0x7fc1200cfb10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.112+0000 7fc124dc5640 1 -- 172.21.15.19:0/1273293341 >> 172.21.15.19:0/1273293341 conn(0x7fc12009bc50 msgr2=0x7fc1200d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:07.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.112+0000 7fc124dc5640 1 -- 172.21.15.19:0/1273293341 shutdown_connections 2023-11-20T06:41:07.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.112+0000 7fc124dc5640 1 -- 172.21.15.19:0/1273293341 wait complete. 2023-11-20T06:41:07.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.112+0000 7fc124dc5640 1 Processor -- start 2023-11-20T06:41:07.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.112+0000 7fc124dc5640 1 -- start start 2023-11-20T06:41:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.112+0000 7fc124dc5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1200d15d0 0x7fc1200cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.112+0000 7fc124dc5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1200d3010 0x7fc1200ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.112+0000 7fc124dc5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc12015cb90 0x7fc120156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.112+0000 7fc124dc5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1200cc790 con 0x7fc12015cb90 2023-11-20T06:41:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.112+0000 7fc124dc5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1200cadf0 con 0x7fc1200d15d0 2023-11-20T06:41:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.112+0000 7fc124dc5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1200cbb10 con 0x7fc1200d3010 2023-11-20T06:41:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.112+0000 7fc11ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc12015cb90 0x7fc120156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.112+0000 7fc11ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc12015cb90 0x7fc120156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41848/0 (socket says 172.21.15.19:41848) 2023-11-20T06:41:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.112+0000 7fc11ed9d640 1 -- 172.21.15.19:0/2952032841 learned_addr learned my addr 172.21.15.19:0/2952032841 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.116+0000 7fc11e59c640 1 --2- 172.21.15.19:0/2952032841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1200d15d0 0x7fc1200cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.116+0000 7fc11dd9b640 1 --2- 172.21.15.19:0/2952032841 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1200d3010 0x7fc1200ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.116+0000 7fc11ed9d640 1 -- 172.21.15.19:0/2952032841 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1200d3010 msgr2=0x7fc1200ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.116+0000 7fc11ed9d640 1 --2- 172.21.15.19:0/2952032841 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1200d3010 0x7fc1200ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.116+0000 7fc11ed9d640 1 -- 172.21.15.19:0/2952032841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1200d15d0 msgr2=0x7fc1200cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.116+0000 7fc11ed9d640 1 --2- 172.21.15.19:0/2952032841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1200d15d0 0x7fc1200cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.116+0000 7fc11ed9d640 1 -- 172.21.15.19:0/2952032841 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc118009a70 con 0x7fc12015cb90 2023-11-20T06:41:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.116+0000 7fc11ed9d640 1 --2- 172.21.15.19:0/2952032841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc12015cb90 0x7fc120156d40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc11801a480 tx=0x7fc1180195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.116+0000 7fc10effd640 1 -- 172.21.15.19:0/2952032841 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1180ad950 con 0x7fc12015cb90 2023-11-20T06:41:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.116+0000 7fc10effd640 1 -- 172.21.15.19:0/2952032841 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1180adab0 con 0x7fc12015cb90 2023-11-20T06:41:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.116+0000 7fc124dc5640 1 -- 172.21.15.19:0/2952032841 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1200cbdf0 con 0x7fc12015cb90 2023-11-20T06:41:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.116+0000 7fc10effd640 1 -- 172.21.15.19:0/2952032841 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1180ade40 con 0x7fc12015cb90 2023-11-20T06:41:07.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.116+0000 7fc124dc5640 1 -- 172.21.15.19:0/2952032841 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1200cc3b0 con 0x7fc12015cb90 2023-11-20T06:41:07.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.116+0000 7fc124dc5640 1 -- 172.21.15.19:0/2952032841 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1200cc8d0 con 0x7fc12015cb90 2023-11-20T06:41:07.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.116+0000 7fc10effd640 1 -- 172.21.15.19:0/2952032841 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc1180c4460 con 0x7fc12015cb90 2023-11-20T06:41:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.116+0000 7fc10effd640 1 --2- 172.21.15.19:0/2952032841 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc1000664a0 0x7fc100068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.120+0000 7fc10effd640 1 -- 172.21.15.19:0/2952032841 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc11811f0c0 con 0x7fc12015cb90 2023-11-20T06:41:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.120+0000 7fc11e59c640 1 --2- 172.21.15.19:0/2952032841 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc1000664a0 0x7fc100068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.120+0000 7fc11e59c640 1 --2- 172.21.15.19:0/2952032841 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc1000664a0 0x7fc100068960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc110007fd0 tx=0x7fc110009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:07.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.120+0000 7fc10effd640 1 -- 172.21.15.19:0/2952032841 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc1200cc8d0 con 0x7fc12015cb90 2023-11-20T06:41:07.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.280+0000 7fc124dc5640 1 -- 172.21.15.19:0/2952032841 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1200ccab0 con 0x7fc12015cb90 2023-11-20T06:41:07.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.284+0000 7fc10effd640 1 -- 172.21.15.19:0/2952032841 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12838 (secure 0 0 0) 0x7fc1200ccab0 con 0x7fc12015cb90 2023-11-20T06:41:07.287 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:07.287 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":16,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:04.194716+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:41:07.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.284+0000 7fc124dc5640 1 -- 172.21.15.19:0/2952032841 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc1000664a0 msgr2=0x7fc100068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:07.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.284+0000 7fc124dc5640 1 --2- 172.21.15.19:0/2952032841 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc1000664a0 0x7fc100068960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc110007fd0 tx=0x7fc110009040 comp rx=0 tx=0).stop 2023-11-20T06:41:07.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.284+0000 7fc124dc5640 1 -- 172.21.15.19:0/2952032841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc12015cb90 msgr2=0x7fc120156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:07.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.284+0000 7fc124dc5640 1 --2- 172.21.15.19:0/2952032841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc12015cb90 0x7fc120156d40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc11801a480 tx=0x7fc1180195f0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.284+0000 7fc124dc5640 1 -- 172.21.15.19:0/2952032841 shutdown_connections 2023-11-20T06:41:07.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.284+0000 7fc124dc5640 1 --2- 172.21.15.19:0/2952032841 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc1000664a0 0x7fc100068960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.284+0000 7fc124dc5640 1 --2- 172.21.15.19:0/2952032841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc12015cb90 0x7fc120156d40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.284+0000 7fc124dc5640 1 --2- 172.21.15.19:0/2952032841 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1200d3010 0x7fc1200ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.284+0000 7fc124dc5640 1 --2- 172.21.15.19:0/2952032841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1200d15d0 0x7fc1200cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.284+0000 7fc124dc5640 1 -- 172.21.15.19:0/2952032841 >> 172.21.15.19:0/2952032841 conn(0x7fc12009bc50 msgr2=0x7fc1200d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:07.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.284+0000 7fc124dc5640 1 -- 172.21.15.19:0/2952032841 shutdown_connections 2023-11-20T06:41:07.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.284+0000 7fc124dc5640 1 -- 172.21.15.19:0/2952032841 wait complete. 2023-11-20T06:41:07.308 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-20T06:41:07.308 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:41:07.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.448+0000 7fee56017640 1 Processor -- start 2023-11-20T06:41:07.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.448+0000 7fee56017640 1 -- start start 2023-11-20T06:41:07.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee56017640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fee5006d010 0x7fee500c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:07.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee56017640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5015ae30 con 0x7fee50069e90 2023-11-20T06:41:07.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee56017640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee500ca510 con 0x7fee500c26b0 2023-11-20T06:41:07.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee56017640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee500cb090 con 0x7fee5006d010 2023-11-20T06:41:07.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4f7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fee50069e90 0x7fee5006a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54368/0 (socket says 172.21.15.19:54368) 2023-11-20T06:41:07.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4f7fe640 1 -- 172.21.15.19:0/331614692 learned_addr learned my addr 172.21.15.19:0/331614692 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:07.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4effd640 1 --2- 172.21.15.19:0/331614692 >> v2:172.21.15.190:3300/0 conn(0x7fee5006d010 0x7fee500c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4e7fc640 1 -- 172.21.15.19:0/331614692 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871932535 0 0) 0x7fee5015ae30 con 0x7fee50069e90 2023-11-20T06:41:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4e7fc640 1 -- 172.21.15.19:0/331614692 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee38003530 con 0x7fee50069e90 2023-11-20T06:41:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4e7fc640 1 -- 172.21.15.19:0/331614692 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4181355980 0 0) 0x7fee500ca510 con 0x7fee500c26b0 2023-11-20T06:41:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4e7fc640 1 -- 172.21.15.19:0/331614692 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee5015ae30 con 0x7fee500c26b0 2023-11-20T06:41:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4e7fc640 1 -- 172.21.15.19:0/331614692 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4109128335 0 0) 0x7fee38003530 con 0x7fee50069e90 2023-11-20T06:41:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4e7fc640 1 -- 172.21.15.19:0/331614692 >> v2:172.21.15.190:3300/0 conn(0x7fee5006d010 msgr2=0x7fee500c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4e7fc640 1 --2- 172.21.15.19:0/331614692 >> v2:172.21.15.190:3300/0 conn(0x7fee5006d010 0x7fee500c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4e7fc640 1 -- 172.21.15.19:0/331614692 >> v1:172.21.15.190:6789/0 conn(0x7fee500c26b0 legacy=0x7fee500c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4e7fc640 1 -- 172.21.15.19:0/331614692 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee500ca7f0 con 0x7fee50069e90 2023-11-20T06:41:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4e7fc640 1 -- 172.21.15.19:0/331614692 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7fee40001680 con 0x7fee50069e90 2023-11-20T06:41:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4e7fc640 1 -- 172.21.15.19:0/331614692 >> v1:172.21.15.19:6789/0 conn(0x7fee50069e90 legacy=0x7fee5006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4e7fc640 1 --2- 172.21.15.19:0/331614692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee38003b10 0x7fee38003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4e7fc640 1 --2- 172.21.15.19:0/331614692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee380047d0 0x7fee38004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4e7fc640 1 --2- 172.21.15.19:0/331614692 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee38005190 0x7fee3800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4e7fc640 1 -- 172.21.15.19:0/331614692 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee500cb090 con 0x7fee38003b10 2023-11-20T06:41:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4e7fc640 1 -- 172.21.15.19:0/331614692 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3800bf80 con 0x7fee380047d0 2023-11-20T06:41:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4e7fc640 1 -- 172.21.15.19:0/331614692 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3800c140 con 0x7fee38005190 2023-11-20T06:41:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4effd640 1 --2- 172.21.15.19:0/331614692 >> v2:172.21.15.190:3300/0 conn(0x7fee5006d010 0x7fee500c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:41:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/331614692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee38003b10 0x7fee38003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4ffff640 1 --2- 172.21.15.19:0/331614692 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee38005190 0x7fee3800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4effd640 1 --2- 172.21.15.19:0/331614692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee380047d0 0x7fee38004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4f7fe640 1 -- 172.21.15.19:0/331614692 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee38005190 msgr2=0x7fee3800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/331614692 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee38005190 0x7fee3800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4f7fe640 1 -- 172.21.15.19:0/331614692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee380047d0 msgr2=0x7fee38004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/331614692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee380047d0 0x7fee38004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4f7fe640 1 -- 172.21.15.19:0/331614692 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee38003530 con 0x7fee38003b10 2023-11-20T06:41:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.452+0000 7fee4ffff640 1 -- 172.21.15.19:0/331614692 reap_dead start 2023-11-20T06:41:07.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.456+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/331614692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee38003b10 0x7fee38003f10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fee4000c160 tx=0x7fee4001cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93dcf76cd07eafb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:07.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.456+0000 7fee4e7fc640 1 -- 172.21.15.19:0/331614692 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee400058e0 con 0x7fee38003b10 2023-11-20T06:41:07.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.456+0000 7fee4e7fc640 1 -- 172.21.15.19:0/331614692 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee40005a40 con 0x7fee38003b10 2023-11-20T06:41:07.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.456+0000 7fee4e7fc640 1 -- 172.21.15.19:0/331614692 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee40005df0 con 0x7fee38003b10 2023-11-20T06:41:07.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.456+0000 7fee56017640 1 -- 172.21.15.19:0/331614692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee38003b10 msgr2=0x7fee38003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:07.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.456+0000 7fee56017640 1 --2- 172.21.15.19:0/331614692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee38003b10 0x7fee38003f10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fee4000c160 tx=0x7fee4001cb60 comp rx=0 tx=0).stop 2023-11-20T06:41:07.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.456+0000 7fee56017640 1 -- 172.21.15.19:0/331614692 shutdown_connections 2023-11-20T06:41:07.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.456+0000 7fee56017640 1 --2- 172.21.15.19:0/331614692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee38003b10 0x7fee38003f10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.456+0000 7fee56017640 1 -- 172.21.15.19:0/331614692 >> 172.21.15.19:0/331614692 conn(0x7fee500b0da0 msgr2=0x7fee500ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:07.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.456+0000 7fee56017640 1 -- 172.21.15.19:0/331614692 shutdown_connections 2023-11-20T06:41:07.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.456+0000 7fee56017640 1 -- 172.21.15.19:0/331614692 wait complete. 2023-11-20T06:41:07.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.456+0000 7fee56017640 1 Processor -- start 2023-11-20T06:41:07.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee56017640 1 -- start start 2023-11-20T06:41:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee56017640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee38003b10 0x7fee500c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee56017640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee50155ab0 0x7fee501f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee56017640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee501f5ef0 0x7fee500ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee56017640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee501f5780 con 0x7fee50155ab0 2023-11-20T06:41:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee56017640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee501f5a60 con 0x7fee38003b10 2023-11-20T06:41:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee56017640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee50159570 con 0x7fee501f5ef0 2023-11-20T06:41:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee4effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee50155ab0 0x7fee501f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee4effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee50155ab0 0x7fee501f1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41864/0 (socket says 172.21.15.19:41864) 2023-11-20T06:41:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee4effd640 1 -- 172.21.15.19:0/939870670 learned_addr learned my addr 172.21.15.19:0/939870670 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/939870670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee38003b10 0x7fee500c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee4effd640 1 -- 172.21.15.19:0/939870670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee501f5ef0 msgr2=0x7fee500ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee4effd640 1 --2- 172.21.15.19:0/939870670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee501f5ef0 0x7fee500ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee4effd640 1 -- 172.21.15.19:0/939870670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee38003b10 msgr2=0x7fee500c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee4effd640 1 --2- 172.21.15.19:0/939870670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee38003b10 0x7fee500c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee4effd640 1 -- 172.21.15.19:0/939870670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee500c8250 con 0x7fee50155ab0 2023-11-20T06:41:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/939870670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee38003b10 0x7fee500c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee4effd640 1 --2- 172.21.15.19:0/939870670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee50155ab0 0x7fee501f1a70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fee44011d00 tx=0x7fee4400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee37fff640 1 -- 172.21.15.19:0/939870670 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4400fc40 con 0x7fee50155ab0 2023-11-20T06:41:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee37fff640 1 -- 172.21.15.19:0/939870670 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4400fda0 con 0x7fee50155ab0 2023-11-20T06:41:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee56017640 1 -- 172.21.15.19:0/939870670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee500c8530 con 0x7fee50155ab0 2023-11-20T06:41:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee37fff640 1 -- 172.21.15.19:0/939870670 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44004270 con 0x7fee50155ab0 2023-11-20T06:41:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee56017640 1 -- 172.21.15.19:0/939870670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee501f1fb0 con 0x7fee50155ab0 2023-11-20T06:41:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.460+0000 7fee56017640 1 -- 172.21.15.19:0/939870670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5004e170 con 0x7fee50155ab0 2023-11-20T06:41:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.464+0000 7fee37fff640 1 -- 172.21.15.19:0/939870670 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fee440043d0 con 0x7fee50155ab0 2023-11-20T06:41:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.464+0000 7fee37fff640 1 --2- 172.21.15.19:0/939870670 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fee3c0664a0 0x7fee3c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.464+0000 7fee37fff640 1 -- 172.21.15.19:0/939870670 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fee44084220 con 0x7fee50155ab0 2023-11-20T06:41:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.464+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/939870670 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fee3c0664a0 0x7fee3c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.464+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/939870670 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fee3c0664a0 0x7fee3c068960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fee4000c160 tx=0x7fee40001990 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:07.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.468+0000 7fee37fff640 1 -- 172.21.15.19:0/939870670 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fee44051a80 con 0x7fee50155ab0 2023-11-20T06:41:07.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.624+0000 7fee56017640 1 -- 172.21.15.19:0/939870670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee501f5ba0 con 0x7fee50155ab0 2023-11-20T06:41:07.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.624+0000 7fee37fff640 1 -- 172.21.15.19:0/939870670 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fee440220a0 con 0x7fee50155ab0 2023-11-20T06:41:07.630 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:41:07.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.628+0000 7fee56017640 1 -- 172.21.15.19:0/939870670 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fee3c0664a0 msgr2=0x7fee3c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:07.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.628+0000 7fee56017640 1 --2- 172.21.15.19:0/939870670 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fee3c0664a0 0x7fee3c068960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fee4000c160 tx=0x7fee40001990 comp rx=0 tx=0).stop 2023-11-20T06:41:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.628+0000 7fee56017640 1 -- 172.21.15.19:0/939870670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee50155ab0 msgr2=0x7fee501f1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.628+0000 7fee56017640 1 --2- 172.21.15.19:0/939870670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee50155ab0 0x7fee501f1a70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fee44011d00 tx=0x7fee4400f610 comp rx=0 tx=0).stop 2023-11-20T06:41:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.628+0000 7fee56017640 1 -- 172.21.15.19:0/939870670 shutdown_connections 2023-11-20T06:41:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.628+0000 7fee56017640 1 --2- 172.21.15.19:0/939870670 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fee3c0664a0 0x7fee3c068960 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.628+0000 7fee56017640 1 --2- 172.21.15.19:0/939870670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee501f5ef0 0x7fee500ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.628+0000 7fee56017640 1 --2- 172.21.15.19:0/939870670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee50155ab0 0x7fee501f1a70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.628+0000 7fee56017640 1 --2- 172.21.15.19:0/939870670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee38003b10 0x7fee500c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.628+0000 7fee56017640 1 -- 172.21.15.19:0/939870670 >> 172.21.15.19:0/939870670 conn(0x7fee500b0da0 msgr2=0x7fee500cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.628+0000 7fee56017640 1 -- 172.21.15.19:0/939870670 shutdown_connections 2023-11-20T06:41:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.628+0000 7fee56017640 1 -- 172.21.15.19:0/939870670 wait complete. 2023-11-20T06:41:07.651 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T06:41:07.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.788+0000 7fdb2709e640 1 Processor -- start 2023-11-20T06:41:07.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.788+0000 7fdb2709e640 1 -- start start 2023-11-20T06:41:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.792+0000 7fdb2709e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb200cf090 0x7fdb200cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.792+0000 7fdb2709e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb200cfa30 con 0x7fdb2015ca70 2023-11-20T06:41:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.792+0000 7fdb2709e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb200c65f0 con 0x7fdb200c6ad0 2023-11-20T06:41:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.792+0000 7fdb2709e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb200ce820 con 0x7fdb200cf090 2023-11-20T06:41:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.792+0000 7fdb24e3a640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdb2015ca70 0x7fdb200d3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54370/0 (socket says 172.21.15.19:54370) 2023-11-20T06:41:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.792+0000 7fdb24e3a640 1 -- 172.21.15.19:0/1901336115 learned_addr learned my addr 172.21.15.19:0/1901336115 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:07.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.792+0000 7fdb1ffff640 1 --2- 172.21.15.19:0/1901336115 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb200cf090 0x7fdb200cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:07.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.792+0000 7fdb1f7fe640 1 -- 172.21.15.19:0/1901336115 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764534106 0 0) 0x7fdb200cfa30 con 0x7fdb2015ca70 2023-11-20T06:41:07.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.792+0000 7fdb1f7fe640 1 -- 172.21.15.19:0/1901336115 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb10003530 con 0x7fdb2015ca70 2023-11-20T06:41:07.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.792+0000 7fdb1f7fe640 1 -- 172.21.15.19:0/1901336115 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691355975 0 0) 0x7fdb200c65f0 con 0x7fdb200c6ad0 2023-11-20T06:41:07.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.792+0000 7fdb1f7fe640 1 -- 172.21.15.19:0/1901336115 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb200cfa30 con 0x7fdb200c6ad0 2023-11-20T06:41:07.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.792+0000 7fdb1ffff640 1 -- 172.21.15.19:0/1901336115 >> v1:172.21.15.190:6789/0 conn(0x7fdb200c6ad0 legacy=0x7fdb200c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:07.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.792+0000 7fdb1ffff640 1 -- 172.21.15.19:0/1901336115 >> v1:172.21.15.19:6789/0 conn(0x7fdb2015ca70 legacy=0x7fdb200d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:07.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.792+0000 7fdb1ffff640 1 -- 172.21.15.19:0/1901336115 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb200cdf80 con 0x7fdb200cf090 2023-11-20T06:41:07.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.796+0000 7fdb1ffff640 1 --2- 172.21.15.19:0/1901336115 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb200cf090 0x7fdb200cf4f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0097f0 tx=0x7fdb0c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a23119650232b9c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:07.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.796+0000 7fdb1f7fe640 1 -- 172.21.15.19:0/1901336115 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c0aa5f0 con 0x7fdb200cf090 2023-11-20T06:41:07.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.796+0000 7fdb1f7fe640 1 -- 172.21.15.19:0/1901336115 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c0aa750 con 0x7fdb200cf090 2023-11-20T06:41:07.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.796+0000 7fdb1f7fe640 1 -- 172.21.15.19:0/1901336115 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c0aaae0 con 0x7fdb200cf090 2023-11-20T06:41:07.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.796+0000 7fdb2709e640 1 -- 172.21.15.19:0/1901336115 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb200cf090 msgr2=0x7fdb200cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:07.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.796+0000 7fdb2709e640 1 --2- 172.21.15.19:0/1901336115 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb200cf090 0x7fdb200cf4f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0097f0 tx=0x7fdb0c01c490 comp rx=0 tx=0).stop 2023-11-20T06:41:07.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.796+0000 7fdb2709e640 1 -- 172.21.15.19:0/1901336115 shutdown_connections 2023-11-20T06:41:07.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.796+0000 7fdb2709e640 1 --2- 172.21.15.19:0/1901336115 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb200cf090 0x7fdb200cf4f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.796+0000 7fdb2709e640 1 -- 172.21.15.19:0/1901336115 >> 172.21.15.19:0/1901336115 conn(0x7fdb2009bc50 msgr2=0x7fdb200d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:07.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.796+0000 7fdb2709e640 1 -- 172.21.15.19:0/1901336115 shutdown_connections 2023-11-20T06:41:07.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.796+0000 7fdb2709e640 1 -- 172.21.15.19:0/1901336115 wait complete. 2023-11-20T06:41:07.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.796+0000 7fdb2709e640 1 Processor -- start 2023-11-20T06:41:07.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.796+0000 7fdb2709e640 1 -- start start 2023-11-20T06:41:07.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb2709e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb200c6ad0 0x7fdb201506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:07.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb2709e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb200cf090 0x7fdb2015bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:07.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb2709e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb2015ca70 0x7fdb20157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:07.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb2709e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb200ca910 con 0x7fdb200cf090 2023-11-20T06:41:07.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb2709e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb20150c30 con 0x7fdb200c6ad0 2023-11-20T06:41:07.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb2709e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2015b410 con 0x7fdb2015ca70 2023-11-20T06:41:07.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb1ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb200cf090 0x7fdb2015bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:07.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb1ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb200cf090 0x7fdb2015bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41874/0 (socket says 172.21.15.19:41874) 2023-11-20T06:41:07.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb1ffff640 1 -- 172.21.15.19:0/3095700582 learned_addr learned my addr 172.21.15.19:0/3095700582 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:07.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb24e3a640 1 --2- 172.21.15.19:0/3095700582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb200c6ad0 0x7fdb201506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:07.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb2563b640 1 --2- 172.21.15.19:0/3095700582 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb2015ca70 0x7fdb20157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:07.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb1ffff640 1 -- 172.21.15.19:0/3095700582 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb2015ca70 msgr2=0x7fdb20157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:07.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb1ffff640 1 --2- 172.21.15.19:0/3095700582 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb2015ca70 0x7fdb20157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb1ffff640 1 -- 172.21.15.19:0/3095700582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb200c6ad0 msgr2=0x7fdb201506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:07.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb1ffff640 1 --2- 172.21.15.19:0/3095700582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb200c6ad0 0x7fdb201506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:07.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb1ffff640 1 -- 172.21.15.19:0/3095700582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c009420 con 0x7fdb200cf090 2023-11-20T06:41:07.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb24e3a640 1 --2- 172.21.15.19:0/3095700582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb200c6ad0 0x7fdb201506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:07.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb1ffff640 1 --2- 172.21.15.19:0/3095700582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb200cf090 0x7fdb2015bd10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0097f0 tx=0x7fdb0c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:07.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb1d7fa640 1 -- 172.21.15.19:0/3095700582 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c0be610 con 0x7fdb200cf090 2023-11-20T06:41:07.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb1d7fa640 1 -- 172.21.15.19:0/3095700582 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c0be790 con 0x7fdb200cf090 2023-11-20T06:41:07.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb1d7fa640 1 -- 172.21.15.19:0/3095700582 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c0beb40 con 0x7fdb200cf090 2023-11-20T06:41:07.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb2709e640 1 -- 172.21.15.19:0/3095700582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb200d38a0 con 0x7fdb200cf090 2023-11-20T06:41:07.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb2709e640 1 -- 172.21.15.19:0/3095700582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb200c9fe0 con 0x7fdb200cf090 2023-11-20T06:41:07.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb2709e640 1 -- 172.21.15.19:0/3095700582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb200caac0 con 0x7fdb200cf090 2023-11-20T06:41:07.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.800+0000 7fdb1d7fa640 1 -- 172.21.15.19:0/3095700582 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdb0c0b4400 con 0x7fdb200cf090 2023-11-20T06:41:07.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.804+0000 7fdb1d7fa640 1 --2- 172.21.15.19:0/3095700582 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdb040664a0 0x7fdb04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:07.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.804+0000 7fdb1d7fa640 1 -- 172.21.15.19:0/3095700582 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdb0c0a7070 con 0x7fdb200cf090 2023-11-20T06:41:07.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.804+0000 7fdb24e3a640 1 --2- 172.21.15.19:0/3095700582 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdb040664a0 0x7fdb04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:07.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.804+0000 7fdb24e3a640 1 --2- 172.21.15.19:0/3095700582 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdb040664a0 0x7fdb04068960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdb14004880 tx=0x7fdb14009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:07.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.808+0000 7fdb1d7fa640 1 -- 172.21.15.19:0/3095700582 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdb200caac0 con 0x7fdb200cf090 2023-11-20T06:41:07.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.996+0000 7fdb2709e640 1 -- 172.21.15.19:0/3095700582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb200caac0 con 0x7fdb200cf090 2023-11-20T06:41:07.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.996+0000 7fdb1d7fa640 1 -- 172.21.15.19:0/3095700582 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7fdb200caac0 con 0x7fdb200cf090 2023-11-20T06:41:08.000 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:08.000 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3845638593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3845638593},{"type":"v1","addr":"172.21.15.19:6833","nonce":3845638593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-20T06:41:08.000 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 2 2023-11-20T06:41:08.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.996+0000 7fdb2709e640 1 -- 172.21.15.19:0/3095700582 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdb040664a0 msgr2=0x7fdb04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:08.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.996+0000 7fdb2709e640 1 --2- 172.21.15.19:0/3095700582 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdb040664a0 0x7fdb04068960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdb14004880 tx=0x7fdb14009040 comp rx=0 tx=0).stop 2023-11-20T06:41:08.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.996+0000 7fdb2709e640 1 -- 172.21.15.19:0/3095700582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb200cf090 msgr2=0x7fdb2015bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:08.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.996+0000 7fdb2709e640 1 --2- 172.21.15.19:0/3095700582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb200cf090 0x7fdb2015bd10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0097f0 tx=0x7fdb0c01acd0 comp rx=0 tx=0).stop 2023-11-20T06:41:08.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.996+0000 7fdb2709e640 1 -- 172.21.15.19:0/3095700582 shutdown_connections 2023-11-20T06:41:08.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.996+0000 7fdb2709e640 1 --2- 172.21.15.19:0/3095700582 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdb040664a0 0x7fdb04068960 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:08.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.996+0000 7fdb2709e640 1 --2- 172.21.15.19:0/3095700582 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb2015ca70 0x7fdb20157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:08.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.996+0000 7fdb2709e640 1 --2- 172.21.15.19:0/3095700582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb200cf090 0x7fdb2015bd10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:08.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.996+0000 7fdb2709e640 1 --2- 172.21.15.19:0/3095700582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb200c6ad0 0x7fdb201506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:08.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.996+0000 7fdb2709e640 1 -- 172.21.15.19:0/3095700582 >> 172.21.15.19:0/3095700582 conn(0x7fdb2009bc50 msgr2=0x7fdb200ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:08.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.996+0000 7fdb2709e640 1 -- 172.21.15.19:0/3095700582 shutdown_connections 2023-11-20T06:41:08.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:07.996+0000 7fdb2709e640 1 -- 172.21.15.19:0/3095700582 wait complete. 2023-11-20T06:41:10.021 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T06:41:10.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.172+0000 7ff4d47c4640 1 Processor -- start 2023-11-20T06:41:10.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.172+0000 7ff4d47c4640 1 -- start start 2023-11-20T06:41:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.172+0000 7ff4d47c4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff4cc15cb90 0x7ff4cc0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.172+0000 7ff4d47c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4cc0d3010 0x7ff4cc0d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.172+0000 7ff4d47c4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4cc0ce770 con 0x7ff4cc0d1400 2023-11-20T06:41:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.172+0000 7ff4d47c4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4cc0d1890 con 0x7ff4cc15cb90 2023-11-20T06:41:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.172+0000 7ff4d47c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc0d0600 con 0x7ff4cc0d3010 2023-11-20T06:41:10.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.172+0000 7ff4d2d61640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7ff4cc0d1400 0x7ff4cc0cd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:47518/0 (socket says 172.21.15.19:47518) 2023-11-20T06:41:10.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.172+0000 7ff4d2560640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff4cc15cb90 0x7ff4cc0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:10.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.172+0000 7ff4d2d61640 1 -- 172.21.15.19:0/3562917345 learned_addr learned my addr 172.21.15.19:0/3562917345 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:10.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.172+0000 7ff4d1d5f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4cc0d3010 0x7ff4cc0d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:10.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.172+0000 7ff4d155e640 1 -- 172.21.15.19:0/3562917345 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51766530 0 0) 0x7ff4cc0ce770 con 0x7ff4cc0d1400 2023-11-20T06:41:10.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.172+0000 7ff4d155e640 1 -- 172.21.15.19:0/3562917345 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4b8003530 con 0x7ff4cc0d1400 2023-11-20T06:41:10.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.172+0000 7ff4d2560640 1 -- 172.21.15.19:0/3562917345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4cc0d3010 msgr2=0x7ff4cc0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:10.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.172+0000 7ff4d2560640 1 --2- 172.21.15.19:0/3562917345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4cc0d3010 0x7ff4cc0d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.172+0000 7ff4d2560640 1 -- 172.21.15.19:0/3562917345 >> v1:172.21.15.190:6789/0 conn(0x7ff4cc0d1400 legacy=0x7ff4cc0cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:10.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.172+0000 7ff4d2560640 1 -- 172.21.15.19:0/3562917345 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4cc0c6450 con 0x7ff4cc15cb90 2023-11-20T06:41:10.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.172+0000 7ff4d1d5f640 1 --2- 172.21.15.19:0/3562917345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4cc0d3010 0x7ff4cc0d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:41:10.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.176+0000 7ff4d2560640 1 --2- 172.21.15.19:0/3562917345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4cc15cb90 0x7ff4cc0cfb10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80097a0 tx=0x7ff4c801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=673bf3d5851c6e5a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:10.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.176+0000 7ff4d155e640 1 -- 172.21.15.19:0/3562917345 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c80ac600 con 0x7ff4cc15cb90 2023-11-20T06:41:10.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.176+0000 7ff4d155e640 1 -- 172.21.15.19:0/3562917345 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c80a8050 con 0x7ff4cc15cb90 2023-11-20T06:41:10.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.176+0000 7ff4d155e640 1 -- 172.21.15.19:0/3562917345 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c80ac980 con 0x7ff4cc15cb90 2023-11-20T06:41:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.176+0000 7ff4d47c4640 1 -- 172.21.15.19:0/3562917345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4cc15cb90 msgr2=0x7ff4cc0cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.176+0000 7ff4d47c4640 1 --2- 172.21.15.19:0/3562917345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4cc15cb90 0x7ff4cc0cfb10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80097a0 tx=0x7ff4c801c3a0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.176+0000 7ff4d47c4640 1 -- 172.21.15.19:0/3562917345 shutdown_connections 2023-11-20T06:41:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.176+0000 7ff4d47c4640 1 --2- 172.21.15.19:0/3562917345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4cc0d3010 0x7ff4cc0d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.176+0000 7ff4d47c4640 1 --2- 172.21.15.19:0/3562917345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4cc15cb90 0x7ff4cc0cfb10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.176+0000 7ff4d47c4640 1 -- 172.21.15.19:0/3562917345 >> 172.21.15.19:0/3562917345 conn(0x7ff4cc09bc50 msgr2=0x7ff4cc0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.176+0000 7ff4d47c4640 1 -- 172.21.15.19:0/3562917345 shutdown_connections 2023-11-20T06:41:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.176+0000 7ff4d47c4640 1 -- 172.21.15.19:0/3562917345 wait complete. 2023-11-20T06:41:10.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d47c4640 1 Processor -- start 2023-11-20T06:41:10.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d47c4640 1 -- start start 2023-11-20T06:41:10.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d47c4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4cc0d1400 0x7ff4cc14f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:10.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d47c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4cc0d3010 0x7ff4cc14b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:10.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d47c4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4cc15cb90 0x7ff4cc0c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:10.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d47c4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc15ac20 con 0x7ff4cc15cb90 2023-11-20T06:41:10.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d47c4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc14b7a0 con 0x7ff4cc0d1400 2023-11-20T06:41:10.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d47c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc157c00 con 0x7ff4cc0d3010 2023-11-20T06:41:10.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d2d61640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4cc15cb90 0x7ff4cc0c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:10.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d2d61640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4cc15cb90 0x7ff4cc0c80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41884/0 (socket says 172.21.15.19:41884) 2023-11-20T06:41:10.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d2d61640 1 -- 172.21.15.19:0/335396993 learned_addr learned my addr 172.21.15.19:0/335396993 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:10.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d2560640 1 --2- 172.21.15.19:0/335396993 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4cc0d1400 0x7ff4cc14f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:10.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d1d5f640 1 --2- 172.21.15.19:0/335396993 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4cc0d3010 0x7ff4cc14b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:10.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d2d61640 1 -- 172.21.15.19:0/335396993 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4cc0d3010 msgr2=0x7ff4cc14b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:10.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d2d61640 1 --2- 172.21.15.19:0/335396993 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4cc0d3010 0x7ff4cc14b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d2d61640 1 -- 172.21.15.19:0/335396993 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4cc0d1400 msgr2=0x7ff4cc14f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:10.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d2d61640 1 --2- 172.21.15.19:0/335396993 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4cc0d1400 0x7ff4cc14f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d2d61640 1 -- 172.21.15.19:0/335396993 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc009420 con 0x7ff4cc15cb90 2023-11-20T06:41:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d2d61640 1 --2- 172.21.15.19:0/335396993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4cc15cb90 0x7ff4cc0c80c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400caa0 tx=0x7ff4c400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4c2ffd640 1 -- 172.21.15.19:0/335396993 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c400ac00 con 0x7ff4cc15cb90 2023-11-20T06:41:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4c2ffd640 1 -- 172.21.15.19:0/335396993 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c400ad60 con 0x7ff4cc15cb90 2023-11-20T06:41:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d47c4640 1 -- 172.21.15.19:0/335396993 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c80093b0 con 0x7ff4cc15cb90 2023-11-20T06:41:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4c2ffd640 1 -- 172.21.15.19:0/335396993 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4012620 con 0x7ff4cc15cb90 2023-11-20T06:41:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.180+0000 7ff4d47c4640 1 -- 172.21.15.19:0/335396993 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4cc1581c0 con 0x7ff4cc15cb90 2023-11-20T06:41:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.184+0000 7ff4d47c4640 1 -- 172.21.15.19:0/335396993 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4cc15ad90 con 0x7ff4cc15cb90 2023-11-20T06:41:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.184+0000 7ff4c2ffd640 1 -- 172.21.15.19:0/335396993 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff4c4007070 con 0x7ff4cc15cb90 2023-11-20T06:41:10.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.184+0000 7ff4c2ffd640 1 --2- 172.21.15.19:0/335396993 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff4b00664d0 0x7ff4b0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:10.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.184+0000 7ff4c2ffd640 1 -- 172.21.15.19:0/335396993 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff4c4083970 con 0x7ff4cc15cb90 2023-11-20T06:41:10.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.184+0000 7ff4d2560640 1 --2- 172.21.15.19:0/335396993 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff4b00664d0 0x7ff4b0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:10.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.184+0000 7ff4d2560640 1 --2- 172.21.15.19:0/335396993 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff4b00664d0 0x7ff4b0068990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80ae000 tx=0x7ff4c80a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:10.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.188+0000 7ff4c2ffd640 1 -- 172.21.15.19:0/335396993 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff4cc15ad90 con 0x7ff4cc15cb90 2023-11-20T06:41:10.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.376+0000 7ff4d47c4640 1 -- 172.21.15.19:0/335396993 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4cc15ad60 con 0x7ff4cc15cb90 2023-11-20T06:41:10.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.376+0000 7ff4c2ffd640 1 -- 172.21.15.19:0/335396993 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3697 (secure 0 0 0) 0x7ff4c4017090 con 0x7ff4cc15cb90 2023-11-20T06:41:10.382 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:10.382 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/212787745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":212787745},{"type":"v1","addr":"172.21.15.190:6836","nonce":212787745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1874314285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1874314285},{"type":"v1","addr":"172.21.15.190:6837","nonce":1874314285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3845638593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3845638593},{"type":"v1","addr":"172.21.15.19:6833","nonce":3845638593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1973335825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1973335825},{"type":"v1","addr":"172.21.15.19:6835","nonce":1973335825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-20T06:41:10.382 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 3 2023-11-20T06:41:10.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.380+0000 7ff4d47c4640 1 -- 172.21.15.19:0/335396993 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff4b00664d0 msgr2=0x7ff4b0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:10.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.380+0000 7ff4d47c4640 1 --2- 172.21.15.19:0/335396993 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff4b00664d0 0x7ff4b0068990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80ae000 tx=0x7ff4c80a7000 comp rx=0 tx=0).stop 2023-11-20T06:41:10.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.380+0000 7ff4d47c4640 1 -- 172.21.15.19:0/335396993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4cc15cb90 msgr2=0x7ff4cc0c80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:10.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.380+0000 7ff4d47c4640 1 --2- 172.21.15.19:0/335396993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4cc15cb90 0x7ff4cc0c80c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400caa0 tx=0x7ff4c400cf60 comp rx=0 tx=0).stop 2023-11-20T06:41:10.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.380+0000 7ff4d47c4640 1 -- 172.21.15.19:0/335396993 shutdown_connections 2023-11-20T06:41:10.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.380+0000 7ff4d47c4640 1 --2- 172.21.15.19:0/335396993 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff4b00664d0 0x7ff4b0068990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.380+0000 7ff4d47c4640 1 --2- 172.21.15.19:0/335396993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4cc15cb90 0x7ff4cc0c80c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.380+0000 7ff4d47c4640 1 --2- 172.21.15.19:0/335396993 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4cc0d3010 0x7ff4cc14b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.380+0000 7ff4d47c4640 1 --2- 172.21.15.19:0/335396993 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4cc0d1400 0x7ff4cc14f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.380+0000 7ff4d47c4640 1 -- 172.21.15.19:0/335396993 >> 172.21.15.19:0/335396993 conn(0x7ff4cc09bc50 msgr2=0x7ff4cc1556c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:10.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.380+0000 7ff4d47c4640 1 -- 172.21.15.19:0/335396993 shutdown_connections 2023-11-20T06:41:10.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.380+0000 7ff4d47c4640 1 -- 172.21.15.19:0/335396993 wait complete. 2023-11-20T06:41:10.403 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:41:10.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.540+0000 7faef09c4640 1 Processor -- start 2023-11-20T06:41:10.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.540+0000 7faef09c4640 1 -- start start 2023-11-20T06:41:10.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.544+0000 7faef09c4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7faeec15cb90 0x7faeec0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:10.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.544+0000 7faef09c4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeec0ce770 con 0x7faeec0d15d0 2023-11-20T06:41:10.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.544+0000 7faef09c4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeec0d0600 con 0x7faeec0d3010 2023-11-20T06:41:10.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.544+0000 7faef09c4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeec0c6450 con 0x7faeec15cb90 2023-11-20T06:41:10.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.544+0000 7faeead9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7faeec0d15d0 0x7faeec0c6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54378/0 (socket says 172.21.15.19:54378) 2023-11-20T06:41:10.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.544+0000 7faeead9d640 1 -- 172.21.15.19:0/3796171979 learned_addr learned my addr 172.21.15.19:0/3796171979 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:10.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.544+0000 7faeea59c640 1 --2- 172.21.15.19:0/3796171979 >> v2:172.21.15.190:3300/0 conn(0x7faeec15cb90 0x7faeec0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:10.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.544+0000 7faee959a640 1 -- 172.21.15.19:0/3796171979 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246330598 0 0) 0x7faeec0ce770 con 0x7faeec0d15d0 2023-11-20T06:41:10.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.544+0000 7faee959a640 1 -- 172.21.15.19:0/3796171979 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed4003530 con 0x7faeec0d15d0 2023-11-20T06:41:10.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.544+0000 7faee959a640 1 -- 172.21.15.19:0/3796171979 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556374441 0 0) 0x7faeec0d0600 con 0x7faeec0d3010 2023-11-20T06:41:10.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.544+0000 7faee959a640 1 -- 172.21.15.19:0/3796171979 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeec0ce770 con 0x7faeec0d3010 2023-11-20T06:41:10.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.544+0000 7faee959a640 1 -- 172.21.15.19:0/3796171979 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3222788812 0 0) 0x7faed4003530 con 0x7faeec0d15d0 2023-11-20T06:41:10.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.544+0000 7faeea59c640 1 -- 172.21.15.19:0/3796171979 >> v1:172.21.15.190:6789/0 conn(0x7faeec0d3010 legacy=0x7faeec0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:10.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.544+0000 7faeea59c640 1 -- 172.21.15.19:0/3796171979 >> v1:172.21.15.19:6789/0 conn(0x7faeec0d15d0 legacy=0x7faeec0c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:10.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.544+0000 7faeea59c640 1 -- 172.21.15.19:0/3796171979 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec0d08a0 con 0x7faeec15cb90 2023-11-20T06:41:10.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.548+0000 7faeea59c640 1 --2- 172.21.15.19:0/3796171979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeec15cb90 0x7faeec0cfb10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faedc0097a0 tx=0x7faedc01c2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=509708f5153f4f15 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:10.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.548+0000 7faee959a640 1 -- 172.21.15.19:0/3796171979 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4001a20 con 0x7faeec15cb90 2023-11-20T06:41:10.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.548+0000 7faee959a640 1 -- 172.21.15.19:0/3796171979 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc0a7050 con 0x7faeec15cb90 2023-11-20T06:41:10.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.548+0000 7faee959a640 1 -- 172.21.15.19:0/3796171979 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc0ab620 con 0x7faeec15cb90 2023-11-20T06:41:10.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.548+0000 7faef09c4640 1 -- 172.21.15.19:0/3796171979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeec15cb90 msgr2=0x7faeec0cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:10.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.548+0000 7faef09c4640 1 --2- 172.21.15.19:0/3796171979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeec15cb90 0x7faeec0cfb10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faedc0097a0 tx=0x7faedc01c2c0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.548+0000 7faef09c4640 1 -- 172.21.15.19:0/3796171979 shutdown_connections 2023-11-20T06:41:10.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.548+0000 7faef09c4640 1 --2- 172.21.15.19:0/3796171979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeec15cb90 0x7faeec0cfb10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.548+0000 7faef09c4640 1 -- 172.21.15.19:0/3796171979 >> 172.21.15.19:0/3796171979 conn(0x7faeec09bc50 msgr2=0x7faeec0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:10.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.548+0000 7faef09c4640 1 -- 172.21.15.19:0/3796171979 shutdown_connections 2023-11-20T06:41:10.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.548+0000 7faef09c4640 1 -- 172.21.15.19:0/3796171979 wait complete. 2023-11-20T06:41:10.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.548+0000 7faef09c4640 1 Processor -- start 2023-11-20T06:41:10.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.548+0000 7faef09c4640 1 -- start start 2023-11-20T06:41:10.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faef09c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeec0d15d0 0x7faeec0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:10.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faef09c4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeec0d3010 0x7faeec159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:10.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faef09c4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faeec15cb90 0x7faeec15ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:10.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faef09c4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec1598a0 con 0x7faeec15cb90 2023-11-20T06:41:10.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faef09c4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec159ad0 con 0x7faeec0d3010 2023-11-20T06:41:10.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faef09c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec159db0 con 0x7faeec0d15d0 2023-11-20T06:41:10.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faeead9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faeec15cb90 0x7faeec15ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:10.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faeead9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faeec15cb90 0x7faeec15ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41888/0 (socket says 172.21.15.19:41888) 2023-11-20T06:41:10.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faeead9d640 1 -- 172.21.15.19:0/23224296 learned_addr learned my addr 172.21.15.19:0/23224296 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:10.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faee9d9b640 1 --2- 172.21.15.19:0/23224296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeec0d3010 0x7faeec159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:10.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faeea59c640 1 --2- 172.21.15.19:0/23224296 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeec0d15d0 0x7faeec0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:10.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faeead9d640 1 -- 172.21.15.19:0/23224296 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeec0d15d0 msgr2=0x7faeec0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:10.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faeead9d640 1 --2- 172.21.15.19:0/23224296 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeec0d15d0 0x7faeec0cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faeead9d640 1 -- 172.21.15.19:0/23224296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeec0d3010 msgr2=0x7faeec159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:10.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faeead9d640 1 --2- 172.21.15.19:0/23224296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeec0d3010 0x7faeec159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faeead9d640 1 -- 172.21.15.19:0/23224296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc0093b0 con 0x7faeec15cb90 2023-11-20T06:41:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faee9d9b640 1 --2- 172.21.15.19:0/23224296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeec0d3010 0x7faeec159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faeead9d640 1 --2- 172.21.15.19:0/23224296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faeec15cb90 0x7faeec15ab70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faee400ca70 tx=0x7faee400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faedaffd640 1 -- 172.21.15.19:0/23224296 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee400a6a0 con 0x7faeec15cb90 2023-11-20T06:41:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faedaffd640 1 -- 172.21.15.19:0/23224296 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee400a820 con 0x7faeec15cb90 2023-11-20T06:41:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faef09c4640 1 -- 172.21.15.19:0/23224296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeec15a090 con 0x7faeec15cb90 2023-11-20T06:41:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faedaffd640 1 -- 172.21.15.19:0/23224296 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee400abd0 con 0x7faeec15cb90 2023-11-20T06:41:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faef09c4640 1 -- 172.21.15.19:0/23224296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeec15a650 con 0x7faeec15cb90 2023-11-20T06:41:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faef09c4640 1 -- 172.21.15.19:0/23224296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeec15a870 con 0x7faeec15cb90 2023-11-20T06:41:10.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.552+0000 7faedaffd640 1 -- 172.21.15.19:0/23224296 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faee400ad30 con 0x7faeec15cb90 2023-11-20T06:41:10.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.556+0000 7faedaffd640 1 --2- 172.21.15.19:0/23224296 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faecc0664a0 0x7faecc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:10.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.556+0000 7faedaffd640 1 -- 172.21.15.19:0/23224296 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faee40835f0 con 0x7faeec15cb90 2023-11-20T06:41:10.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.556+0000 7faeea59c640 1 --2- 172.21.15.19:0/23224296 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faecc0664a0 0x7faecc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:10.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.556+0000 7faeea59c640 1 --2- 172.21.15.19:0/23224296 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faecc0664a0 0x7faecc068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faedc0ad000 tx=0x7faedc0a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:10.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.560+0000 7faedaffd640 1 -- 172.21.15.19:0/23224296 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faee4050d40 con 0x7faeec15cb90 2023-11-20T06:41:10.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.716+0000 7faef09c4640 1 -- 172.21.15.19:0/23224296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faeec074010 con 0x7faeec15cb90 2023-11-20T06:41:10.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.720+0000 7faedaffd640 1 -- 172.21.15.19:0/23224296 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12838 (secure 0 0 0) 0x7faee4018020 con 0x7faeec15cb90 2023-11-20T06:41:10.723 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:10.723 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":16,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:04.194716+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:41:10.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.720+0000 7faef09c4640 1 -- 172.21.15.19:0/23224296 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faecc0664a0 msgr2=0x7faecc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:10.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.720+0000 7faef09c4640 1 --2- 172.21.15.19:0/23224296 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faecc0664a0 0x7faecc068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faedc0ad000 tx=0x7faedc0a6000 comp rx=0 tx=0).stop 2023-11-20T06:41:10.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.720+0000 7faef09c4640 1 -- 172.21.15.19:0/23224296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faeec15cb90 msgr2=0x7faeec15ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:10.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.720+0000 7faef09c4640 1 --2- 172.21.15.19:0/23224296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faeec15cb90 0x7faeec15ab70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faee400ca70 tx=0x7faee400cf30 comp rx=0 tx=0).stop 2023-11-20T06:41:10.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.720+0000 7faef09c4640 1 -- 172.21.15.19:0/23224296 shutdown_connections 2023-11-20T06:41:10.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.720+0000 7faef09c4640 1 --2- 172.21.15.19:0/23224296 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faecc0664a0 0x7faecc068960 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.720+0000 7faef09c4640 1 --2- 172.21.15.19:0/23224296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faeec15cb90 0x7faeec15ab70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.720+0000 7faef09c4640 1 --2- 172.21.15.19:0/23224296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeec0d3010 0x7faeec159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.720+0000 7faef09c4640 1 --2- 172.21.15.19:0/23224296 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeec0d15d0 0x7faeec0cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.720+0000 7faef09c4640 1 -- 172.21.15.19:0/23224296 >> 172.21.15.19:0/23224296 conn(0x7faeec09bc50 msgr2=0x7faeec0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:10.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.720+0000 7faef09c4640 1 -- 172.21.15.19:0/23224296 shutdown_connections 2023-11-20T06:41:10.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.720+0000 7faef09c4640 1 -- 172.21.15.19:0/23224296 wait complete. 2023-11-20T06:41:10.744 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-20T06:41:10.745 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:41:10.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.884+0000 7ff67d091640 1 Processor -- start 2023-11-20T06:41:10.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.888+0000 7ff67d091640 1 -- start start 2023-11-20T06:41:10.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.888+0000 7ff67d091640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff678159900 0x7ff67806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:10.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.888+0000 7ff67d091640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff6780b3f00 0x7ff678069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:10.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.888+0000 7ff67d091640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6780b4390 con 0x7ff67806a3d0 2023-11-20T06:41:10.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.888+0000 7ff67d091640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6780cd740 con 0x7ff678159900 2023-11-20T06:41:10.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.888+0000 7ff67d091640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff67806a840 con 0x7ff6780b3f00 2023-11-20T06:41:10.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.888+0000 7ff676d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff678159900 0x7ff67806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:10.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.888+0000 7ff67759e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff67806a3d0 0x7ff6780cc350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54392/0 (socket says 172.21.15.19:54392) 2023-11-20T06:41:10.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.888+0000 7ff67759e640 1 -- 172.21.15.19:0/3639344859 learned_addr learned my addr 172.21.15.19:0/3639344859 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:10.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.888+0000 7ff67659c640 1 --2- 172.21.15.19:0/3639344859 >> v2:172.21.15.190:3300/0 conn(0x7ff6780b3f00 0x7ff678069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:10.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.888+0000 7ff675d9b640 1 -- 172.21.15.19:0/3639344859 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095236949 0 0) 0x7ff6780b4390 con 0x7ff67806a3d0 2023-11-20T06:41:10.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.888+0000 7ff675d9b640 1 -- 172.21.15.19:0/3639344859 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff660003530 con 0x7ff67806a3d0 2023-11-20T06:41:10.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.888+0000 7ff676d9d640 1 -- 172.21.15.19:0/3639344859 >> v2:172.21.15.190:3300/0 conn(0x7ff6780b3f00 msgr2=0x7ff678069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:10.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.888+0000 7ff676d9d640 1 --2- 172.21.15.19:0/3639344859 >> v2:172.21.15.190:3300/0 conn(0x7ff6780b3f00 0x7ff678069e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.888+0000 7ff676d9d640 1 -- 172.21.15.19:0/3639344859 >> v1:172.21.15.19:6789/0 conn(0x7ff67806a3d0 legacy=0x7ff6780cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:10.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.888+0000 7ff676d9d640 1 -- 172.21.15.19:0/3639344859 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6780b4600 con 0x7ff678159900 2023-11-20T06:41:10.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.888+0000 7ff67659c640 1 --2- 172.21.15.19:0/3639344859 >> v2:172.21.15.190:3300/0 conn(0x7ff6780b3f00 0x7ff678069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:10.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.892+0000 7ff676d9d640 1 --2- 172.21.15.19:0/3639344859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff678159900 0x7ff67806e260 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff678071620 tx=0x7ff66801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4999062095f5ab server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:10.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.892+0000 7ff675d9b640 1 -- 172.21.15.19:0/3639344859 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6680a7070 con 0x7ff678159900 2023-11-20T06:41:10.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.892+0000 7ff675d9b640 1 -- 172.21.15.19:0/3639344859 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6680ab430 con 0x7ff678159900 2023-11-20T06:41:10.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.892+0000 7ff675d9b640 1 -- 172.21.15.19:0/3639344859 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6680ab7c0 con 0x7ff678159900 2023-11-20T06:41:10.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.892+0000 7ff67d091640 1 -- 172.21.15.19:0/3639344859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff678159900 msgr2=0x7ff67806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:10.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.892+0000 7ff67d091640 1 --2- 172.21.15.19:0/3639344859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff678159900 0x7ff67806e260 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff678071620 tx=0x7ff66801c430 comp rx=0 tx=0).stop 2023-11-20T06:41:10.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.892+0000 7ff67d091640 1 -- 172.21.15.19:0/3639344859 shutdown_connections 2023-11-20T06:41:10.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.892+0000 7ff67d091640 1 --2- 172.21.15.19:0/3639344859 >> v2:172.21.15.190:3300/0 conn(0x7ff6780b3f00 0x7ff678069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.892+0000 7ff67d091640 1 --2- 172.21.15.19:0/3639344859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff678159900 0x7ff67806e260 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.892+0000 7ff67d091640 1 -- 172.21.15.19:0/3639344859 >> 172.21.15.19:0/3639344859 conn(0x7ff6780b0da0 msgr2=0x7ff6780ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:10.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.892+0000 7ff67d091640 1 -- 172.21.15.19:0/3639344859 shutdown_connections 2023-11-20T06:41:10.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.892+0000 7ff67d091640 1 -- 172.21.15.19:0/3639344859 wait complete. 2023-11-20T06:41:10.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff67d091640 1 Processor -- start 2023-11-20T06:41:10.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff67d091640 1 -- start start 2023-11-20T06:41:10.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff67d091640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff67806a3d0 0x7ff6780b2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:10.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff67d091640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6780b3f00 0x7ff6780c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:10.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff67d091640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff678159900 0x7ff6780c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:10.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff67d091640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6780b33f0 con 0x7ff67806a3d0 2023-11-20T06:41:10.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff67d091640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6780c2450 con 0x7ff678159900 2023-11-20T06:41:10.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff67d091640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff678152fa0 con 0x7ff6780b3f00 2023-11-20T06:41:10.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff676d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff67806a3d0 0x7ff6780b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:10.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff676d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff67806a3d0 0x7ff6780b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41920/0 (socket says 172.21.15.19:41920) 2023-11-20T06:41:10.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff676d9d640 1 -- 172.21.15.19:0/541857646 learned_addr learned my addr 172.21.15.19:0/541857646 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:10.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff67759e640 1 --2- 172.21.15.19:0/541857646 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff678159900 0x7ff6780c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:10.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff67659c640 1 --2- 172.21.15.19:0/541857646 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6780b3f00 0x7ff6780c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:10.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff676d9d640 1 -- 172.21.15.19:0/541857646 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6780b3f00 msgr2=0x7ff6780c28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:10.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff676d9d640 1 --2- 172.21.15.19:0/541857646 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6780b3f00 0x7ff6780c28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff676d9d640 1 -- 172.21.15.19:0/541857646 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff678159900 msgr2=0x7ff6780c2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:10.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff676d9d640 1 --2- 172.21.15.19:0/541857646 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff678159900 0x7ff6780c2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:10.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff676d9d640 1 -- 172.21.15.19:0/541857646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff668009420 con 0x7ff67806a3d0 2023-11-20T06:41:10.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff676d9d640 1 --2- 172.21.15.19:0/541857646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff67806a3d0 0x7ff6780b2490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff6680ad040 tx=0x7ff66801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:10.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff65f7fe640 1 -- 172.21.15.19:0/541857646 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6680bf610 con 0x7ff67806a3d0 2023-11-20T06:41:10.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff65f7fe640 1 -- 172.21.15.19:0/541857646 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6680bf790 con 0x7ff67806a3d0 2023-11-20T06:41:10.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff65f7fe640 1 -- 172.21.15.19:0/541857646 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6680bfb40 con 0x7ff67806a3d0 2023-11-20T06:41:10.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff67d091640 1 -- 172.21.15.19:0/541857646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6780b2b50 con 0x7ff67806a3d0 2023-11-20T06:41:10.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff67d091640 1 -- 172.21.15.19:0/541857646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6780b3110 con 0x7ff67806a3d0 2023-11-20T06:41:10.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.896+0000 7ff67d091640 1 -- 172.21.15.19:0/541857646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67804e170 con 0x7ff67806a3d0 2023-11-20T06:41:10.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.900+0000 7ff65f7fe640 1 -- 172.21.15.19:0/541857646 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff6680bfca0 con 0x7ff67806a3d0 2023-11-20T06:41:10.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.900+0000 7ff65f7fe640 1 --2- 172.21.15.19:0/541857646 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6640664a0 0x7ff664068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:10.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.900+0000 7ff65f7fe640 1 -- 172.21.15.19:0/541857646 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff66811e1b0 con 0x7ff67806a3d0 2023-11-20T06:41:10.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.900+0000 7ff67659c640 1 --2- 172.21.15.19:0/541857646 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6640664a0 0x7ff664068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:10.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.900+0000 7ff67659c640 1 --2- 172.21.15.19:0/541857646 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6640664a0 0x7ff664068960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff6781f89b0 tx=0x7ff66c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:10.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:10.904+0000 7ff65f7fe640 1 -- 172.21.15.19:0/541857646 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff6680eba30 con 0x7ff67806a3d0 2023-11-20T06:41:11.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.064+0000 7ff67d091640 1 -- 172.21.15.19:0/541857646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6781531d0 con 0x7ff67806a3d0 2023-11-20T06:41:11.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.064+0000 7ff65f7fe640 1 -- 172.21.15.19:0/541857646 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6680ef050 con 0x7ff67806a3d0 2023-11-20T06:41:11.068 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:41:11.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.064+0000 7ff67d091640 1 -- 172.21.15.19:0/541857646 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6640664a0 msgr2=0x7ff664068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:11.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.064+0000 7ff67d091640 1 --2- 172.21.15.19:0/541857646 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6640664a0 0x7ff664068960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff6781f89b0 tx=0x7ff66c008040 comp rx=0 tx=0).stop 2023-11-20T06:41:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.064+0000 7ff67d091640 1 -- 172.21.15.19:0/541857646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff67806a3d0 msgr2=0x7ff6780b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.064+0000 7ff67d091640 1 --2- 172.21.15.19:0/541857646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff67806a3d0 0x7ff6780b2490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff6680ad040 tx=0x7ff66801ac70 comp rx=0 tx=0).stop 2023-11-20T06:41:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.064+0000 7ff67d091640 1 -- 172.21.15.19:0/541857646 shutdown_connections 2023-11-20T06:41:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.064+0000 7ff67d091640 1 --2- 172.21.15.19:0/541857646 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6640664a0 0x7ff664068960 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.064+0000 7ff67d091640 1 --2- 172.21.15.19:0/541857646 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff678159900 0x7ff6780c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.064+0000 7ff67d091640 1 --2- 172.21.15.19:0/541857646 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6780b3f00 0x7ff6780c28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.064+0000 7ff67d091640 1 --2- 172.21.15.19:0/541857646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff67806a3d0 0x7ff6780b2490 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.064+0000 7ff67d091640 1 -- 172.21.15.19:0/541857646 >> 172.21.15.19:0/541857646 conn(0x7ff6780b0da0 msgr2=0x7ff678072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.064+0000 7ff67d091640 1 -- 172.21.15.19:0/541857646 shutdown_connections 2023-11-20T06:41:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.064+0000 7ff67d091640 1 -- 172.21.15.19:0/541857646 wait complete. 2023-11-20T06:41:11.089 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-20T06:41:11.227 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T06:41:11.233 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T06:41:11.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.228+0000 7fb2c20ad640 1 Processor -- start 2023-11-20T06:41:11.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2c20ad640 1 -- start start 2023-11-20T06:41:11.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2c20ad640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc15c910 0x7fb2bc0d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:11.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2c20ad640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2bc0ce730 con 0x7fb2bc0d3170 2023-11-20T06:41:11.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2c20ad640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2bc0d0dd0 con 0x7fb2bc0cefe0 2023-11-20T06:41:11.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2c20ad640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc0ce540 con 0x7fb2bc15c910 2023-11-20T06:41:11.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2c08aa640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb2bc0d3170 0x7fb2bc0cde30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54402/0 (socket says 172.21.15.19:54402) 2023-11-20T06:41:11.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2c08aa640 1 -- 172.21.15.19:0/1952448251 learned_addr learned my addr 172.21.15.19:0/1952448251 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:11.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2c10ab640 1 --2- 172.21.15.19:0/1952448251 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc15c910 0x7fb2bc0d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:11.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2b3fff640 1 -- 172.21.15.19:0/1952448251 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505968567 0 0) 0x7fb2bc0ce730 con 0x7fb2bc0d3170 2023-11-20T06:41:11.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2b3fff640 1 -- 172.21.15.19:0/1952448251 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2a8003530 con 0x7fb2bc0d3170 2023-11-20T06:41:11.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2b3fff640 1 -- 172.21.15.19:0/1952448251 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162063229 0 0) 0x7fb2bc0d0dd0 con 0x7fb2bc0cefe0 2023-11-20T06:41:11.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2b3fff640 1 -- 172.21.15.19:0/1952448251 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2bc0ce730 con 0x7fb2bc0cefe0 2023-11-20T06:41:11.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2b3fff640 1 -- 172.21.15.19:0/1952448251 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1178925357 0 0) 0x7fb2a8003530 con 0x7fb2bc0d3170 2023-11-20T06:41:11.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2b3fff640 1 -- 172.21.15.19:0/1952448251 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc15c910 msgr2=0x7fb2bc0d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:11.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2b3fff640 1 --2- 172.21.15.19:0/1952448251 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc15c910 0x7fb2bc0d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:11.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2b3fff640 1 -- 172.21.15.19:0/1952448251 >> v1:172.21.15.190:6789/0 conn(0x7fb2bc0cefe0 legacy=0x7fb2bc06b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:11.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2b3fff640 1 -- 172.21.15.19:0/1952448251 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2bc0d04a0 con 0x7fb2bc0d3170 2023-11-20T06:41:11.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2b3fff640 1 -- 172.21.15.19:0/1952448251 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7fb2ac001680 con 0x7fb2bc0d3170 2023-11-20T06:41:11.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2c10ab640 1 --2- 172.21.15.19:0/1952448251 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc15c910 0x7fb2bc0d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:41:11.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2b3fff640 1 -- 172.21.15.19:0/1952448251 >> v1:172.21.15.19:6789/0 conn(0x7fb2bc0d3170 legacy=0x7fb2bc0cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:11.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2b3fff640 1 --2- 172.21.15.19:0/1952448251 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2a8003c20 0x7fb2a8004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:11.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2b3fff640 1 --2- 172.21.15.19:0/1952448251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2a80047d0 0x7fb2a8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:11.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2b3fff640 1 --2- 172.21.15.19:0/1952448251 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc15c910 0x7fb2a8005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:11.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2b3fff640 1 -- 172.21.15.19:0/1952448251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a800bb20 con 0x7fb2a80047d0 2023-11-20T06:41:11.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2b3fff640 1 -- 172.21.15.19:0/1952448251 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a800bc90 con 0x7fb2a8003c20 2023-11-20T06:41:11.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2b3fff640 1 -- 172.21.15.19:0/1952448251 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a800be50 con 0x7fb2bc15c910 2023-11-20T06:41:11.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2c08aa640 1 --2- 172.21.15.19:0/1952448251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2a80047d0 0x7fb2a8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:11.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2c10ab640 1 --2- 172.21.15.19:0/1952448251 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2a8003c20 0x7fb2a8004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:11.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2c18ac640 1 --2- 172.21.15.19:0/1952448251 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc15c910 0x7fb2a8005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:11.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2c08aa640 1 -- 172.21.15.19:0/1952448251 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc15c910 msgr2=0x7fb2a8005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:11.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2c08aa640 1 --2- 172.21.15.19:0/1952448251 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc15c910 0x7fb2a8005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:11.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2c08aa640 1 -- 172.21.15.19:0/1952448251 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2a8003c20 msgr2=0x7fb2a8004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:11.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2c08aa640 1 --2- 172.21.15.19:0/1952448251 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2a8003c20 0x7fb2a8004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:11.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.232+0000 7fb2c08aa640 1 -- 172.21.15.19:0/1952448251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b80093b0 con 0x7fb2a80047d0 2023-11-20T06:41:11.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.236+0000 7fb2c08aa640 1 --2- 172.21.15.19:0/1952448251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2a80047d0 0x7fb2a8004c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc0d35b0 tx=0x7fb2ac01caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c3a73e9724ff11 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:11.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.236+0000 7fb2b3fff640 1 -- 172.21.15.19:0/1952448251 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac0058e0 con 0x7fb2a80047d0 2023-11-20T06:41:11.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.236+0000 7fb2b3fff640 1 -- 172.21.15.19:0/1952448251 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ac005a40 con 0x7fb2a80047d0 2023-11-20T06:41:11.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.236+0000 7fb2b3fff640 1 -- 172.21.15.19:0/1952448251 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac005e10 con 0x7fb2a80047d0 2023-11-20T06:41:11.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.236+0000 7fb2c20ad640 1 -- 172.21.15.19:0/1952448251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2a80047d0 msgr2=0x7fb2a8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:11.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.236+0000 7fb2c20ad640 1 --2- 172.21.15.19:0/1952448251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2a80047d0 0x7fb2a8004c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc0d35b0 tx=0x7fb2ac01caf0 comp rx=0 tx=0).stop 2023-11-20T06:41:11.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.236+0000 7fb2c18ac640 1 -- 172.21.15.19:0/1952448251 reap_dead start 2023-11-20T06:41:11.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.236+0000 7fb2c20ad640 1 -- 172.21.15.19:0/1952448251 shutdown_connections 2023-11-20T06:41:11.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.236+0000 7fb2c20ad640 1 -- 172.21.15.19:0/1952448251 >> 172.21.15.19:0/1952448251 conn(0x7fb2bc09bb50 msgr2=0x7fb2bc0d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:11.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.236+0000 7fb2c20ad640 1 -- 172.21.15.19:0/1952448251 shutdown_connections 2023-11-20T06:41:11.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.236+0000 7fb2c20ad640 1 -- 172.21.15.19:0/1952448251 wait complete. 2023-11-20T06:41:11.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c20ad640 1 Processor -- start 2023-11-20T06:41:11.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c20ad640 1 -- start start 2023-11-20T06:41:11.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c20ad640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2a80047d0 0x7fb2bc0cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:11.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c20ad640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2bc15ce70 0x7fb2bc15b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:11.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c20ad640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc15be20 0x7fb2bc158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:11.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c20ad640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc15c2d0 con 0x7fb2a80047d0 2023-11-20T06:41:11.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c20ad640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc15fd00 con 0x7fb2bc15ce70 2023-11-20T06:41:11.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c20ad640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc15d2f0 con 0x7fb2bc15be20 2023-11-20T06:41:11.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c10ab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2a80047d0 0x7fb2bc0cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:11.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c10ab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2a80047d0 0x7fb2bc0cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41938/0 (socket says 172.21.15.19:41938) 2023-11-20T06:41:11.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c10ab640 1 -- 172.21.15.19:0/2550157441 learned_addr learned my addr 172.21.15.19:0/2550157441 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:11.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c08aa640 1 --2- 172.21.15.19:0/2550157441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2bc15ce70 0x7fb2bc15b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:11.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c18ac640 1 --2- 172.21.15.19:0/2550157441 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc15be20 0x7fb2bc158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:11.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c10ab640 1 -- 172.21.15.19:0/2550157441 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc15be20 msgr2=0x7fb2bc158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:11.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c10ab640 1 --2- 172.21.15.19:0/2550157441 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc15be20 0x7fb2bc158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:11.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c10ab640 1 -- 172.21.15.19:0/2550157441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2bc15ce70 msgr2=0x7fb2bc15b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:11.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c10ab640 1 --2- 172.21.15.19:0/2550157441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2bc15ce70 0x7fb2bc15b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:11.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c10ab640 1 -- 172.21.15.19:0/2550157441 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2bc0caa60 con 0x7fb2a80047d0 2023-11-20T06:41:11.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c08aa640 1 --2- 172.21.15.19:0/2550157441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2bc15ce70 0x7fb2bc15b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:11.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c10ab640 1 --2- 172.21.15.19:0/2550157441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2a80047d0 0x7fb2bc0cb820 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8011cd0 tx=0x7fb2b800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:11.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2b1ffb640 1 -- 172.21.15.19:0/2550157441 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b800fd20 con 0x7fb2a80047d0 2023-11-20T06:41:11.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2b1ffb640 1 -- 172.21.15.19:0/2550157441 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b800fe80 con 0x7fb2a80047d0 2023-11-20T06:41:11.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2b1ffb640 1 -- 172.21.15.19:0/2550157441 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8004240 con 0x7fb2a80047d0 2023-11-20T06:41:11.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c20ad640 1 -- 172.21.15.19:0/2550157441 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2bc0cad40 con 0x7fb2a80047d0 2023-11-20T06:41:11.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.240+0000 7fb2c20ad640 1 -- 172.21.15.19:0/2550157441 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2bc0cb300 con 0x7fb2a80047d0 2023-11-20T06:41:11.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.244+0000 7fb2c20ad640 1 -- 172.21.15.19:0/2550157441 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2bc04e9c0 con 0x7fb2a80047d0 2023-11-20T06:41:11.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.244+0000 7fb2b1ffb640 1 -- 172.21.15.19:0/2550157441 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb2b80043a0 con 0x7fb2a80047d0 2023-11-20T06:41:11.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.244+0000 7fb2b1ffb640 1 --2- 172.21.15.19:0/2550157441 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb2a00664a0 0x7fb2a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:11.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.244+0000 7fb2b1ffb640 1 -- 172.21.15.19:0/2550157441 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb2b8084290 con 0x7fb2a80047d0 2023-11-20T06:41:11.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.244+0000 7fb2c08aa640 1 --2- 172.21.15.19:0/2550157441 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb2a00664a0 0x7fb2a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:11.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.244+0000 7fb2c08aa640 1 --2- 172.21.15.19:0/2550157441 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb2a00664a0 0x7fb2a0068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac0aa000 tx=0x7fb2ac001990 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:11.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.248+0000 7fb2b1ffb640 1 -- 172.21.15.19:0/2550157441 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb2b80519c0 con 0x7fb2a80047d0 2023-11-20T06:41:11.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.412+0000 7fb2c20ad640 1 -- 172.21.15.19:0/2550157441 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb2bc0cfe20 con 0x7fb2a80047d0 2023-11-20T06:41:11.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.412+0000 7fb2b1ffb640 1 -- 172.21.15.19:0/2550157441 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb2b8022090 con 0x7fb2a80047d0 2023-11-20T06:41:11.418 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:11.418 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2023-11-20T06:41:11.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:41:11.418 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2023-11-20T06:41:11.418 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2023-11-20T06:41:11.418 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:41:11.419 INFO:teuthology.orchestra.run.smithi019.stdout:] 2023-11-20T06:41:11.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.416+0000 7fb2c20ad640 1 -- 172.21.15.19:0/2550157441 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb2a00664a0 msgr2=0x7fb2a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:11.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.416+0000 7fb2c20ad640 1 --2- 172.21.15.19:0/2550157441 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb2a00664a0 0x7fb2a0068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac0aa000 tx=0x7fb2ac001990 comp rx=0 tx=0).stop 2023-11-20T06:41:11.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.416+0000 7fb2c20ad640 1 -- 172.21.15.19:0/2550157441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2a80047d0 msgr2=0x7fb2bc0cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:11.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.416+0000 7fb2c20ad640 1 --2- 172.21.15.19:0/2550157441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2a80047d0 0x7fb2bc0cb820 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8011cd0 tx=0x7fb2b800f610 comp rx=0 tx=0).stop 2023-11-20T06:41:11.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.416+0000 7fb2c20ad640 1 -- 172.21.15.19:0/2550157441 shutdown_connections 2023-11-20T06:41:11.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.416+0000 7fb2c20ad640 1 --2- 172.21.15.19:0/2550157441 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb2a00664a0 0x7fb2a0068960 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:11.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.416+0000 7fb2c20ad640 1 --2- 172.21.15.19:0/2550157441 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc15be20 0x7fb2bc158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:11.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.416+0000 7fb2c20ad640 1 --2- 172.21.15.19:0/2550157441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2bc15ce70 0x7fb2bc15b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:11.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.416+0000 7fb2c20ad640 1 --2- 172.21.15.19:0/2550157441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2a80047d0 0x7fb2bc0cb820 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:11.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.416+0000 7fb2c20ad640 1 -- 172.21.15.19:0/2550157441 >> 172.21.15.19:0/2550157441 conn(0x7fb2bc09bb50 msgr2=0x7fb2bc0c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:11.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.416+0000 7fb2c20ad640 1 -- 172.21.15.19:0/2550157441 shutdown_connections 2023-11-20T06:41:11.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.416+0000 7fb2c20ad640 1 -- 172.21.15.19:0/2550157441 wait complete. 2023-11-20T06:41:11.439 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-20T06:41:11.439 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-20T06:41:11.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.580+0000 7f9cdf71d640 1 Processor -- start 2023-11-20T06:41:11.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.580+0000 7f9cdf71d640 1 -- start start 2023-11-20T06:41:11.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.584+0000 7f9cdf71d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9cd80d2570 0x7f9cd8161210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:11.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.584+0000 7f9cdf71d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9cd80cfd20 0x7f9cd80d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:11.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.584+0000 7f9cdf71d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd80ce460 con 0x7f9cd80cdc80 2023-11-20T06:41:11.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.584+0000 7f9cdf71d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd80cd830 con 0x7f9cd80cfd20 2023-11-20T06:41:11.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.584+0000 7f9cdf71d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd815da30 con 0x7f9cd80d2570 2023-11-20T06:41:11.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.584+0000 7f9cddcba640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9cd80cfd20 0x7f9cd80d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:11.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.584+0000 7f9cdccb8640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9cd80cdc80 0x7f9cd80cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54414/0 (socket says 172.21.15.19:54414) 2023-11-20T06:41:11.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.584+0000 7f9cdccb8640 1 -- 172.21.15.19:0/2715298941 learned_addr learned my addr 172.21.15.19:0/2715298941 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:11.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.584+0000 7f9cdd4b9640 1 --2- 172.21.15.19:0/2715298941 >> v2:172.21.15.190:3300/0 conn(0x7f9cd80d2570 0x7f9cd8161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:11.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.584+0000 7f9cddcba640 1 -- 172.21.15.19:0/2715298941 >> v2:172.21.15.190:3300/0 conn(0x7f9cd80d2570 msgr2=0x7f9cd8161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:11.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.584+0000 7f9cddcba640 1 --2- 172.21.15.19:0/2715298941 >> v2:172.21.15.190:3300/0 conn(0x7f9cd80d2570 0x7f9cd8161210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:11.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.584+0000 7f9cddcba640 1 -- 172.21.15.19:0/2715298941 >> v1:172.21.15.19:6789/0 conn(0x7f9cd80cdc80 legacy=0x7f9cd80cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:11.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.584+0000 7f9cddcba640 1 -- 172.21.15.19:0/2715298941 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd8161750 con 0x7f9cd80cfd20 2023-11-20T06:41:11.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.584+0000 7f9ccffff640 1 -- 172.21.15.19:0/2715298941 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686794614 0 0) 0x7f9cd80ce460 con 0x7f9cd80cdc80 2023-11-20T06:41:11.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.584+0000 7f9cddcba640 1 --2- 172.21.15.19:0/2715298941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cd80cfd20 0x7f9cd80d0e60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80722b0 tx=0x7f9cd001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91b71180cd0c400 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:11.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9ccffff640 1 -- 172.21.15.19:0/2715298941 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00a58b0 con 0x7f9cd80cfd20 2023-11-20T06:41:11.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9ccffff640 1 -- 172.21.15.19:0/2715298941 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd00a5a10 con 0x7f9cd80cfd20 2023-11-20T06:41:11.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9ccffff640 1 -- 172.21.15.19:0/2715298941 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00a5da0 con 0x7f9cd80cfd20 2023-11-20T06:41:11.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9cdf71d640 1 -- 172.21.15.19:0/2715298941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cd80cfd20 msgr2=0x7f9cd80d0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:11.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9cdf71d640 1 --2- 172.21.15.19:0/2715298941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cd80cfd20 0x7f9cd80d0e60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80722b0 tx=0x7f9cd001c8e0 comp rx=0 tx=0).stop 2023-11-20T06:41:11.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9cdf71d640 1 -- 172.21.15.19:0/2715298941 shutdown_connections 2023-11-20T06:41:11.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9cdf71d640 1 --2- 172.21.15.19:0/2715298941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cd80cfd20 0x7f9cd80d0e60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:11.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9cdf71d640 1 --2- 172.21.15.19:0/2715298941 >> v2:172.21.15.190:3300/0 conn(0x7f9cd80d2570 0x7f9cd8161210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:11.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9cdf71d640 1 -- 172.21.15.19:0/2715298941 >> 172.21.15.19:0/2715298941 conn(0x7f9cd80715c0 msgr2=0x7f9cd80719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:11.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9cdf71d640 1 -- 172.21.15.19:0/2715298941 shutdown_connections 2023-11-20T06:41:11.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9cdf71d640 1 -- 172.21.15.19:0/2715298941 wait complete. 2023-11-20T06:41:11.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9cdf71d640 1 Processor -- start 2023-11-20T06:41:11.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9cdf71d640 1 -- start start 2023-11-20T06:41:11.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9cdf71d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9cd80cdc80 0x7f9cd8159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:11.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9cdf71d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9cd80cfd20 0x7f9cd80c7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:11.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9cdf71d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cd80d2570 0x7f9cd80c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:11.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9cdf71d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd81546d0 con 0x7f9cd80d2570 2023-11-20T06:41:11.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9cdf71d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd815a230 con 0x7f9cd80cdc80 2023-11-20T06:41:11.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9cdf71d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd80c68d0 con 0x7f9cd80cfd20 2023-11-20T06:41:11.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9cddcba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cd80d2570 0x7f9cd80c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:11.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9cddcba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cd80d2570 0x7f9cd80c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41968/0 (socket says 172.21.15.19:41968) 2023-11-20T06:41:11.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.588+0000 7f9cddcba640 1 -- 172.21.15.19:0/1318735997 learned_addr learned my addr 172.21.15.19:0/1318735997 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:11.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.592+0000 7f9cdd4b9640 1 --2- 172.21.15.19:0/1318735997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9cd80cdc80 0x7f9cd8159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:11.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.592+0000 7f9cdccb8640 1 --2- 172.21.15.19:0/1318735997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9cd80cfd20 0x7f9cd80c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:11.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.592+0000 7f9cddcba640 1 -- 172.21.15.19:0/1318735997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9cd80cfd20 msgr2=0x7f9cd80c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:11.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.592+0000 7f9cddcba640 1 --2- 172.21.15.19:0/1318735997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9cd80cfd20 0x7f9cd80c7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:11.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.592+0000 7f9cddcba640 1 -- 172.21.15.19:0/1318735997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9cd80cdc80 msgr2=0x7f9cd8159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:11.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.592+0000 7f9cddcba640 1 --2- 172.21.15.19:0/1318735997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9cd80cdc80 0x7f9cd8159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:11.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.592+0000 7f9cddcba640 1 -- 172.21.15.19:0/1318735997 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd0009a70 con 0x7f9cd80d2570 2023-11-20T06:41:11.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.592+0000 7f9cdccb8640 1 --2- 172.21.15.19:0/1318735997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9cd80cfd20 0x7f9cd80c7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:11.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.592+0000 7f9cddcba640 1 --2- 172.21.15.19:0/1318735997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cd80d2570 0x7f9cd80c7bd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9cd00194f0 tx=0x7f9cd0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:11.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.592+0000 7f9ccdffb640 1 -- 172.21.15.19:0/1318735997 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00b9860 con 0x7f9cd80d2570 2023-11-20T06:41:11.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.592+0000 7f9ccdffb640 1 -- 172.21.15.19:0/1318735997 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd00b99c0 con 0x7f9cd80d2570 2023-11-20T06:41:11.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.592+0000 7f9cdf71d640 1 -- 172.21.15.19:0/1318735997 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd80c6bb0 con 0x7f9cd80d2570 2023-11-20T06:41:11.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.592+0000 7f9ccdffb640 1 -- 172.21.15.19:0/1318735997 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00b9d50 con 0x7f9cd80d2570 2023-11-20T06:41:11.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.592+0000 7f9cdf71d640 1 -- 172.21.15.19:0/1318735997 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd80c7170 con 0x7f9cd80d2570 2023-11-20T06:41:11.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.592+0000 7f9cdf71d640 1 -- 172.21.15.19:0/1318735997 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd80c7360 con 0x7f9cd80d2570 2023-11-20T06:41:11.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.592+0000 7f9ccdffb640 1 -- 172.21.15.19:0/1318735997 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9cd00c4460 con 0x7f9cd80d2570 2023-11-20T06:41:11.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.592+0000 7f9ccdffb640 1 --2- 172.21.15.19:0/1318735997 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9cbc0664a0 0x7f9cbc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:11.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.596+0000 7f9ccdffb640 1 -- 172.21.15.19:0/1318735997 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9cd011eea0 con 0x7f9cd80d2570 2023-11-20T06:41:11.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.596+0000 7f9cdd4b9640 1 --2- 172.21.15.19:0/1318735997 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9cbc0664a0 0x7f9cbc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:11.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.596+0000 7f9cdd4b9640 1 --2- 172.21.15.19:0/1318735997 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9cbc0664a0 0x7f9cbc068960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8071ba0 tx=0x7f9cd4009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:11.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.596+0000 7f9ccdffb640 1 -- 172.21.15.19:0/1318735997 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9cd00ec5d0 con 0x7f9cd80d2570 2023-11-20T06:41:11.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:11.756+0000 7f9cdf71d640 1 -- 172.21.15.19:0/1318735997 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9cd804e170 con 0x7f9cd80d2570 2023-11-20T06:41:12.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.204+0000 7f9ccdffb640 1 -- 172.21.15.19:0/1318735997 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9cd00b2020 con 0x7f9cd80d2570 2023-11-20T06:41:12.209 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2023-11-20T06:41:12.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.204+0000 7f9cdf71d640 1 -- 172.21.15.19:0/1318735997 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9cbc0664a0 msgr2=0x7f9cbc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:12.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.204+0000 7f9cdf71d640 1 --2- 172.21.15.19:0/1318735997 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9cbc0664a0 0x7f9cbc068960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8071ba0 tx=0x7f9cd4009190 comp rx=0 tx=0).stop 2023-11-20T06:41:12.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.204+0000 7f9cdf71d640 1 -- 172.21.15.19:0/1318735997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cd80d2570 msgr2=0x7f9cd80c7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:12.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.204+0000 7f9cdf71d640 1 --2- 172.21.15.19:0/1318735997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cd80d2570 0x7f9cd80c7bd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9cd00194f0 tx=0x7f9cd0019680 comp rx=0 tx=0).stop 2023-11-20T06:41:12.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.208+0000 7f9cdf71d640 1 -- 172.21.15.19:0/1318735997 shutdown_connections 2023-11-20T06:41:12.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.208+0000 7f9cdf71d640 1 --2- 172.21.15.19:0/1318735997 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9cbc0664a0 0x7f9cbc068960 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:12.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.208+0000 7f9cdf71d640 1 --2- 172.21.15.19:0/1318735997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cd80d2570 0x7f9cd80c7bd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:12.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.208+0000 7f9cdf71d640 1 --2- 172.21.15.19:0/1318735997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9cd80cfd20 0x7f9cd80c7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:12.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.208+0000 7f9cdf71d640 1 --2- 172.21.15.19:0/1318735997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9cd80cdc80 0x7f9cd8159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:12.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.208+0000 7f9cdf71d640 1 -- 172.21.15.19:0/1318735997 >> 172.21.15.19:0/1318735997 conn(0x7f9cd80715c0 msgr2=0x7f9cd815b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:12.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.208+0000 7f9cdf71d640 1 -- 172.21.15.19:0/1318735997 shutdown_connections 2023-11-20T06:41:12.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.208+0000 7f9cdf71d640 1 -- 172.21.15.19:0/1318735997 wait complete. 2023-11-20T06:41:12.239 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-11-20T06:41:12.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce2539d640 1 Processor -- start 2023-11-20T06:41:12.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce2539d640 1 -- start start 2023-11-20T06:41:12.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce2539d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce200b89b0 0x7fce200cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:12.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce2539d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce20161720 con 0x7fce200b85d0 2023-11-20T06:41:12.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce2539d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce20160ba0 con 0x7fce200d0130 2023-11-20T06:41:12.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce2539d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce200d05a0 con 0x7fce200b89b0 2023-11-20T06:41:12.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1effd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fce200b85d0 0x7fce2015dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52010/0 (socket says 172.21.15.19:52010) 2023-11-20T06:41:12.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1effd640 1 -- 172.21.15.19:0/2212202926 learned_addr learned my addr 172.21.15.19:0/2212202926 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:12.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1dffb640 1 -- 172.21.15.19:0/2212202926 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1233049932 0 0) 0x7fce20161720 con 0x7fce200b85d0 2023-11-20T06:41:12.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1dffb640 1 -- 172.21.15.19:0/2212202926 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce08003530 con 0x7fce200b85d0 2023-11-20T06:41:12.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1e7fc640 1 --2- 172.21.15.19:0/2212202926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce200b89b0 0x7fce200cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:12.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1dffb640 1 -- 172.21.15.19:0/2212202926 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3350284229 0 0) 0x7fce08003530 con 0x7fce200b85d0 2023-11-20T06:41:12.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1dffb640 1 -- 172.21.15.19:0/2212202926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce200b89b0 msgr2=0x7fce200cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:12.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1dffb640 1 --2- 172.21.15.19:0/2212202926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce200b89b0 0x7fce200cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:12.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1dffb640 1 -- 172.21.15.19:0/2212202926 >> v1:172.21.15.190:6789/0 conn(0x7fce200d0130 legacy=0x7fce200d0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:12.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1dffb640 1 -- 172.21.15.19:0/2212202926 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce20160e80 con 0x7fce200b85d0 2023-11-20T06:41:12.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1dffb640 1 -- 172.21.15.19:0/2212202926 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7fce10001680 con 0x7fce200b85d0 2023-11-20T06:41:12.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1dffb640 1 -- 172.21.15.19:0/2212202926 >> v1:172.21.15.19:6789/0 conn(0x7fce200b85d0 legacy=0x7fce2015dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:12.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1dffb640 1 --2- 172.21.15.19:0/2212202926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce200b89b0 0x7fce080039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:12.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1dffb640 1 --2- 172.21.15.19:0/2212202926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce08003f30 0x7fce080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:12.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1dffb640 1 --2- 172.21.15.19:0/2212202926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce08004d10 0x7fce08005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:12.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1dffb640 1 -- 172.21.15.19:0/2212202926 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce200d05a0 con 0x7fce08004d10 2023-11-20T06:41:12.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1dffb640 1 -- 172.21.15.19:0/2212202926 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0800ba70 con 0x7fce08003f30 2023-11-20T06:41:12.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1dffb640 1 -- 172.21.15.19:0/2212202926 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0800bc30 con 0x7fce200b89b0 2023-11-20T06:41:12.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1f7fe640 1 --2- 172.21.15.19:0/2212202926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce08004d10 0x7fce08005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:12.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1effd640 1 --2- 172.21.15.19:0/2212202926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce200b89b0 0x7fce080039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:12.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1e7fc640 1 --2- 172.21.15.19:0/2212202926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce08003f30 0x7fce080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:12.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1f7fe640 1 -- 172.21.15.19:0/2212202926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce200b89b0 msgr2=0x7fce080039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:12.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1f7fe640 1 --2- 172.21.15.19:0/2212202926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce200b89b0 0x7fce080039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:12.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1f7fe640 1 -- 172.21.15.19:0/2212202926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce08003f30 msgr2=0x7fce080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:12.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1f7fe640 1 --2- 172.21.15.19:0/2212202926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce08003f30 0x7fce080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:12.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.388+0000 7fce1f7fe640 1 -- 172.21.15.19:0/2212202926 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce08003530 con 0x7fce08004d10 2023-11-20T06:41:12.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.392+0000 7fce1f7fe640 1 --2- 172.21.15.19:0/2212202926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce08004d10 0x7fce08005190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fce18001e70 tx=0x7fce1801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749f3aecb1300f61 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:12.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.392+0000 7fce1dffb640 1 -- 172.21.15.19:0/2212202926 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce18003b80 con 0x7fce08004d10 2023-11-20T06:41:12.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.392+0000 7fce1dffb640 1 -- 172.21.15.19:0/2212202926 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce18003ce0 con 0x7fce08004d10 2023-11-20T06:41:12.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.392+0000 7fce1dffb640 1 -- 172.21.15.19:0/2212202926 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce180052c0 con 0x7fce08004d10 2023-11-20T06:41:12.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.392+0000 7fce2539d640 1 -- 172.21.15.19:0/2212202926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce08004d10 msgr2=0x7fce08005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:12.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.392+0000 7fce2539d640 1 --2- 172.21.15.19:0/2212202926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce08004d10 0x7fce08005190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fce18001e70 tx=0x7fce1801c760 comp rx=0 tx=0).stop 2023-11-20T06:41:12.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.392+0000 7fce1f7fe640 1 -- 172.21.15.19:0/2212202926 reap_dead start 2023-11-20T06:41:12.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.392+0000 7fce2539d640 1 -- 172.21.15.19:0/2212202926 shutdown_connections 2023-11-20T06:41:12.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.392+0000 7fce2539d640 1 -- 172.21.15.19:0/2212202926 >> 172.21.15.19:0/2212202926 conn(0x7fce2006b750 msgr2=0x7fce2006bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:12.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.392+0000 7fce2539d640 1 -- 172.21.15.19:0/2212202926 shutdown_connections 2023-11-20T06:41:12.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.392+0000 7fce2539d640 1 -- 172.21.15.19:0/2212202926 wait complete. 2023-11-20T06:41:12.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce2539d640 1 Processor -- start 2023-11-20T06:41:12.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce2539d640 1 -- start start 2023-11-20T06:41:12.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce2539d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce08004d10 0x7fce201f6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:12.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce2539d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce200cd520 0x7fce20148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:12.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce2539d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce201492a0 0x7fce200d2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:12.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce2539d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce200cdcc0 con 0x7fce200cd520 2023-11-20T06:41:12.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce2539d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce200cb4b0 con 0x7fce201492a0 2023-11-20T06:41:12.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce2539d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce201499d0 con 0x7fce08004d10 2023-11-20T06:41:12.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce1e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce200cd520 0x7fce20148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:12.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce1e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce200cd520 0x7fce20148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44790/0 (socket says 172.21.15.19:44790) 2023-11-20T06:41:12.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce1e7fc640 1 -- 172.21.15.19:0/2421058714 learned_addr learned my addr 172.21.15.19:0/2421058714 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:12.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce1effd640 1 --2- 172.21.15.19:0/2421058714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce08004d10 0x7fce201f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:12.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce1f7fe640 1 --2- 172.21.15.19:0/2421058714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce201492a0 0x7fce200d2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:12.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce1e7fc640 1 -- 172.21.15.19:0/2421058714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce08004d10 msgr2=0x7fce201f6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:12.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce1e7fc640 1 --2- 172.21.15.19:0/2421058714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce08004d10 0x7fce201f6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:12.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce1e7fc640 1 -- 172.21.15.19:0/2421058714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce201492a0 msgr2=0x7fce200d2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:12.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce1e7fc640 1 --2- 172.21.15.19:0/2421058714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce201492a0 0x7fce200d2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:12.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce1e7fc640 1 -- 172.21.15.19:0/2421058714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce200cd9e0 con 0x7fce200cd520 2023-11-20T06:41:12.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce1e7fc640 1 --2- 172.21.15.19:0/2421058714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce200cd520 0x7fce20148d60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce14011940 tx=0x7fce14011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:12.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce077fe640 1 -- 172.21.15.19:0/2421058714 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce14004240 con 0x7fce200cd520 2023-11-20T06:41:12.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce077fe640 1 -- 172.21.15.19:0/2421058714 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce140043a0 con 0x7fce200cd520 2023-11-20T06:41:12.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce2539d640 1 -- 172.21.15.19:0/2421058714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce200cadf0 con 0x7fce200cd520 2023-11-20T06:41:12.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce077fe640 1 -- 172.21.15.19:0/2421058714 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1400fa40 con 0x7fce200cd520 2023-11-20T06:41:12.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.396+0000 7fce2539d640 1 -- 172.21.15.19:0/2421058714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce201f6540 con 0x7fce200cd520 2023-11-20T06:41:12.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.400+0000 7fce2539d640 1 -- 172.21.15.19:0/2421058714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce200cac50 con 0x7fce200cd520 2023-11-20T06:41:12.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.400+0000 7fce077fe640 1 -- 172.21.15.19:0/2421058714 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fce1400fba0 con 0x7fce200cd520 2023-11-20T06:41:12.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.400+0000 7fce077fe640 1 --2- 172.21.15.19:0/2421058714 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fce0c0664a0 0x7fce0c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:12.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.400+0000 7fce077fe640 1 -- 172.21.15.19:0/2421058714 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fce14084560 con 0x7fce200cd520 2023-11-20T06:41:12.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.400+0000 7fce1effd640 1 --2- 172.21.15.19:0/2421058714 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fce0c0664a0 0x7fce0c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:12.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.404+0000 7fce1effd640 1 --2- 172.21.15.19:0/2421058714 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fce0c0664a0 0x7fce0c068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fce10007ef0 tx=0x7fce10001640 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:12.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.404+0000 7fce077fe640 1 -- 172.21.15.19:0/2421058714 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fce14051c60 con 0x7fce200cd520 2023-11-20T06:41:12.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:12.564+0000 7fce2539d640 1 -- 172.21.15.19:0/2421058714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fce200cac50 con 0x7fce200cd520 2023-11-20T06:41:13.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.208+0000 7fce077fe640 1 -- 172.21.15.19:0/2421058714 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7fce200cac50 con 0x7fce200cd520 2023-11-20T06:41:13.212 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2023-11-20T06:41:13.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.212+0000 7fce2539d640 1 -- 172.21.15.19:0/2421058714 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fce0c0664a0 msgr2=0x7fce0c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:13.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.212+0000 7fce2539d640 1 --2- 172.21.15.19:0/2421058714 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fce0c0664a0 0x7fce0c068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fce10007ef0 tx=0x7fce10001640 comp rx=0 tx=0).stop 2023-11-20T06:41:13.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.212+0000 7fce2539d640 1 -- 172.21.15.19:0/2421058714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce200cd520 msgr2=0x7fce20148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:13.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.212+0000 7fce2539d640 1 --2- 172.21.15.19:0/2421058714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce200cd520 0x7fce20148d60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce14011940 tx=0x7fce14011d40 comp rx=0 tx=0).stop 2023-11-20T06:41:13.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.212+0000 7fce2539d640 1 -- 172.21.15.19:0/2421058714 shutdown_connections 2023-11-20T06:41:13.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.212+0000 7fce2539d640 1 --2- 172.21.15.19:0/2421058714 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fce0c0664a0 0x7fce0c068960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:13.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.212+0000 7fce2539d640 1 --2- 172.21.15.19:0/2421058714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce201492a0 0x7fce200d2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:13.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.212+0000 7fce2539d640 1 --2- 172.21.15.19:0/2421058714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce200cd520 0x7fce20148d60 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce14011940 tx=0x7fce14011d40 comp rx=0 tx=0).stop 2023-11-20T06:41:13.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.212+0000 7fce2539d640 1 --2- 172.21.15.19:0/2421058714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce08004d10 0x7fce201f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:13.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.212+0000 7fce2539d640 1 -- 172.21.15.19:0/2421058714 >> 172.21.15.19:0/2421058714 conn(0x7fce2006b750 msgr2=0x7fce200729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:13.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.212+0000 7fce2539d640 1 -- 172.21.15.19:0/2421058714 shutdown_connections 2023-11-20T06:41:13.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.212+0000 7fce2539d640 1 -- 172.21.15.19:0/2421058714 wait complete. 2023-11-20T06:41:13.263 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-20T06:41:13.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.408+0000 7f5132068640 1 Processor -- start 2023-11-20T06:41:13.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.408+0000 7f5132068640 1 -- start start 2023-11-20T06:41:13.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.408+0000 7f5132068640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f512c159900 0x7f512c06e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:13.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.408+0000 7f5132068640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f512c06a5a0 0x7f512c0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:13.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.408+0000 7f5132068640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f512c0b4390 con 0x7f512c0b3f00 2023-11-20T06:41:13.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.408+0000 7f5132068640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512c0cd740 con 0x7f512c06a5a0 2023-11-20T06:41:13.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.408+0000 7f5132068640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512c0b4600 con 0x7f512c159900 2023-11-20T06:41:13.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.408+0000 7f512bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f512c06a5a0 0x7f512c0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:13.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.408+0000 7f512affd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f512c0b3f00 0x7f512c069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52014/0 (socket says 172.21.15.19:52014) 2023-11-20T06:41:13.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.408+0000 7f512affd640 1 -- 172.21.15.19:0/2761279863 learned_addr learned my addr 172.21.15.19:0/2761279863 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:13.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.408+0000 7f512b7fe640 1 --2- 172.21.15.19:0/2761279863 >> v2:172.21.15.190:3300/0 conn(0x7f512c159900 0x7f512c06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:13.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.408+0000 7f512bfff640 1 -- 172.21.15.19:0/2761279863 >> v2:172.21.15.190:3300/0 conn(0x7f512c159900 msgr2=0x7f512c06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:13.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.408+0000 7f512bfff640 1 --2- 172.21.15.19:0/2761279863 >> v2:172.21.15.190:3300/0 conn(0x7f512c159900 0x7f512c06e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:13.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.408+0000 7f512bfff640 1 -- 172.21.15.19:0/2761279863 >> v1:172.21.15.19:6789/0 conn(0x7f512c0b3f00 legacy=0x7f512c069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:13.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.408+0000 7f512bfff640 1 -- 172.21.15.19:0/2761279863 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512c0c8dd0 con 0x7f512c06a5a0 2023-11-20T06:41:13.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.408+0000 7f512a7fc640 1 -- 172.21.15.19:0/2761279863 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671776395 0 0) 0x7f512c0b4390 con 0x7f512c0b3f00 2023-11-20T06:41:13.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.412+0000 7f512bfff640 1 --2- 172.21.15.19:0/2761279863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f512c06a5a0 0x7f512c0c9b90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f512c06ab70 tx=0x7f512401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f6ac5ca98482c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:13.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.412+0000 7f512a7fc640 1 -- 172.21.15.19:0/2761279863 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51240a59a0 con 0x7f512c06a5a0 2023-11-20T06:41:13.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.412+0000 7f512a7fc640 1 -- 172.21.15.19:0/2761279863 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51240a5b00 con 0x7f512c06a5a0 2023-11-20T06:41:13.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.412+0000 7f512a7fc640 1 -- 172.21.15.19:0/2761279863 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51240a5e90 con 0x7f512c06a5a0 2023-11-20T06:41:13.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.412+0000 7f5132068640 1 -- 172.21.15.19:0/2761279863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f512c06a5a0 msgr2=0x7f512c0c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:13.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.412+0000 7f5132068640 1 --2- 172.21.15.19:0/2761279863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f512c06a5a0 0x7f512c0c9b90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f512c06ab70 tx=0x7f512401c8e0 comp rx=0 tx=0).stop 2023-11-20T06:41:13.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.412+0000 7f5132068640 1 -- 172.21.15.19:0/2761279863 shutdown_connections 2023-11-20T06:41:13.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.412+0000 7f5132068640 1 --2- 172.21.15.19:0/2761279863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f512c06a5a0 0x7f512c0c9b90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:13.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.412+0000 7f5132068640 1 --2- 172.21.15.19:0/2761279863 >> v2:172.21.15.190:3300/0 conn(0x7f512c159900 0x7f512c06e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:13.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.412+0000 7f5132068640 1 -- 172.21.15.19:0/2761279863 >> 172.21.15.19:0/2761279863 conn(0x7f512c0b0da0 msgr2=0x7f512c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:13.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.412+0000 7f5132068640 1 -- 172.21.15.19:0/2761279863 shutdown_connections 2023-11-20T06:41:13.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.412+0000 7f5132068640 1 -- 172.21.15.19:0/2761279863 wait complete. 2023-11-20T06:41:13.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f5132068640 1 Processor -- start 2023-11-20T06:41:13.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f5132068640 1 -- start start 2023-11-20T06:41:13.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f5132068640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f512c06a5a0 0x7f512c154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:13.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f5132068640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f512c0b3f00 0x7f512c1f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:13.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f5132068640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f512c159900 0x7f512c0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:13.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f5132068640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c153230 con 0x7f512c06a5a0 2023-11-20T06:41:13.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f5132068640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c153430 con 0x7f512c0b3f00 2023-11-20T06:41:13.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f5132068640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512c1f59a0 con 0x7f512c159900 2023-11-20T06:41:13.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f512b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f512c06a5a0 0x7f512c154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:13.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f512b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f512c06a5a0 0x7f512c154180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44796/0 (socket says 172.21.15.19:44796) 2023-11-20T06:41:13.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f512b7fe640 1 -- 172.21.15.19:0/4287921375 learned_addr learned my addr 172.21.15.19:0/4287921375 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:13.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f512affd640 1 --2- 172.21.15.19:0/4287921375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f512c0b3f00 0x7f512c1f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:13.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f512bfff640 1 --2- 172.21.15.19:0/4287921375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f512c159900 0x7f512c0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:13.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f512b7fe640 1 -- 172.21.15.19:0/4287921375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f512c159900 msgr2=0x7f512c0c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:13.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f512b7fe640 1 --2- 172.21.15.19:0/4287921375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f512c159900 0x7f512c0c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:13.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f512b7fe640 1 -- 172.21.15.19:0/4287921375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f512c0b3f00 msgr2=0x7f512c1f5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:13.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f512b7fe640 1 --2- 172.21.15.19:0/4287921375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f512c0b3f00 0x7f512c1f5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:13.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f512b7fe640 1 -- 172.21.15.19:0/4287921375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5124009a70 con 0x7f512c06a5a0 2023-11-20T06:41:13.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f512b7fe640 1 --2- 172.21.15.19:0/4287921375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f512c06a5a0 0x7f512c154180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f511c00e8a0 tx=0x7f511c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:13.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f5113fff640 1 -- 172.21.15.19:0/4287921375 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c009510 con 0x7f512c06a5a0 2023-11-20T06:41:13.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f5113fff640 1 -- 172.21.15.19:0/4287921375 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c00c940 con 0x7f512c06a5a0 2023-11-20T06:41:13.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f5113fff640 1 -- 172.21.15.19:0/4287921375 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c00ccb0 con 0x7f512c06a5a0 2023-11-20T06:41:13.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f5132068640 1 -- 172.21.15.19:0/4287921375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512c155930 con 0x7f512c06a5a0 2023-11-20T06:41:13.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.416+0000 7f5132068640 1 -- 172.21.15.19:0/4287921375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512c153980 con 0x7f512c06a5a0 2023-11-20T06:41:13.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.420+0000 7f5132068640 1 -- 172.21.15.19:0/4287921375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512c04e170 con 0x7f512c06a5a0 2023-11-20T06:41:13.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.420+0000 7f5113fff640 1 -- 172.21.15.19:0/4287921375 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f511c013470 con 0x7f512c06a5a0 2023-11-20T06:41:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.420+0000 7f5113fff640 1 --2- 172.21.15.19:0/4287921375 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f51180664a0 0x7f5118068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.420+0000 7f5113fff640 1 -- 172.21.15.19:0/4287921375 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f511c083ee0 con 0x7f512c06a5a0 2023-11-20T06:41:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.420+0000 7f512affd640 1 --2- 172.21.15.19:0/4287921375 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f51180664a0 0x7f5118068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.420+0000 7f512affd640 1 --2- 172.21.15.19:0/4287921375 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f51180664a0 0x7f5118068960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f512c0c4f50 tx=0x7f5120007d60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:13.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.424+0000 7f5113fff640 1 -- 172.21.15.19:0/4287921375 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f511c0513d0 con 0x7f512c06a5a0 2023-11-20T06:41:13.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:13.616+0000 7f5132068640 1 -- 172.21.15.19:0/4287921375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f512c06d830 con 0x7f512c06a5a0 2023-11-20T06:41:14.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.240+0000 7f5113fff640 1 -- 172.21.15.19:0/4287921375 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f511c0549f0 con 0x7f512c06a5a0 2023-11-20T06:41:14.247 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 2 and data pool 3 2023-11-20T06:41:14.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.244+0000 7f5132068640 1 -- 172.21.15.19:0/4287921375 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f51180664a0 msgr2=0x7f5118068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:14.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.244+0000 7f5132068640 1 --2- 172.21.15.19:0/4287921375 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f51180664a0 0x7f5118068960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f512c0c4f50 tx=0x7f5120007d60 comp rx=0 tx=0).stop 2023-11-20T06:41:14.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.244+0000 7f5132068640 1 -- 172.21.15.19:0/4287921375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f512c06a5a0 msgr2=0x7f512c154180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:14.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.244+0000 7f5132068640 1 --2- 172.21.15.19:0/4287921375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f512c06a5a0 0x7f512c154180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f511c00e8a0 tx=0x7f511c00eca0 comp rx=0 tx=0).stop 2023-11-20T06:41:14.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.244+0000 7f5132068640 1 -- 172.21.15.19:0/4287921375 shutdown_connections 2023-11-20T06:41:14.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.244+0000 7f5132068640 1 --2- 172.21.15.19:0/4287921375 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f51180664a0 0x7f5118068960 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f512c0c4f50 tx=0x7f5120007d60 comp rx=0 tx=0).stop 2023-11-20T06:41:14.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.244+0000 7f5132068640 1 --2- 172.21.15.19:0/4287921375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f512c159900 0x7f512c0c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:14.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.244+0000 7f5132068640 1 --2- 172.21.15.19:0/4287921375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f512c0b3f00 0x7f512c1f5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:14.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.244+0000 7f5132068640 1 --2- 172.21.15.19:0/4287921375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f512c06a5a0 0x7f512c154180 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f511c00e8a0 tx=0x7f511c00eca0 comp rx=0 tx=0).stop 2023-11-20T06:41:14.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.244+0000 7f5132068640 1 -- 172.21.15.19:0/4287921375 >> 172.21.15.19:0/4287921375 conn(0x7f512c0b0da0 msgr2=0x7f512c0acfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:14.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.248+0000 7f5132068640 1 -- 172.21.15.19:0/4287921375 shutdown_connections 2023-11-20T06:41:14.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.248+0000 7f5132068640 1 -- 172.21.15.19:0/4287921375 wait complete. 2023-11-20T06:41:14.301 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-11-20T06:41:14.301 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-11-20T06:41:14.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.444+0000 7fe597654640 1 Processor -- start 2023-11-20T06:41:14.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.444+0000 7fe597654640 1 -- start start 2023-11-20T06:41:14.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.448+0000 7fe597654640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe5900d2570 0x7fe590161210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:14.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.448+0000 7fe597654640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe5900cfd20 0x7fe5900d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:14.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.448+0000 7fe597654640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5900ce460 con 0x7fe5900cdc80 2023-11-20T06:41:14.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.448+0000 7fe597654640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5900cd830 con 0x7fe5900d2570 2023-11-20T06:41:14.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.448+0000 7fe597654640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe59015da30 con 0x7fe5900cfd20 2023-11-20T06:41:14.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.448+0000 7fe5953f0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe5900d2570 0x7fe590161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:14.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.448+0000 7fe5953f0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe5900d2570 0x7fe590161210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44804/0 (socket says 172.21.15.19:44804) 2023-11-20T06:41:14.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.448+0000 7fe5953f0640 1 -- 172.21.15.19:0/88955961 learned_addr learned my addr 172.21.15.19:0/88955961 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:14.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.448+0000 7fe5953f0640 1 -- 172.21.15.19:0/88955961 >> v2:172.21.15.190:3300/0 conn(0x7fe5900cfd20 msgr2=0x7fe5900d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:14.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.448+0000 7fe5953f0640 1 --2- 172.21.15.19:0/88955961 >> v2:172.21.15.190:3300/0 conn(0x7fe5900cfd20 0x7fe5900d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:14.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.448+0000 7fe5953f0640 1 -- 172.21.15.19:0/88955961 >> v1:172.21.15.190:6789/0 conn(0x7fe5900cdc80 legacy=0x7fe5900cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:14.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.448+0000 7fe5953f0640 1 -- 172.21.15.19:0/88955961 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe590161750 con 0x7fe5900d2570 2023-11-20T06:41:14.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.452+0000 7fe5953f0640 1 --2- 172.21.15.19:0/88955961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5900d2570 0x7fe590161210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe5900cd200 tx=0x7fe58c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2f292f47b8a893 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:14.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.452+0000 7fe587fff640 1 -- 172.21.15.19:0/88955961 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c0ac600 con 0x7fe5900d2570 2023-11-20T06:41:14.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.452+0000 7fe587fff640 1 -- 172.21.15.19:0/88955961 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c0a8050 con 0x7fe5900d2570 2023-11-20T06:41:14.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.452+0000 7fe587fff640 1 -- 172.21.15.19:0/88955961 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c0ac980 con 0x7fe5900d2570 2023-11-20T06:41:14.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.452+0000 7fe597654640 1 -- 172.21.15.19:0/88955961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5900d2570 msgr2=0x7fe590161210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:14.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.452+0000 7fe597654640 1 --2- 172.21.15.19:0/88955961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5900d2570 0x7fe590161210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe5900cd200 tx=0x7fe58c01c490 comp rx=0 tx=0).stop 2023-11-20T06:41:14.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.452+0000 7fe597654640 1 -- 172.21.15.19:0/88955961 shutdown_connections 2023-11-20T06:41:14.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.452+0000 7fe597654640 1 --2- 172.21.15.19:0/88955961 >> v2:172.21.15.190:3300/0 conn(0x7fe5900cfd20 0x7fe5900d0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:14.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.452+0000 7fe597654640 1 --2- 172.21.15.19:0/88955961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5900d2570 0x7fe590161210 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:14.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.452+0000 7fe597654640 1 -- 172.21.15.19:0/88955961 >> 172.21.15.19:0/88955961 conn(0x7fe5900715c0 msgr2=0x7fe5900719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:14.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.452+0000 7fe597654640 1 -- 172.21.15.19:0/88955961 shutdown_connections 2023-11-20T06:41:14.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.452+0000 7fe597654640 1 -- 172.21.15.19:0/88955961 wait complete. 2023-11-20T06:41:14.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.452+0000 7fe597654640 1 Processor -- start 2023-11-20T06:41:14.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.452+0000 7fe597654640 1 -- start start 2023-11-20T06:41:14.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe597654640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5900cdc80 0x7fe5900c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:14.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe597654640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5900cfd20 0x7fe590148990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:14.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe597654640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5900d2570 0x7fe5900b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:14.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe597654640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900c7da0 con 0x7fe5900cdc80 2023-11-20T06:41:14.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe597654640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900c95b0 con 0x7fe5900d2570 2023-11-20T06:41:14.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe597654640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900c7fd0 con 0x7fe5900cfd20 2023-11-20T06:41:14.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe5953f0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5900cdc80 0x7fe5900c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:14.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe5953f0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5900cdc80 0x7fe5900c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44818/0 (socket says 172.21.15.19:44818) 2023-11-20T06:41:14.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe5953f0640 1 -- 172.21.15.19:0/3901910126 learned_addr learned my addr 172.21.15.19:0/3901910126 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:14.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe5953f0640 1 -- 172.21.15.19:0/3901910126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5900cfd20 msgr2=0x7fe590148990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:14.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe5953f0640 1 --2- 172.21.15.19:0/3901910126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5900cfd20 0x7fe590148990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:14.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe5953f0640 1 -- 172.21.15.19:0/3901910126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5900d2570 msgr2=0x7fe5900b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:14.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe5953f0640 1 --2- 172.21.15.19:0/3901910126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5900d2570 0x7fe5900b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:14.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe5953f0640 1 -- 172.21.15.19:0/3901910126 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58c0094d0 con 0x7fe5900cdc80 2023-11-20T06:41:14.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe5953f0640 1 --2- 172.21.15.19:0/3901910126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5900cdc80 0x7fe5900c9070 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe58c01a0c0 tx=0x7fe58c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:14.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe585ffb640 1 -- 172.21.15.19:0/3901910126 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c0bd070 con 0x7fe5900cdc80 2023-11-20T06:41:14.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe585ffb640 1 -- 172.21.15.19:0/3901910126 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c0b7420 con 0x7fe5900cdc80 2023-11-20T06:41:14.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe585ffb640 1 -- 172.21.15.19:0/3901910126 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c0b7790 con 0x7fe5900cdc80 2023-11-20T06:41:14.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe597654640 1 -- 172.21.15.19:0/3901910126 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5900c82b0 con 0x7fe5900cdc80 2023-11-20T06:41:14.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe597654640 1 -- 172.21.15.19:0/3901910126 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5900c8870 con 0x7fe5900cdc80 2023-11-20T06:41:14.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe597654640 1 -- 172.21.15.19:0/3901910126 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59004e170 con 0x7fe5900cdc80 2023-11-20T06:41:14.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.456+0000 7fe585ffb640 1 -- 172.21.15.19:0/3901910126 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe58c0b3040 con 0x7fe5900cdc80 2023-11-20T06:41:14.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.460+0000 7fe585ffb640 1 --2- 172.21.15.19:0/3901910126 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe5740664a0 0x7fe574068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:14.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.460+0000 7fe585ffb640 1 -- 172.21.15.19:0/3901910126 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe58c11dad0 con 0x7fe5900cdc80 2023-11-20T06:41:14.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.460+0000 7fe594bef640 1 --2- 172.21.15.19:0/3901910126 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe5740664a0 0x7fe574068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:14.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.460+0000 7fe594bef640 1 --2- 172.21.15.19:0/3901910126 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe5740664a0 0x7fe574068960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe5901603f0 tx=0x7fe580006bb0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:14.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.464+0000 7fe585ffb640 1 -- 172.21.15.19:0/3901910126 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe58c0eaf40 con 0x7fe5900cdc80 2023-11-20T06:41:14.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:14.632+0000 7fe597654640 1 -- 172.21.15.19:0/3901910126 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fe5900cda60 con 0x7fe5900cdc80 2023-11-20T06:41:15.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.248+0000 7fe585ffb640 1 -- 172.21.15.19:0/3901910126 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7fe58c0ee560 con 0x7fe5900cdc80 2023-11-20T06:41:15.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.252+0000 7fe597654640 1 -- 172.21.15.19:0/3901910126 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe5740664a0 msgr2=0x7fe574068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:15.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.252+0000 7fe597654640 1 --2- 172.21.15.19:0/3901910126 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe5740664a0 0x7fe574068960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe5901603f0 tx=0x7fe580006bb0 comp rx=0 tx=0).stop 2023-11-20T06:41:15.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.252+0000 7fe597654640 1 -- 172.21.15.19:0/3901910126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5900cdc80 msgr2=0x7fe5900c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:15.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.252+0000 7fe597654640 1 --2- 172.21.15.19:0/3901910126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5900cdc80 0x7fe5900c9070 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe58c01a0c0 tx=0x7fe58c01acd0 comp rx=0 tx=0).stop 2023-11-20T06:41:15.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.252+0000 7fe597654640 1 -- 172.21.15.19:0/3901910126 shutdown_connections 2023-11-20T06:41:15.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.252+0000 7fe597654640 1 --2- 172.21.15.19:0/3901910126 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe5740664a0 0x7fe574068960 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:15.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.252+0000 7fe597654640 1 --2- 172.21.15.19:0/3901910126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5900d2570 0x7fe5900b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:15.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.252+0000 7fe597654640 1 --2- 172.21.15.19:0/3901910126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5900cfd20 0x7fe590148990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:15.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.252+0000 7fe597654640 1 --2- 172.21.15.19:0/3901910126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5900cdc80 0x7fe5900c9070 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:15.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.252+0000 7fe597654640 1 -- 172.21.15.19:0/3901910126 >> 172.21.15.19:0/3901910126 conn(0x7fe5900715c0 msgr2=0x7fe5900b79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:15.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.252+0000 7fe597654640 1 -- 172.21.15.19:0/3901910126 shutdown_connections 2023-11-20T06:41:15.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.252+0000 7fe597654640 1 -- 172.21.15.19:0/3901910126 wait complete. 2023-11-20T06:41:15.277 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-11-20T06:41:15.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f000be91640 1 Processor -- start 2023-11-20T06:41:15.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f000be91640 1 -- start start 2023-11-20T06:41:15.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f000be91640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f000415cc10 0x7f00040b8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:15.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f000be91640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00040cd800 0x7f00040cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:15.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f000be91640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000415cff0 con 0x7f00040b5ba0 2023-11-20T06:41:15.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f000be91640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00040b8b80 con 0x7f000415cc10 2023-11-20T06:41:15.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f000be91640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00040ce1d0 con 0x7f00040cd800 2023-11-20T06:41:15.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f000942c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f00040b5ba0 0x7f00040d0b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52026/0 (socket says 172.21.15.19:52026) 2023-11-20T06:41:15.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f000942c640 1 -- 172.21.15.19:0/2163703785 learned_addr learned my addr 172.21.15.19:0/2163703785 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:15.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f0009c2d640 1 --2- 172.21.15.19:0/2163703785 >> v2:172.21.15.190:3300/0 conn(0x7f000415cc10 0x7f00040b8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:15.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f000a42e640 1 --2- 172.21.15.19:0/2163703785 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00040cd800 0x7f00040cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:15.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f0008c2b640 1 -- 172.21.15.19:0/2163703785 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651511808 0 0) 0x7f000415cff0 con 0x7f00040b5ba0 2023-11-20T06:41:15.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f0008c2b640 1 -- 172.21.15.19:0/2163703785 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff0003530 con 0x7f00040b5ba0 2023-11-20T06:41:15.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f0008c2b640 1 -- 172.21.15.19:0/2163703785 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 882493824 0 0) 0x7efff0003530 con 0x7f00040b5ba0 2023-11-20T06:41:15.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f0008c2b640 1 -- 172.21.15.19:0/2163703785 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00040cd800 msgr2=0x7f00040cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:15.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f0008c2b640 1 --2- 172.21.15.19:0/2163703785 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00040cd800 0x7f00040cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:15.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f0008c2b640 1 -- 172.21.15.19:0/2163703785 >> v2:172.21.15.190:3300/0 conn(0x7f000415cc10 msgr2=0x7f00040b8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:15.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f0008c2b640 1 --2- 172.21.15.19:0/2163703785 >> v2:172.21.15.190:3300/0 conn(0x7f000415cc10 0x7f00040b8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:15.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f0008c2b640 1 -- 172.21.15.19:0/2163703785 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00040b63f0 con 0x7f00040b5ba0 2023-11-20T06:41:15.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f0008c2b640 1 -- 172.21.15.19:0/2163703785 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7efff4001680 con 0x7f00040b5ba0 2023-11-20T06:41:15.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f0008c2b640 1 -- 172.21.15.19:0/2163703785 >> v1:172.21.15.19:6789/0 conn(0x7f00040b5ba0 legacy=0x7f00040d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:15.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f0008c2b640 1 --2- 172.21.15.19:0/2163703785 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efff0003980 0x7efff0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:15.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f0008c2b640 1 --2- 172.21.15.19:0/2163703785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efff00047d0 0x7efff0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:15.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f0008c2b640 1 --2- 172.21.15.19:0/2163703785 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00040cd800 0x7efff0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:15.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f0008c2b640 1 -- 172.21.15.19:0/2163703785 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00040ce1d0 con 0x7efff00047d0 2023-11-20T06:41:15.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f0008c2b640 1 -- 172.21.15.19:0/2163703785 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff000b990 con 0x7efff0003980 2023-11-20T06:41:15.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f0008c2b640 1 -- 172.21.15.19:0/2163703785 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff000bad0 con 0x7f00040cd800 2023-11-20T06:41:15.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f000942c640 1 --2- 172.21.15.19:0/2163703785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efff00047d0 0x7efff0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:15.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f0009c2d640 1 --2- 172.21.15.19:0/2163703785 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efff0003980 0x7efff0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:15.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.424+0000 7f000a42e640 1 --2- 172.21.15.19:0/2163703785 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00040cd800 0x7efff0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:15.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.428+0000 7f000942c640 1 -- 172.21.15.19:0/2163703785 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00040cd800 msgr2=0x7efff0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:15.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.428+0000 7f000942c640 1 --2- 172.21.15.19:0/2163703785 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00040cd800 0x7efff0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:15.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.428+0000 7f000942c640 1 -- 172.21.15.19:0/2163703785 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efff0003980 msgr2=0x7efff0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:15.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.428+0000 7f000942c640 1 --2- 172.21.15.19:0/2163703785 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efff0003980 0x7efff0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:15.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.428+0000 7f000942c640 1 -- 172.21.15.19:0/2163703785 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff0003530 con 0x7efff00047d0 2023-11-20T06:41:15.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.428+0000 7f000942c640 1 --2- 172.21.15.19:0/2163703785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efff00047d0 0x7efff0004c50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efff400c210 tx=0x7efff401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2fa2ec90252192 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:15.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.428+0000 7f0008c2b640 1 -- 172.21.15.19:0/2163703785 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff40058e0 con 0x7efff00047d0 2023-11-20T06:41:15.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.428+0000 7f0008c2b640 1 -- 172.21.15.19:0/2163703785 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff4005a40 con 0x7efff00047d0 2023-11-20T06:41:15.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.428+0000 7f0008c2b640 1 -- 172.21.15.19:0/2163703785 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4005e10 con 0x7efff00047d0 2023-11-20T06:41:15.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.428+0000 7f000be91640 1 -- 172.21.15.19:0/2163703785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efff00047d0 msgr2=0x7efff0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:15.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.428+0000 7f000be91640 1 --2- 172.21.15.19:0/2163703785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efff00047d0 0x7efff0004c50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efff400c210 tx=0x7efff401cc60 comp rx=0 tx=0).stop 2023-11-20T06:41:15.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.428+0000 7f000a42e640 1 -- 172.21.15.19:0/2163703785 reap_dead start 2023-11-20T06:41:15.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.428+0000 7f000be91640 1 -- 172.21.15.19:0/2163703785 shutdown_connections 2023-11-20T06:41:15.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.428+0000 7f000be91640 1 -- 172.21.15.19:0/2163703785 >> 172.21.15.19:0/2163703785 conn(0x7f00040719c0 msgr2=0x7f0004071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:15.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.428+0000 7f000be91640 1 -- 172.21.15.19:0/2163703785 shutdown_connections 2023-11-20T06:41:15.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.428+0000 7f000be91640 1 -- 172.21.15.19:0/2163703785 wait complete. 2023-11-20T06:41:15.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f000be91640 1 Processor -- start 2023-11-20T06:41:15.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f000be91640 1 -- start start 2023-11-20T06:41:15.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f000be91640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efff00047d0 0x7f0004150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:15.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f000be91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00040cbbb0 0x7f00040cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:15.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f000be91640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00040c7ff0 0x7f00040b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:15.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f000be91640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00040c6f90 con 0x7f00040cbbb0 2023-11-20T06:41:15.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f000be91640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00040c7230 con 0x7f00040c7ff0 2023-11-20T06:41:15.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f000be91640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00040c7510 con 0x7efff00047d0 2023-11-20T06:41:15.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f000942c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00040cbbb0 0x7f00040cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:15.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f000942c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00040cbbb0 0x7f00040cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44832/0 (socket says 172.21.15.19:44832) 2023-11-20T06:41:15.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f000942c640 1 -- 172.21.15.19:0/714514918 learned_addr learned my addr 172.21.15.19:0/714514918 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:15.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f0009c2d640 1 --2- 172.21.15.19:0/714514918 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efff00047d0 0x7f0004150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:15.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f000942c640 1 -- 172.21.15.19:0/714514918 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efff00047d0 msgr2=0x7f0004150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:15.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f000a42e640 1 --2- 172.21.15.19:0/714514918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00040c7ff0 0x7f00040b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:15.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f000942c640 1 --2- 172.21.15.19:0/714514918 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efff00047d0 0x7f0004150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:15.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f000942c640 1 -- 172.21.15.19:0/714514918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00040c7ff0 msgr2=0x7f00040b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:15.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f000942c640 1 --2- 172.21.15.19:0/714514918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00040c7ff0 0x7f00040b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:15.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f000942c640 1 -- 172.21.15.19:0/714514918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00040c77f0 con 0x7f00040cbbb0 2023-11-20T06:41:15.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f0009c2d640 1 --2- 172.21.15.19:0/714514918 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efff00047d0 0x7f0004150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:15.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f000a42e640 1 --2- 172.21.15.19:0/714514918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00040c7ff0 0x7f00040b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:15.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7f000942c640 1 --2- 172.21.15.19:0/714514918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00040cbbb0 0x7f00040cc130 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efff400c210 tx=0x7efff0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:15.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.432+0000 7efffa7fc640 1 -- 172.21.15.19:0/714514918 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff40a5c90 con 0x7f00040cbbb0 2023-11-20T06:41:15.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.436+0000 7efffa7fc640 1 -- 172.21.15.19:0/714514918 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff40a5df0 con 0x7f00040cbbb0 2023-11-20T06:41:15.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.436+0000 7f000be91640 1 -- 172.21.15.19:0/714514918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00040c7ad0 con 0x7f00040cbbb0 2023-11-20T06:41:15.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.436+0000 7efffa7fc640 1 -- 172.21.15.19:0/714514918 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff40049f0 con 0x7f00040cbbb0 2023-11-20T06:41:15.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.436+0000 7f000be91640 1 -- 172.21.15.19:0/714514918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00040cc670 con 0x7f00040cbbb0 2023-11-20T06:41:15.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.436+0000 7f000be91640 1 -- 172.21.15.19:0/714514918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00040c7c60 con 0x7f00040cbbb0 2023-11-20T06:41:15.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.436+0000 7efffa7fc640 1 -- 172.21.15.19:0/714514918 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efff4004b50 con 0x7f00040cbbb0 2023-11-20T06:41:15.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.436+0000 7efffa7fc640 1 --2- 172.21.15.19:0/714514918 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7effe80664a0 0x7effe8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:15.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.436+0000 7efffa7fc640 1 -- 172.21.15.19:0/714514918 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7efff411df90 con 0x7f00040cbbb0 2023-11-20T06:41:15.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.440+0000 7f0009c2d640 1 --2- 172.21.15.19:0/714514918 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7effe80664a0 0x7effe8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:15.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.440+0000 7f0009c2d640 1 --2- 172.21.15.19:0/714514918 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7effe80664a0 0x7effe8068960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0000009ad0 tx=0x7f0000008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:15.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.444+0000 7efffa7fc640 1 -- 172.21.15.19:0/714514918 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efff40eb320 con 0x7f00040cbbb0 2023-11-20T06:41:15.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:15.600+0000 7f000be91640 1 -- 172.21.15.19:0/714514918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f000404e170 con 0x7f00040cbbb0 2023-11-20T06:41:17.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.260+0000 7efffa7fc640 1 -- 172.21.15.19:0/714514918 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7efff40ee940 con 0x7f00040cbbb0 2023-11-20T06:41:17.264 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data_ec' created 2023-11-20T06:41:17.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.264+0000 7f000be91640 1 -- 172.21.15.19:0/714514918 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7effe80664a0 msgr2=0x7effe8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:17.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.264+0000 7f000be91640 1 --2- 172.21.15.19:0/714514918 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7effe80664a0 0x7effe8068960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0000009ad0 tx=0x7f0000008040 comp rx=0 tx=0).stop 2023-11-20T06:41:17.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.264+0000 7f000be91640 1 -- 172.21.15.19:0/714514918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00040cbbb0 msgr2=0x7f00040cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:17.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.264+0000 7f000be91640 1 --2- 172.21.15.19:0/714514918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00040cbbb0 0x7f00040cc130 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efff400c210 tx=0x7efff0005800 comp rx=0 tx=0).stop 2023-11-20T06:41:17.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.264+0000 7f000be91640 1 -- 172.21.15.19:0/714514918 shutdown_connections 2023-11-20T06:41:17.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.264+0000 7f000be91640 1 --2- 172.21.15.19:0/714514918 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7effe80664a0 0x7effe8068960 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:17.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.264+0000 7f000be91640 1 --2- 172.21.15.19:0/714514918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00040c7ff0 0x7f00040b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:17.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.264+0000 7f000be91640 1 --2- 172.21.15.19:0/714514918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00040cbbb0 0x7f00040cc130 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:17.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.264+0000 7f000be91640 1 --2- 172.21.15.19:0/714514918 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efff00047d0 0x7f0004150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:17.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.264+0000 7f000be91640 1 -- 172.21.15.19:0/714514918 >> 172.21.15.19:0/714514918 conn(0x7f00040719c0 msgr2=0x7f000415d840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:17.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.264+0000 7f000be91640 1 -- 172.21.15.19:0/714514918 shutdown_connections 2023-11-20T06:41:17.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.264+0000 7f000be91640 1 -- 172.21.15.19:0/714514918 wait complete. 2023-11-20T06:41:17.304 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-11-20T06:41:17.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.448+0000 7f496cd0f640 1 Processor -- start 2023-11-20T06:41:17.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.448+0000 7f496cd0f640 1 -- start start 2023-11-20T06:41:17.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.452+0000 7f496cd0f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f49680d2570 0x7f4968161210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:17.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.452+0000 7f496cd0f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f49680cdc80 0x7f49680cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:17.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.452+0000 7f496cd0f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f496815dec0 0x7f49680cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:17.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.452+0000 7f496cd0f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49680cd830 con 0x7f49680d2570 2023-11-20T06:41:17.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.452+0000 7f496cd0f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49680ce460 con 0x7f49680cdc80 2023-11-20T06:41:17.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.452+0000 7f496cd0f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496815da30 con 0x7f496815dec0 2023-11-20T06:41:17.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.452+0000 7f496659c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f49680d2570 0x7f4968161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:17.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.452+0000 7f496659c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f49680d2570 0x7f4968161210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44838/0 (socket says 172.21.15.19:44838) 2023-11-20T06:41:17.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.452+0000 7f496659c640 1 -- 172.21.15.19:0/2611437255 learned_addr learned my addr 172.21.15.19:0/2611437255 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:17.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.452+0000 7f495ffff640 1 --2- 172.21.15.19:0/2611437255 >> v2:172.21.15.190:3300/0 conn(0x7f49680cdc80 0x7f49680cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:17.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.452+0000 7f4966d9d640 1 --2- 172.21.15.19:0/2611437255 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f496815dec0 0x7f49680cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:17.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.452+0000 7f496659c640 1 -- 172.21.15.19:0/2611437255 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f496815dec0 msgr2=0x7f49680cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:17.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.452+0000 7f496659c640 1 --2- 172.21.15.19:0/2611437255 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f496815dec0 0x7f49680cfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:17.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.452+0000 7f496659c640 1 -- 172.21.15.19:0/2611437255 >> v2:172.21.15.190:3300/0 conn(0x7f49680cdc80 msgr2=0x7f49680cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:17.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.452+0000 7f496659c640 1 --2- 172.21.15.19:0/2611437255 >> v2:172.21.15.190:3300/0 conn(0x7f49680cdc80 0x7f49680cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:17.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.452+0000 7f496659c640 1 -- 172.21.15.19:0/2611437255 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4968161750 con 0x7f49680d2570 2023-11-20T06:41:17.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f496659c640 1 --2- 172.21.15.19:0/2611437255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49680d2570 0x7f4968161210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f49680664e0 tx=0x7f495801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1a19e79aceaa8c server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:17.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f4965d9b640 1 -- 172.21.15.19:0/2611437255 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49580ab600 con 0x7f49680d2570 2023-11-20T06:41:17.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f4965d9b640 1 -- 172.21.15.19:0/2611437255 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49580ab760 con 0x7f49680d2570 2023-11-20T06:41:17.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f4965d9b640 1 -- 172.21.15.19:0/2611437255 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49580abaf0 con 0x7f49680d2570 2023-11-20T06:41:17.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f496cd0f640 1 -- 172.21.15.19:0/2611437255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49680d2570 msgr2=0x7f4968161210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:17.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f496cd0f640 1 --2- 172.21.15.19:0/2611437255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49680d2570 0x7f4968161210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f49680664e0 tx=0x7f495801c440 comp rx=0 tx=0).stop 2023-11-20T06:41:17.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f496cd0f640 1 -- 172.21.15.19:0/2611437255 shutdown_connections 2023-11-20T06:41:17.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f496cd0f640 1 --2- 172.21.15.19:0/2611437255 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f496815dec0 0x7f49680cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:17.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f496cd0f640 1 --2- 172.21.15.19:0/2611437255 >> v2:172.21.15.190:3300/0 conn(0x7f49680cdc80 0x7f49680cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:17.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f496cd0f640 1 --2- 172.21.15.19:0/2611437255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49680d2570 0x7f4968161210 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:17.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f496cd0f640 1 -- 172.21.15.19:0/2611437255 >> 172.21.15.19:0/2611437255 conn(0x7f49680715c0 msgr2=0x7f49680719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:17.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f496cd0f640 1 -- 172.21.15.19:0/2611437255 shutdown_connections 2023-11-20T06:41:17.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f496cd0f640 1 -- 172.21.15.19:0/2611437255 wait complete. 2023-11-20T06:41:17.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f496cd0f640 1 Processor -- start 2023-11-20T06:41:17.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f496cd0f640 1 -- start start 2023-11-20T06:41:17.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f496cd0f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49680cdc80 0x7f49680c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:17.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f496cd0f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49680d2570 0x7f49680c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:17.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f496cd0f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f496815dec0 0x7f4968158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:17.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f496cd0f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49680c6e50 con 0x7f49680cdc80 2023-11-20T06:41:17.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f496cd0f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49680c6fe0 con 0x7f49680d2570 2023-11-20T06:41:17.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.456+0000 7f496cd0f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49680c5300 con 0x7f496815dec0 2023-11-20T06:41:17.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.460+0000 7f496659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49680cdc80 0x7f49680c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:17.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.460+0000 7f496659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49680cdc80 0x7f49680c30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44844/0 (socket says 172.21.15.19:44844) 2023-11-20T06:41:17.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.460+0000 7f496659c640 1 -- 172.21.15.19:0/3079420382 learned_addr learned my addr 172.21.15.19:0/3079420382 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:17.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.460+0000 7f495ffff640 1 --2- 172.21.15.19:0/3079420382 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49680d2570 0x7f49680c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:17.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.460+0000 7f4966d9d640 1 --2- 172.21.15.19:0/3079420382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f496815dec0 0x7f4968158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:17.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.460+0000 7f496659c640 1 -- 172.21.15.19:0/3079420382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f496815dec0 msgr2=0x7f4968158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:17.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.460+0000 7f496659c640 1 --2- 172.21.15.19:0/3079420382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f496815dec0 0x7f4968158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:17.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.460+0000 7f496659c640 1 -- 172.21.15.19:0/3079420382 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49680d2570 msgr2=0x7f49680c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:17.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.460+0000 7f496659c640 1 --2- 172.21.15.19:0/3079420382 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49680d2570 0x7f49680c4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:17.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.460+0000 7f496659c640 1 -- 172.21.15.19:0/3079420382 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49580094d0 con 0x7f49680cdc80 2023-11-20T06:41:17.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.460+0000 7f496659c640 1 --2- 172.21.15.19:0/3079420382 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49680cdc80 0x7f49680c30c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f49580ad040 tx=0x7f495801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:17.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.460+0000 7f495effd640 1 -- 172.21.15.19:0/3079420382 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49580b4800 con 0x7f49680cdc80 2023-11-20T06:41:17.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.460+0000 7f495effd640 1 -- 172.21.15.19:0/3079420382 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49580b4960 con 0x7f49680cdc80 2023-11-20T06:41:17.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.460+0000 7f495effd640 1 -- 172.21.15.19:0/3079420382 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49580b4cf0 con 0x7f49680cdc80 2023-11-20T06:41:17.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.460+0000 7f496cd0f640 1 -- 172.21.15.19:0/3079420382 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49680c55e0 con 0x7f49680cdc80 2023-11-20T06:41:17.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.460+0000 7f496cd0f640 1 -- 172.21.15.19:0/3079420382 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49680c5ba0 con 0x7f49680cdc80 2023-11-20T06:41:17.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.460+0000 7f496cd0f640 1 -- 172.21.15.19:0/3079420382 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496804e170 con 0x7f49680cdc80 2023-11-20T06:41:17.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.460+0000 7f495effd640 1 -- 172.21.15.19:0/3079420382 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f49580c83e0 con 0x7f49680cdc80 2023-11-20T06:41:17.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.464+0000 7f495effd640 1 --2- 172.21.15.19:0/3079420382 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f49480664a0 0x7f4948068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:17.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.464+0000 7f495effd640 1 -- 172.21.15.19:0/3079420382 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f495811eca0 con 0x7f49680cdc80 2023-11-20T06:41:17.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.464+0000 7f495ffff640 1 --2- 172.21.15.19:0/3079420382 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f49480664a0 0x7f4948068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:17.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.464+0000 7f495ffff640 1 --2- 172.21.15.19:0/3079420382 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f49480664a0 0x7f4948068960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4968157280 tx=0x7f4950008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:17.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.464+0000 7f495effd640 1 -- 172.21.15.19:0/3079420382 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f49580ebee0 con 0x7f49680cdc80 2023-11-20T06:41:17.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:17.624+0000 7f496cd0f640 1 -- 172.21.15.19:0/3079420382 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f49680cda60 con 0x7f49680cdc80 2023-11-20T06:41:18.073 INFO:tasks.ceph.mds.c.smithi019.stderr:2023-11-20T06:41:18.072+0000 7fd251d55640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-20T06:41:18.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.260+0000 7f495effd640 1 -- 172.21.15.19:0/3079420382 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f49580c4020 con 0x7f49680cdc80 2023-11-20T06:41:18.266 INFO:teuthology.orchestra.run.smithi019.stderr:set pool 4 allow_ec_overwrites to true 2023-11-20T06:41:18.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.268+0000 7f496cd0f640 1 -- 172.21.15.19:0/3079420382 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f49480664a0 msgr2=0x7f4948068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:18.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.268+0000 7f496cd0f640 1 --2- 172.21.15.19:0/3079420382 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f49480664a0 0x7f4948068960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4968157280 tx=0x7f4950008040 comp rx=0 tx=0).stop 2023-11-20T06:41:18.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.268+0000 7f496cd0f640 1 -- 172.21.15.19:0/3079420382 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49680cdc80 msgr2=0x7f49680c30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:18.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.268+0000 7f496cd0f640 1 --2- 172.21.15.19:0/3079420382 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49680cdc80 0x7f49680c30c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f49580ad040 tx=0x7f495801ac80 comp rx=0 tx=0).stop 2023-11-20T06:41:18.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.268+0000 7f496cd0f640 1 -- 172.21.15.19:0/3079420382 shutdown_connections 2023-11-20T06:41:18.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.268+0000 7f496cd0f640 1 --2- 172.21.15.19:0/3079420382 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f49480664a0 0x7f4948068960 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:18.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.268+0000 7f496cd0f640 1 --2- 172.21.15.19:0/3079420382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f496815dec0 0x7f4968158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:18.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.268+0000 7f496cd0f640 1 --2- 172.21.15.19:0/3079420382 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49680d2570 0x7f49680c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:18.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.268+0000 7f496cd0f640 1 --2- 172.21.15.19:0/3079420382 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49680cdc80 0x7f49680c30c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:18.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.268+0000 7f496cd0f640 1 -- 172.21.15.19:0/3079420382 >> 172.21.15.19:0/3079420382 conn(0x7f49680715c0 msgr2=0x7f4968156760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:18.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.272+0000 7f496cd0f640 1 -- 172.21.15.19:0/3079420382 shutdown_connections 2023-11-20T06:41:18.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.272+0000 7f496cd0f640 1 -- 172.21.15.19:0/3079420382 wait complete. 2023-11-20T06:41:18.325 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-11-20T06:41:18.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.468+0000 7ff63d301640 1 Processor -- start 2023-11-20T06:41:18.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.468+0000 7ff63d301640 1 -- start start 2023-11-20T06:41:18.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.468+0000 7ff63d301640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff63815cba0 0x7ff6380d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:18.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.468+0000 7ff63d301640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff6380d0210 0x7ff6380b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:18.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.468+0000 7ff63d301640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6380d1670 con 0x7ff6380b84e0 2023-11-20T06:41:18.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.468+0000 7ff63d301640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6380d1460 con 0x7ff63815cba0 2023-11-20T06:41:18.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.468+0000 7ff63d301640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6380d1950 con 0x7ff6380d0210 2023-11-20T06:41:18.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.468+0000 7ff636ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff63815cba0 0x7ff6380d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:18.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.468+0000 7ff636ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff63815cba0 0x7ff6380d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44852/0 (socket says 172.21.15.19:44852) 2023-11-20T06:41:18.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.468+0000 7ff636ffd640 1 -- 172.21.15.19:0/1853738059 learned_addr learned my addr 172.21.15.19:0/1853738059 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:18.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.468+0000 7ff636ffd640 1 -- 172.21.15.19:0/1853738059 >> v2:172.21.15.190:3300/0 conn(0x7ff6380d0210 msgr2=0x7ff6380b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:18.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.468+0000 7ff636ffd640 1 --2- 172.21.15.19:0/1853738059 >> v2:172.21.15.190:3300/0 conn(0x7ff6380d0210 0x7ff6380b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:18.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.468+0000 7ff636ffd640 1 -- 172.21.15.19:0/1853738059 >> v1:172.21.15.190:6789/0 conn(0x7ff6380b84e0 legacy=0x7ff6380cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:18.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.468+0000 7ff636ffd640 1 -- 172.21.15.19:0/1853738059 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6380d1c30 con 0x7ff63815cba0 2023-11-20T06:41:18.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.472+0000 7ff636ffd640 1 --2- 172.21.15.19:0/1853738059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff63815cba0 0x7ff6380d0f20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff6380ce450 tx=0x7ff62801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f7030435f4f39e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:18.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.472+0000 7ff635ffb640 1 -- 172.21.15.19:0/1853738059 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6280a7070 con 0x7ff63815cba0 2023-11-20T06:41:18.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.472+0000 7ff635ffb640 1 -- 172.21.15.19:0/1853738059 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6280ab430 con 0x7ff63815cba0 2023-11-20T06:41:18.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.472+0000 7ff635ffb640 1 -- 172.21.15.19:0/1853738059 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6280ab7c0 con 0x7ff63815cba0 2023-11-20T06:41:18.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.472+0000 7ff63d301640 1 -- 172.21.15.19:0/1853738059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff63815cba0 msgr2=0x7ff6380d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:18.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.472+0000 7ff63d301640 1 --2- 172.21.15.19:0/1853738059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff63815cba0 0x7ff6380d0f20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff6380ce450 tx=0x7ff62801c430 comp rx=0 tx=0).stop 2023-11-20T06:41:18.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.472+0000 7ff63d301640 1 -- 172.21.15.19:0/1853738059 shutdown_connections 2023-11-20T06:41:18.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.472+0000 7ff63d301640 1 --2- 172.21.15.19:0/1853738059 >> v2:172.21.15.190:3300/0 conn(0x7ff6380d0210 0x7ff6380b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:18.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.472+0000 7ff63d301640 1 --2- 172.21.15.19:0/1853738059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff63815cba0 0x7ff6380d0f20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:18.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.472+0000 7ff63d301640 1 -- 172.21.15.19:0/1853738059 >> 172.21.15.19:0/1853738059 conn(0x7ff6380719c0 msgr2=0x7ff638071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:18.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.472+0000 7ff63d301640 1 -- 172.21.15.19:0/1853738059 shutdown_connections 2023-11-20T06:41:18.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.472+0000 7ff63d301640 1 -- 172.21.15.19:0/1853738059 wait complete. 2023-11-20T06:41:18.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff63d301640 1 Processor -- start 2023-11-20T06:41:18.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff63d301640 1 -- start start 2023-11-20T06:41:18.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff63d301640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6380b84e0 0x7ff63814fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:18.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff63d301640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6380d0210 0x7ff63806b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:18.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff63d301640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff63815cba0 0x7ff63814dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:18.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff63d301640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff638152990 con 0x7ff63815cba0 2023-11-20T06:41:18.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff63d301640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6381526b0 con 0x7ff6380d0210 2023-11-20T06:41:18.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff63d301640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63814f3e0 con 0x7ff6380b84e0 2023-11-20T06:41:18.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff6377fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff63815cba0 0x7ff63814dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:18.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff636ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6380b84e0 0x7ff63814fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:18.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff636ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6380b84e0 0x7ff63814fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:33398/0 (socket says 172.21.15.19:33398) 2023-11-20T06:41:18.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff636ffd640 1 -- 172.21.15.19:0/3550333084 learned_addr learned my addr 172.21.15.19:0/3550333084 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:18.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff6367fc640 1 --2- 172.21.15.19:0/3550333084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6380d0210 0x7ff63806b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:18.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff6377fe640 1 -- 172.21.15.19:0/3550333084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6380b84e0 msgr2=0x7ff63814fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:18.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff6377fe640 1 --2- 172.21.15.19:0/3550333084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6380b84e0 0x7ff63814fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:18.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff6377fe640 1 -- 172.21.15.19:0/3550333084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6380d0210 msgr2=0x7ff63806b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:18.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff6377fe640 1 --2- 172.21.15.19:0/3550333084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6380d0210 0x7ff63806b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:18.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff6377fe640 1 -- 172.21.15.19:0/3550333084 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6280094d0 con 0x7ff63815cba0 2023-11-20T06:41:18.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff6377fe640 1 --2- 172.21.15.19:0/3550333084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff63815cba0 0x7ff63814dda0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff63000be20 tx=0x7ff63000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:18.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff61f7fe640 1 -- 172.21.15.19:0/3550333084 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63000ce70 con 0x7ff63815cba0 2023-11-20T06:41:18.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff61f7fe640 1 -- 172.21.15.19:0/3550333084 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff630014440 con 0x7ff63815cba0 2023-11-20T06:41:18.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff61f7fe640 1 -- 172.21.15.19:0/3550333084 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff630014810 con 0x7ff63815cba0 2023-11-20T06:41:18.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff63d301640 1 -- 172.21.15.19:0/3550333084 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63814f6c0 con 0x7ff63815cba0 2023-11-20T06:41:18.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.476+0000 7ff63d301640 1 -- 172.21.15.19:0/3550333084 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff638152340 con 0x7ff63815cba0 2023-11-20T06:41:18.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.480+0000 7ff63d301640 1 -- 172.21.15.19:0/3550333084 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63814fbe0 con 0x7ff63815cba0 2023-11-20T06:41:18.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.480+0000 7ff61f7fe640 1 -- 172.21.15.19:0/3550333084 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff63001d3b0 con 0x7ff63815cba0 2023-11-20T06:41:18.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.480+0000 7ff61f7fe640 1 --2- 172.21.15.19:0/3550333084 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6240664a0 0x7ff624068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:18.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.480+0000 7ff61f7fe640 1 -- 172.21.15.19:0/3550333084 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7ff630084310 con 0x7ff63815cba0 2023-11-20T06:41:18.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.480+0000 7ff636ffd640 1 --2- 172.21.15.19:0/3550333084 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6240664a0 0x7ff624068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:18.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.480+0000 7ff636ffd640 1 --2- 172.21.15.19:0/3550333084 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6240664a0 0x7ff624068960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff62801c470 tx=0x7ff628008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:18.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.484+0000 7ff61f7fe640 1 -- 172.21.15.19:0/3550333084 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff63814fbe0 con 0x7ff63815cba0 2023-11-20T06:41:18.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:18.676+0000 7ff63d301640 1 -- 172.21.15.19:0/3550333084 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7ff63814fbe0 con 0x7ff63815cba0 2023-11-20T06:41:19.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.300+0000 7ff61f7fe640 1 -- 172.21.15.19:0/3550333084 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7ff63814fbe0 con 0x7ff63815cba0 2023-11-20T06:41:19.307 INFO:teuthology.orchestra.run.smithi019.stderr:added data pool 4 to fsmap 2023-11-20T06:41:19.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.304+0000 7ff63d301640 1 -- 172.21.15.19:0/3550333084 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6240664a0 msgr2=0x7ff624068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:19.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.304+0000 7ff63d301640 1 --2- 172.21.15.19:0/3550333084 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6240664a0 0x7ff624068960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff62801c470 tx=0x7ff628008040 comp rx=0 tx=0).stop 2023-11-20T06:41:19.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.304+0000 7ff63d301640 1 -- 172.21.15.19:0/3550333084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff63815cba0 msgr2=0x7ff63814dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:19.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.304+0000 7ff63d301640 1 --2- 172.21.15.19:0/3550333084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff63815cba0 0x7ff63814dda0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff63000be20 tx=0x7ff63000bf10 comp rx=0 tx=0).stop 2023-11-20T06:41:19.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.304+0000 7ff63d301640 1 -- 172.21.15.19:0/3550333084 shutdown_connections 2023-11-20T06:41:19.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.304+0000 7ff63d301640 1 --2- 172.21.15.19:0/3550333084 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6240664a0 0x7ff624068960 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.304+0000 7ff63d301640 1 --2- 172.21.15.19:0/3550333084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff63815cba0 0x7ff63814dda0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.304+0000 7ff63d301640 1 --2- 172.21.15.19:0/3550333084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6380d0210 0x7ff63806b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.304+0000 7ff63d301640 1 --2- 172.21.15.19:0/3550333084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6380b84e0 0x7ff63814fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.304+0000 7ff63d301640 1 -- 172.21.15.19:0/3550333084 >> 172.21.15.19:0/3550333084 conn(0x7ff6380719c0 msgr2=0x7ff638156bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:19.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.304+0000 7ff63d301640 1 -- 172.21.15.19:0/3550333084 shutdown_connections 2023-11-20T06:41:19.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.304+0000 7ff63d301640 1 -- 172.21.15.19:0/3550333084 wait complete. 2023-11-20T06:41:19.333 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T06:41:19.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.472+0000 7f53bfa46640 1 Processor -- start 2023-11-20T06:41:19.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.472+0000 7f53bfa46640 1 -- start start 2023-11-20T06:41:19.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.472+0000 7f53bfa46640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f53b815cb30 0x7f53b81608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:19.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.472+0000 7f53bfa46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53b815cf10 0x7f53b806cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:19.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.472+0000 7f53bfa46640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b80ccbd0 con 0x7f53b8065a80 2023-11-20T06:41:19.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.472+0000 7f53bfa46640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b806b180 con 0x7f53b815cb30 2023-11-20T06:41:19.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.472+0000 7f53bfa46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b806b460 con 0x7f53b815cf10 2023-11-20T06:41:19.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.476+0000 7f53bd7e2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f53b815cb30 0x7f53b81608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:19.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.476+0000 7f53bd7e2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f53b815cb30 0x7f53b81608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44878/0 (socket says 172.21.15.19:44878) 2023-11-20T06:41:19.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.476+0000 7f53bd7e2640 1 -- 172.21.15.19:0/1215660665 learned_addr learned my addr 172.21.15.19:0/1215660665 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:19.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.476+0000 7f53bdfe3640 1 --2- 172.21.15.19:0/1215660665 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53b815cf10 0x7f53b806cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:19.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.476+0000 7f53bd7e2640 1 -- 172.21.15.19:0/1215660665 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53b815cf10 msgr2=0x7f53b806cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:19.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.476+0000 7f53bd7e2640 1 --2- 172.21.15.19:0/1215660665 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53b815cf10 0x7f53b806cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.476+0000 7f53bd7e2640 1 -- 172.21.15.19:0/1215660665 >> v1:172.21.15.190:6789/0 conn(0x7f53b8065a80 legacy=0x7f53b8160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:19.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.476+0000 7f53bd7e2640 1 -- 172.21.15.19:0/1215660665 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b806c6e0 con 0x7f53b815cb30 2023-11-20T06:41:19.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.476+0000 7f53bd7e2640 1 --2- 172.21.15.19:0/1215660665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53b815cb30 0x7f53b81608f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f53b4009870 tx=0x7f53b401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a03864fb2c1da97 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:19.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.476+0000 7f53affff640 1 -- 172.21.15.19:0/1215660665 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b40ab680 con 0x7f53b815cb30 2023-11-20T06:41:19.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.476+0000 7f53affff640 1 -- 172.21.15.19:0/1215660665 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b40ab7e0 con 0x7f53b815cb30 2023-11-20T06:41:19.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.476+0000 7f53affff640 1 -- 172.21.15.19:0/1215660665 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b40abb70 con 0x7f53b815cb30 2023-11-20T06:41:19.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.480+0000 7f53bfa46640 1 -- 172.21.15.19:0/1215660665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53b815cb30 msgr2=0x7f53b81608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:19.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.480+0000 7f53bfa46640 1 --2- 172.21.15.19:0/1215660665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53b815cb30 0x7f53b81608f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f53b4009870 tx=0x7f53b401c480 comp rx=0 tx=0).stop 2023-11-20T06:41:19.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.480+0000 7f53bfa46640 1 -- 172.21.15.19:0/1215660665 shutdown_connections 2023-11-20T06:41:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.480+0000 7f53bfa46640 1 --2- 172.21.15.19:0/1215660665 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53b815cf10 0x7f53b806cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.480+0000 7f53bfa46640 1 --2- 172.21.15.19:0/1215660665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53b815cb30 0x7f53b81608f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.480+0000 7f53bfa46640 1 -- 172.21.15.19:0/1215660665 >> 172.21.15.19:0/1215660665 conn(0x7f53b80b0880 msgr2=0x7f53b80b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.480+0000 7f53bfa46640 1 -- 172.21.15.19:0/1215660665 shutdown_connections 2023-11-20T06:41:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.480+0000 7f53bfa46640 1 -- 172.21.15.19:0/1215660665 wait complete. 2023-11-20T06:41:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.480+0000 7f53bfa46640 1 Processor -- start 2023-11-20T06:41:19.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.480+0000 7f53bfa46640 1 -- start start 2023-11-20T06:41:19.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.480+0000 7f53bfa46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53b8065a80 0x7f53b80c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:19.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.480+0000 7f53bfa46640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53b815cb30 0x7f53b809cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:19.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.480+0000 7f53bfa46640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53b815cf10 0x7f53b80b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:19.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.480+0000 7f53bfa46640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b80b29e0 con 0x7f53b815cb30 2023-11-20T06:41:19.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.480+0000 7f53bfa46640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b80b1dd0 con 0x7f53b815cf10 2023-11-20T06:41:19.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.480+0000 7f53bfa46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b80b20b0 con 0x7f53b8065a80 2023-11-20T06:41:19.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.480+0000 7f53bcfe1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53b815cb30 0x7f53b809cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:19.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.480+0000 7f53bcfe1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53b815cb30 0x7f53b809cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44880/0 (socket says 172.21.15.19:44880) 2023-11-20T06:41:19.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.484+0000 7f53bd7e2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53b8065a80 0x7f53b80c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:19.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.484+0000 7f53bcfe1640 1 -- 172.21.15.19:0/2992131604 learned_addr learned my addr 172.21.15.19:0/2992131604 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:19.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.484+0000 7f53bdfe3640 1 --2- 172.21.15.19:0/2992131604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53b815cf10 0x7f53b80b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:19.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.484+0000 7f53bcfe1640 1 -- 172.21.15.19:0/2992131604 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53b8065a80 msgr2=0x7f53b80c36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:19.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.484+0000 7f53bcfe1640 1 --2- 172.21.15.19:0/2992131604 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53b8065a80 0x7f53b80c36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.484+0000 7f53bcfe1640 1 -- 172.21.15.19:0/2992131604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53b815cf10 msgr2=0x7f53b80b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:19.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.484+0000 7f53bcfe1640 1 --2- 172.21.15.19:0/2992131604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53b815cf10 0x7f53b80b2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.484+0000 7f53bcfe1640 1 -- 172.21.15.19:0/2992131604 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b40094d0 con 0x7f53b815cb30 2023-11-20T06:41:19.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.484+0000 7f53bcfe1640 1 --2- 172.21.15.19:0/2992131604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53b815cb30 0x7f53b809cf40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f53a800c400 tx=0x7f53a800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:19.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.484+0000 7f53adffb640 1 -- 172.21.15.19:0/2992131604 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a80052d0 con 0x7f53b815cb30 2023-11-20T06:41:19.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.484+0000 7f53adffb640 1 -- 172.21.15.19:0/2992131604 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a8005430 con 0x7f53b815cb30 2023-11-20T06:41:19.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.484+0000 7f53adffb640 1 -- 172.21.15.19:0/2992131604 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a8003840 con 0x7f53b815cb30 2023-11-20T06:41:19.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.484+0000 7f53bfa46640 1 -- 172.21.15.19:0/2992131604 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b80b2390 con 0x7f53b815cb30 2023-11-20T06:41:19.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.484+0000 7f53bfa46640 1 -- 172.21.15.19:0/2992131604 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b80c3c30 con 0x7f53b815cb30 2023-11-20T06:41:19.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.484+0000 7f53bfa46640 1 -- 172.21.15.19:0/2992131604 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b80b2b90 con 0x7f53b815cb30 2023-11-20T06:41:19.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.484+0000 7f53adffb640 1 -- 172.21.15.19:0/2992131604 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f53a80039a0 con 0x7f53b815cb30 2023-11-20T06:41:19.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.484+0000 7f53adffb640 1 --2- 172.21.15.19:0/2992131604 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f539c0664f0 0x7f539c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:19.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.484+0000 7f53adffb640 1 -- 172.21.15.19:0/2992131604 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f53a80836c0 con 0x7f53b815cb30 2023-11-20T06:41:19.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.488+0000 7f53bd7e2640 1 --2- 172.21.15.19:0/2992131604 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f539c0664f0 0x7f539c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:19.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.488+0000 7f53bd7e2640 1 --2- 172.21.15.19:0/2992131604 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f539c0664f0 0x7f539c0689b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53b40af000 tx=0x7f53b40b6040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.492+0000 7f53adffb640 1 -- 172.21.15.19:0/2992131604 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f53a80508e0 con 0x7f53b815cb30 2023-11-20T06:41:19.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.680+0000 7f53bfa46640 1 -- 172.21.15.19:0/2992131604 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53b8074010 con 0x7f53b815cb30 2023-11-20T06:41:19.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.684+0000 7f53adffb640 1 -- 172.21.15.19:0/2992131604 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f53a8053f00 con 0x7f53b815cb30 2023-11-20T06:41:19.687 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:19.687 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/212787745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":212787745},{"type":"v1","addr":"172.21.15.190:6836","nonce":212787745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1874314285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1874314285},{"type":"v1","addr":"172.21.15.190:6837","nonce":1874314285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3845638593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3845638593},{"type":"v1","addr":"172.21.15.19:6833","nonce":3845638593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T06:41:13.620144+0000","modified":"2023-11-20T06:41:18.681077+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/1973335825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1973335825},{"type":"v1","addr":"172.21.15.19:6835","nonce":1973335825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-20T06:41:19.688 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 7 2023-11-20T06:41:19.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.684+0000 7f53bfa46640 1 -- 172.21.15.19:0/2992131604 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f539c0664f0 msgr2=0x7f539c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:19.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.684+0000 7f53bfa46640 1 --2- 172.21.15.19:0/2992131604 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f539c0664f0 0x7f539c0689b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53b40af000 tx=0x7f53b40b6040 comp rx=0 tx=0).stop 2023-11-20T06:41:19.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.684+0000 7f53bfa46640 1 -- 172.21.15.19:0/2992131604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53b815cb30 msgr2=0x7f53b809cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:19.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.684+0000 7f53bfa46640 1 --2- 172.21.15.19:0/2992131604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53b815cb30 0x7f53b809cf40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f53a800c400 tx=0x7f53a800c8c0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.684+0000 7f53bfa46640 1 -- 172.21.15.19:0/2992131604 shutdown_connections 2023-11-20T06:41:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.684+0000 7f53bfa46640 1 --2- 172.21.15.19:0/2992131604 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f539c0664f0 0x7f539c0689b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.684+0000 7f53bfa46640 1 --2- 172.21.15.19:0/2992131604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53b815cf10 0x7f53b80b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.684+0000 7f53bfa46640 1 --2- 172.21.15.19:0/2992131604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53b815cb30 0x7f53b809cf40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.684+0000 7f53bfa46640 1 --2- 172.21.15.19:0/2992131604 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53b8065a80 0x7f53b80c36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.684+0000 7f53bfa46640 1 -- 172.21.15.19:0/2992131604 >> 172.21.15.19:0/2992131604 conn(0x7f53b80b0880 msgr2=0x7f53b815bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.684+0000 7f53bfa46640 1 -- 172.21.15.19:0/2992131604 shutdown_connections 2023-11-20T06:41:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.684+0000 7f53bfa46640 1 -- 172.21.15.19:0/2992131604 wait complete. 2023-11-20T06:41:19.708 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:41:19.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.844+0000 7fd3bd09e640 1 Processor -- start 2023-11-20T06:41:19.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3bd09e640 1 -- start start 2023-11-20T06:41:19.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3bd09e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd3b80c8cb0 0x7fd3b80cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:19.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3bd09e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b80723d0 con 0x7fd3b81597c0 2023-11-20T06:41:19.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3bd09e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b80717c0 con 0x7fd3b8159ba0 2023-11-20T06:41:19.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3bd09e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b8071aa0 con 0x7fd3b80c8cb0 2023-11-20T06:41:19.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b6d9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd3b81597c0 0x7fd3b80ad6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52042/0 (socket says 172.21.15.19:52042) 2023-11-20T06:41:19.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b6d9d640 1 -- 172.21.15.19:0/3157508185 learned_addr learned my addr 172.21.15.19:0/3157508185 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:19.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b759e640 1 --2- 172.21.15.19:0/3157508185 >> v2:172.21.15.190:3300/0 conn(0x7fd3b80c8cb0 0x7fd3b80cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:19.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b659c640 1 -- 172.21.15.19:0/3157508185 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895979454 0 0) 0x7fd3b80723d0 con 0x7fd3b81597c0 2023-11-20T06:41:19.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b659c640 1 -- 172.21.15.19:0/3157508185 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3a4003530 con 0x7fd3b81597c0 2023-11-20T06:41:19.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b659c640 1 -- 172.21.15.19:0/3157508185 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4277482404 0 0) 0x7fd3a4003530 con 0x7fd3b81597c0 2023-11-20T06:41:19.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b659c640 1 -- 172.21.15.19:0/3157508185 >> v2:172.21.15.190:3300/0 conn(0x7fd3b80c8cb0 msgr2=0x7fd3b80cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:19.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b659c640 1 --2- 172.21.15.19:0/3157508185 >> v2:172.21.15.190:3300/0 conn(0x7fd3b80c8cb0 0x7fd3b80cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b659c640 1 -- 172.21.15.19:0/3157508185 >> v1:172.21.15.190:6789/0 conn(0x7fd3b8159ba0 legacy=0x7fd3b80cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:19.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b659c640 1 -- 172.21.15.19:0/3157508185 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b8071d80 con 0x7fd3b81597c0 2023-11-20T06:41:19.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b659c640 1 -- 172.21.15.19:0/3157508185 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7fd3a8001680 con 0x7fd3b81597c0 2023-11-20T06:41:19.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b659c640 1 -- 172.21.15.19:0/3157508185 >> v1:172.21.15.19:6789/0 conn(0x7fd3b81597c0 legacy=0x7fd3b80ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:19.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b659c640 1 --2- 172.21.15.19:0/3157508185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a4003980 0x7fd3a4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:19.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b659c640 1 --2- 172.21.15.19:0/3157508185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3a40047d0 0x7fd3a4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:19.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b659c640 1 --2- 172.21.15.19:0/3157508185 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3a4005190 0x7fd3a400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:19.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b659c640 1 -- 172.21.15.19:0/3157508185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b8071aa0 con 0x7fd3a40047d0 2023-11-20T06:41:19.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b659c640 1 -- 172.21.15.19:0/3157508185 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a400c030 con 0x7fd3a4003980 2023-11-20T06:41:19.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b659c640 1 -- 172.21.15.19:0/3157508185 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a400c1f0 con 0x7fd3a4005190 2023-11-20T06:41:19.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b759e640 1 --2- 172.21.15.19:0/3157508185 >> v2:172.21.15.190:3300/0 conn(0x7fd3b80c8cb0 0x7fd3b80cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:41:19.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b6d9d640 1 --2- 172.21.15.19:0/3157508185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a4003980 0x7fd3a4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:19.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3affff640 1 --2- 172.21.15.19:0/3157508185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3a40047d0 0x7fd3a4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:19.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b759e640 1 --2- 172.21.15.19:0/3157508185 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3a4005190 0x7fd3a400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:19.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3affff640 1 -- 172.21.15.19:0/3157508185 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3a4005190 msgr2=0x7fd3a400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:19.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3affff640 1 --2- 172.21.15.19:0/3157508185 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3a4005190 0x7fd3a400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3affff640 1 -- 172.21.15.19:0/3157508185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a4003980 msgr2=0x7fd3a4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:19.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3affff640 1 --2- 172.21.15.19:0/3157508185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a4003980 0x7fd3a4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3affff640 1 -- 172.21.15.19:0/3157508185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a4003530 con 0x7fd3a40047d0 2023-11-20T06:41:19.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b759e640 1 -- 172.21.15.19:0/3157508185 reap_dead start 2023-11-20T06:41:19.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.848+0000 7fd3b6d9d640 1 --2- 172.21.15.19:0/3157508185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a4003980 0x7fd3a4003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:41:19.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.852+0000 7fd3affff640 1 --2- 172.21.15.19:0/3157508185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3a40047d0 0x7fd3a4004c50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8159fb0 tx=0x7fd3a001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3469c032c3ec60ce server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:19.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.852+0000 7fd3b659c640 1 -- 172.21.15.19:0/3157508185 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a00052d0 con 0x7fd3a40047d0 2023-11-20T06:41:19.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.852+0000 7fd3b659c640 1 -- 172.21.15.19:0/3157508185 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a00a7050 con 0x7fd3a40047d0 2023-11-20T06:41:19.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.852+0000 7fd3b659c640 1 -- 172.21.15.19:0/3157508185 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0003600 con 0x7fd3a40047d0 2023-11-20T06:41:19.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.852+0000 7fd3bd09e640 1 -- 172.21.15.19:0/3157508185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3a40047d0 msgr2=0x7fd3a4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:19.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.852+0000 7fd3bd09e640 1 --2- 172.21.15.19:0/3157508185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3a40047d0 0x7fd3a4004c50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8159fb0 tx=0x7fd3a001c3a0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.852+0000 7fd3bd09e640 1 -- 172.21.15.19:0/3157508185 shutdown_connections 2023-11-20T06:41:19.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.852+0000 7fd3bd09e640 1 --2- 172.21.15.19:0/3157508185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3a40047d0 0x7fd3a4004c50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.852+0000 7fd3bd09e640 1 -- 172.21.15.19:0/3157508185 >> 172.21.15.19:0/3157508185 conn(0x7fd3b806c190 msgr2=0x7fd3b806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:19.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.852+0000 7fd3bd09e640 1 -- 172.21.15.19:0/3157508185 shutdown_connections 2023-11-20T06:41:19.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.852+0000 7fd3bd09e640 1 -- 172.21.15.19:0/3157508185 wait complete. 2023-11-20T06:41:19.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3bd09e640 1 Processor -- start 2023-11-20T06:41:19.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3bd09e640 1 -- start start 2023-11-20T06:41:19.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3bd09e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3a40047d0 0x7fd3b814e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:19.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3bd09e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3b80c6480 0x7fd3b8150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:19.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3bd09e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3b80c6900 0x7fd3b8150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:19.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3bd09e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80c6df0 con 0x7fd3a40047d0 2023-11-20T06:41:19.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3bd09e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80c70d0 con 0x7fd3b80c6900 2023-11-20T06:41:19.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3bd09e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80c73b0 con 0x7fd3b80c6480 2023-11-20T06:41:19.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3b6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3a40047d0 0x7fd3b814e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3b6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3a40047d0 0x7fd3b814e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44910/0 (socket says 172.21.15.19:44910) 2023-11-20T06:41:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3b6d9d640 1 -- 172.21.15.19:0/319375996 learned_addr learned my addr 172.21.15.19:0/319375996 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3affff640 1 --2- 172.21.15.19:0/319375996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3b80c6480 0x7fd3b8150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3b6d9d640 1 -- 172.21.15.19:0/319375996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3b80c6480 msgr2=0x7fd3b8150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3b759e640 1 --2- 172.21.15.19:0/319375996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3b80c6900 0x7fd3b8150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3b6d9d640 1 --2- 172.21.15.19:0/319375996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3b80c6480 0x7fd3b8150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3b6d9d640 1 -- 172.21.15.19:0/319375996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3b80c6900 msgr2=0x7fd3b8150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3b6d9d640 1 --2- 172.21.15.19:0/319375996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3b80c6900 0x7fd3b8150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3b6d9d640 1 -- 172.21.15.19:0/319375996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b80c7690 con 0x7fd3a40047d0 2023-11-20T06:41:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3b759e640 1 --2- 172.21.15.19:0/319375996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3b80c6900 0x7fd3b8150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3b6d9d640 1 --2- 172.21.15.19:0/319375996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3a40047d0 0x7fd3b814e010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80017b0 tx=0x7fd3a8012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3af7fe640 1 -- 172.21.15.19:0/319375996 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8014750 con 0x7fd3a40047d0 2023-11-20T06:41:19.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3af7fe640 1 -- 172.21.15.19:0/319375996 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a80148b0 con 0x7fd3a40047d0 2023-11-20T06:41:19.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3bd09e640 1 -- 172.21.15.19:0/319375996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b80c7970 con 0x7fd3a40047d0 2023-11-20T06:41:19.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3af7fe640 1 -- 172.21.15.19:0/319375996 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8014c20 con 0x7fd3a40047d0 2023-11-20T06:41:19.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.856+0000 7fd3bd09e640 1 -- 172.21.15.19:0/319375996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b80c7e90 con 0x7fd3a40047d0 2023-11-20T06:41:19.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.860+0000 7fd3bd09e640 1 -- 172.21.15.19:0/319375996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b8074010 con 0x7fd3a40047d0 2023-11-20T06:41:19.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.860+0000 7fd3af7fe640 1 -- 172.21.15.19:0/319375996 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd3a80153e0 con 0x7fd3a40047d0 2023-11-20T06:41:19.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.860+0000 7fd3af7fe640 1 --2- 172.21.15.19:0/319375996 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd3980664a0 0x7fd398068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:19.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.860+0000 7fd3af7fe640 1 -- 172.21.15.19:0/319375996 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd3a8086cf0 con 0x7fd3a40047d0 2023-11-20T06:41:19.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.860+0000 7fd3affff640 1 --2- 172.21.15.19:0/319375996 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd3980664a0 0x7fd398068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:19.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.860+0000 7fd3affff640 1 --2- 172.21.15.19:0/319375996 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd3980664a0 0x7fd398068960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd3b80ce540 tx=0x7fd3a00011a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:19.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:19.864+0000 7fd3af7fe640 1 -- 172.21.15.19:0/319375996 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd3a8053de0 con 0x7fd3a40047d0 2023-11-20T06:41:20.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.024+0000 7fd3bd09e640 1 -- 172.21.15.19:0/319375996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3b80cd3f0 con 0x7fd3a40047d0 2023-11-20T06:41:20.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.024+0000 7fd3af7fe640 1 -- 172.21.15.19:0/319375996 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18347 (secure 0 0 0) 0x7fd3a801c020 con 0x7fd3a40047d0 2023-11-20T06:41:20.030 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:20.030 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:18.680849+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:41:20.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.028+0000 7fd3bd09e640 1 -- 172.21.15.19:0/319375996 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd3980664a0 msgr2=0x7fd398068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:20.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.028+0000 7fd3bd09e640 1 --2- 172.21.15.19:0/319375996 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd3980664a0 0x7fd398068960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd3b80ce540 tx=0x7fd3a00011a0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.028+0000 7fd3bd09e640 1 -- 172.21.15.19:0/319375996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3a40047d0 msgr2=0x7fd3b814e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:20.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.028+0000 7fd3bd09e640 1 --2- 172.21.15.19:0/319375996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3a40047d0 0x7fd3b814e010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80017b0 tx=0x7fd3a8012920 comp rx=0 tx=0).stop 2023-11-20T06:41:20.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.028+0000 7fd3bd09e640 1 -- 172.21.15.19:0/319375996 shutdown_connections 2023-11-20T06:41:20.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.028+0000 7fd3bd09e640 1 --2- 172.21.15.19:0/319375996 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd3980664a0 0x7fd398068960 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.028+0000 7fd3bd09e640 1 --2- 172.21.15.19:0/319375996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3b80c6900 0x7fd3b8150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.028+0000 7fd3bd09e640 1 --2- 172.21.15.19:0/319375996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3b80c6480 0x7fd3b8150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.028+0000 7fd3bd09e640 1 --2- 172.21.15.19:0/319375996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3a40047d0 0x7fd3b814e010 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.028+0000 7fd3bd09e640 1 -- 172.21.15.19:0/319375996 >> 172.21.15.19:0/319375996 conn(0x7fd3b806c190 msgr2=0x7fd3b80ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:20.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.028+0000 7fd3bd09e640 1 -- 172.21.15.19:0/319375996 shutdown_connections 2023-11-20T06:41:20.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.028+0000 7fd3bd09e640 1 -- 172.21.15.19:0/319375996 wait complete. 2023-11-20T06:41:20.053 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:41:20.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.192+0000 7f9a2bb3e640 1 Processor -- start 2023-11-20T06:41:20.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.192+0000 7f9a2bb3e640 1 -- start start 2023-11-20T06:41:20.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.192+0000 7f9a2bb3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a2415cb90 0x7f9a240cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:20.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.192+0000 7f9a2bb3e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9a240d3010 0x7f9a240d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:20.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.192+0000 7f9a2bb3e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a240ce770 con 0x7f9a240d1400 2023-11-20T06:41:20.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.192+0000 7f9a2bb3e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a240d1890 con 0x7f9a240d3010 2023-11-20T06:41:20.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.192+0000 7f9a2bb3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a240d0600 con 0x7f9a2415cb90 2023-11-20T06:41:20.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.192+0000 7f9a2a0db640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9a240d1400 0x7f9a240cd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52054/0 (socket says 172.21.15.19:52054) 2023-11-20T06:41:20.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.192+0000 7f9a2a0db640 1 -- 172.21.15.19:0/403167592 learned_addr learned my addr 172.21.15.19:0/403167592 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:20.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.192+0000 7f9a298da640 1 --2- 172.21.15.19:0/403167592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a2415cb90 0x7f9a240cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:20.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.192+0000 7f9a290d9640 1 --2- 172.21.15.19:0/403167592 >> v2:172.21.15.190:3300/0 conn(0x7f9a240d3010 0x7f9a240d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:20.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.192+0000 7f9a288d8640 1 -- 172.21.15.19:0/403167592 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205012739 0 0) 0x7f9a240ce770 con 0x7f9a240d1400 2023-11-20T06:41:20.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.192+0000 7f9a288d8640 1 -- 172.21.15.19:0/403167592 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a10003530 con 0x7f9a240d1400 2023-11-20T06:41:20.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.192+0000 7f9a298da640 1 -- 172.21.15.19:0/403167592 >> v2:172.21.15.190:3300/0 conn(0x7f9a240d3010 msgr2=0x7f9a240d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:20.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.192+0000 7f9a298da640 1 --2- 172.21.15.19:0/403167592 >> v2:172.21.15.190:3300/0 conn(0x7f9a240d3010 0x7f9a240d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.192+0000 7f9a298da640 1 -- 172.21.15.19:0/403167592 >> v1:172.21.15.19:6789/0 conn(0x7f9a240d1400 legacy=0x7f9a240cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:20.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.192+0000 7f9a298da640 1 -- 172.21.15.19:0/403167592 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a240c6450 con 0x7f9a2415cb90 2023-11-20T06:41:20.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.192+0000 7f9a290d9640 1 --2- 172.21.15.19:0/403167592 >> v2:172.21.15.190:3300/0 conn(0x7f9a240d3010 0x7f9a240d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:41:20.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.196+0000 7f9a298da640 1 --2- 172.21.15.19:0/403167592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a2415cb90 0x7f9a240cfb10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9a200097a0 tx=0x7f9a2001c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40a8fa1ea8d7313d server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:20.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.196+0000 7f9a288d8640 1 -- 172.21.15.19:0/403167592 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a200ac600 con 0x7f9a2415cb90 2023-11-20T06:41:20.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.196+0000 7f9a288d8640 1 -- 172.21.15.19:0/403167592 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a200a8050 con 0x7f9a2415cb90 2023-11-20T06:41:20.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.196+0000 7f9a288d8640 1 -- 172.21.15.19:0/403167592 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a200ac980 con 0x7f9a2415cb90 2023-11-20T06:41:20.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.196+0000 7f9a2bb3e640 1 -- 172.21.15.19:0/403167592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a2415cb90 msgr2=0x7f9a240cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:20.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.196+0000 7f9a2bb3e640 1 --2- 172.21.15.19:0/403167592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a2415cb90 0x7f9a240cfb10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9a200097a0 tx=0x7f9a2001c3a0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.196+0000 7f9a2bb3e640 1 -- 172.21.15.19:0/403167592 shutdown_connections 2023-11-20T06:41:20.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.196+0000 7f9a2bb3e640 1 --2- 172.21.15.19:0/403167592 >> v2:172.21.15.190:3300/0 conn(0x7f9a240d3010 0x7f9a240d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.196+0000 7f9a2bb3e640 1 --2- 172.21.15.19:0/403167592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a2415cb90 0x7f9a240cfb10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.196+0000 7f9a2bb3e640 1 -- 172.21.15.19:0/403167592 >> 172.21.15.19:0/403167592 conn(0x7f9a2409bc50 msgr2=0x7f9a240d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:20.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.196+0000 7f9a2bb3e640 1 -- 172.21.15.19:0/403167592 shutdown_connections 2023-11-20T06:41:20.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.196+0000 7f9a2bb3e640 1 -- 172.21.15.19:0/403167592 wait complete. 2023-11-20T06:41:20.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a2bb3e640 1 Processor -- start 2023-11-20T06:41:20.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a2bb3e640 1 -- start start 2023-11-20T06:41:20.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a2bb3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a240d1400 0x7f9a240c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:20.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a2bb3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a240d3010 0x7f9a2415b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:20.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a2bb3e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a2415cb90 0x7f9a241577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:20.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a2bb3e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2414c2a0 con 0x7f9a240d3010 2023-11-20T06:41:20.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a2bb3e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a240c9fb0 con 0x7f9a2415cb90 2023-11-20T06:41:20.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a2bb3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a240ca290 con 0x7f9a240d1400 2023-11-20T06:41:20.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a290d9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a240d3010 0x7f9a2415b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:20.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a290d9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a240d3010 0x7f9a2415b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44916/0 (socket says 172.21.15.19:44916) 2023-11-20T06:41:20.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a290d9640 1 -- 172.21.15.19:0/3593344008 learned_addr learned my addr 172.21.15.19:0/3593344008 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:20.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a298da640 1 --2- 172.21.15.19:0/3593344008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a240d1400 0x7f9a240c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:20.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a2a0db640 1 --2- 172.21.15.19:0/3593344008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a2415cb90 0x7f9a241577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:20.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a290d9640 1 -- 172.21.15.19:0/3593344008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a240d1400 msgr2=0x7f9a240c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:20.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a290d9640 1 --2- 172.21.15.19:0/3593344008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a240d1400 0x7f9a240c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a290d9640 1 -- 172.21.15.19:0/3593344008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a2415cb90 msgr2=0x7f9a241577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:20.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a290d9640 1 --2- 172.21.15.19:0/3593344008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a2415cb90 0x7f9a241577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a290d9640 1 -- 172.21.15.19:0/3593344008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a14009420 con 0x7f9a240d3010 2023-11-20T06:41:20.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a2a0db640 1 --2- 172.21.15.19:0/3593344008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a2415cb90 0x7f9a241577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:20.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a298da640 1 --2- 172.21.15.19:0/3593344008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a240d1400 0x7f9a240c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:20.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a290d9640 1 --2- 172.21.15.19:0/3593344008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a240d3010 0x7f9a2415b7c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400e980 tx=0x7f9a1400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:20.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a1a7fc640 1 -- 172.21.15.19:0/3593344008 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1400ca00 con 0x7f9a240d3010 2023-11-20T06:41:20.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a1a7fc640 1 -- 172.21.15.19:0/3593344008 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1400cb60 con 0x7f9a240d3010 2023-11-20T06:41:20.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a2bb3e640 1 -- 172.21.15.19:0/3593344008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a200093b0 con 0x7f9a240d3010 2023-11-20T06:41:20.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a1a7fc640 1 -- 172.21.15.19:0/3593344008 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14013470 con 0x7f9a240d3010 2023-11-20T06:41:20.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.200+0000 7f9a2bb3e640 1 -- 172.21.15.19:0/3593344008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a240ca850 con 0x7f9a240d3010 2023-11-20T06:41:20.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.204+0000 7f9a2bb3e640 1 -- 172.21.15.19:0/3593344008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a24074010 con 0x7f9a240d3010 2023-11-20T06:41:20.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.204+0000 7f9a1a7fc640 1 -- 172.21.15.19:0/3593344008 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9a140135d0 con 0x7f9a240d3010 2023-11-20T06:41:20.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.204+0000 7f9a1a7fc640 1 --2- 172.21.15.19:0/3593344008 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9a080664a0 0x7f9a08068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:20.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.204+0000 7f9a1a7fc640 1 -- 172.21.15.19:0/3593344008 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9a140843d0 con 0x7f9a240d3010 2023-11-20T06:41:20.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.204+0000 7f9a298da640 1 --2- 172.21.15.19:0/3593344008 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9a080664a0 0x7f9a08068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:20.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.204+0000 7f9a298da640 1 --2- 172.21.15.19:0/3593344008 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9a080664a0 0x7f9a08068960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a200ae000 tx=0x7f9a20008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:20.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.208+0000 7f9a1a7fc640 1 -- 172.21.15.19:0/3593344008 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9a14051560 con 0x7f9a240d3010 2023-11-20T06:41:20.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.368+0000 7f9a2bb3e640 1 -- 172.21.15.19:0/3593344008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a24150ac0 con 0x7f9a240d3010 2023-11-20T06:41:20.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.368+0000 7f9a1a7fc640 1 -- 172.21.15.19:0/3593344008 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f9a14054b80 con 0x7f9a240d3010 2023-11-20T06:41:20.374 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:20.374 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":25,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:20.306335+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:41:20.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.372+0000 7f9a2bb3e640 1 -- 172.21.15.19:0/3593344008 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9a080664a0 msgr2=0x7f9a08068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:20.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.372+0000 7f9a2bb3e640 1 --2- 172.21.15.19:0/3593344008 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9a080664a0 0x7f9a08068960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a200ae000 tx=0x7f9a20008040 comp rx=0 tx=0).stop 2023-11-20T06:41:20.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.372+0000 7f9a2bb3e640 1 -- 172.21.15.19:0/3593344008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a240d3010 msgr2=0x7f9a2415b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:20.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.372+0000 7f9a2bb3e640 1 --2- 172.21.15.19:0/3593344008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a240d3010 0x7f9a2415b7c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400e980 tx=0x7f9a1400ee40 comp rx=0 tx=0).stop 2023-11-20T06:41:20.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.372+0000 7f9a2bb3e640 1 -- 172.21.15.19:0/3593344008 shutdown_connections 2023-11-20T06:41:20.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.372+0000 7f9a2bb3e640 1 --2- 172.21.15.19:0/3593344008 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9a080664a0 0x7f9a08068960 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.372+0000 7f9a2bb3e640 1 --2- 172.21.15.19:0/3593344008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a2415cb90 0x7f9a241577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.372+0000 7f9a2bb3e640 1 --2- 172.21.15.19:0/3593344008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a240d3010 0x7f9a2415b7c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.372+0000 7f9a2bb3e640 1 --2- 172.21.15.19:0/3593344008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a240d1400 0x7f9a240c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.372+0000 7f9a2bb3e640 1 -- 172.21.15.19:0/3593344008 >> 172.21.15.19:0/3593344008 conn(0x7f9a2409bc50 msgr2=0x7f9a24155d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:20.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.372+0000 7f9a2bb3e640 1 -- 172.21.15.19:0/3593344008 shutdown_connections 2023-11-20T06:41:20.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.372+0000 7f9a2bb3e640 1 -- 172.21.15.19:0/3593344008 wait complete. 2023-11-20T06:41:20.481 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T06:41:20.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.620+0000 7f410b491640 1 Processor -- start 2023-11-20T06:41:20.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.620+0000 7f410b491640 1 -- start start 2023-11-20T06:41:20.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.620+0000 7f410b491640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f410415cb90 0x7f41040cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:20.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.620+0000 7f410b491640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41040ce770 con 0x7f41040d15d0 2023-11-20T06:41:20.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.620+0000 7f410b491640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41040d0600 con 0x7f41040d3010 2023-11-20T06:41:20.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.620+0000 7f410b491640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41040c6450 con 0x7f410415cb90 2023-11-20T06:41:20.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.620+0000 7f4109a2e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f41040d15d0 0x7f41040c6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52058/0 (socket says 172.21.15.19:52058) 2023-11-20T06:41:20.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.620+0000 7f4109a2e640 1 -- 172.21.15.19:0/2710201387 learned_addr learned my addr 172.21.15.19:0/2710201387 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:20.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.620+0000 7f410922d640 1 --2- 172.21.15.19:0/2710201387 >> v2:172.21.15.19:3300/0 conn(0x7f410415cb90 0x7f41040cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:20.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.620+0000 7f40fbfff640 1 -- 172.21.15.19:0/2710201387 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973420161 0 0) 0x7f41040ce770 con 0x7f41040d15d0 2023-11-20T06:41:20.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.620+0000 7f40fbfff640 1 -- 172.21.15.19:0/2710201387 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40f0003530 con 0x7f41040d15d0 2023-11-20T06:41:20.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.620+0000 7f410922d640 1 -- 172.21.15.19:0/2710201387 >> v1:172.21.15.190:6789/0 conn(0x7f41040d3010 legacy=0x7f41040d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:20.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.620+0000 7f410922d640 1 -- 172.21.15.19:0/2710201387 >> v1:172.21.15.19:6789/0 conn(0x7f41040d15d0 legacy=0x7f41040c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:20.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.620+0000 7f410922d640 1 -- 172.21.15.19:0/2710201387 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41040d08a0 con 0x7f410415cb90 2023-11-20T06:41:20.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.624+0000 7f410922d640 1 --2- 172.21.15.19:0/2710201387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f410415cb90 0x7f41040cfb10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f41000097a0 tx=0x7f410001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff77d175a8d5c64b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:20.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.624+0000 7f40fbfff640 1 -- 172.21.15.19:0/2710201387 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41000ac600 con 0x7f410415cb90 2023-11-20T06:41:20.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.624+0000 7f40fbfff640 1 -- 172.21.15.19:0/2710201387 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41000a8050 con 0x7f410415cb90 2023-11-20T06:41:20.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.624+0000 7f40fbfff640 1 -- 172.21.15.19:0/2710201387 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41000ac980 con 0x7f410415cb90 2023-11-20T06:41:20.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.624+0000 7f410b491640 1 -- 172.21.15.19:0/2710201387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f410415cb90 msgr2=0x7f41040cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:20.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.624+0000 7f410b491640 1 --2- 172.21.15.19:0/2710201387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f410415cb90 0x7f41040cfb10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f41000097a0 tx=0x7f410001c3a0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.624+0000 7f410b491640 1 -- 172.21.15.19:0/2710201387 shutdown_connections 2023-11-20T06:41:20.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.624+0000 7f410b491640 1 --2- 172.21.15.19:0/2710201387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f410415cb90 0x7f41040cfb10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.624+0000 7f410b491640 1 -- 172.21.15.19:0/2710201387 >> 172.21.15.19:0/2710201387 conn(0x7f410409bc50 msgr2=0x7f41040d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:20.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.624+0000 7f410b491640 1 -- 172.21.15.19:0/2710201387 shutdown_connections 2023-11-20T06:41:20.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.624+0000 7f410b491640 1 -- 172.21.15.19:0/2710201387 wait complete. 2023-11-20T06:41:20.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f410b491640 1 Processor -- start 2023-11-20T06:41:20.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f410b491640 1 -- start start 2023-11-20T06:41:20.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f410b491640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41040d15d0 0x7f4104156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:20.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f410b491640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41040d3010 0x7f410406bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:20.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f410b491640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f410415cb90 0x7f41040b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:20.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f410b491640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4104159c80 con 0x7f41040d3010 2023-11-20T06:41:20.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f410b491640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410406c000 con 0x7f410415cb90 2023-11-20T06:41:20.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f410b491640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41041593e0 con 0x7f41040d15d0 2023-11-20T06:41:20.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f4108a2c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41040d3010 0x7f410406bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:20.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f4108a2c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41040d3010 0x7f410406bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44936/0 (socket says 172.21.15.19:44936) 2023-11-20T06:41:20.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f4108a2c640 1 -- 172.21.15.19:0/3659159686 learned_addr learned my addr 172.21.15.19:0/3659159686 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:20.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f4109a2e640 1 --2- 172.21.15.19:0/3659159686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f410415cb90 0x7f41040b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:20.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f410922d640 1 --2- 172.21.15.19:0/3659159686 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41040d15d0 0x7f4104156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:20.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f4108a2c640 1 -- 172.21.15.19:0/3659159686 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41040d15d0 msgr2=0x7f4104156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:20.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f4108a2c640 1 --2- 172.21.15.19:0/3659159686 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41040d15d0 0x7f4104156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f4108a2c640 1 -- 172.21.15.19:0/3659159686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f410415cb90 msgr2=0x7f41040b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:20.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f4108a2c640 1 --2- 172.21.15.19:0/3659159686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f410415cb90 0x7f41040b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f4108a2c640 1 -- 172.21.15.19:0/3659159686 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41000093b0 con 0x7f41040d3010 2023-11-20T06:41:20.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f410922d640 1 --2- 172.21.15.19:0/3659159686 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41040d15d0 0x7f4104156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:20.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f4109a2e640 1 --2- 172.21.15.19:0/3659159686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f410415cb90 0x7f41040b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:20.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f4108a2c640 1 --2- 172.21.15.19:0/3659159686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41040d3010 0x7f410406bac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f40f400c500 tx=0x7f40f400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:20.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f40f9ffb640 1 -- 172.21.15.19:0/3659159686 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4005220 con 0x7f41040d3010 2023-11-20T06:41:20.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f40f9ffb640 1 -- 172.21.15.19:0/3659159686 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f4005380 con 0x7f41040d3010 2023-11-20T06:41:20.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f40f9ffb640 1 -- 172.21.15.19:0/3659159686 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4007270 con 0x7f41040d3010 2023-11-20T06:41:20.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f410b491640 1 -- 172.21.15.19:0/3659159686 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41041596c0 con 0x7f41040d3010 2023-11-20T06:41:20.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.628+0000 7f410b491640 1 -- 172.21.15.19:0/3659159686 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4104154280 con 0x7f41040d3010 2023-11-20T06:41:20.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.632+0000 7f410b491640 1 -- 172.21.15.19:0/3659159686 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4104159ff0 con 0x7f41040d3010 2023-11-20T06:41:20.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.632+0000 7f40f9ffb640 1 -- 172.21.15.19:0/3659159686 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f40f40073d0 con 0x7f41040d3010 2023-11-20T06:41:20.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.632+0000 7f40f9ffb640 1 --2- 172.21.15.19:0/3659159686 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f40e80664a0 0x7f40e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:20.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.632+0000 7f40f9ffb640 1 -- 172.21.15.19:0/3659159686 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f40f4083af0 con 0x7f41040d3010 2023-11-20T06:41:20.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.632+0000 7f410922d640 1 --2- 172.21.15.19:0/3659159686 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f40e80664a0 0x7f40e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:20.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.632+0000 7f410922d640 1 --2- 172.21.15.19:0/3659159686 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f40e80664a0 0x7f40e8068960 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f41000ae000 tx=0x7f41000a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:20.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.636+0000 7f40f9ffb640 1 -- 172.21.15.19:0/3659159686 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f40f4050bf0 con 0x7f41040d3010 2023-11-20T06:41:20.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.828+0000 7f410b491640 1 -- 172.21.15.19:0/3659159686 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4104074010 con 0x7f41040d3010 2023-11-20T06:41:20.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.828+0000 7f40f9ffb640 1 -- 172.21.15.19:0/3659159686 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f40f4054210 con 0x7f41040d3010 2023-11-20T06:41:20.833 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:20.834 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/212787745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":212787745},{"type":"v1","addr":"172.21.15.190:6836","nonce":212787745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1874314285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1874314285},{"type":"v1","addr":"172.21.15.190:6837","nonce":1874314285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3845638593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3845638593},{"type":"v1","addr":"172.21.15.19:6833","nonce":3845638593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T06:41:13.620144+0000","modified":"2023-11-20T06:41:18.681077+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/1973335825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1973335825},{"type":"v1","addr":"172.21.15.19:6835","nonce":1973335825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-20T06:41:20.834 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 7 2023-11-20T06:41:20.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.832+0000 7f410b491640 1 -- 172.21.15.19:0/3659159686 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f40e80664a0 msgr2=0x7f40e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:20.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.832+0000 7f410b491640 1 --2- 172.21.15.19:0/3659159686 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f40e80664a0 0x7f40e8068960 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f41000ae000 tx=0x7f41000a7000 comp rx=0 tx=0).stop 2023-11-20T06:41:20.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.832+0000 7f410b491640 1 -- 172.21.15.19:0/3659159686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41040d3010 msgr2=0x7f410406bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:20.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.832+0000 7f410b491640 1 --2- 172.21.15.19:0/3659159686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41040d3010 0x7f410406bac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f40f400c500 tx=0x7f40f400c9c0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.832+0000 7f410b491640 1 -- 172.21.15.19:0/3659159686 shutdown_connections 2023-11-20T06:41:20.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.832+0000 7f410b491640 1 --2- 172.21.15.19:0/3659159686 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f40e80664a0 0x7f40e8068960 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.832+0000 7f410b491640 1 --2- 172.21.15.19:0/3659159686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f410415cb90 0x7f41040b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.832+0000 7f410b491640 1 --2- 172.21.15.19:0/3659159686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41040d3010 0x7f410406bac0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.832+0000 7f410b491640 1 --2- 172.21.15.19:0/3659159686 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41040d15d0 0x7f4104156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:20.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.832+0000 7f410b491640 1 -- 172.21.15.19:0/3659159686 >> 172.21.15.19:0/3659159686 conn(0x7f410409bc50 msgr2=0x7f4104157e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:20.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.832+0000 7f410b491640 1 -- 172.21.15.19:0/3659159686 shutdown_connections 2023-11-20T06:41:20.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.832+0000 7f410b491640 1 -- 172.21.15.19:0/3659159686 wait complete. 2023-11-20T06:41:20.854 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:41:20.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.992+0000 7fc16790f640 1 Processor -- start 2023-11-20T06:41:20.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.992+0000 7fc16790f640 1 -- start start 2023-11-20T06:41:20.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.992+0000 7fc16790f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc160070c40 0x7fc16015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:20.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.992+0000 7fc16790f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc16015be60 con 0x7fc1600b4020 2023-11-20T06:41:20.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.992+0000 7fc16790f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc16015c1f0 con 0x7fc1600b07f0 2023-11-20T06:41:20.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.992+0000 7fc16790f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc16015b3b0 con 0x7fc160070c40 2023-11-20T06:41:20.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.992+0000 7fc164eaa640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc1600b4020 0x7fc1600b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52072/0 (socket says 172.21.15.19:52072) 2023-11-20T06:41:20.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.992+0000 7fc164eaa640 1 -- 172.21.15.19:0/3396625076 learned_addr learned my addr 172.21.15.19:0/3396625076 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:21.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc157fff640 1 -- 172.21.15.19:0/3396625076 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583174817 0 0) 0x7fc16015be60 con 0x7fc1600b4020 2023-11-20T06:41:21.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc1656ab640 1 --2- 172.21.15.19:0/3396625076 >> v2:172.21.15.190:3300/0 conn(0x7fc160070c40 0x7fc16015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc157fff640 1 -- 172.21.15.19:0/3396625076 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc14c003530 con 0x7fc1600b4020 2023-11-20T06:41:21.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc157fff640 1 -- 172.21.15.19:0/3396625076 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4019284136 0 0) 0x7fc14c003530 con 0x7fc1600b4020 2023-11-20T06:41:21.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc157fff640 1 -- 172.21.15.19:0/3396625076 >> v2:172.21.15.190:3300/0 conn(0x7fc160070c40 msgr2=0x7fc16015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:21.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc157fff640 1 --2- 172.21.15.19:0/3396625076 >> v2:172.21.15.190:3300/0 conn(0x7fc160070c40 0x7fc16015ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc157fff640 1 -- 172.21.15.19:0/3396625076 >> v1:172.21.15.190:6789/0 conn(0x7fc1600b07f0 legacy=0x7fc160164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc157fff640 1 -- 172.21.15.19:0/3396625076 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc160071020 con 0x7fc1600b4020 2023-11-20T06:41:21.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc157fff640 1 -- 172.21.15.19:0/3396625076 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7fc150001680 con 0x7fc1600b4020 2023-11-20T06:41:21.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc157fff640 1 -- 172.21.15.19:0/3396625076 >> v1:172.21.15.19:6789/0 conn(0x7fc1600b4020 legacy=0x7fc1600b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc157fff640 1 --2- 172.21.15.19:0/3396625076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc14c003980 0x7fc14c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc157fff640 1 --2- 172.21.15.19:0/3396625076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc14c004380 0x7fc14c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc157fff640 1 --2- 172.21.15.19:0/3396625076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc14c0050f0 0x7fc14c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc157fff640 1 -- 172.21.15.19:0/3396625076 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16015b3b0 con 0x7fc14c003980 2023-11-20T06:41:21.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc157fff640 1 -- 172.21.15.19:0/3396625076 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c00c030 con 0x7fc14c0050f0 2023-11-20T06:41:21.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc157fff640 1 -- 172.21.15.19:0/3396625076 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c00c1f0 con 0x7fc14c004380 2023-11-20T06:41:21.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc1656ab640 1 --2- 172.21.15.19:0/3396625076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc14c003980 0x7fc14c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc165eac640 1 --2- 172.21.15.19:0/3396625076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc14c0050f0 0x7fc14c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc164eaa640 1 --2- 172.21.15.19:0/3396625076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc14c004380 0x7fc14c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc1656ab640 1 -- 172.21.15.19:0/3396625076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc14c004380 msgr2=0x7fc14c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:21.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc1656ab640 1 --2- 172.21.15.19:0/3396625076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc14c004380 0x7fc14c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc1656ab640 1 -- 172.21.15.19:0/3396625076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc14c0050f0 msgr2=0x7fc14c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:21.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc1656ab640 1 --2- 172.21.15.19:0/3396625076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc14c0050f0 0x7fc14c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc1656ab640 1 -- 172.21.15.19:0/3396625076 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c003530 con 0x7fc14c003980 2023-11-20T06:41:21.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc165eac640 1 --2- 172.21.15.19:0/3396625076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc14c0050f0 0x7fc14c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:21.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc165eac640 1 -- 172.21.15.19:0/3396625076 reap_dead start 2023-11-20T06:41:21.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:20.996+0000 7fc1656ab640 1 --2- 172.21.15.19:0/3396625076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc14c003980 0x7fc14c003d60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009ae0 tx=0x7fc15c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb060066c21713c server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:21.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.000+0000 7fc157fff640 1 -- 172.21.15.19:0/3396625076 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c0a5530 con 0x7fc14c003980 2023-11-20T06:41:21.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.000+0000 7fc157fff640 1 -- 172.21.15.19:0/3396625076 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15c0a5690 con 0x7fc14c003980 2023-11-20T06:41:21.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.000+0000 7fc157fff640 1 -- 172.21.15.19:0/3396625076 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c0a5a80 con 0x7fc14c003980 2023-11-20T06:41:21.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.000+0000 7fc16790f640 1 -- 172.21.15.19:0/3396625076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc14c003980 msgr2=0x7fc14c003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.000+0000 7fc16790f640 1 --2- 172.21.15.19:0/3396625076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc14c003980 0x7fc14c003d60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009ae0 tx=0x7fc15c01ca50 comp rx=0 tx=0).stop 2023-11-20T06:41:21.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.000+0000 7fc16790f640 1 -- 172.21.15.19:0/3396625076 shutdown_connections 2023-11-20T06:41:21.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.000+0000 7fc16790f640 1 --2- 172.21.15.19:0/3396625076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc14c003980 0x7fc14c003d60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.000+0000 7fc16790f640 1 -- 172.21.15.19:0/3396625076 >> 172.21.15.19:0/3396625076 conn(0x7fc16006c190 msgr2=0x7fc16006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:21.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.000+0000 7fc16790f640 1 -- 172.21.15.19:0/3396625076 shutdown_connections 2023-11-20T06:41:21.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.000+0000 7fc16790f640 1 -- 172.21.15.19:0/3396625076 wait complete. 2023-11-20T06:41:21.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.000+0000 7fc16790f640 1 Processor -- start 2023-11-20T06:41:21.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.000+0000 7fc16790f640 1 -- start start 2023-11-20T06:41:21.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.000+0000 7fc16790f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc14c003980 0x7fc1600c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.000+0000 7fc16790f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1600cb300 0x7fc1601f8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.000+0000 7fc16790f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1600c7190 0x7fc1600c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.000+0000 7fc16790f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1601f8c80 con 0x7fc14c003980 2023-11-20T06:41:21.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.000+0000 7fc16790f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc160147c60 con 0x7fc1600cb300 2023-11-20T06:41:21.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.000+0000 7fc16790f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc160147f40 con 0x7fc1600c7190 2023-11-20T06:41:21.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.000+0000 7fc1656ab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc14c003980 0x7fc1600c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.004+0000 7fc1656ab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc14c003980 0x7fc1600c8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44958/0 (socket says 172.21.15.19:44958) 2023-11-20T06:41:21.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.004+0000 7fc1656ab640 1 -- 172.21.15.19:0/4089427212 learned_addr learned my addr 172.21.15.19:0/4089427212 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:21.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.004+0000 7fc164eaa640 1 --2- 172.21.15.19:0/4089427212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1600cb300 0x7fc1601f8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.004+0000 7fc165eac640 1 --2- 172.21.15.19:0/4089427212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1600c7190 0x7fc1600c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.004+0000 7fc1656ab640 1 -- 172.21.15.19:0/4089427212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1600c7190 msgr2=0x7fc1600c4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.004+0000 7fc1656ab640 1 --2- 172.21.15.19:0/4089427212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1600c7190 0x7fc1600c4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.004+0000 7fc1656ab640 1 -- 172.21.15.19:0/4089427212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1600cb300 msgr2=0x7fc1601f8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.004+0000 7fc1656ab640 1 --2- 172.21.15.19:0/4089427212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1600cb300 0x7fc1601f8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.004+0000 7fc1656ab640 1 -- 172.21.15.19:0/4089427212 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc160148220 con 0x7fc14c003980 2023-11-20T06:41:21.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.004+0000 7fc1656ab640 1 --2- 172.21.15.19:0/4089427212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc14c003980 0x7fc1600c8490 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009ae0 tx=0x7fc15c0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:21.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.004+0000 7fc155ffb640 1 -- 172.21.15.19:0/4089427212 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c00f000 con 0x7fc14c003980 2023-11-20T06:41:21.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.004+0000 7fc155ffb640 1 -- 172.21.15.19:0/4089427212 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15c0a5d80 con 0x7fc14c003980 2023-11-20T06:41:21.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.004+0000 7fc155ffb640 1 -- 172.21.15.19:0/4089427212 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c004260 con 0x7fc14c003980 2023-11-20T06:41:21.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.004+0000 7fc16790f640 1 -- 172.21.15.19:0/4089427212 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc160148500 con 0x7fc14c003980 2023-11-20T06:41:21.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.004+0000 7fc16790f640 1 -- 172.21.15.19:0/4089427212 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1600c7640 con 0x7fc14c003980 2023-11-20T06:41:21.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.004+0000 7fc16790f640 1 -- 172.21.15.19:0/4089427212 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc160074010 con 0x7fc14c003980 2023-11-20T06:41:21.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.004+0000 7fc155ffb640 1 -- 172.21.15.19:0/4089427212 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc15c0b4070 con 0x7fc14c003980 2023-11-20T06:41:21.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.008+0000 7fc155ffb640 1 --2- 172.21.15.19:0/4089427212 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc1440664d0 0x7fc144068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.008+0000 7fc155ffb640 1 -- 172.21.15.19:0/4089427212 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc15c11dfe0 con 0x7fc14c003980 2023-11-20T06:41:21.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.008+0000 7fc164eaa640 1 --2- 172.21.15.19:0/4089427212 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc1440664d0 0x7fc144068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.008+0000 7fc164eaa640 1 --2- 172.21.15.19:0/4089427212 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc1440664d0 0x7fc144068990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc150001ec0 tx=0x7fc150009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:21.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.012+0000 7fc155ffb640 1 -- 172.21.15.19:0/4089427212 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc15c0eb130 con 0x7fc14c003980 2023-11-20T06:41:21.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.168+0000 7fc16790f640 1 -- 172.21.15.19:0/4089427212 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1600c4140 con 0x7fc14c003980 2023-11-20T06:41:21.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.168+0000 7fc155ffb640 1 -- 172.21.15.19:0/4089427212 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18334 (secure 0 0 0) 0x7fc15c0ee750 con 0x7fc14c003980 2023-11-20T06:41:21.175 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:21.175 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":25,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:20.306335+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:41:21.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.172+0000 7fc16790f640 1 -- 172.21.15.19:0/4089427212 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc1440664d0 msgr2=0x7fc144068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.172+0000 7fc16790f640 1 --2- 172.21.15.19:0/4089427212 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc1440664d0 0x7fc144068990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc150001ec0 tx=0x7fc150009040 comp rx=0 tx=0).stop 2023-11-20T06:41:21.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.172+0000 7fc16790f640 1 -- 172.21.15.19:0/4089427212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc14c003980 msgr2=0x7fc1600c8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.172+0000 7fc16790f640 1 --2- 172.21.15.19:0/4089427212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc14c003980 0x7fc1600c8490 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009ae0 tx=0x7fc15c0197f0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.172+0000 7fc16790f640 1 -- 172.21.15.19:0/4089427212 shutdown_connections 2023-11-20T06:41:21.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.172+0000 7fc16790f640 1 --2- 172.21.15.19:0/4089427212 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc1440664d0 0x7fc144068990 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.172+0000 7fc16790f640 1 --2- 172.21.15.19:0/4089427212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1600c7190 0x7fc1600c4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.172+0000 7fc16790f640 1 --2- 172.21.15.19:0/4089427212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1600cb300 0x7fc1601f8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.172+0000 7fc16790f640 1 --2- 172.21.15.19:0/4089427212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc14c003980 0x7fc1600c8490 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.172+0000 7fc16790f640 1 -- 172.21.15.19:0/4089427212 >> 172.21.15.19:0/4089427212 conn(0x7fc16006c190 msgr2=0x7fc16015a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:21.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.172+0000 7fc16790f640 1 -- 172.21.15.19:0/4089427212 shutdown_connections 2023-11-20T06:41:21.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.172+0000 7fc16790f640 1 -- 172.21.15.19:0/4089427212 wait complete. 2023-11-20T06:41:21.597 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-20T06:41:13.620144+0000', 'modified': '2023-11-20T06:41:18.681077+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.19:6835/1973335825', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6834', 'nonce': 1973335825}, {'type': 'v1', 'addr': '172.21.15.19:6835', 'nonce': 1973335825}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-11-20T06:41:21.597 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-20T06:41:21.598 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-20T06:41:21.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.736+0000 7eff208d6640 1 Processor -- start 2023-11-20T06:41:21.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff208d6640 1 -- start start 2023-11-20T06:41:21.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff208d6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7eff1c159ba0 0x7eff1c0cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff208d6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c0723d0 con 0x7eff1c1597c0 2023-11-20T06:41:21.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff208d6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c0717c0 con 0x7eff1c0c8cb0 2023-11-20T06:41:21.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff208d6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c071aa0 con 0x7eff1c159ba0 2023-11-20T06:41:21.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1a59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7eff1c1597c0 0x7eff1c0ad6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52078/0 (socket says 172.21.15.19:52078) 2023-11-20T06:41:21.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1a59c640 1 -- 172.21.15.19:0/3670896061 learned_addr learned my addr 172.21.15.19:0/3670896061 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1959a640 1 -- 172.21.15.19:0/3670896061 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664204339 0 0) 0x7eff1c0723d0 con 0x7eff1c1597c0 2023-11-20T06:41:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1959a640 1 -- 172.21.15.19:0/3670896061 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff04003530 con 0x7eff1c1597c0 2023-11-20T06:41:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff19d9b640 1 --2- 172.21.15.19:0/3670896061 >> v2:172.21.15.190:3300/0 conn(0x7eff1c159ba0 0x7eff1c0cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1959a640 1 -- 172.21.15.19:0/3670896061 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2522732809 0 0) 0x7eff04003530 con 0x7eff1c1597c0 2023-11-20T06:41:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1959a640 1 -- 172.21.15.19:0/3670896061 >> v2:172.21.15.190:3300/0 conn(0x7eff1c159ba0 msgr2=0x7eff1c0cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1959a640 1 --2- 172.21.15.19:0/3670896061 >> v2:172.21.15.190:3300/0 conn(0x7eff1c159ba0 0x7eff1c0cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1959a640 1 -- 172.21.15.19:0/3670896061 >> v1:172.21.15.190:6789/0 conn(0x7eff1c0c8cb0 legacy=0x7eff1c0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1959a640 1 -- 172.21.15.19:0/3670896061 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c071d80 con 0x7eff1c1597c0 2023-11-20T06:41:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1959a640 1 -- 172.21.15.19:0/3670896061 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7eff0c001680 con 0x7eff1c1597c0 2023-11-20T06:41:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1959a640 1 -- 172.21.15.19:0/3670896061 >> v1:172.21.15.19:6789/0 conn(0x7eff1c1597c0 legacy=0x7eff1c0ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1959a640 1 --2- 172.21.15.19:0/3670896061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff04003980 0x7eff04003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1959a640 1 --2- 172.21.15.19:0/3670896061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff040047d0 0x7eff04004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1959a640 1 --2- 172.21.15.19:0/3670896061 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff04005190 0x7eff0400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1959a640 1 -- 172.21.15.19:0/3670896061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c071aa0 con 0x7eff04003980 2023-11-20T06:41:21.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1959a640 1 -- 172.21.15.19:0/3670896061 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0400c030 con 0x7eff040047d0 2023-11-20T06:41:21.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1959a640 1 -- 172.21.15.19:0/3670896061 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0400c1f0 con 0x7eff04005190 2023-11-20T06:41:21.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1a59c640 1 --2- 172.21.15.19:0/3670896061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff04003980 0x7eff04003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff19d9b640 1 --2- 172.21.15.19:0/3670896061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff040047d0 0x7eff04004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1ad9d640 1 --2- 172.21.15.19:0/3670896061 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff04005190 0x7eff0400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1a59c640 1 -- 172.21.15.19:0/3670896061 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff04005190 msgr2=0x7eff0400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:21.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1a59c640 1 --2- 172.21.15.19:0/3670896061 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff04005190 0x7eff0400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1a59c640 1 -- 172.21.15.19:0/3670896061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff040047d0 msgr2=0x7eff04004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:21.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1a59c640 1 --2- 172.21.15.19:0/3670896061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff040047d0 0x7eff04004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1a59c640 1 -- 172.21.15.19:0/3670896061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff04003530 con 0x7eff04003980 2023-11-20T06:41:21.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.740+0000 7eff1ad9d640 1 -- 172.21.15.19:0/3670896061 reap_dead start 2023-11-20T06:41:21.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.744+0000 7eff1a59c640 1 --2- 172.21.15.19:0/3670896061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff04003980 0x7eff04003da0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7eff0c007cb0 tx=0x7eff0c01ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814d88db0d73f07b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:21.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.744+0000 7eff1959a640 1 -- 172.21.15.19:0/3670896061 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c005ae0 con 0x7eff04003980 2023-11-20T06:41:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.744+0000 7eff1959a640 1 -- 172.21.15.19:0/3670896061 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c005c60 con 0x7eff04003980 2023-11-20T06:41:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.744+0000 7eff1959a640 1 -- 172.21.15.19:0/3670896061 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0a78a0 con 0x7eff04003980 2023-11-20T06:41:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.744+0000 7eff208d6640 1 -- 172.21.15.19:0/3670896061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff04003980 msgr2=0x7eff04003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.744+0000 7eff208d6640 1 --2- 172.21.15.19:0/3670896061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff04003980 0x7eff04003da0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7eff0c007cb0 tx=0x7eff0c01ec20 comp rx=0 tx=0).stop 2023-11-20T06:41:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.744+0000 7eff208d6640 1 -- 172.21.15.19:0/3670896061 shutdown_connections 2023-11-20T06:41:21.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.744+0000 7eff208d6640 1 --2- 172.21.15.19:0/3670896061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff04003980 0x7eff04003da0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.744+0000 7eff208d6640 1 -- 172.21.15.19:0/3670896061 >> 172.21.15.19:0/3670896061 conn(0x7eff1c06c190 msgr2=0x7eff1c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:21.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.744+0000 7eff208d6640 1 -- 172.21.15.19:0/3670896061 shutdown_connections 2023-11-20T06:41:21.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.744+0000 7eff208d6640 1 -- 172.21.15.19:0/3670896061 wait complete. 2023-11-20T06:41:21.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff208d6640 1 Processor -- start 2023-11-20T06:41:21.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff208d6640 1 -- start start 2023-11-20T06:41:21.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff208d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff04003980 0x7eff1c0c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff208d6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff1c157480 0x7eff1c157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff208d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff1c14d750 0x7eff1c14dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff208d6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c14e110 con 0x7eff1c14d750 2023-11-20T06:41:21.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff208d6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c1f6010 con 0x7eff1c157480 2023-11-20T06:41:21.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff208d6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c155af0 con 0x7eff04003980 2023-11-20T06:41:21.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff1ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff1c14d750 0x7eff1c14dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff1ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff1c14d750 0x7eff1c14dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44964/0 (socket says 172.21.15.19:44964) 2023-11-20T06:41:21.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff1ad9d640 1 -- 172.21.15.19:0/2975863041 learned_addr learned my addr 172.21.15.19:0/2975863041 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:21.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff19d9b640 1 --2- 172.21.15.19:0/2975863041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff1c157480 0x7eff1c157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff1a59c640 1 --2- 172.21.15.19:0/2975863041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff04003980 0x7eff1c0c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff1ad9d640 1 -- 172.21.15.19:0/2975863041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff04003980 msgr2=0x7eff1c0c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff1ad9d640 1 --2- 172.21.15.19:0/2975863041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff04003980 0x7eff1c0c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff1ad9d640 1 -- 172.21.15.19:0/2975863041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff1c157480 msgr2=0x7eff1c157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff1ad9d640 1 --2- 172.21.15.19:0/2975863041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff1c157480 0x7eff1c157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff1ad9d640 1 -- 172.21.15.19:0/2975863041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c1f56e0 con 0x7eff1c14d750 2023-11-20T06:41:21.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff1ad9d640 1 --2- 172.21.15.19:0/2975863041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff1c14d750 0x7eff1c14dbd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0c9140 tx=0x7eff1400fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:21.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff0affd640 1 -- 172.21.15.19:0/2975863041 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14006b60 con 0x7eff1c14d750 2023-11-20T06:41:21.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff0affd640 1 -- 172.21.15.19:0/2975863041 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff14006ce0 con 0x7eff1c14d750 2023-11-20T06:41:21.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff208d6640 1 -- 172.21.15.19:0/2975863041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c1f59c0 con 0x7eff1c14d750 2023-11-20T06:41:21.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff0affd640 1 -- 172.21.15.19:0/2975863041 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14003bc0 con 0x7eff1c14d750 2023-11-20T06:41:21.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.748+0000 7eff208d6640 1 -- 172.21.15.19:0/2975863041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c1f64a0 con 0x7eff1c14d750 2023-11-20T06:41:21.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.752+0000 7eff0affd640 1 -- 172.21.15.19:0/2975863041 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7eff14003d20 con 0x7eff1c14d750 2023-11-20T06:41:21.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.752+0000 7eff0affd640 1 --2- 172.21.15.19:0/2975863041 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7efefc0664d0 0x7efefc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.752+0000 7eff0affd640 1 -- 172.21.15.19:0/2975863041 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7eff14083750 con 0x7eff1c14d750 2023-11-20T06:41:21.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.752+0000 7eff1a59c640 1 --2- 172.21.15.19:0/2975863041 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7efefc0664d0 0x7efefc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.752+0000 7eff23c4f000 1 Processor -- start 2023-11-20T06:41:21.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.752+0000 7eff23c4f000 1 -- start start 2023-11-20T06:41:21.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.752+0000 7eff1a59c640 1 --2- 172.21.15.19:0/2975863041 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7efefc0664d0 0x7efefc068990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0ad000 tx=0x7eff0c0b3040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:21.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff23c4f000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fbcaaf840 0x555fbcaafc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff23c4f000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbcab0160 0x555fbca656b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff23c4f000 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbca65bf0 0x555fbca65fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff23c4f000 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fbc85acc0 con 0x555fbca65bf0 2023-11-20T06:41:21.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff23c4f000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fbc8bd8e0 con 0x555fbcaaf840 2023-11-20T06:41:21.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff23c4f000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x555fbc8bae10 con 0x555fbcab0160 2023-11-20T06:41:21.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff1ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbca65bf0 0x555fbca65fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff1ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbca65bf0 0x555fbca65fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44970/0 (socket says 172.21.15.19:44970) 2023-11-20T06:41:21.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff1ad9d640 1 -- 172.21.15.19:0/1233062990 learned_addr learned my addr 172.21.15.19:0/1233062990 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:21.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff1a59c640 1 --2- 172.21.15.19:0/1233062990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fbcaaf840 0x555fbcaafc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff19d9b640 1 --2- 172.21.15.19:0/1233062990 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbcab0160 0x555fbca656b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff1ad9d640 1 -- 172.21.15.19:0/1233062990 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbcab0160 msgr2=0x555fbca656b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:21.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff1ad9d640 1 --2- 172.21.15.19:0/1233062990 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbcab0160 0x555fbca656b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff1ad9d640 1 -- 172.21.15.19:0/1233062990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fbcaaf840 msgr2=0x555fbcaafc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:21.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff1ad9d640 1 --2- 172.21.15.19:0/1233062990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fbcaaf840 0x555fbcaafc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff1ad9d640 1 -- 172.21.15.19:0/1233062990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fbc5af890 con 0x555fbca65bf0 2023-11-20T06:41:21.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff1ad9d640 1 --2- 172.21.15.19:0/1233062990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbca65bf0 0x555fbca65fd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff14005040 tx=0x7eff140545b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592bdd4038e75836 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:21.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7efefbfff640 1 -- 172.21.15.19:0/1233062990 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1405c800 con 0x555fbca65bf0 2023-11-20T06:41:21.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7efefbfff640 1 -- 172.21.15.19:0/1233062990 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff14052950 con 0x555fbca65bf0 2023-11-20T06:41:21.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7efefbfff640 1 -- 172.21.15.19:0/1233062990 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1405c370 con 0x555fbca65bf0 2023-11-20T06:41:21.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff23c4f000 1 -- 172.21.15.19:0/1233062990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbca65bf0 msgr2=0x555fbca65fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff23c4f000 1 --2- 172.21.15.19:0/1233062990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbca65bf0 0x555fbca65fd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff14005040 tx=0x7eff140545b0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff23c4f000 1 -- 172.21.15.19:0/1233062990 shutdown_connections 2023-11-20T06:41:21.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff23c4f000 1 --2- 172.21.15.19:0/1233062990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbca65bf0 0x555fbca65fd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff23c4f000 1 --2- 172.21.15.19:0/1233062990 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbcab0160 0x555fbca656b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff23c4f000 1 --2- 172.21.15.19:0/1233062990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fbcaaf840 0x555fbcaafc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff23c4f000 1 -- 172.21.15.19:0/1233062990 >> 172.21.15.19:0/1233062990 conn(0x555fbca5cf60 msgr2=0x555fbca63f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:21.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff23c4f000 1 -- 172.21.15.19:0/1233062990 shutdown_connections 2023-11-20T06:41:21.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff23c4f000 1 -- 172.21.15.19:0/1233062990 wait complete. 2023-11-20T06:41:21.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff23c4f000 1 -- start start 2023-11-20T06:41:21.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.756+0000 7eff23c4f000 1 Processor -- start 2023-11-20T06:41:21.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff23c4f000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbca65bf0 0x555fbcaaf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff23c4f000 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcaaf840 0x555fbca6ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff23c4f000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fbcab0160 0x555fbca6b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff23c4f000 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fbc8b6700 con 0x555fbcaaf840 2023-11-20T06:41:21.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff23c4f000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fbc875d10 con 0x555fbcab0160 2023-11-20T06:41:21.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff23c4f000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x555fbc8759b0 con 0x555fbca65bf0 2023-11-20T06:41:21.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff23c4f000 10 client.0 _ll_register_callbacks cb 0x555fbca51330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-20T06:41:21.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff19d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcaaf840 0x555fbca6ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff19d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcaaf840 0x555fbca6ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44984/0 (socket says 172.21.15.19:44984) 2023-11-20T06:41:21.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff19d9b640 1 -- 172.21.15.19:0/1243189177 learned_addr learned my addr 172.21.15.19:0/1243189177 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:21.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff1a59c640 1 --2- 172.21.15.19:0/1243189177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbca65bf0 0x555fbcaaf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff1ad9d640 1 --2- 172.21.15.19:0/1243189177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fbcab0160 0x555fbca6b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff19d9b640 1 -- 172.21.15.19:0/1243189177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbca65bf0 msgr2=0x555fbcaaf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:21.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff19d9b640 1 --2- 172.21.15.19:0/1243189177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbca65bf0 0x555fbcaaf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff19d9b640 1 -- 172.21.15.19:0/1243189177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fbcab0160 msgr2=0x555fbca6b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:21.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff19d9b640 1 --2- 172.21.15.19:0/1243189177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fbcab0160 0x555fbca6b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff19d9b640 1 -- 172.21.15.19:0/1243189177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c1f64a0 con 0x555fbcaaf840 2023-11-20T06:41:21.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff1a59c640 1 --2- 172.21.15.19:0/1243189177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbca65bf0 0x555fbcaaf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:21.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff19d9b640 1 --2- 172.21.15.19:0/1243189177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcaaf840 0x555fbca6ad10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7eff10017750 tx=0x7eff10017c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad48855e3338661b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:21.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7efef97fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2023-11-20T06:41:21.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7efef97fa640 1 -- 172.21.15.19:0/1243189177 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff10004240 con 0x555fbcaaf840 2023-11-20T06:41:21.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7efef97fa640 1 -- 172.21.15.19:0/1243189177 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7eff10021de0 con 0x555fbcaaf840 2023-11-20T06:41:21.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff23c4f000 1 -- 172.21.15.19:0/1243189177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555fbc86a370 con 0x555fbcaaf840 2023-11-20T06:41:21.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7efef97fa640 1 -- 172.21.15.19:0/1243189177 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff100043a0 con 0x555fbcaaf840 2023-11-20T06:41:21.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff23c4f000 10 client.4422 fetch_fsmap learned FSMap version 7 2023-11-20T06:41:21.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff23c4f000 1 -- 172.21.15.19:0/1243189177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x555fbc878460 con 0x555fbcaaf840 2023-11-20T06:41:21.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7efef97fa640 1 -- 172.21.15.19:0/1243189177 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555fbc86a370 con 0x555fbcaaf840 2023-11-20T06:41:21.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7efef97fa640 1 -- 172.21.15.19:0/1243189177 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7eff10011040 con 0x555fbcaaf840 2023-11-20T06:41:21.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff23c4f000 10 client.4422 fetch_fsmap finished waiting for FSMap version 7 2023-11-20T06:41:21.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff23c4f000 10 client.4422 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-20T06:41:21.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff23c4f000 20 client.4422 populate_metadata read hostname 'smithi019' 2023-11-20T06:41:21.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff23c4f000 1 --2- 172.21.15.19:0/1243189177 >> [v2:172.21.15.19:6834/1973335825,v1:172.21.15.19:6835/1973335825] conn(0x555fbca72080 0x555fbcac1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff23c4f000 4 client.4422 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-20T06:41:21.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff23c4f000 1 -- 172.21.15.19:0/1243189177 --> [v2:172.21.15.19:6834/1973335825,v1:172.21.15.19:6835/1973335825] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555fbc8502d0 con 0x555fbca72080 2023-11-20T06:41:21.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff1a59c640 1 --2- 172.21.15.19:0/1243189177 >> [v2:172.21.15.19:6834/1973335825,v1:172.21.15.19:6835/1973335825] conn(0x555fbca72080 0x555fbcac1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7eff1a59c640 1 --2- 172.21.15.19:0/1243189177 >> [v2:172.21.15.19:6834/1973335825,v1:172.21.15.19:6835/1973335825] conn(0x555fbca72080 0x555fbcac1b00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2a74961beec275e server_cookie=7e7071de96c7d167 in_seq=0 out_seq=0 2023-11-20T06:41:21.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.760+0000 7efef97fa640 10 client.4422 ms_handle_connect on v2:172.21.15.19:6834/1973335825 2023-11-20T06:41:21.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.764+0000 7efef97fa640 1 -- 172.21.15.19:0/1243189177 <== mds.0 v2:172.21.15.19:6834/1973335825 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555fbc8502d0 con 0x555fbca72080 2023-11-20T06:41:21.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.764+0000 7efef97fa640 10 client.4422 handle_command_reply: tid=0 2023-11-20T06:41:21.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.764+0000 7eff23c4f000 1 client.4422 shutdown 2023-11-20T06:41:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.764+0000 7eff23c4f000 1 -- 172.21.15.19:0/1243189177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcaaf840 msgr2=0x555fbca6ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.764+0000 7eff23c4f000 1 --2- 172.21.15.19:0/1243189177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcaaf840 0x555fbca6ad10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7eff10017750 tx=0x7eff10017c10 comp rx=0 tx=0).stop 2023-11-20T06:41:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.764+0000 7eff23c4f000 1 -- 172.21.15.19:0/1243189177 shutdown_connections 2023-11-20T06:41:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.764+0000 7eff23c4f000 1 --2- 172.21.15.19:0/1243189177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fbcab0160 0x555fbca6b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.764+0000 7eff23c4f000 1 --2- 172.21.15.19:0/1243189177 >> [v2:172.21.15.19:6834/1973335825,v1:172.21.15.19:6835/1973335825] conn(0x555fbca72080 0x555fbcac1b00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.764+0000 7eff23c4f000 1 --2- 172.21.15.19:0/1243189177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcaaf840 0x555fbca6ad10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.764+0000 7eff23c4f000 1 --2- 172.21.15.19:0/1243189177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbca65bf0 0x555fbcaaf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.764+0000 7efef97fa640 0 client.4422 ms_handle_reset on v2:172.21.15.19:6834/1973335825 2023-11-20T06:41:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.764+0000 7eff23c4f000 1 -- 172.21.15.19:0/1243189177 >> 172.21.15.19:0/1243189177 conn(0x555fbca5cf60 msgr2=0x555fbca64690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:21.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.764+0000 7eff23c4f000 1 -- 172.21.15.19:0/1243189177 shutdown_connections 2023-11-20T06:41:21.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.764+0000 7eff23c4f000 1 -- 172.21.15.19:0/1243189177 wait complete. 2023-11-20T06:41:21.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.764+0000 7eff23c4f000 20 client.4422 trim_cache size 0 max 16384 2023-11-20T06:41:21.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff23c4f000 1 Processor -- start 2023-11-20T06:41:21.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff23c4f000 1 -- start start 2023-11-20T06:41:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff23c4f000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbca65bf0 0x555fbcac2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff23c4f000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fbcaaf840 0x555fbcac3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff23c4f000 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcab0160 0x555fbcaaa620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff23c4f000 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fbc570940 con 0x555fbcab0160 2023-11-20T06:41:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff23c4f000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fbc88c9d0 con 0x555fbcaaf840 2023-11-20T06:41:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff23c4f000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x555fbcac6490 con 0x555fbca65bf0 2023-11-20T06:41:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff1ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcab0160 0x555fbcaaa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff1ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcab0160 0x555fbcaaa620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44990/0 (socket says 172.21.15.19:44990) 2023-11-20T06:41:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff1ad9d640 1 -- 172.21.15.19:0/2844996318 learned_addr learned my addr 172.21.15.19:0/2844996318 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff19d9b640 1 --2- 172.21.15.19:0/2844996318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fbcaaf840 0x555fbcac3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff1a59c640 1 --2- 172.21.15.19:0/2844996318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbca65bf0 0x555fbcac2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff1ad9d640 1 -- 172.21.15.19:0/2844996318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbca65bf0 msgr2=0x555fbcac2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff1ad9d640 1 --2- 172.21.15.19:0/2844996318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbca65bf0 0x555fbcac2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff1ad9d640 1 -- 172.21.15.19:0/2844996318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fbcaaf840 msgr2=0x555fbcac3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff1ad9d640 1 --2- 172.21.15.19:0/2844996318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fbcaaf840 0x555fbcac3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff1ad9d640 1 -- 172.21.15.19:0/2844996318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fbc85e760 con 0x555fbcab0160 2023-11-20T06:41:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff1ad9d640 1 --2- 172.21.15.19:0/2844996318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcab0160 0x555fbcaaa620 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7eff140544f0 tx=0x7eff14082000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dcc80c2030140c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff08ff9640 1 -- 172.21.15.19:0/2844996318 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14050cc0 con 0x555fbcab0160 2023-11-20T06:41:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff08ff9640 1 -- 172.21.15.19:0/2844996318 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff14050e20 con 0x555fbcab0160 2023-11-20T06:41:21.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff08ff9640 1 -- 172.21.15.19:0/2844996318 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1405c5b0 con 0x555fbcab0160 2023-11-20T06:41:21.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff23c4f000 1 -- 172.21.15.19:0/2844996318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcab0160 msgr2=0x555fbcaaa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff23c4f000 1 --2- 172.21.15.19:0/2844996318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcab0160 0x555fbcaaa620 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7eff140544f0 tx=0x7eff14082000 comp rx=0 tx=0).stop 2023-11-20T06:41:21.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff23c4f000 1 -- 172.21.15.19:0/2844996318 shutdown_connections 2023-11-20T06:41:21.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff23c4f000 1 --2- 172.21.15.19:0/2844996318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcab0160 0x555fbcaaa620 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff23c4f000 1 --2- 172.21.15.19:0/2844996318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fbcaaf840 0x555fbcac3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff23c4f000 1 --2- 172.21.15.19:0/2844996318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbca65bf0 0x555fbcac2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff23c4f000 1 -- 172.21.15.19:0/2844996318 >> 172.21.15.19:0/2844996318 conn(0x555fbca5cf60 msgr2=0x555fbcabce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff23c4f000 1 -- 172.21.15.19:0/2844996318 shutdown_connections 2023-11-20T06:41:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff23c4f000 1 -- 172.21.15.19:0/2844996318 wait complete. 2023-11-20T06:41:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff23c4f000 1 -- start start 2023-11-20T06:41:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.780+0000 7eff23c4f000 1 Processor -- start 2023-11-20T06:41:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff23c4f000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fbca65bf0 0x555fbcaad520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff23c4f000 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcaaf840 0x555fbcacaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff23c4f000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbcab0160 0x555fbcacb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff23c4f000 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fbc8f7b40 con 0x555fbcaaf840 2023-11-20T06:41:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff23c4f000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fbc8646c0 con 0x555fbca65bf0 2023-11-20T06:41:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff23c4f000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x555fbc8754d0 con 0x555fbcab0160 2023-11-20T06:41:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff23c4f000 10 client.0 _ll_register_callbacks cb 0x7eff140508f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-20T06:41:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff19d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcaaf840 0x555fbcacaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff19d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcaaf840 0x555fbcacaec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44992/0 (socket says 172.21.15.19:44992) 2023-11-20T06:41:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff19d9b640 1 -- 172.21.15.19:0/513801026 learned_addr learned my addr 172.21.15.19:0/513801026 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff1a59c640 1 --2- 172.21.15.19:0/513801026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fbca65bf0 0x555fbcaad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff1ad9d640 1 --2- 172.21.15.19:0/513801026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbcab0160 0x555fbcacb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff19d9b640 1 -- 172.21.15.19:0/513801026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbcab0160 msgr2=0x555fbcacb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff19d9b640 1 --2- 172.21.15.19:0/513801026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbcab0160 0x555fbcacb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff19d9b640 1 -- 172.21.15.19:0/513801026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fbca65bf0 msgr2=0x555fbcaad520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff19d9b640 1 --2- 172.21.15.19:0/513801026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fbca65bf0 0x555fbcaad520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff19d9b640 1 -- 172.21.15.19:0/513801026 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555fbc5af890 con 0x555fbcaaf840 2023-11-20T06:41:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff19d9b640 1 --2- 172.21.15.19:0/513801026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcaaf840 0x555fbcacaec0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7eff100096d0 tx=0x7eff10004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e833d7e6267adacd server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7efef97fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2023-11-20T06:41:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7efef97fa640 1 -- 172.21.15.19:0/513801026 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff10005bb0 con 0x555fbcaaf840 2023-11-20T06:41:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7efef97fa640 1 -- 172.21.15.19:0/513801026 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7eff10034db0 con 0x555fbcaaf840 2023-11-20T06:41:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff23c4f000 1 -- 172.21.15.19:0/513801026 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555fbc84e6f0 con 0x555fbcaaf840 2023-11-20T06:41:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7efef97fa640 1 -- 172.21.15.19:0/513801026 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff10005d10 con 0x555fbcaaf840 2023-11-20T06:41:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff23c4f000 10 client.4428 fetch_fsmap learned FSMap version 7 2023-11-20T06:41:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff23c4f000 1 -- 172.21.15.19:0/513801026 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x555fbc5afcc0 con 0x555fbcaaf840 2023-11-20T06:41:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7efef97fa640 1 -- 172.21.15.19:0/513801026 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555fbc84e6f0 con 0x555fbcaaf840 2023-11-20T06:41:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7efef97fa640 1 -- 172.21.15.19:0/513801026 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7eff10011040 con 0x555fbcaaf840 2023-11-20T06:41:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff23c4f000 10 client.4428 fetch_fsmap finished waiting for FSMap version 7 2023-11-20T06:41:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff23c4f000 10 client.4428 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-20T06:41:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff23c4f000 20 client.4428 populate_metadata read hostname 'smithi019' 2023-11-20T06:41:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff23c4f000 1 --2- 172.21.15.19:0/513801026 >> [v2:172.21.15.19:6834/1973335825,v1:172.21.15.19:6835/1973335825] conn(0x555fbcacb940 0x555fbcb16330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff23c4f000 4 client.4428 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-20T06:41:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff23c4f000 1 -- 172.21.15.19:0/513801026 --> [v2:172.21.15.19:6834/1973335825,v1:172.21.15.19:6835/1973335825] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555fbc8af6e0 con 0x555fbcacb940 2023-11-20T06:41:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff1a59c640 1 --2- 172.21.15.19:0/513801026 >> [v2:172.21.15.19:6834/1973335825,v1:172.21.15.19:6835/1973335825] conn(0x555fbcacb940 0x555fbcb16330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7efef97fa640 10 client.4428 ms_handle_connect on v2:172.21.15.19:6834/1973335825 2023-11-20T06:41:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff1a59c640 1 --2- 172.21.15.19:0/513801026 >> [v2:172.21.15.19:6834/1973335825,v1:172.21.15.19:6835/1973335825] conn(0x555fbcacb940 0x555fbcb16330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86c2127e43922831 server_cookie=91904f0aec2bdb09 in_seq=0 out_seq=0 2023-11-20T06:41:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7efef97fa640 1 -- 172.21.15.19:0/513801026 <== mds.0 v2:172.21.15.19:6834/1973335825 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x555fbc8af6e0 con 0x555fbcacb940 2023-11-20T06:41:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7efef97fa640 10 client.4428 handle_command_reply: tid=0 2023-11-20T06:41:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff23c4f000 1 client.4428 shutdown 2023-11-20T06:41:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff23c4f000 1 -- 172.21.15.19:0/513801026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcaaf840 msgr2=0x555fbcacaec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.784+0000 7eff23c4f000 1 --2- 172.21.15.19:0/513801026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcaaf840 0x555fbcacaec0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7eff100096d0 tx=0x7eff10004740 comp rx=0 tx=0).stop 2023-11-20T06:41:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff23c4f000 1 -- 172.21.15.19:0/513801026 shutdown_connections 2023-11-20T06:41:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff23c4f000 1 --2- 172.21.15.19:0/513801026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fbcab0160 0x555fbcacb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff23c4f000 1 --2- 172.21.15.19:0/513801026 >> [v2:172.21.15.19:6834/1973335825,v1:172.21.15.19:6835/1973335825] conn(0x555fbcacb940 0x555fbcb16330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff23c4f000 1 --2- 172.21.15.19:0/513801026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555fbcaaf840 0x555fbcacaec0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff23c4f000 1 --2- 172.21.15.19:0/513801026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fbca65bf0 0x555fbcaad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7efef97fa640 0 client.4428 ms_handle_reset on v2:172.21.15.19:6834/1973335825 2023-11-20T06:41:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff23c4f000 1 -- 172.21.15.19:0/513801026 >> 172.21.15.19:0/513801026 conn(0x555fbca5cf60 msgr2=0x555fbcac1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff23c4f000 1 -- 172.21.15.19:0/513801026 shutdown_connections 2023-11-20T06:41:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff23c4f000 1 -- 172.21.15.19:0/513801026 wait complete. 2023-11-20T06:41:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff23c4f000 20 client.4428 trim_cache size 0 max 16384 2023-11-20T06:41:21.796 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-20T06:41:21.796 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "c7c2bc89-520e-40d6-94f5-74b01db83356", 2023-11-20T06:41:21.797 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2023-11-20T06:41:21.797 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4272, 2023-11-20T06:41:21.797 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2023-11-20T06:41:21.797 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2023-11-20T06:41:21.797 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2023-11-20T06:41:21.797 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 7.5460182969999998, 2023-11-20T06:41:21.797 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 7, 2023-11-20T06:41:21.797 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 25, 2023-11-20T06:41:21.797 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 23, 2023-11-20T06:41:21.797 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 14.738036424000001 2023-11-20T06:41:21.797 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-20T06:41:21.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff208d6640 1 -- 172.21.15.19:0/2975863041 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7efefc0664d0 msgr2=0x7efefc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff208d6640 1 --2- 172.21.15.19:0/2975863041 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7efefc0664d0 0x7efefc068990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0ad000 tx=0x7eff0c0b3040 comp rx=0 tx=0).stop 2023-11-20T06:41:21.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff208d6640 1 -- 172.21.15.19:0/2975863041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff1c14d750 msgr2=0x7eff1c14dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff208d6640 1 --2- 172.21.15.19:0/2975863041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff1c14d750 0x7eff1c14dbd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0c9140 tx=0x7eff1400fb40 comp rx=0 tx=0).stop 2023-11-20T06:41:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff208d6640 1 -- 172.21.15.19:0/2975863041 shutdown_connections 2023-11-20T06:41:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff208d6640 1 --2- 172.21.15.19:0/2975863041 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7efefc0664d0 0x7efefc068990 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff208d6640 1 --2- 172.21.15.19:0/2975863041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff1c14d750 0x7eff1c14dbd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff208d6640 1 --2- 172.21.15.19:0/2975863041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff1c157480 0x7eff1c157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff208d6640 1 --2- 172.21.15.19:0/2975863041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff04003980 0x7eff1c0c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff208d6640 1 -- 172.21.15.19:0/2975863041 >> 172.21.15.19:0/2975863041 conn(0x7eff1c06c190 msgr2=0x7eff1c14e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff208d6640 1 -- 172.21.15.19:0/2975863041 shutdown_connections 2023-11-20T06:41:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.788+0000 7eff208d6640 1 -- 172.21.15.19:0/2975863041 wait complete. 2023-11-20T06:41:21.810 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-20T06:41:21.810 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-20T06:41:21.811 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-20T06:41:21.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.948+0000 7f0e8f59d640 1 Processor -- start 2023-11-20T06:41:21.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.948+0000 7f0e8f59d640 1 -- start start 2023-11-20T06:41:21.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.948+0000 7f0e8f59d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0e880b07f0 0x7f0e8815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.948+0000 7f0e8f59d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0e8815d690 0x7f0e88164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.948+0000 7f0e8f59d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e8815be60 con 0x7f0e88070c40 2023-11-20T06:41:21.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.948+0000 7f0e8f59d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e8815b3b0 con 0x7f0e8815d690 2023-11-20T06:41:21.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.948+0000 7f0e8f59d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e8815c1f0 con 0x7f0e880b07f0 2023-11-20T06:41:21.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.948+0000 7f0e8db3a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0e8815d690 0x7f0e88164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.948+0000 7f0e8d339640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0e88070c40 0x7f0e880b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52084/0 (socket says 172.21.15.19:52084) 2023-11-20T06:41:21.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.952+0000 7f0e8d339640 1 -- 172.21.15.19:0/2792699882 learned_addr learned my addr 172.21.15.19:0/2792699882 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:21.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.952+0000 7f0e8cb38640 1 --2- 172.21.15.19:0/2792699882 >> v2:172.21.15.190:3300/0 conn(0x7f0e880b07f0 0x7f0e8815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.952+0000 7f0e8db3a640 1 -- 172.21.15.19:0/2792699882 >> v2:172.21.15.190:3300/0 conn(0x7f0e880b07f0 msgr2=0x7f0e8815ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:21.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.952+0000 7f0e8db3a640 1 --2- 172.21.15.19:0/2792699882 >> v2:172.21.15.190:3300/0 conn(0x7f0e880b07f0 0x7f0e8815ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.952+0000 7f0e8db3a640 1 -- 172.21.15.19:0/2792699882 >> v1:172.21.15.19:6789/0 conn(0x7f0e88070c40 legacy=0x7f0e880b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.952+0000 7f0e8db3a640 1 -- 172.21.15.19:0/2792699882 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e88071020 con 0x7f0e8815d690 2023-11-20T06:41:21.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.952+0000 7f0e7ffff640 1 -- 172.21.15.19:0/2792699882 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576468294 0 0) 0x7f0e8815be60 con 0x7f0e88070c40 2023-11-20T06:41:21.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.952+0000 7f0e8cb38640 1 --2- 172.21.15.19:0/2792699882 >> v2:172.21.15.190:3300/0 conn(0x7f0e880b07f0 0x7f0e8815ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:21.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.952+0000 7f0e8db3a640 1 --2- 172.21.15.19:0/2792699882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8815d690 0x7f0e88164490 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0e880cc1e0 tx=0x7f0e8001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f18027226336946 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:21.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.952+0000 7f0e7ffff640 1 -- 172.21.15.19:0/2792699882 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800a5940 con 0x7f0e8815d690 2023-11-20T06:41:21.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.952+0000 7f0e7ffff640 1 -- 172.21.15.19:0/2792699882 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e800a5aa0 con 0x7f0e8815d690 2023-11-20T06:41:21.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.952+0000 7f0e7ffff640 1 -- 172.21.15.19:0/2792699882 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800a5e30 con 0x7f0e8815d690 2023-11-20T06:41:21.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8f59d640 1 -- 172.21.15.19:0/2792699882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8815d690 msgr2=0x7f0e88164490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8f59d640 1 --2- 172.21.15.19:0/2792699882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8815d690 0x7f0e88164490 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0e880cc1e0 tx=0x7f0e8001c880 comp rx=0 tx=0).stop 2023-11-20T06:41:21.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8f59d640 1 -- 172.21.15.19:0/2792699882 shutdown_connections 2023-11-20T06:41:21.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8f59d640 1 --2- 172.21.15.19:0/2792699882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8815d690 0x7f0e88164490 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8f59d640 1 --2- 172.21.15.19:0/2792699882 >> v2:172.21.15.190:3300/0 conn(0x7f0e880b07f0 0x7f0e8815ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8f59d640 1 -- 172.21.15.19:0/2792699882 >> 172.21.15.19:0/2792699882 conn(0x7f0e8806c190 msgr2=0x7f0e8806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:21.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8f59d640 1 -- 172.21.15.19:0/2792699882 shutdown_connections 2023-11-20T06:41:21.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8f59d640 1 -- 172.21.15.19:0/2792699882 wait complete. 2023-11-20T06:41:21.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8f59d640 1 Processor -- start 2023-11-20T06:41:21.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8f59d640 1 -- start start 2023-11-20T06:41:21.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8f59d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e88070c40 0x7f0e8815e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8f59d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e880b07f0 0x7f0e88153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8f59d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e8815d690 0x7f0e88154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8f59d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e880b1060 con 0x7f0e88070c40 2023-11-20T06:41:21.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8f59d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8815eab0 con 0x7f0e8815d690 2023-11-20T06:41:21.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8f59d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e880b12b0 con 0x7f0e880b07f0 2023-11-20T06:41:21.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8d339640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e88070c40 0x7f0e8815e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8d339640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e88070c40 0x7f0e8815e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45008/0 (socket says 172.21.15.19:45008) 2023-11-20T06:41:21.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8d339640 1 -- 172.21.15.19:0/3958680002 learned_addr learned my addr 172.21.15.19:0/3958680002 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:21.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8cb38640 1 --2- 172.21.15.19:0/3958680002 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e880b07f0 0x7f0e88153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8db3a640 1 --2- 172.21.15.19:0/3958680002 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e8815d690 0x7f0e88154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8d339640 1 -- 172.21.15.19:0/3958680002 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e880b07f0 msgr2=0x7f0e88153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8d339640 1 --2- 172.21.15.19:0/3958680002 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e880b07f0 0x7f0e88153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8d339640 1 -- 172.21.15.19:0/3958680002 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e8815d690 msgr2=0x7f0e88154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:21.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8d339640 1 --2- 172.21.15.19:0/3958680002 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e8815d690 0x7f0e88154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:21.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.956+0000 7f0e8d339640 1 -- 172.21.15.19:0/3958680002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e80009a70 con 0x7f0e88070c40 2023-11-20T06:41:21.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.960+0000 7f0e8d339640 1 --2- 172.21.15.19:0/3958680002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e88070c40 0x7f0e8815e570 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0e840011f0 tx=0x7f0e8400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:21.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.960+0000 7f0e7dffb640 1 -- 172.21.15.19:0/3958680002 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e840074e0 con 0x7f0e88070c40 2023-11-20T06:41:21.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.960+0000 7f0e7dffb640 1 -- 172.21.15.19:0/3958680002 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e84007640 con 0x7f0e88070c40 2023-11-20T06:41:21.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.960+0000 7f0e7dffb640 1 -- 172.21.15.19:0/3958680002 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e84004a10 con 0x7f0e88070c40 2023-11-20T06:41:21.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.960+0000 7f0e8f59d640 1 -- 172.21.15.19:0/3958680002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e880b1590 con 0x7f0e88070c40 2023-11-20T06:41:21.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.960+0000 7f0e8f59d640 1 -- 172.21.15.19:0/3958680002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e880b1b50 con 0x7f0e88070c40 2023-11-20T06:41:21.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.960+0000 7f0e8f59d640 1 -- 172.21.15.19:0/3958680002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e88074010 con 0x7f0e88070c40 2023-11-20T06:41:21.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.960+0000 7f0e7dffb640 1 -- 172.21.15.19:0/3958680002 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0e84004b70 con 0x7f0e88070c40 2023-11-20T06:41:21.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.960+0000 7f0e7dffb640 1 --2- 172.21.15.19:0/3958680002 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0e6c0664a0 0x7f0e6c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:21.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.960+0000 7f0e7dffb640 1 -- 172.21.15.19:0/3958680002 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0e840833b0 con 0x7f0e88070c40 2023-11-20T06:41:21.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.960+0000 7f0e8cb38640 1 --2- 172.21.15.19:0/3958680002 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0e6c0664a0 0x7f0e6c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:21.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.964+0000 7f0e8cb38640 1 --2- 172.21.15.19:0/3958680002 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0e6c0664a0 0x7f0e6c068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0e881f82a0 tx=0x7f0e78008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:21.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:21.964+0000 7f0e7dffb640 1 -- 172.21.15.19:0/3958680002 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0e840505e0 con 0x7f0e88070c40 2023-11-20T06:41:22.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:22.156+0000 7f0e8f59d640 1 -- 172.21.15.19:0/3958680002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0e880b0120 con 0x7f0e88070c40 2023-11-20T06:41:22.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:22.156+0000 7f0e7dffb640 1 -- 172.21.15.19:0/3958680002 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0e84018070 con 0x7f0e88070c40 2023-11-20T06:41:22.161 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-20T06:41:22.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:22.160+0000 7f0e8f59d640 1 -- 172.21.15.19:0/3958680002 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0e6c0664a0 msgr2=0x7f0e6c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:22.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:22.160+0000 7f0e8f59d640 1 --2- 172.21.15.19:0/3958680002 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0e6c0664a0 0x7f0e6c068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0e881f82a0 tx=0x7f0e78008040 comp rx=0 tx=0).stop 2023-11-20T06:41:22.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:22.160+0000 7f0e8f59d640 1 -- 172.21.15.19:0/3958680002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e88070c40 msgr2=0x7f0e8815e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:22.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:22.160+0000 7f0e8f59d640 1 --2- 172.21.15.19:0/3958680002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e88070c40 0x7f0e8815e570 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0e840011f0 tx=0x7f0e8400c9b0 comp rx=0 tx=0).stop 2023-11-20T06:41:22.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:22.160+0000 7f0e8f59d640 1 -- 172.21.15.19:0/3958680002 shutdown_connections 2023-11-20T06:41:22.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:22.160+0000 7f0e8f59d640 1 --2- 172.21.15.19:0/3958680002 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0e6c0664a0 0x7f0e6c068960 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:22.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:22.160+0000 7f0e8f59d640 1 --2- 172.21.15.19:0/3958680002 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e8815d690 0x7f0e88154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:22.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:22.160+0000 7f0e8f59d640 1 --2- 172.21.15.19:0/3958680002 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e880b07f0 0x7f0e88153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:22.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:22.160+0000 7f0e8f59d640 1 --2- 172.21.15.19:0/3958680002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e88070c40 0x7f0e8815e570 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:22.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:22.160+0000 7f0e8f59d640 1 -- 172.21.15.19:0/3958680002 >> 172.21.15.19:0/3958680002 conn(0x7f0e8806c190 msgr2=0x7f0e880ce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:22.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:22.160+0000 7f0e8f59d640 1 -- 172.21.15.19:0/3958680002 shutdown_connections 2023-11-20T06:41:22.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:22.160+0000 7f0e8f59d640 1 -- 172.21.15.19:0/3958680002 wait complete. 2023-11-20T06:41:22.182 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-20T06:41:22.182 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-20T06:41:22.182 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2023-11-20T06:41:22.182 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-11-20T06:41:22.183 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-20T06:41:22.183 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-20T06:41:22.183 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-20T06:41:22.183 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-20T06:41:22.183 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-11-20T06:41:22.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:22.183 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2023-11-20T06:41:22.193 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-20T06:41:22.193 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-20T06:41:22.193 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2023-11-20T06:41:22.193 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:22.193 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2023-11-20T06:41:22.193 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:22.193 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T06:41:22.193 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:22.194 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2023-11-20T06:41:22.194 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T06:41:22.194 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:22.194 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2023-11-20T06:41:22.194 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-20T06:41:22.194 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:22.194 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2023-11-20T06:41:22.194 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-20T06:41:22.194 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42433sec preferred_lft 42433sec 2023-11-20T06:41:22.194 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2023-11-20T06:41:22.194 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:22.195 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T06:41:22.195 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:22.195 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2023-11-20T06:41:22.195 INFO:teuthology.orchestra.run.smithi019.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-20T06:41:22.195 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:42:42:0b:69:dd brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:22.195 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-20T06:41:22.195 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:22.196 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-20T06:41:22.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:22.196 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2023-11-20T06:41:22.196 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2023-11-20T06:41:22.197 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add name ceph-brx type bridge 2023-11-20T06:41:22.197 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr flush dev ceph-brx 2023-11-20T06:41:22.197 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set ceph-brx up 2023-11-20T06:41:22.197 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-20T06:41:22.197 DEBUG:teuthology.orchestra.run.smithi019:> ') 2023-11-20T06:41:22.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:22.317 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-20T06:41:22.337 INFO:teuthology.orchestra.run.smithi019.stdout:1 2023-11-20T06:41:22.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:22.339 DEBUG:teuthology.orchestra.run.smithi019:> route 2023-11-20T06:41:22.409 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2023-11-20T06:41:22.409 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-20T06:41:22.409 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-20T06:41:22.409 INFO:teuthology.orchestra.run.smithi019.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-20T06:41:22.410 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-20T06:41:22.410 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-20T06:41:22.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:22.410 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2023-11-20T06:41:22.410 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2023-11-20T06:41:22.410 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-20T06:41:22.410 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-20T06:41:22.411 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-20T06:41:22.411 DEBUG:teuthology.orchestra.run.smithi019:> ') 2023-11-20T06:41:22.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:22.503 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2023-11-20T06:41:22.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:22.513 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list-id 2023-11-20T06:41:22.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:22.564 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2023-11-20T06:41:22.564 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2023-11-20T06:41:22.564 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-20T06:41:22.564 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-11-20T06:41:22.564 DEBUG:teuthology.orchestra.run.smithi019:> ') 2023-11-20T06:41:22.647 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-11-20T06:41:22.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:22.647 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2023-11-20T06:41:22.647 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2023-11-20T06:41:22.647 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-11-20T06:41:22.647 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-20T06:41:22.647 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-11-20T06:41:22.647 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-11-20T06:41:22.647 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-11-20T06:41:22.647 DEBUG:teuthology.orchestra.run.smithi019:> ') 2023-11-20T06:41:22.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:22.815 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2023-11-20T06:41:22.815 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2023-11-20T06:41:22.815 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2023-11-20T06:41:22.815 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set dev brx.0 master ceph-brx 2023-11-20T06:41:22.815 DEBUG:teuthology.orchestra.run.smithi019:> ') 2023-11-20T06:41:22.857 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-11-20T06:41:22.857 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T06:41:22.857 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-11-20T06:41:22.911 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-11-20T06:41:22.911 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T06:41:22.911 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-11-20T06:41:22.966 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2023-11-20T06:41:23.028 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T06:41:23.080 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2023-11-20T06:41:23.081 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2023-11-20T06:41:23.081 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2023-11-20T06:41:23.081 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2023-11-20T06:41:23.081 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2023-11-20T06:41:23.081 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2023-11-20T06:41:23.081 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2023-11-20T06:41:23.081 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2023-11-20T06:41:23.081 INFO:teuthology.orchestra.run.smithi019.stdout:/run/lock 2023-11-20T06:41:23.081 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2023-11-20T06:41:23.081 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2023-11-20T06:41:23.082 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2023-11-20T06:41:23.082 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T06:41:23.082 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2023-11-20T06:41:23.082 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2023-11-20T06:41:23.082 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2023-11-20T06:41:23.082 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2023-11-20T06:41:23.082 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/fs/nfsd 2023-11-20T06:41:23.082 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2023-11-20T06:41:23.082 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2023-11-20T06:41:23.082 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T06:41:23.082 INFO:teuthology.orchestra.run.smithi019.stdout:/run/rpc_pipefs 2023-11-20T06:41:23.082 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2023-11-20T06:41:23.083 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2023-11-20T06:41:23.083 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2023-11-20T06:41:23.083 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2023-11-20T06:41:23.083 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2023-11-20T06:41:23.083 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2023-11-20T06:41:23.083 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2023-11-20T06:41:23.083 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-20T06:41:23.083 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-20T06:41:23.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:23.084 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2023-11-20T06:41:23.139 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-20T06:41:23.139 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-11-20T06:41:23.189 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2023-11-20T06:41:23.212 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T06:41:23.268 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2023-11-20T06:41:23.268 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2023-11-20T06:41:23.268 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2023-11-20T06:41:23.269 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2023-11-20T06:41:23.269 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2023-11-20T06:41:23.269 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2023-11-20T06:41:23.269 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2023-11-20T06:41:23.269 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2023-11-20T06:41:23.269 INFO:teuthology.orchestra.run.smithi019.stdout:/run/lock 2023-11-20T06:41:23.269 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2023-11-20T06:41:23.269 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2023-11-20T06:41:23.269 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2023-11-20T06:41:23.269 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T06:41:23.269 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2023-11-20T06:41:23.269 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2023-11-20T06:41:23.270 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2023-11-20T06:41:23.270 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2023-11-20T06:41:23.270 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/fs/nfsd 2023-11-20T06:41:23.270 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2023-11-20T06:41:23.270 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2023-11-20T06:41:23.270 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T06:41:23.270 INFO:teuthology.orchestra.run.smithi019.stdout:/run/rpc_pipefs 2023-11-20T06:41:23.270 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2023-11-20T06:41:23.270 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2023-11-20T06:41:23.270 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2023-11-20T06:41:23.270 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2023-11-20T06:41:23.270 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2023-11-20T06:41:23.271 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2023-11-20T06:41:23.271 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2023-11-20T06:41:23.271 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-20T06:41:23.271 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-20T06:41:23.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:23.272 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2023-11-20T06:41:23.304 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi019.stderr:2023-11-20T06:41:23.300+0000 7f600e503580 -1 init, newargv = 0x55de8d59b440 newargc=15 2023-11-20T06:41:23.304 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi019.stderr:ceph-fuse[44074]: starting ceph client 2023-11-20T06:41:23.319 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi019.stderr:ceph-fuse[44074]: starting fuse 2023-11-20T06:41:24.413 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2023-11-20T06:41:24.440 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T06:41:24.493 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2023-11-20T06:41:24.494 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2023-11-20T06:41:24.494 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2023-11-20T06:41:24.494 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2023-11-20T06:41:24.494 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2023-11-20T06:41:24.494 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2023-11-20T06:41:24.494 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2023-11-20T06:41:24.494 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2023-11-20T06:41:24.494 INFO:teuthology.orchestra.run.smithi019.stdout:/run/lock 2023-11-20T06:41:24.494 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2023-11-20T06:41:24.495 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2023-11-20T06:41:24.495 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2023-11-20T06:41:24.495 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T06:41:24.495 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2023-11-20T06:41:24.495 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2023-11-20T06:41:24.495 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2023-11-20T06:41:24.495 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2023-11-20T06:41:24.495 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/fs/nfsd 2023-11-20T06:41:24.495 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2023-11-20T06:41:24.495 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2023-11-20T06:41:24.495 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T06:41:24.495 INFO:teuthology.orchestra.run.smithi019.stdout:/run/rpc_pipefs 2023-11-20T06:41:24.496 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2023-11-20T06:41:24.496 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2023-11-20T06:41:24.496 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2023-11-20T06:41:24.496 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2023-11-20T06:41:24.496 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2023-11-20T06:41:24.496 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2023-11-20T06:41:24.496 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2023-11-20T06:41:24.496 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-20T06:41:24.496 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-20T06:41:24.496 INFO:teuthology.orchestra.run.smithi019.stdout:/home/ubuntu/cephtest/mnt.admin 2023-11-20T06:41:24.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:24.497 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2023-11-20T06:41:24.552 INFO:teuthology.orchestra.run.smithi019.stdout:43 2023-11-20T06:41:24.552 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-20T06:41:24.552 DEBUG:teuthology.orchestra.run.smithi019:> sudo stdin-killer -- python3 -c ' 2023-11-20T06:41:24.552 DEBUG:teuthology.orchestra.run.smithi019:> import glob 2023-11-20T06:41:24.552 DEBUG:teuthology.orchestra.run.smithi019:> import re 2023-11-20T06:41:24.552 DEBUG:teuthology.orchestra.run.smithi019:> import os 2023-11-20T06:41:24.553 DEBUG:teuthology.orchestra.run.smithi019:> import subprocess 2023-11-20T06:41:24.553 DEBUG:teuthology.orchestra.run.smithi019:> 2023-11-20T06:41:24.553 DEBUG:teuthology.orchestra.run.smithi019:> def _find_admin_socket(client_name): 2023-11-20T06:41:24.553 DEBUG:teuthology.orchestra.run.smithi019:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-11-20T06:41:24.553 DEBUG:teuthology.orchestra.run.smithi019:> files = glob.glob(asok_path) 2023-11-20T06:41:24.553 DEBUG:teuthology.orchestra.run.smithi019:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-11-20T06:41:24.553 DEBUG:teuthology.orchestra.run.smithi019:> 2023-11-20T06:41:24.553 DEBUG:teuthology.orchestra.run.smithi019:> # Given a non-glob path, it better be there 2023-11-20T06:41:24.553 DEBUG:teuthology.orchestra.run.smithi019:> if "*" not in asok_path: 2023-11-20T06:41:24.553 DEBUG:teuthology.orchestra.run.smithi019:> assert(len(files) == 1) 2023-11-20T06:41:24.553 DEBUG:teuthology.orchestra.run.smithi019:> return files[0] 2023-11-20T06:41:24.553 DEBUG:teuthology.orchestra.run.smithi019:> 2023-11-20T06:41:24.554 DEBUG:teuthology.orchestra.run.smithi019:> for f in files: 2023-11-20T06:41:24.554 DEBUG:teuthology.orchestra.run.smithi019:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-20T06:41:24.554 DEBUG:teuthology.orchestra.run.smithi019:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-20T06:41:24.554 DEBUG:teuthology.orchestra.run.smithi019:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-20T06:41:24.554 DEBUG:teuthology.orchestra.run.smithi019:> contents = proc_f.read() 2023-11-20T06:41:24.554 DEBUG:teuthology.orchestra.run.smithi019:> if mountpoint in contents: 2023-11-20T06:41:24.554 DEBUG:teuthology.orchestra.run.smithi019:> return f 2023-11-20T06:41:24.554 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-20T06:41:24.554 DEBUG:teuthology.orchestra.run.smithi019:> 2023-11-20T06:41:24.554 DEBUG:teuthology.orchestra.run.smithi019:> print(_find_admin_socket("client.admin")) 2023-11-20T06:41:24.554 DEBUG:teuthology.orchestra.run.smithi019:> ' 2023-11-20T06:41:24.688 INFO:teuthology.orchestra.run.smithi019.stdout:/var/run/ceph/ceph-client.admin.44074.asok 2023-11-20T06:41:24.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-20T06:41:24.701 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44074.asok 2023-11-20T06:41:24.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:24.701 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44074.asok status 2023-11-20T06:41:24.881 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-20T06:41:24.881 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": { 2023-11-20T06:41:24.881 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-20T06:41:24.881 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-20T06:41:24.881 INFO:teuthology.orchestra.run.smithi019.stdout: "entity_id": "admin", 2023-11-20T06:41:24.881 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": "smithi019", 2023-11-20T06:41:24.882 INFO:teuthology.orchestra.run.smithi019.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-11-20T06:41:24.882 INFO:teuthology.orchestra.run.smithi019.stdout: "pid": "44074", 2023-11-20T06:41:24.882 INFO:teuthology.orchestra.run.smithi019.stdout: "root": "/" 2023-11-20T06:41:24.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:41:24.882 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_count": 0, 2023-11-20T06:41:24.882 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_pinned_count": 0, 2023-11-20T06:41:24.882 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4417, 2023-11-20T06:41:24.882 INFO:teuthology.orchestra.run.smithi019.stdout: "inst": { 2023-11-20T06:41:24.882 INFO:teuthology.orchestra.run.smithi019.stdout: "name": { 2023-11-20T06:41:24.882 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "client", 2023-11-20T06:41:24.882 INFO:teuthology.orchestra.run.smithi019.stdout: "num": 4417 2023-11-20T06:41:24.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:41:24.883 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2023-11-20T06:41:24.883 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-11-20T06:41:24.883 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:0", 2023-11-20T06:41:24.883 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 933417112 2023-11-20T06:41:24.883 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:41:24.883 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:41:24.883 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2023-11-20T06:41:24.883 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-11-20T06:41:24.883 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:0", 2023-11-20T06:41:24.883 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 933417112 2023-11-20T06:41:24.883 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:41:24.883 INFO:teuthology.orchestra.run.smithi019.stdout: "inst_str": "client.4417 172.21.15.19:0/933417112", 2023-11-20T06:41:24.883 INFO:teuthology.orchestra.run.smithi019.stdout: "addr_str": "172.21.15.19:0/933417112", 2023-11-20T06:41:24.884 INFO:teuthology.orchestra.run.smithi019.stdout: "inode_count": 1, 2023-11-20T06:41:24.884 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_epoch": 7, 2023-11-20T06:41:24.884 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch": 25, 2023-11-20T06:41:24.884 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch_barrier": 0, 2023-11-20T06:41:24.884 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklisted": false, 2023-11-20T06:41:24.884 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs" 2023-11-20T06:41:24.884 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-20T06:41:24.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:24.896 DEBUG:teuthology.orchestra.run.smithi019:> stat --file-system '--printf=%T 2023-11-20T06:41:24.896 DEBUG:teuthology.orchestra.run.smithi019:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-11-20T06:41:24.906 INFO:teuthology.orchestra.run.smithi019.stdout:fuseblk 2023-11-20T06:41:24.906 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-11-20T06:41:24.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:24.907 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-11-20T06:41:24.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:24.972 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-11-20T06:41:25.043 INFO:teuthology.orchestra.run.smithi019.stdout:# file: . 2023-11-20T06:41:25.043 INFO:teuthology.orchestra.run.smithi019.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-11-20T06:41:25.043 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:25.044 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:41:25.044 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:41:25.100 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:41:25.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.284+0000 7f86a71b8640 1 Processor -- start 2023-11-20T06:41:25.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.284+0000 7f86a71b8640 1 -- start start 2023-11-20T06:41:25.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.288+0000 7f86a71b8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f86a01597c0 0x7f86a00ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:25.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.288+0000 7f86a71b8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f86a0159ba0 0x7f86a00cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:25.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.288+0000 7f86a71b8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a00723d0 con 0x7f86a00adc10 2023-11-20T06:41:25.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.288+0000 7f86a71b8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a00717c0 con 0x7f86a01597c0 2023-11-20T06:41:25.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.288+0000 7f86a71b8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a0071aa0 con 0x7f86a0159ba0 2023-11-20T06:41:25.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.288+0000 7f86a4f54640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f86a01597c0 0x7f86a00ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:25.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.288+0000 7f86a4f54640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f86a01597c0 0x7f86a00ad6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54128/0 (socket says 172.21.15.19:54128) 2023-11-20T06:41:25.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.288+0000 7f86a5755640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f86a00adc10 0x7f86a00cb350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:51204/0 (socket says 172.21.15.19:51204) 2023-11-20T06:41:25.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.288+0000 7f86a4f54640 1 -- 172.21.15.19:0/3443711681 learned_addr learned my addr 172.21.15.19:0/3443711681 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:25.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.288+0000 7f869ffff640 1 --2- 172.21.15.19:0/3443711681 >> v2:172.21.15.190:3300/0 conn(0x7f86a0159ba0 0x7f86a00cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.288+0000 7f86a4f54640 1 -- 172.21.15.19:0/3443711681 >> v2:172.21.15.190:3300/0 conn(0x7f86a0159ba0 msgr2=0x7f86a00cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.288+0000 7f86a4f54640 1 --2- 172.21.15.19:0/3443711681 >> v2:172.21.15.190:3300/0 conn(0x7f86a0159ba0 0x7f86a00cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.288+0000 7f86a4f54640 1 -- 172.21.15.19:0/3443711681 >> v1:172.21.15.19:6789/0 conn(0x7f86a00adc10 legacy=0x7f86a00cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.288+0000 7f86a4f54640 1 -- 172.21.15.19:0/3443711681 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a0071d80 con 0x7f86a01597c0 2023-11-20T06:41:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.288+0000 7f869f7fe640 1 -- 172.21.15.19:0/3443711681 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483683514 0 0) 0x7f86a00723d0 con 0x7f86a00adc10 2023-11-20T06:41:25.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.292+0000 7f86a4f54640 1 --2- 172.21.15.19:0/3443711681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a01597c0 0x7f86a00ad6d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f86a00b4690 tx=0x7f869401ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489da422289028e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:25.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.292+0000 7f869f7fe640 1 -- 172.21.15.19:0/3443711681 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86940a7c40 con 0x7f86a01597c0 2023-11-20T06:41:25.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.292+0000 7f869f7fe640 1 -- 172.21.15.19:0/3443711681 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86940a7da0 con 0x7f86a01597c0 2023-11-20T06:41:25.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.292+0000 7f869f7fe640 1 -- 172.21.15.19:0/3443711681 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86940af660 con 0x7f86a01597c0 2023-11-20T06:41:25.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.292+0000 7f86a71b8640 1 -- 172.21.15.19:0/3443711681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a01597c0 msgr2=0x7f86a00ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:25.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.292+0000 7f86a71b8640 1 --2- 172.21.15.19:0/3443711681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a01597c0 0x7f86a00ad6d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f86a00b4690 tx=0x7f869401ebd0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.292+0000 7f86a71b8640 1 -- 172.21.15.19:0/3443711681 shutdown_connections 2023-11-20T06:41:25.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.292+0000 7f86a71b8640 1 --2- 172.21.15.19:0/3443711681 >> v2:172.21.15.190:3300/0 conn(0x7f86a0159ba0 0x7f86a00cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.292+0000 7f86a71b8640 1 --2- 172.21.15.19:0/3443711681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a01597c0 0x7f86a00ad6d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.292+0000 7f86a71b8640 1 -- 172.21.15.19:0/3443711681 >> 172.21.15.19:0/3443711681 conn(0x7f86a006c190 msgr2=0x7f86a006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:25.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.292+0000 7f86a71b8640 1 -- 172.21.15.19:0/3443711681 shutdown_connections 2023-11-20T06:41:25.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.292+0000 7f86a71b8640 1 -- 172.21.15.19:0/3443711681 wait complete. 2023-11-20T06:41:25.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.292+0000 7f86a71b8640 1 Processor -- start 2023-11-20T06:41:25.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.292+0000 7f86a71b8640 1 -- start start 2023-11-20T06:41:25.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.292+0000 7f86a71b8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a00adc10 0x7f86a0148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:25.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.292+0000 7f86a71b8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86a01597c0 0x7f86a01f0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:25.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.292+0000 7f86a71b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86a0159ba0 0x7f86a014f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.292+0000 7f86a71b8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00cb1d0 con 0x7f86a00adc10 2023-11-20T06:41:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.292+0000 7f86a71b8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a0148ea0 con 0x7f86a01597c0 2023-11-20T06:41:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.292+0000 7f86a71b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00ca9c0 con 0x7f86a0159ba0 2023-11-20T06:41:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.296+0000 7f86a4f54640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a00adc10 0x7f86a0148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.296+0000 7f86a4f54640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a00adc10 0x7f86a0148960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54132/0 (socket says 172.21.15.19:54132) 2023-11-20T06:41:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.296+0000 7f86a4f54640 1 -- 172.21.15.19:0/2103604617 learned_addr learned my addr 172.21.15.19:0/2103604617 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.296+0000 7f869ffff640 1 --2- 172.21.15.19:0/2103604617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86a01597c0 0x7f86a01f0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.296+0000 7f86a5755640 1 --2- 172.21.15.19:0/2103604617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86a0159ba0 0x7f86a014f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.296+0000 7f86a4f54640 1 -- 172.21.15.19:0/2103604617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86a0159ba0 msgr2=0x7f86a014f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.296+0000 7f86a4f54640 1 --2- 172.21.15.19:0/2103604617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86a0159ba0 0x7f86a014f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.296+0000 7f86a4f54640 1 -- 172.21.15.19:0/2103604617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86a01597c0 msgr2=0x7f86a01f0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:25.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.296+0000 7f86a4f54640 1 --2- 172.21.15.19:0/2103604617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86a01597c0 0x7f86a01f0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.296+0000 7f86a4f54640 1 -- 172.21.15.19:0/2103604617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869400b770 con 0x7f86a00adc10 2023-11-20T06:41:25.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.296+0000 7f869ffff640 1 --2- 172.21.15.19:0/2103604617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86a01597c0 0x7f86a01f0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:25.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.296+0000 7f86a4f54640 1 --2- 172.21.15.19:0/2103604617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a00adc10 0x7f86a0148960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f869400b2c0 tx=0x7f869401b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:25.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.296+0000 7f869d7fa640 1 -- 172.21.15.19:0/2103604617 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694006ee0 con 0x7f86a00adc10 2023-11-20T06:41:25.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.296+0000 7f869d7fa640 1 -- 172.21.15.19:0/2103604617 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86940afdf0 con 0x7f86a00adc10 2023-11-20T06:41:25.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.296+0000 7f869d7fa640 1 -- 172.21.15.19:0/2103604617 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86940b8640 con 0x7f86a00adc10 2023-11-20T06:41:25.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.296+0000 7f86a71b8640 1 -- 172.21.15.19:0/2103604617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a00cac10 con 0x7f86a00adc10 2023-11-20T06:41:25.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.296+0000 7f86a71b8640 1 -- 172.21.15.19:0/2103604617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a00c72f0 con 0x7f86a00adc10 2023-11-20T06:41:25.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.296+0000 7f86a71b8640 1 -- 172.21.15.19:0/2103604617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a00c7150 con 0x7f86a00adc10 2023-11-20T06:41:25.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.296+0000 7f869d7fa640 1 -- 172.21.15.19:0/2103604617 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f86940b6040 con 0x7f86a00adc10 2023-11-20T06:41:25.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.300+0000 7f869d7fa640 1 --2- 172.21.15.19:0/2103604617 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f86840664a0 0x7f8684068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:25.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.300+0000 7f869d7fa640 1 -- 172.21.15.19:0/2103604617 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8694121080 con 0x7f86a00adc10 2023-11-20T06:41:25.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.300+0000 7f869ffff640 1 --2- 172.21.15.19:0/2103604617 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f86840664a0 0x7f8684068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:25.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.300+0000 7f869ffff640 1 --2- 172.21.15.19:0/2103604617 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f86840664a0 0x7f8684068960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f86a015cfe0 tx=0x7f868c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:25.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.304+0000 7f869d7fa640 1 -- 172.21.15.19:0/2103604617 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f86a00c7150 con 0x7f86a00adc10 2023-11-20T06:41:25.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.464+0000 7f86a71b8640 1 -- 172.21.15.19:0/2103604617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86a00c7150 con 0x7f86a00adc10 2023-11-20T06:41:25.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.464+0000 7f869d7fa640 1 -- 172.21.15.19:0/2103604617 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f86a00c7150 con 0x7f86a00adc10 2023-11-20T06:41:25.470 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:25.470 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":25,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:20.306335+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:41:25.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.468+0000 7f86a71b8640 1 -- 172.21.15.19:0/2103604617 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f86840664a0 msgr2=0x7f8684068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:25.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.468+0000 7f86a71b8640 1 --2- 172.21.15.19:0/2103604617 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f86840664a0 0x7f8684068960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f86a015cfe0 tx=0x7f868c008040 comp rx=0 tx=0).stop 2023-11-20T06:41:25.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.468+0000 7f86a71b8640 1 -- 172.21.15.19:0/2103604617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a00adc10 msgr2=0x7f86a0148960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:25.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.468+0000 7f86a71b8640 1 --2- 172.21.15.19:0/2103604617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a00adc10 0x7f86a0148960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f869400b2c0 tx=0x7f869401b970 comp rx=0 tx=0).stop 2023-11-20T06:41:25.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.468+0000 7f86a71b8640 1 -- 172.21.15.19:0/2103604617 shutdown_connections 2023-11-20T06:41:25.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.468+0000 7f86a71b8640 1 --2- 172.21.15.19:0/2103604617 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f86840664a0 0x7f8684068960 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.468+0000 7f86a71b8640 1 --2- 172.21.15.19:0/2103604617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86a0159ba0 0x7f86a014f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.468+0000 7f86a71b8640 1 --2- 172.21.15.19:0/2103604617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86a01597c0 0x7f86a01f0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.468+0000 7f86a71b8640 1 --2- 172.21.15.19:0/2103604617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a00adc10 0x7f86a0148960 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.468+0000 7f86a71b8640 1 -- 172.21.15.19:0/2103604617 >> 172.21.15.19:0/2103604617 conn(0x7f86a006c190 msgr2=0x7f86a006c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:25.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.468+0000 7f86a71b8640 1 -- 172.21.15.19:0/2103604617 shutdown_connections 2023-11-20T06:41:25.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.468+0000 7f86a71b8640 1 -- 172.21.15.19:0/2103604617 wait complete. 2023-11-20T06:41:25.492 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T06:41:11.805111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T06:41:12.614034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T06:41:16.311206+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T06:41:25.492 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:41:25.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.632+0000 7faeb1b48640 1 Processor -- start 2023-11-20T06:41:25.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.632+0000 7faeb1b48640 1 -- start start 2023-11-20T06:41:25.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.636+0000 7faeb1b48640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faeac0cf210 0x7faeac0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:25.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.636+0000 7faeb1b48640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeac15cdc0 0x7faeac0b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:25.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.636+0000 7faeb1b48640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeac0cfb30 con 0x7faeac0d3320 2023-11-20T06:41:25.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.636+0000 7faeb1b48640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeac0d0880 con 0x7faeac0cf210 2023-11-20T06:41:25.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.636+0000 7faeb1b48640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0b1c00 con 0x7faeac15cdc0 2023-11-20T06:41:25.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.636+0000 7faeb0b46640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faeac0cf210 0x7faeac0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:25.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.636+0000 7faeb0b46640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faeac0cf210 0x7faeac0cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54134/0 (socket says 172.21.15.19:54134) 2023-11-20T06:41:25.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.636+0000 7faeb0b46640 1 -- 172.21.15.19:0/454631532 learned_addr learned my addr 172.21.15.19:0/454631532 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:25.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.636+0000 7faeabfff640 1 --2- 172.21.15.19:0/454631532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeac15cdc0 0x7faeac0b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:25.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.636+0000 7faeb0b46640 1 -- 172.21.15.19:0/454631532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeac15cdc0 msgr2=0x7faeac0b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:25.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.636+0000 7faeb0b46640 1 --2- 172.21.15.19:0/454631532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeac15cdc0 0x7faeac0b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.636+0000 7faeb0b46640 1 -- 172.21.15.19:0/454631532 >> v1:172.21.15.190:6789/0 conn(0x7faeac0d3320 legacy=0x7faeac0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:25.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.636+0000 7faeb0b46640 1 -- 172.21.15.19:0/454631532 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac0b1ee0 con 0x7faeac0cf210 2023-11-20T06:41:25.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.636+0000 7faeb0b46640 1 --2- 172.21.15.19:0/454631532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faeac0cf210 0x7faeac0cf5f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faea0006fd0 tx=0x7faeac0b4100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfee6808ba2a23ca server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:25.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeab7fe640 1 -- 172.21.15.19:0/454631532 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea00aa650 con 0x7faeac0cf210 2023-11-20T06:41:25.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeab7fe640 1 -- 172.21.15.19:0/454631532 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea00aa7b0 con 0x7faeac0cf210 2023-11-20T06:41:25.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeab7fe640 1 -- 172.21.15.19:0/454631532 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea00aab40 con 0x7faeac0cf210 2023-11-20T06:41:25.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeb1b48640 1 -- 172.21.15.19:0/454631532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faeac0cf210 msgr2=0x7faeac0cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:25.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeb1b48640 1 --2- 172.21.15.19:0/454631532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faeac0cf210 0x7faeac0cf5f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faea0006fd0 tx=0x7faeac0b4100 comp rx=0 tx=0).stop 2023-11-20T06:41:25.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeb1b48640 1 -- 172.21.15.19:0/454631532 shutdown_connections 2023-11-20T06:41:25.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeb1b48640 1 --2- 172.21.15.19:0/454631532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeac15cdc0 0x7faeac0b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeb1b48640 1 --2- 172.21.15.19:0/454631532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faeac0cf210 0x7faeac0cf5f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeb1b48640 1 -- 172.21.15.19:0/454631532 >> 172.21.15.19:0/454631532 conn(0x7faeac0d2800 msgr2=0x7faeac0d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:25.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeb1b48640 1 -- 172.21.15.19:0/454631532 shutdown_connections 2023-11-20T06:41:25.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeb1b48640 1 -- 172.21.15.19:0/454631532 wait complete. 2023-11-20T06:41:25.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeb1b48640 1 Processor -- start 2023-11-20T06:41:25.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeb1b48640 1 -- start start 2023-11-20T06:41:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeb1b48640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faeac0cf210 0x7faeac151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeb1b48640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeac0d3320 0x7faeac152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeb1b48640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeac15cdc0 0x7faeac15e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeb1b48640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0cb290 con 0x7faeac0cf210 2023-11-20T06:41:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeb1b48640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac152000 con 0x7faeac0d3320 2023-11-20T06:41:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeb1b48640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac15f100 con 0x7faeac15cdc0 2023-11-20T06:41:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeb0b46640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faeac0cf210 0x7faeac151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeb0b46640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faeac0cf210 0x7faeac151ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54136/0 (socket says 172.21.15.19:54136) 2023-11-20T06:41:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.640+0000 7faeb0b46640 1 -- 172.21.15.19:0/3614751061 learned_addr learned my addr 172.21.15.19:0/3614751061 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.644+0000 7faeabfff640 1 --2- 172.21.15.19:0/3614751061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeac0d3320 0x7faeac152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.644+0000 7faeb1347640 1 --2- 172.21.15.19:0/3614751061 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeac15cdc0 0x7faeac15e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.644+0000 7faeb0b46640 1 -- 172.21.15.19:0/3614751061 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeac15cdc0 msgr2=0x7faeac15e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.644+0000 7faeb0b46640 1 --2- 172.21.15.19:0/3614751061 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeac15cdc0 0x7faeac15e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.644+0000 7faeb0b46640 1 -- 172.21.15.19:0/3614751061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeac0d3320 msgr2=0x7faeac152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.644+0000 7faeb0b46640 1 --2- 172.21.15.19:0/3614751061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeac0d3320 0x7faeac152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.644+0000 7faeb0b46640 1 -- 172.21.15.19:0/3614751061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea0009480 con 0x7faeac0cf210 2023-11-20T06:41:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.644+0000 7faeabfff640 1 --2- 172.21.15.19:0/3614751061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeac0d3320 0x7faeac152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.644+0000 7faeb0b46640 1 --2- 172.21.15.19:0/3614751061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faeac0cf210 0x7faeac151ac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faea001aba0 tx=0x7faea0019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.644+0000 7faea97fa640 1 -- 172.21.15.19:0/3614751061 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea00aad30 con 0x7faeac0cf210 2023-11-20T06:41:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.644+0000 7faea97fa640 1 -- 172.21.15.19:0/3614751061 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea00aae90 con 0x7faeac0cf210 2023-11-20T06:41:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.644+0000 7faea97fa640 1 -- 172.21.15.19:0/3614751061 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0003860 con 0x7faeac0cf210 2023-11-20T06:41:25.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.644+0000 7faeb1b48640 1 -- 172.21.15.19:0/3614751061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeac15eb40 con 0x7faeac0cf210 2023-11-20T06:41:25.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.644+0000 7faeb1b48640 1 -- 172.21.15.19:0/3614751061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeac0caeb0 con 0x7faeac0cf210 2023-11-20T06:41:25.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.644+0000 7faeb1b48640 1 -- 172.21.15.19:0/3614751061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeac04e9c0 con 0x7faeac0cf210 2023-11-20T06:41:25.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.644+0000 7faea97fa640 1 -- 172.21.15.19:0/3614751061 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faea00039c0 con 0x7faeac0cf210 2023-11-20T06:41:25.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.644+0000 7faea97fa640 1 --2- 172.21.15.19:0/3614751061 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fae900664a0 0x7fae90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:25.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.644+0000 7faea97fa640 1 -- 172.21.15.19:0/3614751061 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faea011e7f0 con 0x7faeac0cf210 2023-11-20T06:41:25.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.648+0000 7faeabfff640 1 --2- 172.21.15.19:0/3614751061 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fae900664a0 0x7fae90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:25.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.648+0000 7faeabfff640 1 --2- 172.21.15.19:0/3614751061 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fae900664a0 0x7fae90068960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faeac0c9880 tx=0x7fae98008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:25.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.648+0000 7faea97fa640 1 -- 172.21.15.19:0/3614751061 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faea00eb8e0 con 0x7faeac0cf210 2023-11-20T06:41:25.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.808+0000 7faeb1b48640 1 -- 172.21.15.19:0/3614751061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faeac0d0bc0 con 0x7faeac0cf210 2023-11-20T06:41:25.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.808+0000 7faea97fa640 1 -- 172.21.15.19:0/3614751061 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7faea00eef00 con 0x7faeac0cf210 2023-11-20T06:41:25.812 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:41:25.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.808+0000 7faeb1b48640 1 -- 172.21.15.19:0/3614751061 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fae900664a0 msgr2=0x7fae90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:25.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.808+0000 7faeb1b48640 1 --2- 172.21.15.19:0/3614751061 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fae900664a0 0x7fae90068960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faeac0c9880 tx=0x7fae98008040 comp rx=0 tx=0).stop 2023-11-20T06:41:25.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.808+0000 7faeb1b48640 1 -- 172.21.15.19:0/3614751061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faeac0cf210 msgr2=0x7faeac151ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:25.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.808+0000 7faeb1b48640 1 --2- 172.21.15.19:0/3614751061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faeac0cf210 0x7faeac151ac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faea001aba0 tx=0x7faea0019290 comp rx=0 tx=0).stop 2023-11-20T06:41:25.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.808+0000 7faeb1b48640 1 -- 172.21.15.19:0/3614751061 shutdown_connections 2023-11-20T06:41:25.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.808+0000 7faeb1b48640 1 --2- 172.21.15.19:0/3614751061 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fae900664a0 0x7fae90068960 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.808+0000 7faeb1b48640 1 --2- 172.21.15.19:0/3614751061 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faeac15cdc0 0x7faeac15e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.808+0000 7faeb1b48640 1 --2- 172.21.15.19:0/3614751061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faeac0d3320 0x7faeac152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.808+0000 7faeb1b48640 1 --2- 172.21.15.19:0/3614751061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faeac0cf210 0x7faeac151ac0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.808+0000 7faeb1b48640 1 -- 172.21.15.19:0/3614751061 >> 172.21.15.19:0/3614751061 conn(0x7faeac0d2800 msgr2=0x7faeac0af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:25.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.808+0000 7faeb1b48640 1 -- 172.21.15.19:0/3614751061 shutdown_connections 2023-11-20T06:41:25.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.808+0000 7faeb1b48640 1 -- 172.21.15.19:0/3614751061 wait complete. 2023-11-20T06:41:25.833 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T06:41:25.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.972+0000 7f05ad0c9640 1 Processor -- start 2023-11-20T06:41:25.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.976+0000 7f05ad0c9640 1 -- start start 2023-11-20T06:41:25.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.976+0000 7f05ad0c9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f05a815cba0 0x7f05a80d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:25.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.976+0000 7f05ad0c9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f05a80b84e0 0x7f05a80cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:25.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.976+0000 7f05ad0c9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a80d1670 con 0x7f05a80d0040 2023-11-20T06:41:25.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.976+0000 7f05ad0c9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a80d1460 con 0x7f05a815cba0 2023-11-20T06:41:25.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.976+0000 7f05ad0c9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a80d04b0 con 0x7f05a80b84e0 2023-11-20T06:41:25.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.976+0000 7f05a6d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f05a815cba0 0x7f05a80d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:25.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.976+0000 7f05a759e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f05a80d0040 0x7f05a80d2ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:51210/0 (socket says 172.21.15.19:51210) 2023-11-20T06:41:25.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.976+0000 7f05a759e640 1 -- 172.21.15.19:0/2848527308 learned_addr learned my addr 172.21.15.19:0/2848527308 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:25.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.976+0000 7f059ffff640 1 --2- 172.21.15.19:0/2848527308 >> v2:172.21.15.190:3300/0 conn(0x7f05a80b84e0 0x7f05a80cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:25.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.976+0000 7f05a6d9d640 1 -- 172.21.15.19:0/2848527308 >> v2:172.21.15.190:3300/0 conn(0x7f05a80b84e0 msgr2=0x7f05a80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:25.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.976+0000 7f05a6d9d640 1 --2- 172.21.15.19:0/2848527308 >> v2:172.21.15.190:3300/0 conn(0x7f05a80b84e0 0x7f05a80cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.976+0000 7f05a6d9d640 1 -- 172.21.15.19:0/2848527308 >> v1:172.21.15.19:6789/0 conn(0x7f05a80d0040 legacy=0x7f05a80d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:25.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.976+0000 7f05a6d9d640 1 -- 172.21.15.19:0/2848527308 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a80d1950 con 0x7f05a815cba0 2023-11-20T06:41:25.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.976+0000 7f05a659c640 1 -- 172.21.15.19:0/2848527308 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1464699999 0 0) 0x7f05a80d1670 con 0x7f05a80d0040 2023-11-20T06:41:25.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.976+0000 7f059ffff640 1 --2- 172.21.15.19:0/2848527308 >> v2:172.21.15.190:3300/0 conn(0x7f05a80b84e0 0x7f05a80cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:25.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.980+0000 7f05a6d9d640 1 --2- 172.21.15.19:0/2848527308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05a815cba0 0x7f05a80d0f20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f05a80cf2f0 tx=0x7f059801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f82b64a5f4c1dc server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:25.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.980+0000 7f05a659c640 1 -- 172.21.15.19:0/2848527308 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05980ab600 con 0x7f05a815cba0 2023-11-20T06:41:25.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.980+0000 7f05a659c640 1 -- 172.21.15.19:0/2848527308 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05980a7050 con 0x7f05a815cba0 2023-11-20T06:41:25.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.980+0000 7f05a659c640 1 -- 172.21.15.19:0/2848527308 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05980ab980 con 0x7f05a815cba0 2023-11-20T06:41:25.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.980+0000 7f05ad0c9640 1 -- 172.21.15.19:0/2848527308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05a815cba0 msgr2=0x7f05a80d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:25.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.980+0000 7f05ad0c9640 1 --2- 172.21.15.19:0/2848527308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05a815cba0 0x7f05a80d0f20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f05a80cf2f0 tx=0x7f059801c3d0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.980+0000 7f05ad0c9640 1 -- 172.21.15.19:0/2848527308 shutdown_connections 2023-11-20T06:41:25.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.980+0000 7f05ad0c9640 1 --2- 172.21.15.19:0/2848527308 >> v2:172.21.15.190:3300/0 conn(0x7f05a80b84e0 0x7f05a80cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.980+0000 7f05ad0c9640 1 --2- 172.21.15.19:0/2848527308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05a815cba0 0x7f05a80d0f20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.980+0000 7f05ad0c9640 1 -- 172.21.15.19:0/2848527308 >> 172.21.15.19:0/2848527308 conn(0x7f05a80719c0 msgr2=0x7f05a8071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:25.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.980+0000 7f05ad0c9640 1 -- 172.21.15.19:0/2848527308 shutdown_connections 2023-11-20T06:41:25.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.980+0000 7f05ad0c9640 1 -- 172.21.15.19:0/2848527308 wait complete. 2023-11-20T06:41:25.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.980+0000 7f05ad0c9640 1 Processor -- start 2023-11-20T06:41:25.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.980+0000 7f05ad0c9640 1 -- start start 2023-11-20T06:41:25.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f05ad0c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05a80b84e0 0x7f05a814fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:25.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f05ad0c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05a80d0040 0x7f05a80c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:25.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f05ad0c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05a815cba0 0x7f05a8151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:25.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f05ad0c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a80c7150 con 0x7f05a80b84e0 2023-11-20T06:41:25.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f05ad0c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a8159020 con 0x7f05a80d0040 2023-11-20T06:41:25.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f05ad0c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a81592c0 con 0x7f05a815cba0 2023-11-20T06:41:25.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f05a6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05a80b84e0 0x7f05a814fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:25.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f05a6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05a80b84e0 0x7f05a814fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54150/0 (socket says 172.21.15.19:54150) 2023-11-20T06:41:25.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f05a6d9d640 1 -- 172.21.15.19:0/2262273943 learned_addr learned my addr 172.21.15.19:0/2262273943 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:25.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f05a6d9d640 1 -- 172.21.15.19:0/2262273943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05a815cba0 msgr2=0x7f05a8151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:25.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f05a6d9d640 1 --2- 172.21.15.19:0/2262273943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05a815cba0 0x7f05a8151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f05a6d9d640 1 -- 172.21.15.19:0/2262273943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05a80d0040 msgr2=0x7f05a80c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:25.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f059ffff640 1 --2- 172.21.15.19:0/2262273943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05a80d0040 0x7f05a80c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:25.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f05a6d9d640 1 --2- 172.21.15.19:0/2262273943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05a80d0040 0x7f05a80c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:25.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f05a6d9d640 1 -- 172.21.15.19:0/2262273943 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0598009420 con 0x7f05a80b84e0 2023-11-20T06:41:25.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f059ffff640 1 --2- 172.21.15.19:0/2262273943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05a80d0040 0x7f05a80c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:25.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f05a6d9d640 1 --2- 172.21.15.19:0/2262273943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05a80b84e0 0x7f05a814fa90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f05980ae040 tx=0x7f059801ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:25.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f059f7fe640 1 -- 172.21.15.19:0/2262273943 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05980b7650 con 0x7f05a80b84e0 2023-11-20T06:41:25.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f059f7fe640 1 -- 172.21.15.19:0/2262273943 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05980b77d0 con 0x7f05a80b84e0 2023-11-20T06:41:25.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f059f7fe640 1 -- 172.21.15.19:0/2262273943 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05980b7b80 con 0x7f05a80b84e0 2023-11-20T06:41:25.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f05ad0c9640 1 -- 172.21.15.19:0/2262273943 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a8157180 con 0x7f05a80b84e0 2023-11-20T06:41:25.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f05ad0c9640 1 -- 172.21.15.19:0/2262273943 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a80ca160 con 0x7f05a80b84e0 2023-11-20T06:41:25.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f05ad0c9640 1 -- 172.21.15.19:0/2262273943 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a804e170 con 0x7f05a80b84e0 2023-11-20T06:41:25.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.984+0000 7f059f7fe640 1 -- 172.21.15.19:0/2262273943 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f05980b7ce0 con 0x7f05a80b84e0 2023-11-20T06:41:25.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.988+0000 7f059f7fe640 1 --2- 172.21.15.19:0/2262273943 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f05880664a0 0x7f0588068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:25.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.988+0000 7f059f7fe640 1 -- 172.21.15.19:0/2262273943 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f059811ea60 con 0x7f05a80b84e0 2023-11-20T06:41:25.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.988+0000 7f059ffff640 1 --2- 172.21.15.19:0/2262273943 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f05880664a0 0x7f0588068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:25.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.988+0000 7f059ffff640 1 --2- 172.21.15.19:0/2262273943 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f05880664a0 0x7f0588068960 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f05a80cc970 tx=0x7f0590008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:25.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:25.992+0000 7f059f7fe640 1 -- 172.21.15.19:0/2262273943 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f05980ebb50 con 0x7f05a80b84e0 2023-11-20T06:41:26.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.148+0000 7f05ad0c9640 1 -- 172.21.15.19:0/2262273943 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f05a80b6ab0 con 0x7f05a80b84e0 2023-11-20T06:41:26.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.148+0000 7f059f7fe640 1 -- 172.21.15.19:0/2262273943 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f05980ef170 con 0x7f05a80b84e0 2023-11-20T06:41:26.153 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:41:26.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.148+0000 7f05ad0c9640 1 -- 172.21.15.19:0/2262273943 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f05880664a0 msgr2=0x7f0588068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:26.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.148+0000 7f05ad0c9640 1 --2- 172.21.15.19:0/2262273943 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f05880664a0 0x7f0588068960 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f05a80cc970 tx=0x7f0590008040 comp rx=0 tx=0).stop 2023-11-20T06:41:26.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.148+0000 7f05ad0c9640 1 -- 172.21.15.19:0/2262273943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05a80b84e0 msgr2=0x7f05a814fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:26.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.148+0000 7f05ad0c9640 1 --2- 172.21.15.19:0/2262273943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05a80b84e0 0x7f05a814fa90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f05980ae040 tx=0x7f059801ac10 comp rx=0 tx=0).stop 2023-11-20T06:41:26.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.148+0000 7f05ad0c9640 1 -- 172.21.15.19:0/2262273943 shutdown_connections 2023-11-20T06:41:26.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.148+0000 7f05ad0c9640 1 --2- 172.21.15.19:0/2262273943 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f05880664a0 0x7f0588068960 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.148+0000 7f05ad0c9640 1 --2- 172.21.15.19:0/2262273943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05a815cba0 0x7f05a8151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.148+0000 7f05ad0c9640 1 --2- 172.21.15.19:0/2262273943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05a80d0040 0x7f05a80c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.148+0000 7f05ad0c9640 1 --2- 172.21.15.19:0/2262273943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05a80b84e0 0x7f05a814fa90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.148+0000 7f05ad0c9640 1 -- 172.21.15.19:0/2262273943 >> 172.21.15.19:0/2262273943 conn(0x7f05a80719c0 msgr2=0x7f05a8159ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:26.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.148+0000 7f05ad0c9640 1 -- 172.21.15.19:0/2262273943 shutdown_connections 2023-11-20T06:41:26.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.148+0000 7f05ad0c9640 1 -- 172.21.15.19:0/2262273943 wait complete. 2023-11-20T06:41:26.173 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T06:41:26.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.316+0000 7fe0183b8640 1 Processor -- start 2023-11-20T06:41:26.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.316+0000 7fe0183b8640 1 -- start start 2023-11-20T06:41:26.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.316+0000 7fe0183b8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe01015cba0 0x7fe0100d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:26.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.316+0000 7fe0183b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0100b84e0 0x7fe0100cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:26.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.316+0000 7fe0183b8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe0100d0040 0x7fe0100d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.316+0000 7fe0183b8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0100d1460 con 0x7fe01015cba0 2023-11-20T06:41:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.316+0000 7fe0183b8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0100d04b0 con 0x7fe0100d0040 2023-11-20T06:41:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.316+0000 7fe0183b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0100d1670 con 0x7fe0100b84e0 2023-11-20T06:41:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.316+0000 7fe016154640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe01015cba0 0x7fe0100d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.316+0000 7fe016154640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe01015cba0 0x7fe0100d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54164/0 (socket says 172.21.15.19:54164) 2023-11-20T06:41:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.316+0000 7fe016154640 1 -- 172.21.15.19:0/752090046 learned_addr learned my addr 172.21.15.19:0/752090046 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.316+0000 7fe015953640 1 --2- 172.21.15.19:0/752090046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0100b84e0 0x7fe0100cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.316+0000 7fe016955640 1 --2- 172.21.15.19:0/752090046 >> v2:172.21.15.190:3300/0 conn(0x7fe0100d0040 0x7fe0100d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.316+0000 7fe016154640 1 -- 172.21.15.19:0/752090046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0100b84e0 msgr2=0x7fe0100cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.316+0000 7fe016154640 1 --2- 172.21.15.19:0/752090046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0100b84e0 0x7fe0100cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.316+0000 7fe016154640 1 -- 172.21.15.19:0/752090046 >> v2:172.21.15.190:3300/0 conn(0x7fe0100d0040 msgr2=0x7fe0100d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.316+0000 7fe016154640 1 --2- 172.21.15.19:0/752090046 >> v2:172.21.15.190:3300/0 conn(0x7fe0100d0040 0x7fe0100d2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.316+0000 7fe016154640 1 -- 172.21.15.19:0/752090046 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0100d1950 con 0x7fe01015cba0 2023-11-20T06:41:26.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.316+0000 7fe015953640 1 --2- 172.21.15.19:0/752090046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0100b84e0 0x7fe0100cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:26.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.320+0000 7fe016154640 1 --2- 172.21.15.19:0/752090046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe01015cba0 0x7fe0100d0f20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe0100cf040 tx=0x7fe00c01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a479e6ef6c6bc3fc server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:26.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.320+0000 7fe015152640 1 -- 172.21.15.19:0/752090046 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0ab600 con 0x7fe01015cba0 2023-11-20T06:41:26.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.320+0000 7fe015152640 1 -- 172.21.15.19:0/752090046 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c0a7050 con 0x7fe01015cba0 2023-11-20T06:41:26.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.320+0000 7fe015152640 1 -- 172.21.15.19:0/752090046 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0ab980 con 0x7fe01015cba0 2023-11-20T06:41:26.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.320+0000 7fe0183b8640 1 -- 172.21.15.19:0/752090046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe01015cba0 msgr2=0x7fe0100d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:26.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.320+0000 7fe0183b8640 1 --2- 172.21.15.19:0/752090046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe01015cba0 0x7fe0100d0f20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe0100cf040 tx=0x7fe00c01c240 comp rx=0 tx=0).stop 2023-11-20T06:41:26.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.320+0000 7fe0183b8640 1 -- 172.21.15.19:0/752090046 shutdown_connections 2023-11-20T06:41:26.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.320+0000 7fe0183b8640 1 --2- 172.21.15.19:0/752090046 >> v2:172.21.15.190:3300/0 conn(0x7fe0100d0040 0x7fe0100d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.320+0000 7fe0183b8640 1 --2- 172.21.15.19:0/752090046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0100b84e0 0x7fe0100cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.320+0000 7fe0183b8640 1 --2- 172.21.15.19:0/752090046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe01015cba0 0x7fe0100d0f20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.320+0000 7fe0183b8640 1 -- 172.21.15.19:0/752090046 >> 172.21.15.19:0/752090046 conn(0x7fe0100719c0 msgr2=0x7fe010071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:26.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.320+0000 7fe0183b8640 1 -- 172.21.15.19:0/752090046 shutdown_connections 2023-11-20T06:41:26.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.320+0000 7fe0183b8640 1 -- 172.21.15.19:0/752090046 wait complete. 2023-11-20T06:41:26.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe0183b8640 1 Processor -- start 2023-11-20T06:41:26.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe0183b8640 1 -- start start 2023-11-20T06:41:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe0183b8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0100b84e0 0x7fe010158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe0183b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0100d0040 0x7fe0101f5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe0183b8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe01015cba0 0x7fe01014fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe0183b8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0101595d0 con 0x7fe01015cba0 2023-11-20T06:41:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe0183b8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe010151370 con 0x7fe0100b84e0 2023-11-20T06:41:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe0183b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0101592f0 con 0x7fe0100d0040 2023-11-20T06:41:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe016955640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe01015cba0 0x7fe01014fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe016955640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe01015cba0 0x7fe01014fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54170/0 (socket says 172.21.15.19:54170) 2023-11-20T06:41:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe016955640 1 -- 172.21.15.19:0/559830519 learned_addr learned my addr 172.21.15.19:0/559830519 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe015953640 1 --2- 172.21.15.19:0/559830519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0100d0040 0x7fe0101f5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe016154640 1 --2- 172.21.15.19:0/559830519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0100b84e0 0x7fe010158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe016955640 1 -- 172.21.15.19:0/559830519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0100d0040 msgr2=0x7fe0101f5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe016955640 1 --2- 172.21.15.19:0/559830519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0100d0040 0x7fe0101f5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe016955640 1 -- 172.21.15.19:0/559830519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0100b84e0 msgr2=0x7fe010158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe016955640 1 --2- 172.21.15.19:0/559830519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0100b84e0 0x7fe010158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe016955640 1 -- 172.21.15.19:0/559830519 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c0094d0 con 0x7fe01015cba0 2023-11-20T06:41:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe015953640 1 --2- 172.21.15.19:0/559830519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0100d0040 0x7fe0101f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe016154640 1 --2- 172.21.15.19:0/559830519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0100b84e0 0x7fe010158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe016955640 1 --2- 172.21.15.19:0/559830519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe01015cba0 0x7fe01014fdf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe008007e40 tx=0x7fe00800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:26.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe006ffd640 1 -- 172.21.15.19:0/559830519 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe008014620 con 0x7fe01015cba0 2023-11-20T06:41:26.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe006ffd640 1 -- 172.21.15.19:0/559830519 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00800ee90 con 0x7fe01015cba0 2023-11-20T06:41:26.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe006ffd640 1 -- 172.21.15.19:0/559830519 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0080149e0 con 0x7fe01015cba0 2023-11-20T06:41:26.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe0183b8640 1 -- 172.21.15.19:0/559830519 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe010150d20 con 0x7fe01015cba0 2023-11-20T06:41:26.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.324+0000 7fe0183b8640 1 -- 172.21.15.19:0/559830519 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe010157a50 con 0x7fe01015cba0 2023-11-20T06:41:26.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.328+0000 7fe0183b8640 1 -- 172.21.15.19:0/559830519 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0101514e0 con 0x7fe01015cba0 2023-11-20T06:41:26.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.328+0000 7fe006ffd640 1 -- 172.21.15.19:0/559830519 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe008014b40 con 0x7fe01015cba0 2023-11-20T06:41:26.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.328+0000 7fe006ffd640 1 --2- 172.21.15.19:0/559830519 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdff40664a0 0x7fdff4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:26.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.328+0000 7fe006ffd640 1 -- 172.21.15.19:0/559830519 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe008084cb0 con 0x7fe01015cba0 2023-11-20T06:41:26.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.328+0000 7fe016154640 1 --2- 172.21.15.19:0/559830519 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdff40664a0 0x7fdff4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:26.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.328+0000 7fe016154640 1 --2- 172.21.15.19:0/559830519 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdff40664a0 0x7fdff4068960 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0ad000 tx=0x7fe00c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:26.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.332+0000 7fe006ffd640 1 -- 172.21.15.19:0/559830519 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe008051d10 con 0x7fe01015cba0 2023-11-20T06:41:26.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.488+0000 7fe0183b8640 1 -- 172.21.15.19:0/559830519 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe01004e170 con 0x7fe01015cba0 2023-11-20T06:41:26.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.488+0000 7fe006ffd640 1 -- 172.21.15.19:0/559830519 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe008055330 con 0x7fe01015cba0 2023-11-20T06:41:26.495 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-20T06:41:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.492+0000 7fe0183b8640 1 -- 172.21.15.19:0/559830519 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdff40664a0 msgr2=0x7fdff4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.492+0000 7fe0183b8640 1 --2- 172.21.15.19:0/559830519 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdff40664a0 0x7fdff4068960 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0ad000 tx=0x7fe00c008040 comp rx=0 tx=0).stop 2023-11-20T06:41:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.492+0000 7fe0183b8640 1 -- 172.21.15.19:0/559830519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe01015cba0 msgr2=0x7fe01014fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.492+0000 7fe0183b8640 1 --2- 172.21.15.19:0/559830519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe01015cba0 0x7fe01014fdf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe008007e40 tx=0x7fe00800e4b0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.492+0000 7fe0183b8640 1 -- 172.21.15.19:0/559830519 shutdown_connections 2023-11-20T06:41:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.492+0000 7fe0183b8640 1 --2- 172.21.15.19:0/559830519 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdff40664a0 0x7fdff4068960 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.492+0000 7fe0183b8640 1 --2- 172.21.15.19:0/559830519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe01015cba0 0x7fe01014fdf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.492+0000 7fe0183b8640 1 --2- 172.21.15.19:0/559830519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0100d0040 0x7fe0101f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.492+0000 7fe0183b8640 1 --2- 172.21.15.19:0/559830519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0100b84e0 0x7fe010158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.492+0000 7fe0183b8640 1 -- 172.21.15.19:0/559830519 >> 172.21.15.19:0/559830519 conn(0x7fe0100719c0 msgr2=0x7fe010152ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:26.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.492+0000 7fe0183b8640 1 -- 172.21.15.19:0/559830519 shutdown_connections 2023-11-20T06:41:26.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.492+0000 7fe0183b8640 1 -- 172.21.15.19:0/559830519 wait complete. 2023-11-20T06:41:26.515 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T06:41:26.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.656+0000 7f523f9c5640 1 Processor -- start 2023-11-20T06:41:26.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.656+0000 7f523f9c5640 1 -- start start 2023-11-20T06:41:26.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.656+0000 7f523f9c5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f523815cba0 0x7f52380d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:26.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.656+0000 7f523f9c5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f52380b84e0 0x7f52380cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:26.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.656+0000 7f523f9c5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380d0040 0x7f52380d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:26.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.656+0000 7f523f9c5640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52380d1460 con 0x7f523815cba0 2023-11-20T06:41:26.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.656+0000 7f523f9c5640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52380d04b0 con 0x7f52380b84e0 2023-11-20T06:41:26.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.656+0000 7f523f9c5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52380d1670 con 0x7f52380d0040 2023-11-20T06:41:26.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.656+0000 7f523d761640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f523815cba0 0x7f52380d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:26.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.656+0000 7f523d761640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f523815cba0 0x7f52380d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54186/0 (socket says 172.21.15.19:54186) 2023-11-20T06:41:26.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.656+0000 7f523d761640 1 -- 172.21.15.19:0/2293974801 learned_addr learned my addr 172.21.15.19:0/2293974801 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:26.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.656+0000 7f523cf60640 1 --2- 172.21.15.19:0/2293974801 >> v2:172.21.15.190:3300/0 conn(0x7f52380b84e0 0x7f52380cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:26.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.656+0000 7f523df62640 1 --2- 172.21.15.19:0/2293974801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380d0040 0x7f52380d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:26.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.656+0000 7f523d761640 1 -- 172.21.15.19:0/2293974801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380d0040 msgr2=0x7f52380d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:26.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.656+0000 7f523d761640 1 --2- 172.21.15.19:0/2293974801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380d0040 0x7f52380d2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.656+0000 7f523d761640 1 -- 172.21.15.19:0/2293974801 >> v2:172.21.15.190:3300/0 conn(0x7f52380b84e0 msgr2=0x7f52380cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:26.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.656+0000 7f523d761640 1 --2- 172.21.15.19:0/2293974801 >> v2:172.21.15.190:3300/0 conn(0x7f52380b84e0 0x7f52380cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.656+0000 7f523d761640 1 -- 172.21.15.19:0/2293974801 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52380d1950 con 0x7f523815cba0 2023-11-20T06:41:26.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.656+0000 7f523cf60640 1 --2- 172.21.15.19:0/2293974801 >> v2:172.21.15.190:3300/0 conn(0x7f52380b84e0 0x7f52380cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:26.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.656+0000 7f523df62640 1 --2- 172.21.15.19:0/2293974801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380d0040 0x7f52380d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:26.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.660+0000 7f523d761640 1 --2- 172.21.15.19:0/2293974801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f523815cba0 0x7f52380d0f20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f52380cf2f0 tx=0x7f523401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d664c8098b821ba6 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:26.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.660+0000 7f522ffff640 1 -- 172.21.15.19:0/2293974801 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52340ab600 con 0x7f523815cba0 2023-11-20T06:41:26.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.660+0000 7f522ffff640 1 -- 172.21.15.19:0/2293974801 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52340a7050 con 0x7f523815cba0 2023-11-20T06:41:26.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.660+0000 7f522ffff640 1 -- 172.21.15.19:0/2293974801 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52340ab980 con 0x7f523815cba0 2023-11-20T06:41:26.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.660+0000 7f523f9c5640 1 -- 172.21.15.19:0/2293974801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f523815cba0 msgr2=0x7f52380d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:26.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.660+0000 7f523f9c5640 1 --2- 172.21.15.19:0/2293974801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f523815cba0 0x7f52380d0f20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f52380cf2f0 tx=0x7f523401c240 comp rx=0 tx=0).stop 2023-11-20T06:41:26.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.660+0000 7f523f9c5640 1 -- 172.21.15.19:0/2293974801 shutdown_connections 2023-11-20T06:41:26.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.660+0000 7f523f9c5640 1 --2- 172.21.15.19:0/2293974801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380d0040 0x7f52380d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.660+0000 7f523f9c5640 1 --2- 172.21.15.19:0/2293974801 >> v2:172.21.15.190:3300/0 conn(0x7f52380b84e0 0x7f52380cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.660+0000 7f523f9c5640 1 --2- 172.21.15.19:0/2293974801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f523815cba0 0x7f52380d0f20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.660+0000 7f523f9c5640 1 -- 172.21.15.19:0/2293974801 >> 172.21.15.19:0/2293974801 conn(0x7f52380719c0 msgr2=0x7f5238071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:26.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.660+0000 7f523f9c5640 1 -- 172.21.15.19:0/2293974801 shutdown_connections 2023-11-20T06:41:26.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.660+0000 7f523f9c5640 1 -- 172.21.15.19:0/2293974801 wait complete. 2023-11-20T06:41:26.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f523f9c5640 1 Processor -- start 2023-11-20T06:41:26.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f523f9c5640 1 -- start start 2023-11-20T06:41:26.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f523f9c5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52380b84e0 0x7f523814e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:26.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f523f9c5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380d0040 0x7f523814f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:26.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f523f9c5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f523815cba0 0x7f5238151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:26.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f523f9c5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523814e6f0 con 0x7f52380b84e0 2023-11-20T06:41:26.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f523f9c5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523814e8c0 con 0x7f523815cba0 2023-11-20T06:41:26.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f523f9c5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523814eba0 con 0x7f52380d0040 2023-11-20T06:41:26.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f523d761640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52380b84e0 0x7f523814e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:26.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f523d761640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52380b84e0 0x7f523814e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54190/0 (socket says 172.21.15.19:54190) 2023-11-20T06:41:26.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f523d761640 1 -- 172.21.15.19:0/751783053 learned_addr learned my addr 172.21.15.19:0/751783053 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:26.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f523d761640 1 -- 172.21.15.19:0/751783053 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380d0040 msgr2=0x7f523814f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:26.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f523d761640 1 --2- 172.21.15.19:0/751783053 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380d0040 0x7f523814f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f523d761640 1 -- 172.21.15.19:0/751783053 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f523815cba0 msgr2=0x7f5238151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:26.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f523d761640 1 --2- 172.21.15.19:0/751783053 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f523815cba0 0x7f5238151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f523d761640 1 -- 172.21.15.19:0/751783053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52340094d0 con 0x7f52380b84e0 2023-11-20T06:41:26.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f523d761640 1 --2- 172.21.15.19:0/751783053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52380b84e0 0x7f523814e1b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f52340ae040 tx=0x7f5234018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:26.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f522dffb640 1 -- 172.21.15.19:0/751783053 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52340b4640 con 0x7f52380b84e0 2023-11-20T06:41:26.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f522dffb640 1 -- 172.21.15.19:0/751783053 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52340a4e90 con 0x7f52380b84e0 2023-11-20T06:41:26.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f523f9c5640 1 -- 172.21.15.19:0/751783053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523814ee80 con 0x7f52380b84e0 2023-11-20T06:41:26.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f522dffb640 1 -- 172.21.15.19:0/751783053 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52340b4a00 con 0x7f52380b84e0 2023-11-20T06:41:26.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.664+0000 7f523f9c5640 1 -- 172.21.15.19:0/751783053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523814f440 con 0x7f52380b84e0 2023-11-20T06:41:26.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.668+0000 7f523f9c5640 1 -- 172.21.15.19:0/751783053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523804e170 con 0x7f52380b84e0 2023-11-20T06:41:26.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.668+0000 7f522dffb640 1 -- 172.21.15.19:0/751783053 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f52340b2070 con 0x7f52380b84e0 2023-11-20T06:41:26.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.668+0000 7f522dffb640 1 --2- 172.21.15.19:0/751783053 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f521c0664a0 0x7f521c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:26.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.668+0000 7f522dffb640 1 -- 172.21.15.19:0/751783053 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f523411dfa0 con 0x7f52380b84e0 2023-11-20T06:41:26.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.668+0000 7f523cf60640 1 --2- 172.21.15.19:0/751783053 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f521c0664a0 0x7f521c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:26.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.668+0000 7f523cf60640 1 --2- 172.21.15.19:0/751783053 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f521c0664a0 0x7f521c068960 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5228006b20 tx=0x7f5228008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:26.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.672+0000 7f522dffb640 1 -- 172.21.15.19:0/751783053 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f52340eb1b0 con 0x7f52380b84e0 2023-11-20T06:41:26.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.832+0000 7f523f9c5640 1 -- 172.21.15.19:0/751783053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5238153c70 con 0x7f52380b84e0 2023-11-20T06:41:26.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.832+0000 7f522dffb640 1 -- 172.21.15.19:0/751783053 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f52340b00a0 con 0x7f52380b84e0 2023-11-20T06:41:26.837 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:41:26.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.836+0000 7f523f9c5640 1 -- 172.21.15.19:0/751783053 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f521c0664a0 msgr2=0x7f521c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:26.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.836+0000 7f523f9c5640 1 --2- 172.21.15.19:0/751783053 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f521c0664a0 0x7f521c068960 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5228006b20 tx=0x7f5228008040 comp rx=0 tx=0).stop 2023-11-20T06:41:26.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.836+0000 7f523f9c5640 1 -- 172.21.15.19:0/751783053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52380b84e0 msgr2=0x7f523814e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:26.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.836+0000 7f523f9c5640 1 --2- 172.21.15.19:0/751783053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52380b84e0 0x7f523814e1b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f52340ae040 tx=0x7f5234018fe0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.836+0000 7f523f9c5640 1 -- 172.21.15.19:0/751783053 shutdown_connections 2023-11-20T06:41:26.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.836+0000 7f523f9c5640 1 --2- 172.21.15.19:0/751783053 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f521c0664a0 0x7f521c068960 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.836+0000 7f523f9c5640 1 --2- 172.21.15.19:0/751783053 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f523815cba0 0x7f5238151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.836+0000 7f523f9c5640 1 --2- 172.21.15.19:0/751783053 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52380d0040 0x7f523814f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.836+0000 7f523f9c5640 1 --2- 172.21.15.19:0/751783053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52380b84e0 0x7f523814e1b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:26.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.836+0000 7f523f9c5640 1 -- 172.21.15.19:0/751783053 >> 172.21.15.19:0/751783053 conn(0x7f52380719c0 msgr2=0x7f523806b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:26.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.836+0000 7f523f9c5640 1 -- 172.21.15.19:0/751783053 shutdown_connections 2023-11-20T06:41:26.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:26.836+0000 7f523f9c5640 1 -- 172.21.15.19:0/751783053 wait complete. 2023-11-20T06:41:26.858 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T06:41:27.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.000+0000 7f4200780640 1 Processor -- start 2023-11-20T06:41:27.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.000+0000 7f4200780640 1 -- start start 2023-11-20T06:41:27.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.000+0000 7f4200780640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f41f80b00e0 0x7f41f80b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:27.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.000+0000 7f4200780640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f80cb1d0 con 0x7f41f80cca20 2023-11-20T06:41:27.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.000+0000 7f4200780640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f80cb4b0 con 0x7f41f815a880 2023-11-20T06:41:27.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.000+0000 7f4200780640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f80b0ab0 con 0x7f41f80b00e0 2023-11-20T06:41:27.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.000+0000 7f41fed1d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f41f80cca20 0x7f41f80cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:51222/0 (socket says 172.21.15.19:51222) 2023-11-20T06:41:27.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.000+0000 7f41fed1d640 1 -- 172.21.15.19:0/2643103669 learned_addr learned my addr 172.21.15.19:0/2643103669 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:27.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.000+0000 7f41fdd1b640 1 --2- 172.21.15.19:0/2643103669 >> v2:172.21.15.190:3300/0 conn(0x7f41f80b00e0 0x7f41f80b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:27.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.000+0000 7f41fd51a640 1 -- 172.21.15.19:0/2643103669 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273164824 0 0) 0x7f41f80cb1d0 con 0x7f41f80cca20 2023-11-20T06:41:27.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.000+0000 7f41fd51a640 1 -- 172.21.15.19:0/2643103669 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41e4003530 con 0x7f41f80cca20 2023-11-20T06:41:27.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.000+0000 7f41fdd1b640 1 -- 172.21.15.19:0/2643103669 >> v1:172.21.15.190:6789/0 conn(0x7f41f815a880 legacy=0x7f41f815dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:27.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.000+0000 7f41fd51a640 1 -- 172.21.15.19:0/2643103669 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743602033 0 0) 0x7f41f80cb4b0 con 0x7f41f815a880 2023-11-20T06:41:27.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.000+0000 7f41fdd1b640 1 -- 172.21.15.19:0/2643103669 >> v1:172.21.15.19:6789/0 conn(0x7f41f80cca20 legacy=0x7f41f80cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:27.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.000+0000 7f41fdd1b640 1 -- 172.21.15.19:0/2643103669 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f80cb790 con 0x7f41f80b00e0 2023-11-20T06:41:27.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.004+0000 7f41fdd1b640 1 --2- 172.21.15.19:0/2643103669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41f80b00e0 0x7f41f80b0570 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f41e80097c0 tx=0x7f41e801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95d9f0f0574d1c46 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:27.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.004+0000 7f41fd51a640 1 -- 172.21.15.19:0/2643103669 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f80cdd90 con 0x7f41f80b00e0 2023-11-20T06:41:27.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.004+0000 7f41fd51a640 1 -- 172.21.15.19:0/2643103669 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e80a7050 con 0x7f41f80b00e0 2023-11-20T06:41:27.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.004+0000 7f41fd51a640 1 -- 172.21.15.19:0/2643103669 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e80ab820 con 0x7f41f80b00e0 2023-11-20T06:41:27.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.004+0000 7f4200780640 1 -- 172.21.15.19:0/2643103669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41f80b00e0 msgr2=0x7f41f80b0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:27.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.004+0000 7f4200780640 1 --2- 172.21.15.19:0/2643103669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41f80b00e0 0x7f41f80b0570 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f41e80097c0 tx=0x7f41e801c480 comp rx=0 tx=0).stop 2023-11-20T06:41:27.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.004+0000 7f4200780640 1 -- 172.21.15.19:0/2643103669 shutdown_connections 2023-11-20T06:41:27.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.004+0000 7f4200780640 1 --2- 172.21.15.19:0/2643103669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41f80b00e0 0x7f41f80b0570 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.004+0000 7f4200780640 1 -- 172.21.15.19:0/2643103669 >> 172.21.15.19:0/2643103669 conn(0x7f41f806c190 msgr2=0x7f41f806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:27.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.004+0000 7f4200780640 1 -- 172.21.15.19:0/2643103669 shutdown_connections 2023-11-20T06:41:27.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.004+0000 7f4200780640 1 -- 172.21.15.19:0/2643103669 wait complete. 2023-11-20T06:41:27.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f4200780640 1 Processor -- start 2023-11-20T06:41:27.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f4200780640 1 -- start start 2023-11-20T06:41:27.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f4200780640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41f80b00e0 0x7f41f814c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:27.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f4200780640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41f80cca20 0x7f41f8157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:27.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f4200780640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41f815a880 0x7f41f81550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:27.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f4200780640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f8154c60 con 0x7f41f80cca20 2023-11-20T06:41:27.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f4200780640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f8156a50 con 0x7f41f80b00e0 2023-11-20T06:41:27.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f4200780640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f815c630 con 0x7f41f815a880 2023-11-20T06:41:27.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f41fdd1b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41f80cca20 0x7f41f8157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:27.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f41fdd1b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41f80cca20 0x7f41f8157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54202/0 (socket says 172.21.15.19:54202) 2023-11-20T06:41:27.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f41fdd1b640 1 -- 172.21.15.19:0/1929318246 learned_addr learned my addr 172.21.15.19:0/1929318246 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:27.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f41fed1d640 1 --2- 172.21.15.19:0/1929318246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41f815a880 0x7f41f81550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:27.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f41fe51c640 1 --2- 172.21.15.19:0/1929318246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41f80b00e0 0x7f41f814c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:27.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f41fdd1b640 1 -- 172.21.15.19:0/1929318246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41f815a880 msgr2=0x7f41f81550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:27.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f41fdd1b640 1 --2- 172.21.15.19:0/1929318246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41f815a880 0x7f41f81550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f41fdd1b640 1 -- 172.21.15.19:0/1929318246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41f80b00e0 msgr2=0x7f41f814c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:27.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f41fdd1b640 1 --2- 172.21.15.19:0/1929318246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41f80b00e0 0x7f41f814c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f41fdd1b640 1 -- 172.21.15.19:0/1929318246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e8009420 con 0x7f41f80cca20 2023-11-20T06:41:27.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f41fed1d640 1 --2- 172.21.15.19:0/1929318246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41f815a880 0x7f41f81550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:27.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f41fdd1b640 1 --2- 172.21.15.19:0/1929318246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41f80cca20 0x7f41f8157d40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f41e80097c0 tx=0x7f41e8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:27.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f41eeffd640 1 -- 172.21.15.19:0/1929318246 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8004020 con 0x7f41f80cca20 2023-11-20T06:41:27.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f41eeffd640 1 -- 172.21.15.19:0/1929318246 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e8004180 con 0x7f41f80cca20 2023-11-20T06:41:27.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f41eeffd640 1 -- 172.21.15.19:0/1929318246 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e80044f0 con 0x7f41f80cca20 2023-11-20T06:41:27.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f4200780640 1 -- 172.21.15.19:0/1929318246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f8156490 con 0x7f41f80cca20 2023-11-20T06:41:27.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f4200780640 1 -- 172.21.15.19:0/1929318246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f81548f0 con 0x7f41f80cca20 2023-11-20T06:41:27.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.008+0000 7f4200780640 1 -- 172.21.15.19:0/1929318246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f8154ab0 con 0x7f41f80cca20 2023-11-20T06:41:27.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.012+0000 7f41eeffd640 1 -- 172.21.15.19:0/1929318246 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f41e80b2040 con 0x7f41f80cca20 2023-11-20T06:41:27.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.012+0000 7f41eeffd640 1 --2- 172.21.15.19:0/1929318246 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f41dc0664d0 0x7f41dc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:27.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.012+0000 7f41eeffd640 1 -- 172.21.15.19:0/1929318246 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f41e811dfe0 con 0x7f41f80cca20 2023-11-20T06:41:27.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.012+0000 7f41fe51c640 1 --2- 172.21.15.19:0/1929318246 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f41dc0664d0 0x7f41dc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:27.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.012+0000 7f41fe51c640 1 --2- 172.21.15.19:0/1929318246 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f41dc0664d0 0x7f41dc068990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f41f4000f70 tx=0x7f41f4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:27.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.016+0000 7f41eeffd640 1 -- 172.21.15.19:0/1929318246 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f41e80eb180 con 0x7f41f80cca20 2023-11-20T06:41:27.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.188+0000 7f4200780640 1 -- 172.21.15.19:0/1929318246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f41f8074010 con 0x7f41f80cca20 2023-11-20T06:41:27.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.188+0000 7f41eeffd640 1 -- 172.21.15.19:0/1929318246 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f41e80ee7a0 con 0x7f41f80cca20 2023-11-20T06:41:27.192 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2023-11-20T06:41:27.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.188+0000 7f4200780640 1 -- 172.21.15.19:0/1929318246 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f41dc0664d0 msgr2=0x7f41dc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:27.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.188+0000 7f4200780640 1 --2- 172.21.15.19:0/1929318246 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f41dc0664d0 0x7f41dc068990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f41f4000f70 tx=0x7f41f4009040 comp rx=0 tx=0).stop 2023-11-20T06:41:27.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.188+0000 7f4200780640 1 -- 172.21.15.19:0/1929318246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41f80cca20 msgr2=0x7f41f8157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:27.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.188+0000 7f4200780640 1 --2- 172.21.15.19:0/1929318246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41f80cca20 0x7f41f8157d40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f41e80097c0 tx=0x7f41e8019220 comp rx=0 tx=0).stop 2023-11-20T06:41:27.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.188+0000 7f4200780640 1 -- 172.21.15.19:0/1929318246 shutdown_connections 2023-11-20T06:41:27.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.188+0000 7f4200780640 1 --2- 172.21.15.19:0/1929318246 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f41dc0664d0 0x7f41dc068990 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.188+0000 7f4200780640 1 --2- 172.21.15.19:0/1929318246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41f815a880 0x7f41f81550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.188+0000 7f4200780640 1 --2- 172.21.15.19:0/1929318246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41f80cca20 0x7f41f8157d40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.188+0000 7f4200780640 1 --2- 172.21.15.19:0/1929318246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41f80b00e0 0x7f41f814c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.188+0000 7f4200780640 1 -- 172.21.15.19:0/1929318246 >> 172.21.15.19:0/1929318246 conn(0x7f41f806c190 msgr2=0x7f41f80703e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:27.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.188+0000 7f4200780640 1 -- 172.21.15.19:0/1929318246 shutdown_connections 2023-11-20T06:41:27.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.188+0000 7f4200780640 1 -- 172.21.15.19:0/1929318246 wait complete. 2023-11-20T06:41:27.212 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:41:27.212 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:41:27.221 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:41:27.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.400+0000 7f338f468640 1 Processor -- start 2023-11-20T06:41:27.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.400+0000 7f338f468640 1 -- start start 2023-11-20T06:41:27.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.400+0000 7f338f468640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33880ad960 0x7f33880ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:27.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.400+0000 7f338f468640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33880c96f0 con 0x7f3388164520 2023-11-20T06:41:27.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.400+0000 7f338f468640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33880cb950 con 0x7f33880b07f0 2023-11-20T06:41:27.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.400+0000 7f338f468640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3388164900 con 0x7f33880ad960 2023-11-20T06:41:27.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.400+0000 7f338d204640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3388164520 0x7f33880b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:51232/0 (socket says 172.21.15.19:51232) 2023-11-20T06:41:27.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.400+0000 7f338d204640 1 -- 172.21.15.19:0/1313658662 learned_addr learned my addr 172.21.15.19:0/1313658662 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:27.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f338ca03640 1 --2- 172.21.15.19:0/1313658662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33880ad960 0x7f33880ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f337ffff640 1 -- 172.21.15.19:0/1313658662 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872377248 0 0) 0x7f33880c96f0 con 0x7f3388164520 2023-11-20T06:41:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f337ffff640 1 -- 172.21.15.19:0/1313658662 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3374003530 con 0x7f3388164520 2023-11-20T06:41:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f337ffff640 1 -- 172.21.15.19:0/1313658662 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423198255 0 0) 0x7f33880cb950 con 0x7f33880b07f0 2023-11-20T06:41:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f337ffff640 1 -- 172.21.15.19:0/1313658662 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33880c96f0 con 0x7f33880b07f0 2023-11-20T06:41:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f337ffff640 1 -- 172.21.15.19:0/1313658662 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 451738036 0 0) 0x7f3374003530 con 0x7f3388164520 2023-11-20T06:41:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f337ffff640 1 -- 172.21.15.19:0/1313658662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33880ad960 msgr2=0x7f33880ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f337ffff640 1 --2- 172.21.15.19:0/1313658662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33880ad960 0x7f33880ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f337ffff640 1 -- 172.21.15.19:0/1313658662 >> v1:172.21.15.190:6789/0 conn(0x7f33880b07f0 legacy=0x7f33880cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f337ffff640 1 -- 172.21.15.19:0/1313658662 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33880cbed0 con 0x7f3388164520 2023-11-20T06:41:27.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f337ffff640 1 -- 172.21.15.19:0/1313658662 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7f3384001680 con 0x7f3388164520 2023-11-20T06:41:27.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f337ffff640 1 -- 172.21.15.19:0/1313658662 >> v1:172.21.15.19:6789/0 conn(0x7f3388164520 legacy=0x7f33880b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:27.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f337ffff640 1 --2- 172.21.15.19:0/1313658662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3374003b40 0x7f3374003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:27.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f337ffff640 1 --2- 172.21.15.19:0/1313658662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33740047d0 0x7f3374004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:27.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f337ffff640 1 --2- 172.21.15.19:0/1313658662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3374005190 0x7f337400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:27.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f337ffff640 1 -- 172.21.15.19:0/1313658662 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337400bf80 con 0x7f3374005190 2023-11-20T06:41:27.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f337ffff640 1 -- 172.21.15.19:0/1313658662 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337400c0c0 con 0x7f33740047d0 2023-11-20T06:41:27.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f337ffff640 1 -- 172.21.15.19:0/1313658662 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337400c280 con 0x7f3374003b40 2023-11-20T06:41:27.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f338ca03640 1 --2- 172.21.15.19:0/1313658662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33880ad960 0x7f33880ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:41:27.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f338da05640 1 --2- 172.21.15.19:0/1313658662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3374005190 0x7f337400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:27.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f338d204640 1 --2- 172.21.15.19:0/1313658662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3374003b40 0x7f3374003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:27.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f338ca03640 1 --2- 172.21.15.19:0/1313658662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33740047d0 0x7f3374004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:27.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f338da05640 1 -- 172.21.15.19:0/1313658662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3374003b40 msgr2=0x7f3374003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:27.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f338da05640 1 --2- 172.21.15.19:0/1313658662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3374003b40 0x7f3374003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f338da05640 1 -- 172.21.15.19:0/1313658662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33740047d0 msgr2=0x7f3374004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:27.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f338da05640 1 --2- 172.21.15.19:0/1313658662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33740047d0 0x7f3374004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.404+0000 7f338da05640 1 -- 172.21.15.19:0/1313658662 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3374003530 con 0x7f3374005190 2023-11-20T06:41:27.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.408+0000 7f338da05640 1 --2- 172.21.15.19:0/1313658662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3374005190 0x7f337400b990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3380001fc0 tx=0x7f338001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db1e0801b4f13f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:27.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.408+0000 7f337ffff640 1 -- 172.21.15.19:0/1313658662 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384007ea0 con 0x7f3374005190 2023-11-20T06:41:27.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.408+0000 7f337ffff640 1 -- 172.21.15.19:0/1313658662 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3380003b80 con 0x7f3374005190 2023-11-20T06:41:27.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.408+0000 7f337ffff640 1 -- 172.21.15.19:0/1313658662 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33800050d0 con 0x7f3374005190 2023-11-20T06:41:27.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.408+0000 7f338f468640 1 -- 172.21.15.19:0/1313658662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3374005190 msgr2=0x7f337400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:27.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.408+0000 7f338f468640 1 --2- 172.21.15.19:0/1313658662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3374005190 0x7f337400b990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3380001fc0 tx=0x7f338001c8e0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.408+0000 7f338da05640 1 -- 172.21.15.19:0/1313658662 reap_dead start 2023-11-20T06:41:27.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.408+0000 7f338f468640 1 -- 172.21.15.19:0/1313658662 shutdown_connections 2023-11-20T06:41:27.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.408+0000 7f338f468640 1 -- 172.21.15.19:0/1313658662 >> 172.21.15.19:0/1313658662 conn(0x7f338806c190 msgr2=0x7f338806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:27.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.408+0000 7f338f468640 1 -- 172.21.15.19:0/1313658662 shutdown_connections 2023-11-20T06:41:27.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.408+0000 7f338f468640 1 -- 172.21.15.19:0/1313658662 wait complete. 2023-11-20T06:41:27.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.408+0000 7f338f468640 1 Processor -- start 2023-11-20T06:41:27.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.408+0000 7f338f468640 1 -- start start 2023-11-20T06:41:27.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f338f468640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3374005190 0x7f338815ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:27.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f338f468640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33880c8530 0x7f33880c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:27.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f338f468640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33880c71f0 0x7f33880ae560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:27.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f338f468640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33880c6490 con 0x7f33880c71f0 2023-11-20T06:41:27.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f338f468640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33880c4860 con 0x7f3374005190 2023-11-20T06:41:27.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f338f468640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33880c6710 con 0x7f33880c8530 2023-11-20T06:41:27.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f338da05640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33880c71f0 0x7f33880ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:27.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f338d204640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3374005190 0x7f338815ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:27.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f338da05640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33880c71f0 0x7f33880ae560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54218/0 (socket says 172.21.15.19:54218) 2023-11-20T06:41:27.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f338da05640 1 -- 172.21.15.19:0/1619972241 learned_addr learned my addr 172.21.15.19:0/1619972241 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:27.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f338ca03640 1 --2- 172.21.15.19:0/1619972241 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33880c8530 0x7f33880c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:27.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f338da05640 1 -- 172.21.15.19:0/1619972241 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33880c8530 msgr2=0x7f33880c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:27.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f338da05640 1 --2- 172.21.15.19:0/1619972241 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33880c8530 0x7f33880c3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f338da05640 1 -- 172.21.15.19:0/1619972241 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3374005190 msgr2=0x7f338815ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:27.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f338da05640 1 --2- 172.21.15.19:0/1619972241 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3374005190 0x7f338815ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f338da05640 1 -- 172.21.15.19:0/1619972241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33880c69f0 con 0x7f33880c71f0 2023-11-20T06:41:27.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f338da05640 1 --2- 172.21.15.19:0/1619972241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33880c71f0 0x7f33880ae560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3380005040 tx=0x7f3374005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:27.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f337dffb640 1 -- 172.21.15.19:0/1619972241 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380006d60 con 0x7f33880c71f0 2023-11-20T06:41:27.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f337dffb640 1 -- 172.21.15.19:0/1619972241 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3380003a00 con 0x7f33880c71f0 2023-11-20T06:41:27.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f337dffb640 1 -- 172.21.15.19:0/1619972241 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33800052f0 con 0x7f33880c71f0 2023-11-20T06:41:27.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f338f468640 1 -- 172.21.15.19:0/1619972241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33880c6cd0 con 0x7f33880c71f0 2023-11-20T06:41:27.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f338f468640 1 -- 172.21.15.19:0/1619972241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33880c44e0 con 0x7f33880c71f0 2023-11-20T06:41:27.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f338f468640 1 -- 172.21.15.19:0/1619972241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33880c6ec0 con 0x7f33880c71f0 2023-11-20T06:41:27.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.412+0000 7f337dffb640 1 -- 172.21.15.19:0/1619972241 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3380005450 con 0x7f33880c71f0 2023-11-20T06:41:27.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.416+0000 7f337dffb640 1 --2- 172.21.15.19:0/1619972241 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f336c0664f0 0x7f336c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:27.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.416+0000 7f337dffb640 1 -- 172.21.15.19:0/1619972241 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f33800b5040 con 0x7f33880c71f0 2023-11-20T06:41:27.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.416+0000 7f338d204640 1 --2- 172.21.15.19:0/1619972241 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f336c0664f0 0x7f336c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:27.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.416+0000 7f338d204640 1 --2- 172.21.15.19:0/1619972241 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f336c0664f0 0x7f336c0689b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3384001c30 tx=0x7f3384001e10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:27.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.420+0000 7f337dffb640 1 -- 172.21.15.19:0/1619972241 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f33800eb0a0 con 0x7f33880c71f0 2023-11-20T06:41:27.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.580+0000 7f338f468640 1 -- 172.21.15.19:0/1619972241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3388074010 con 0x7f33880c71f0 2023-11-20T06:41:27.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.580+0000 7f337dffb640 1 -- 172.21.15.19:0/1619972241 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f33800be090 con 0x7f33880c71f0 2023-11-20T06:41:27.586 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:27.586 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":25,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:20.306335+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:41:27.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.584+0000 7f338f468640 1 -- 172.21.15.19:0/1619972241 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f336c0664f0 msgr2=0x7f336c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:27.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.584+0000 7f338f468640 1 --2- 172.21.15.19:0/1619972241 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f336c0664f0 0x7f336c0689b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3384001c30 tx=0x7f3384001e10 comp rx=0 tx=0).stop 2023-11-20T06:41:27.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.584+0000 7f338f468640 1 -- 172.21.15.19:0/1619972241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33880c71f0 msgr2=0x7f33880ae560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:27.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.584+0000 7f338f468640 1 --2- 172.21.15.19:0/1619972241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33880c71f0 0x7f33880ae560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3380005040 tx=0x7f3374005800 comp rx=0 tx=0).stop 2023-11-20T06:41:27.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.584+0000 7f338f468640 1 -- 172.21.15.19:0/1619972241 shutdown_connections 2023-11-20T06:41:27.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.584+0000 7f338f468640 1 --2- 172.21.15.19:0/1619972241 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f336c0664f0 0x7f336c0689b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.584+0000 7f338f468640 1 --2- 172.21.15.19:0/1619972241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33880c71f0 0x7f33880ae560 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.584+0000 7f338f468640 1 --2- 172.21.15.19:0/1619972241 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33880c8530 0x7f33880c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.584+0000 7f338f468640 1 --2- 172.21.15.19:0/1619972241 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3374005190 0x7f338815ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.584+0000 7f338f468640 1 -- 172.21.15.19:0/1619972241 >> 172.21.15.19:0/1619972241 conn(0x7f338806c190 msgr2=0x7f33880cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:27.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.584+0000 7f338f468640 1 -- 172.21.15.19:0/1619972241 shutdown_connections 2023-11-20T06:41:27.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.584+0000 7f338f468640 1 -- 172.21.15.19:0/1619972241 wait complete. 2023-11-20T06:41:27.607 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T06:41:11.805111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T06:41:12.614034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T06:41:16.311206+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T06:41:27.607 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:41:27.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.748+0000 7f9cb0a9e640 1 Processor -- start 2023-11-20T06:41:27.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.748+0000 7f9cb0a9e640 1 -- start start 2023-11-20T06:41:27.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.748+0000 7f9cb0a9e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9cac15cba0 0x7f9cac0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:27.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.748+0000 7f9cb0a9e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9cac0b84e0 0x7f9cac0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:27.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.748+0000 7f9cb0a9e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9cac0d0040 0x7f9cac0d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:27.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.748+0000 7f9cb0a9e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cac0d1460 con 0x7f9cac0b84e0 2023-11-20T06:41:27.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.748+0000 7f9cb0a9e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cac0d04b0 con 0x7f9cac0d0040 2023-11-20T06:41:27.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.748+0000 7f9cb0a9e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac0d1670 con 0x7f9cac15cba0 2023-11-20T06:41:27.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.748+0000 7f9ca3fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9cac0b84e0 0x7f9cac0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:27.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.748+0000 7f9ca3fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9cac0b84e0 0x7f9cac0cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54226/0 (socket says 172.21.15.19:54226) 2023-11-20T06:41:27.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.748+0000 7f9ca3fff640 1 -- 172.21.15.19:0/2920559050 learned_addr learned my addr 172.21.15.19:0/2920559050 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:27.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.748+0000 7f9caa59c640 1 --2- 172.21.15.19:0/2920559050 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9cac15cba0 0x7f9cac0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:27.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.748+0000 7f9caad9d640 1 --2- 172.21.15.19:0/2920559050 >> v2:172.21.15.190:3300/0 conn(0x7f9cac0d0040 0x7f9cac0d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:27.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.752+0000 7f9ca3fff640 1 -- 172.21.15.19:0/2920559050 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9cac15cba0 msgr2=0x7f9cac0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:27.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.752+0000 7f9ca3fff640 1 --2- 172.21.15.19:0/2920559050 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9cac15cba0 0x7f9cac0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.752+0000 7f9ca3fff640 1 -- 172.21.15.19:0/2920559050 >> v2:172.21.15.190:3300/0 conn(0x7f9cac0d0040 msgr2=0x7f9cac0d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:27.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.752+0000 7f9ca3fff640 1 --2- 172.21.15.19:0/2920559050 >> v2:172.21.15.190:3300/0 conn(0x7f9cac0d0040 0x7f9cac0d2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.752+0000 7f9ca3fff640 1 -- 172.21.15.19:0/2920559050 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac0d1950 con 0x7f9cac0b84e0 2023-11-20T06:41:27.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.752+0000 7f9caad9d640 1 --2- 172.21.15.19:0/2920559050 >> v2:172.21.15.190:3300/0 conn(0x7f9cac0d0040 0x7f9cac0d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:27.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.752+0000 7f9ca3fff640 1 --2- 172.21.15.19:0/2920559050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cac0b84e0 0x7f9cac0cfb00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0cf040 tx=0x7f9c9401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8e40bd82438372 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:27.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.752+0000 7f9ca9d9b640 1 -- 172.21.15.19:0/2920559050 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c940ab600 con 0x7f9cac0b84e0 2023-11-20T06:41:27.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.752+0000 7f9ca9d9b640 1 -- 172.21.15.19:0/2920559050 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c940a7050 con 0x7f9cac0b84e0 2023-11-20T06:41:27.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.752+0000 7f9ca9d9b640 1 -- 172.21.15.19:0/2920559050 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c940ab980 con 0x7f9cac0b84e0 2023-11-20T06:41:27.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.752+0000 7f9cb0a9e640 1 -- 172.21.15.19:0/2920559050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cac0b84e0 msgr2=0x7f9cac0cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:27.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.752+0000 7f9cb0a9e640 1 --2- 172.21.15.19:0/2920559050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cac0b84e0 0x7f9cac0cfb00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0cf040 tx=0x7f9c9401c240 comp rx=0 tx=0).stop 2023-11-20T06:41:27.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.752+0000 7f9cb0a9e640 1 -- 172.21.15.19:0/2920559050 shutdown_connections 2023-11-20T06:41:27.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.752+0000 7f9cb0a9e640 1 --2- 172.21.15.19:0/2920559050 >> v2:172.21.15.190:3300/0 conn(0x7f9cac0d0040 0x7f9cac0d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.752+0000 7f9cb0a9e640 1 --2- 172.21.15.19:0/2920559050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cac0b84e0 0x7f9cac0cfb00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.752+0000 7f9cb0a9e640 1 --2- 172.21.15.19:0/2920559050 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9cac15cba0 0x7f9cac0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.752+0000 7f9cb0a9e640 1 -- 172.21.15.19:0/2920559050 >> 172.21.15.19:0/2920559050 conn(0x7f9cac0719c0 msgr2=0x7f9cac071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:27.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9cb0a9e640 1 -- 172.21.15.19:0/2920559050 shutdown_connections 2023-11-20T06:41:27.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9cb0a9e640 1 -- 172.21.15.19:0/2920559050 wait complete. 2023-11-20T06:41:27.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9cb0a9e640 1 Processor -- start 2023-11-20T06:41:27.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9cb0a9e640 1 -- start start 2023-11-20T06:41:27.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9cb0a9e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9cac0b84e0 0x7f9cac14e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:27.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9cb0a9e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cac0d0040 0x7f9cac13a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:27.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9cb0a9e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9cac15cba0 0x7f9cac13aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:27.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9cb0a9e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac14e7d0 con 0x7f9cac0d0040 2023-11-20T06:41:27.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9cb0a9e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac14dd40 con 0x7f9cac0b84e0 2023-11-20T06:41:27.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9cb0a9e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac156440 con 0x7f9cac15cba0 2023-11-20T06:41:27.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9ca3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cac0d0040 0x7f9cac13a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:27.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9ca3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cac0d0040 0x7f9cac13a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54240/0 (socket says 172.21.15.19:54240) 2023-11-20T06:41:27.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9ca3fff640 1 -- 172.21.15.19:0/3232975438 learned_addr learned my addr 172.21.15.19:0/3232975438 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:27.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9caa59c640 1 --2- 172.21.15.19:0/3232975438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9cac0b84e0 0x7f9cac14e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:27.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9caad9d640 1 --2- 172.21.15.19:0/3232975438 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9cac15cba0 0x7f9cac13aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:27.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9ca3fff640 1 -- 172.21.15.19:0/3232975438 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9cac15cba0 msgr2=0x7f9cac13aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:27.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9ca3fff640 1 --2- 172.21.15.19:0/3232975438 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9cac15cba0 0x7f9cac13aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9ca3fff640 1 -- 172.21.15.19:0/3232975438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9cac0b84e0 msgr2=0x7f9cac14e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:27.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9ca3fff640 1 --2- 172.21.15.19:0/3232975438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9cac0b84e0 0x7f9cac14e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9ca3fff640 1 -- 172.21.15.19:0/3232975438 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c940094d0 con 0x7f9cac0d0040 2023-11-20T06:41:27.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.756+0000 7f9ca3fff640 1 --2- 172.21.15.19:0/3232975438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cac0d0040 0x7f9cac13a580 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9c9401a8f0 tx=0x7f9c94018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:27.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.760+0000 7f9ca2ffd640 1 -- 172.21.15.19:0/3232975438 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c940b4420 con 0x7f9cac0d0040 2023-11-20T06:41:27.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.760+0000 7f9ca2ffd640 1 -- 172.21.15.19:0/3232975438 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c940a4e90 con 0x7f9cac0d0040 2023-11-20T06:41:27.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.760+0000 7f9ca2ffd640 1 -- 172.21.15.19:0/3232975438 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c940b4780 con 0x7f9cac0d0040 2023-11-20T06:41:27.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.760+0000 7f9cb0a9e640 1 -- 172.21.15.19:0/3232975438 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cac156720 con 0x7f9cac0d0040 2023-11-20T06:41:27.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.760+0000 7f9cb0a9e640 1 -- 172.21.15.19:0/3232975438 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cac156ce0 con 0x7f9cac0d0040 2023-11-20T06:41:27.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.760+0000 7f9cb0a9e640 1 -- 172.21.15.19:0/3232975438 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cac04e170 con 0x7f9cac0d0040 2023-11-20T06:41:27.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.760+0000 7f9ca2ffd640 1 -- 172.21.15.19:0/3232975438 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9c940b2070 con 0x7f9cac0d0040 2023-11-20T06:41:27.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.760+0000 7f9ca2ffd640 1 --2- 172.21.15.19:0/3232975438 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c8c0664a0 0x7f9c8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:27.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.760+0000 7f9ca2ffd640 1 -- 172.21.15.19:0/3232975438 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9c9411d060 con 0x7f9cac0d0040 2023-11-20T06:41:27.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.760+0000 7f9caa59c640 1 --2- 172.21.15.19:0/3232975438 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c8c0664a0 0x7f9c8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:27.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.764+0000 7f9caa59c640 1 --2- 172.21.15.19:0/3232975438 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c8c0664a0 0x7f9c8c068960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009ac0 tx=0x7f9c9c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:27.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.764+0000 7f9ca2ffd640 1 -- 172.21.15.19:0/3232975438 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9c940ea3b0 con 0x7f9cac0d0040 2023-11-20T06:41:27.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.920+0000 7f9cb0a9e640 1 -- 172.21.15.19:0/3232975438 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9cac0b7a40 con 0x7f9cac0d0040 2023-11-20T06:41:27.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.924+0000 7f9ca2ffd640 1 -- 172.21.15.19:0/3232975438 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9c940ed9d0 con 0x7f9cac0d0040 2023-11-20T06:41:27.927 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:41:27.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.924+0000 7f9cb0a9e640 1 -- 172.21.15.19:0/3232975438 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c8c0664a0 msgr2=0x7f9c8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:27.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.924+0000 7f9cb0a9e640 1 --2- 172.21.15.19:0/3232975438 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c8c0664a0 0x7f9c8c068960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009ac0 tx=0x7f9c9c009190 comp rx=0 tx=0).stop 2023-11-20T06:41:27.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.924+0000 7f9cb0a9e640 1 -- 172.21.15.19:0/3232975438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cac0d0040 msgr2=0x7f9cac13a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:27.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.924+0000 7f9cb0a9e640 1 --2- 172.21.15.19:0/3232975438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cac0d0040 0x7f9cac13a580 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9c9401a8f0 tx=0x7f9c94018fe0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.924+0000 7f9cb0a9e640 1 -- 172.21.15.19:0/3232975438 shutdown_connections 2023-11-20T06:41:27.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.924+0000 7f9cb0a9e640 1 --2- 172.21.15.19:0/3232975438 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c8c0664a0 0x7f9c8c068960 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.924+0000 7f9cb0a9e640 1 --2- 172.21.15.19:0/3232975438 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9cac15cba0 0x7f9cac13aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.924+0000 7f9cb0a9e640 1 --2- 172.21.15.19:0/3232975438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cac0d0040 0x7f9cac13a580 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.924+0000 7f9cb0a9e640 1 --2- 172.21.15.19:0/3232975438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9cac0b84e0 0x7f9cac14e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:27.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.924+0000 7f9cb0a9e640 1 -- 172.21.15.19:0/3232975438 >> 172.21.15.19:0/3232975438 conn(0x7f9cac0719c0 msgr2=0x7f9cac071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:27.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.924+0000 7f9cb0a9e640 1 -- 172.21.15.19:0/3232975438 shutdown_connections 2023-11-20T06:41:27.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:27.924+0000 7f9cb0a9e640 1 -- 172.21.15.19:0/3232975438 wait complete. 2023-11-20T06:41:27.948 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T06:41:28.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.092+0000 7feeb15c5640 1 Processor -- start 2023-11-20T06:41:28.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.092+0000 7feeb15c5640 1 -- start start 2023-11-20T06:41:28.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.092+0000 7feeb15c5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7feeac0cb040 0x7feeac0ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:28.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.092+0000 7feeb15c5640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeac0cc330 con 0x7feeac0cebd0 2023-11-20T06:41:28.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.092+0000 7feeb15c5640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeac0cb4d0 con 0x7feeac15cc60 2023-11-20T06:41:28.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.092+0000 7feeb15c5640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeac0cefe0 con 0x7feeac0cb040 2023-11-20T06:41:28.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.092+0000 7feeab7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7feeac0cebd0 0x7feeac0cc990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:51242/0 (socket says 172.21.15.19:51242) 2023-11-20T06:41:28.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.092+0000 7feeab7fe640 1 -- 172.21.15.19:0/1841160446 learned_addr learned my addr 172.21.15.19:0/1841160446 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:28.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.092+0000 7feea3fff640 1 --2- 172.21.15.19:0/1841160446 >> v2:172.21.15.190:3300/0 conn(0x7feeac0cb040 0x7feeac0ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:28.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.092+0000 7feeaa7fc640 1 -- 172.21.15.19:0/1841160446 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898728619 0 0) 0x7feeac0cc330 con 0x7feeac0cebd0 2023-11-20T06:41:28.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.092+0000 7feeaa7fc640 1 -- 172.21.15.19:0/1841160446 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee98003530 con 0x7feeac0cebd0 2023-11-20T06:41:28.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.092+0000 7feea3fff640 1 -- 172.21.15.19:0/1841160446 >> v1:172.21.15.190:6789/0 conn(0x7feeac15cc60 legacy=0x7feeac161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:28.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.092+0000 7feea3fff640 1 -- 172.21.15.19:0/1841160446 >> v1:172.21.15.19:6789/0 conn(0x7feeac0cebd0 legacy=0x7feeac0cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:28.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.092+0000 7feea3fff640 1 -- 172.21.15.19:0/1841160446 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac0cb720 con 0x7feeac0cb040 2023-11-20T06:41:28.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.096+0000 7feea3fff640 1 --2- 172.21.15.19:0/1841160446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feeac0cb040 0x7feeac0ce690 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fee940097c0 tx=0x7fee9401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d49a6a29f8f998b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:28.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.096+0000 7feeaa7fc640 1 -- 172.21.15.19:0/1841160446 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee940ab650 con 0x7feeac0cb040 2023-11-20T06:41:28.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.096+0000 7feeaa7fc640 1 -- 172.21.15.19:0/1841160446 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee940ab7b0 con 0x7feeac0cb040 2023-11-20T06:41:28.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.096+0000 7feeaa7fc640 1 -- 172.21.15.19:0/1841160446 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee940abb40 con 0x7feeac0cb040 2023-11-20T06:41:28.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.096+0000 7feeb15c5640 1 -- 172.21.15.19:0/1841160446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feeac0cb040 msgr2=0x7feeac0ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.096+0000 7feeb15c5640 1 --2- 172.21.15.19:0/1841160446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feeac0cb040 0x7feeac0ce690 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fee940097c0 tx=0x7fee9401c450 comp rx=0 tx=0).stop 2023-11-20T06:41:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.096+0000 7feeb15c5640 1 -- 172.21.15.19:0/1841160446 shutdown_connections 2023-11-20T06:41:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.096+0000 7feeb15c5640 1 --2- 172.21.15.19:0/1841160446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feeac0cb040 0x7feeac0ce690 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.096+0000 7feeb15c5640 1 -- 172.21.15.19:0/1841160446 >> 172.21.15.19:0/1841160446 conn(0x7feeac06e570 msgr2=0x7feeac06e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.096+0000 7feeb15c5640 1 -- 172.21.15.19:0/1841160446 shutdown_connections 2023-11-20T06:41:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.096+0000 7feeb15c5640 1 -- 172.21.15.19:0/1841160446 wait complete. 2023-11-20T06:41:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.096+0000 7feeb15c5640 1 Processor -- start 2023-11-20T06:41:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feeb15c5640 1 -- start start 2023-11-20T06:41:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feeb15c5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feeac0cb040 0x7feeac0c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feeb15c5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feeac0cebd0 0x7feeac151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feeb15c5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feeac15cc60 0x7feeac0b4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feeb15c5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac0c8d60 con 0x7feeac0cb040 2023-11-20T06:41:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feeb15c5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac0c7ec0 con 0x7feeac0cebd0 2023-11-20T06:41:28.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feeb15c5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac0cab60 con 0x7feeac15cc60 2023-11-20T06:41:28.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feeaaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feeac0cb040 0x7feeac0c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:28.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feeaaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feeac0cb040 0x7feeac0c7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54252/0 (socket says 172.21.15.19:54252) 2023-11-20T06:41:28.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feeaaffd640 1 -- 172.21.15.19:0/2124368238 learned_addr learned my addr 172.21.15.19:0/2124368238 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:28.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feea3fff640 1 --2- 172.21.15.19:0/2124368238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feeac0cebd0 0x7feeac151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:28.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feeab7fe640 1 --2- 172.21.15.19:0/2124368238 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feeac15cc60 0x7feeac0b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feeaaffd640 1 -- 172.21.15.19:0/2124368238 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feeac15cc60 msgr2=0x7feeac0b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feeaaffd640 1 --2- 172.21.15.19:0/2124368238 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feeac15cc60 0x7feeac0b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feeaaffd640 1 -- 172.21.15.19:0/2124368238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feeac0cebd0 msgr2=0x7feeac151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feeaaffd640 1 --2- 172.21.15.19:0/2124368238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feeac0cebd0 0x7feeac151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feeaaffd640 1 -- 172.21.15.19:0/2124368238 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee94009420 con 0x7feeac0cb040 2023-11-20T06:41:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feeaaffd640 1 --2- 172.21.15.19:0/2124368238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feeac0cb040 0x7feeac0c7980 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00c3c0 tx=0x7fee9c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feea37fe640 1 -- 172.21.15.19:0/2124368238 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c0052d0 con 0x7feeac0cb040 2023-11-20T06:41:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feea37fe640 1 -- 172.21.15.19:0/2124368238 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c005430 con 0x7feeac0cb040 2023-11-20T06:41:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feeb15c5640 1 -- 172.21.15.19:0/2124368238 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeac154c80 con 0x7feeac0cb040 2023-11-20T06:41:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feea37fe640 1 -- 172.21.15.19:0/2124368238 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c003840 con 0x7feeac0cb040 2023-11-20T06:41:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feeb15c5640 1 -- 172.21.15.19:0/2124368238 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeac0ca880 con 0x7feeac0cb040 2023-11-20T06:41:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.100+0000 7feeb15c5640 1 -- 172.21.15.19:0/2124368238 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeac0b4620 con 0x7feeac0cb040 2023-11-20T06:41:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.104+0000 7feea37fe640 1 -- 172.21.15.19:0/2124368238 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fee9c0039a0 con 0x7feeac0cb040 2023-11-20T06:41:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.104+0000 7feea37fe640 1 --2- 172.21.15.19:0/2124368238 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fee8c0664a0 0x7fee8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.104+0000 7feea37fe640 1 -- 172.21.15.19:0/2124368238 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fee9c083460 con 0x7feeac0cb040 2023-11-20T06:41:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.104+0000 7feea3fff640 1 --2- 172.21.15.19:0/2124368238 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fee8c0664a0 0x7fee8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.104+0000 7feea3fff640 1 --2- 172.21.15.19:0/2124368238 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fee8c0664a0 0x7fee8c068960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fee940af000 tx=0x7fee940a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:28.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.108+0000 7feea37fe640 1 -- 172.21.15.19:0/2124368238 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fee9c0506a0 con 0x7feeac0cb040 2023-11-20T06:41:28.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.264+0000 7feeb15c5640 1 -- 172.21.15.19:0/2124368238 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feeac154c50 con 0x7feeac0cb040 2023-11-20T06:41:28.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.264+0000 7feea37fe640 1 -- 172.21.15.19:0/2124368238 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fee9c053cc0 con 0x7feeac0cb040 2023-11-20T06:41:28.269 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:41:28.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.264+0000 7feeb15c5640 1 -- 172.21.15.19:0/2124368238 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fee8c0664a0 msgr2=0x7fee8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:28.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.264+0000 7feeb15c5640 1 --2- 172.21.15.19:0/2124368238 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fee8c0664a0 0x7fee8c068960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fee940af000 tx=0x7fee940a7000 comp rx=0 tx=0).stop 2023-11-20T06:41:28.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.264+0000 7feeb15c5640 1 -- 172.21.15.19:0/2124368238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feeac0cb040 msgr2=0x7feeac0c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:28.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.264+0000 7feeb15c5640 1 --2- 172.21.15.19:0/2124368238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feeac0cb040 0x7feeac0c7980 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00c3c0 tx=0x7fee9c00c880 comp rx=0 tx=0).stop 2023-11-20T06:41:28.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.264+0000 7feeb15c5640 1 -- 172.21.15.19:0/2124368238 shutdown_connections 2023-11-20T06:41:28.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.264+0000 7feeb15c5640 1 --2- 172.21.15.19:0/2124368238 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fee8c0664a0 0x7fee8c068960 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.264+0000 7feeb15c5640 1 --2- 172.21.15.19:0/2124368238 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feeac15cc60 0x7feeac0b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.264+0000 7feeb15c5640 1 --2- 172.21.15.19:0/2124368238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feeac0cebd0 0x7feeac151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.264+0000 7feeb15c5640 1 --2- 172.21.15.19:0/2124368238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feeac0cb040 0x7feeac0c7980 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.264+0000 7feeb15c5640 1 -- 172.21.15.19:0/2124368238 >> 172.21.15.19:0/2124368238 conn(0x7feeac06e570 msgr2=0x7feeac15d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:28.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.264+0000 7feeb15c5640 1 -- 172.21.15.19:0/2124368238 shutdown_connections 2023-11-20T06:41:28.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.264+0000 7feeb15c5640 1 -- 172.21.15.19:0/2124368238 wait complete. 2023-11-20T06:41:28.290 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T06:41:28.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.432+0000 7fd7c4054640 1 Processor -- start 2023-11-20T06:41:28.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.432+0000 7fd7c4054640 1 -- start start 2023-11-20T06:41:28.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.432+0000 7fd7c4054640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd7bc15cba0 0x7fd7bc0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:28.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.432+0000 7fd7c4054640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7bc0d1670 con 0x7fd7bc0d0210 2023-11-20T06:41:28.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.432+0000 7fd7c4054640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7bc0d1950 con 0x7fd7bc0b84e0 2023-11-20T06:41:28.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.432+0000 7fd7c4054640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7bc0d1460 con 0x7fd7bc15cba0 2023-11-20T06:41:28.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.432+0000 7fd7c25f1640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd7bc0d0210 0x7fd7bc0b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:51252/0 (socket says 172.21.15.19:51252) 2023-11-20T06:41:28.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.432+0000 7fd7c25f1640 1 -- 172.21.15.19:0/1561474419 learned_addr learned my addr 172.21.15.19:0/1561474419 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:28.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c1df0640 1 --2- 172.21.15.19:0/1561474419 >> v2:172.21.15.190:3300/0 conn(0x7fd7bc15cba0 0x7fd7bc0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:28.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c0dee640 1 -- 172.21.15.19:0/1561474419 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2132504835 0 0) 0x7fd7bc0d1670 con 0x7fd7bc0d0210 2023-11-20T06:41:28.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c0dee640 1 -- 172.21.15.19:0/1561474419 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7a8003530 con 0x7fd7bc0d0210 2023-11-20T06:41:28.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c0dee640 1 -- 172.21.15.19:0/1561474419 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3286510246 0 0) 0x7fd7a8003530 con 0x7fd7bc0d0210 2023-11-20T06:41:28.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c0dee640 1 -- 172.21.15.19:0/1561474419 >> v2:172.21.15.190:3300/0 conn(0x7fd7bc15cba0 msgr2=0x7fd7bc0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:28.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c0dee640 1 --2- 172.21.15.19:0/1561474419 >> v2:172.21.15.190:3300/0 conn(0x7fd7bc15cba0 0x7fd7bc0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c0dee640 1 -- 172.21.15.19:0/1561474419 >> v1:172.21.15.190:6789/0 conn(0x7fd7bc0b84e0 legacy=0x7fd7bc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:28.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c0dee640 1 -- 172.21.15.19:0/1561474419 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7bc0d1c30 con 0x7fd7bc0d0210 2023-11-20T06:41:28.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c0dee640 1 -- 172.21.15.19:0/1561474419 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7fd7b4001a00 con 0x7fd7bc0d0210 2023-11-20T06:41:28.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c1df0640 1 --2- 172.21.15.19:0/1561474419 >> v2:172.21.15.190:3300/0 conn(0x7fd7bc15cba0 0x7fd7bc0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:41:28.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c0dee640 1 -- 172.21.15.19:0/1561474419 >> v1:172.21.15.19:6789/0 conn(0x7fd7bc0d0210 legacy=0x7fd7bc0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:28.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c0dee640 1 --2- 172.21.15.19:0/1561474419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7a8003980 0x7fd7a8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:28.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c0dee640 1 --2- 172.21.15.19:0/1561474419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a80047d0 0x7fd7a8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:28.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c0dee640 1 --2- 172.21.15.19:0/1561474419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7a8005190 0x7fd7a800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:28.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c0dee640 1 -- 172.21.15.19:0/1561474419 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc0d1460 con 0x7fd7a80047d0 2023-11-20T06:41:28.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c0dee640 1 -- 172.21.15.19:0/1561474419 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a800c130 con 0x7fd7a8003980 2023-11-20T06:41:28.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c0dee640 1 -- 172.21.15.19:0/1561474419 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a800c2f0 con 0x7fd7a8005190 2023-11-20T06:41:28.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c15ef640 1 --2- 172.21.15.19:0/1561474419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a80047d0 0x7fd7a8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:28.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c1df0640 1 --2- 172.21.15.19:0/1561474419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7a8003980 0x7fd7a8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:28.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c25f1640 1 --2- 172.21.15.19:0/1561474419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7a8005190 0x7fd7a800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:28.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c15ef640 1 -- 172.21.15.19:0/1561474419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7a8005190 msgr2=0x7fd7a800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:28.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c15ef640 1 --2- 172.21.15.19:0/1561474419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7a8005190 0x7fd7a800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c15ef640 1 -- 172.21.15.19:0/1561474419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7a8003980 msgr2=0x7fd7a8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:28.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c15ef640 1 --2- 172.21.15.19:0/1561474419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7a8003980 0x7fd7a8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c15ef640 1 -- 172.21.15.19:0/1561474419 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a8003530 con 0x7fd7a80047d0 2023-11-20T06:41:28.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.436+0000 7fd7c25f1640 1 -- 172.21.15.19:0/1561474419 reap_dead start 2023-11-20T06:41:28.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.440+0000 7fd7c15ef640 1 --2- 172.21.15.19:0/1561474419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a80047d0 0x7fd7a8004c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac001780 tx=0x7fd7ac01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31df9809d5aac28 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:28.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.440+0000 7fd7c0dee640 1 -- 172.21.15.19:0/1561474419 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac0050d0 con 0x7fd7a80047d0 2023-11-20T06:41:28.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.440+0000 7fd7c0dee640 1 -- 172.21.15.19:0/1561474419 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ac005250 con 0x7fd7a80047d0 2023-11-20T06:41:28.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.440+0000 7fd7c0dee640 1 -- 172.21.15.19:0/1561474419 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac003600 con 0x7fd7a80047d0 2023-11-20T06:41:28.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.440+0000 7fd7c4054640 1 -- 172.21.15.19:0/1561474419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a80047d0 msgr2=0x7fd7a8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:28.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.440+0000 7fd7c4054640 1 --2- 172.21.15.19:0/1561474419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a80047d0 0x7fd7a8004c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac001780 tx=0x7fd7ac01c3e0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.440+0000 7fd7c4054640 1 -- 172.21.15.19:0/1561474419 shutdown_connections 2023-11-20T06:41:28.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.440+0000 7fd7c4054640 1 --2- 172.21.15.19:0/1561474419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a80047d0 0x7fd7a8004c50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.440+0000 7fd7c4054640 1 -- 172.21.15.19:0/1561474419 >> 172.21.15.19:0/1561474419 conn(0x7fd7bc0719c0 msgr2=0x7fd7bc071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:28.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.440+0000 7fd7c4054640 1 -- 172.21.15.19:0/1561474419 shutdown_connections 2023-11-20T06:41:28.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.440+0000 7fd7c4054640 1 -- 172.21.15.19:0/1561474419 wait complete. 2023-11-20T06:41:28.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.440+0000 7fd7c4054640 1 Processor -- start 2023-11-20T06:41:28.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.440+0000 7fd7c4054640 1 -- start start 2023-11-20T06:41:28.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7c4054640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a80047d0 0x7fd7bc0c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:28.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7c4054640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7bc0c9290 0x7fd7bc0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:28.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7c4054640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7bc0cc190 0x7fd7bc0c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:28.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7c4054640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc0cc620 con 0x7fd7a80047d0 2023-11-20T06:41:28.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7c4054640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc0c8260 con 0x7fd7bc0c9290 2023-11-20T06:41:28.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7c4054640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc14d8d0 con 0x7fd7bc0cc190 2023-11-20T06:41:28.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7c1df0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a80047d0 0x7fd7bc0c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:28.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7c1df0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a80047d0 0x7fd7bc0c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54264/0 (socket says 172.21.15.19:54264) 2023-11-20T06:41:28.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7c1df0640 1 -- 172.21.15.19:0/4057289830 learned_addr learned my addr 172.21.15.19:0/4057289830 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:28.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7c1df0640 1 -- 172.21.15.19:0/4057289830 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7bc0cc190 msgr2=0x7fd7bc0c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:28.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7c1df0640 1 --2- 172.21.15.19:0/4057289830 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7bc0cc190 0x7fd7bc0c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7c1df0640 1 -- 172.21.15.19:0/4057289830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7bc0c9290 msgr2=0x7fd7bc0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:28.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7c1df0640 1 --2- 172.21.15.19:0/4057289830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7bc0c9290 0x7fd7bc0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7c1df0640 1 -- 172.21.15.19:0/4057289830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7bc0c71c0 con 0x7fd7a80047d0 2023-11-20T06:41:28.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7c1df0640 1 --2- 172.21.15.19:0/4057289830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a80047d0 0x7fd7bc0c8d50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8011d00 tx=0x7fd7b800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:28.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7b27fc640 1 -- 172.21.15.19:0/4057289830 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8011eb0 con 0x7fd7a80047d0 2023-11-20T06:41:28.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7b27fc640 1 -- 172.21.15.19:0/4057289830 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b800fe50 con 0x7fd7a80047d0 2023-11-20T06:41:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7b27fc640 1 -- 172.21.15.19:0/4057289830 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8004240 con 0x7fd7a80047d0 2023-11-20T06:41:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7c4054640 1 -- 172.21.15.19:0/4057289830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7bc0c74a0 con 0x7fd7a80047d0 2023-11-20T06:41:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7c4054640 1 -- 172.21.15.19:0/4057289830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7bc0c7a60 con 0x7fd7a80047d0 2023-11-20T06:41:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7c4054640 1 -- 172.21.15.19:0/4057289830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7bc04e170 con 0x7fd7a80047d0 2023-11-20T06:41:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.444+0000 7fd7b27fc640 1 -- 172.21.15.19:0/4057289830 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd7b80043a0 con 0x7fd7a80047d0 2023-11-20T06:41:28.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.448+0000 7fd7b27fc640 1 --2- 172.21.15.19:0/4057289830 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd7a00664d0 0x7fd7a0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:28.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.448+0000 7fd7b27fc640 1 -- 172.21.15.19:0/4057289830 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd7b80849a0 con 0x7fd7a80047d0 2023-11-20T06:41:28.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.448+0000 7fd7c15ef640 1 --2- 172.21.15.19:0/4057289830 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd7a00664d0 0x7fd7a0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:28.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.448+0000 7fd7c15ef640 1 --2- 172.21.15.19:0/4057289830 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd7a00664d0 0x7fd7a0068990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac001750 tx=0x7fd7ac001130 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:28.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.452+0000 7fd7b27fc640 1 -- 172.21.15.19:0/4057289830 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd7b8051a90 con 0x7fd7a80047d0 2023-11-20T06:41:28.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.608+0000 7fd7c4054640 1 -- 172.21.15.19:0/4057289830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd7bc0cba30 con 0x7fd7a80047d0 2023-11-20T06:41:28.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.608+0000 7fd7b27fc640 1 -- 172.21.15.19:0/4057289830 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd7b8022020 con 0x7fd7a80047d0 2023-11-20T06:41:28.613 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-20T06:41:28.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.612+0000 7fd7c4054640 1 -- 172.21.15.19:0/4057289830 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd7a00664d0 msgr2=0x7fd7a0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:28.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.612+0000 7fd7c4054640 1 --2- 172.21.15.19:0/4057289830 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd7a00664d0 0x7fd7a0068990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac001750 tx=0x7fd7ac001130 comp rx=0 tx=0).stop 2023-11-20T06:41:28.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.612+0000 7fd7c4054640 1 -- 172.21.15.19:0/4057289830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a80047d0 msgr2=0x7fd7bc0c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:28.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.612+0000 7fd7c4054640 1 --2- 172.21.15.19:0/4057289830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a80047d0 0x7fd7bc0c8d50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8011d00 tx=0x7fd7b800f610 comp rx=0 tx=0).stop 2023-11-20T06:41:28.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.612+0000 7fd7c4054640 1 -- 172.21.15.19:0/4057289830 shutdown_connections 2023-11-20T06:41:28.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.612+0000 7fd7c4054640 1 --2- 172.21.15.19:0/4057289830 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd7a00664d0 0x7fd7a0068990 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.612+0000 7fd7c4054640 1 --2- 172.21.15.19:0/4057289830 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7bc0cc190 0x7fd7bc0c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.612+0000 7fd7c4054640 1 --2- 172.21.15.19:0/4057289830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7bc0c9290 0x7fd7bc0cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.612+0000 7fd7c4054640 1 --2- 172.21.15.19:0/4057289830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a80047d0 0x7fd7bc0c8d50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.612+0000 7fd7c4054640 1 -- 172.21.15.19:0/4057289830 >> 172.21.15.19:0/4057289830 conn(0x7fd7bc0719c0 msgr2=0x7fd7bc0b6430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:28.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.612+0000 7fd7c4054640 1 -- 172.21.15.19:0/4057289830 shutdown_connections 2023-11-20T06:41:28.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.612+0000 7fd7c4054640 1 -- 172.21.15.19:0/4057289830 wait complete. 2023-11-20T06:41:28.634 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T06:41:28.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.776+0000 7f2b28e9c640 1 Processor -- start 2023-11-20T06:41:28.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.776+0000 7f2b28e9c640 1 -- start start 2023-11-20T06:41:28.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.776+0000 7f2b28e9c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2b240ab870 0x7f2b24069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:28.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.776+0000 7f2b28e9c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b2406a3d0 0x7f2b240cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:28.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.776+0000 7f2b28e9c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2406a800 con 0x7f2b2415cbc0 2023-11-20T06:41:28.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.776+0000 7f2b28e9c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b240abd00 con 0x7f2b240ab870 2023-11-20T06:41:28.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.776+0000 7f2b28e9c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b24161390 con 0x7f2b2406a3d0 2023-11-20T06:41:28.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.776+0000 7f2b22d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b2406a3d0 0x7f2b240cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:28.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.776+0000 7f2b22d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b2406a3d0 0x7f2b240cd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:44334/0 (socket says 172.21.15.19:44334) 2023-11-20T06:41:28.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.776+0000 7f2b22d9d640 1 -- 172.21.15.19:0/1903246016 learned_addr learned my addr 172.21.15.19:0/1903246016 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:28.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.776+0000 7f2b1bfff640 1 --2- 172.21.15.19:0/1903246016 >> v2:172.21.15.190:3300/0 conn(0x7f2b240ab870 0x7f2b24069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:28.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.780+0000 7f2b22d9d640 1 -- 172.21.15.19:0/1903246016 >> v2:172.21.15.190:3300/0 conn(0x7f2b240ab870 msgr2=0x7f2b24069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:28.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.780+0000 7f2b22d9d640 1 --2- 172.21.15.19:0/1903246016 >> v2:172.21.15.190:3300/0 conn(0x7f2b240ab870 0x7f2b24069e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.780+0000 7f2b22d9d640 1 -- 172.21.15.19:0/1903246016 >> v1:172.21.15.190:6789/0 conn(0x7f2b2415cbc0 legacy=0x7f2b24160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:28.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.780+0000 7f2b22d9d640 1 -- 172.21.15.19:0/1903246016 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b240ccda0 con 0x7f2b2406a3d0 2023-11-20T06:41:28.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.780+0000 7f2b21d9b640 1 -- 172.21.15.19:0/1903246016 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924790943 0 0) 0x7f2b2406a800 con 0x7f2b2415cbc0 2023-11-20T06:41:28.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.780+0000 7f2b22d9d640 1 --2- 172.21.15.19:0/1903246016 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b2406a3d0 0x7f2b240cd880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c009e50 tx=0x7f2b1c01c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a43d5a3f5eed08de server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:28.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.780+0000 7f2b21d9b640 1 -- 172.21.15.19:0/1903246016 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c0a57a0 con 0x7f2b2406a3d0 2023-11-20T06:41:28.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.780+0000 7f2b21d9b640 1 -- 172.21.15.19:0/1903246016 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1c0a5900 con 0x7f2b2406a3d0 2023-11-20T06:41:28.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.780+0000 7f2b21d9b640 1 -- 172.21.15.19:0/1903246016 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c0a5c90 con 0x7f2b2406a3d0 2023-11-20T06:41:28.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.780+0000 7f2b28e9c640 1 -- 172.21.15.19:0/1903246016 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b2406a3d0 msgr2=0x7f2b240cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:28.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.780+0000 7f2b28e9c640 1 --2- 172.21.15.19:0/1903246016 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b2406a3d0 0x7f2b240cd880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c009e50 tx=0x7f2b1c01c9e0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b28e9c640 1 -- 172.21.15.19:0/1903246016 shutdown_connections 2023-11-20T06:41:28.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b28e9c640 1 --2- 172.21.15.19:0/1903246016 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b2406a3d0 0x7f2b240cd880 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b28e9c640 1 --2- 172.21.15.19:0/1903246016 >> v2:172.21.15.190:3300/0 conn(0x7f2b240ab870 0x7f2b24069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b28e9c640 1 -- 172.21.15.19:0/1903246016 >> 172.21.15.19:0/1903246016 conn(0x7f2b240b0da0 msgr2=0x7f2b240ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:28.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b28e9c640 1 -- 172.21.15.19:0/1903246016 shutdown_connections 2023-11-20T06:41:28.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b28e9c640 1 -- 172.21.15.19:0/1903246016 wait complete. 2023-11-20T06:41:28.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b28e9c640 1 Processor -- start 2023-11-20T06:41:28.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b28e9c640 1 -- start start 2023-11-20T06:41:28.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b28e9c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b2406a3d0 0x7f2b2415d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:28.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b28e9c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b240ab870 0x7f2b240cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:28.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b28e9c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b2415cbc0 0x7f2b24144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:28.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b28e9c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2415faa0 con 0x7f2b240ab870 2023-11-20T06:41:28.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b28e9c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2415ebb0 con 0x7f2b2406a3d0 2023-11-20T06:41:28.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b28e9c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2415ee90 con 0x7f2b2415cbc0 2023-11-20T06:41:28.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b1bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b240ab870 0x7f2b240cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:28.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b1bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b240ab870 0x7f2b240cb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54272/0 (socket says 172.21.15.19:54272) 2023-11-20T06:41:28.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b1bfff640 1 -- 172.21.15.19:0/3441259727 learned_addr learned my addr 172.21.15.19:0/3441259727 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:28.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b22d9d640 1 --2- 172.21.15.19:0/3441259727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b2415cbc0 0x7f2b24144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:28.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b2259c640 1 --2- 172.21.15.19:0/3441259727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b2406a3d0 0x7f2b2415d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:28.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b1bfff640 1 -- 172.21.15.19:0/3441259727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b2415cbc0 msgr2=0x7f2b24144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:28.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b1bfff640 1 --2- 172.21.15.19:0/3441259727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b2415cbc0 0x7f2b24144300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b1bfff640 1 -- 172.21.15.19:0/3441259727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b2406a3d0 msgr2=0x7f2b2415d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:28.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b1bfff640 1 --2- 172.21.15.19:0/3441259727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b2406a3d0 0x7f2b2415d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b1bfff640 1 -- 172.21.15.19:0/3441259727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1c009b30 con 0x7f2b240ab870 2023-11-20T06:41:28.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.784+0000 7f2b2259c640 1 --2- 172.21.15.19:0/3441259727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b2406a3d0 0x7f2b2415d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:28.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.788+0000 7f2b1bfff640 1 --2- 172.21.15.19:0/3441259727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b240ab870 0x7f2b240cb3b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00e930 tx=0x7f2b0c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:28.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.788+0000 7f2b1affd640 1 -- 172.21.15.19:0/3441259727 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c009690 con 0x7f2b240ab870 2023-11-20T06:41:28.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.788+0000 7f2b1affd640 1 -- 172.21.15.19:0/3441259727 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0c00ca00 con 0x7f2b240ab870 2023-11-20T06:41:28.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.788+0000 7f2b1affd640 1 -- 172.21.15.19:0/3441259727 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c00cd70 con 0x7f2b240ab870 2023-11-20T06:41:28.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.788+0000 7f2b28e9c640 1 -- 172.21.15.19:0/3441259727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2415f170 con 0x7f2b240ab870 2023-11-20T06:41:28.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.788+0000 7f2b28e9c640 1 -- 172.21.15.19:0/3441259727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2415f730 con 0x7f2b240ab870 2023-11-20T06:41:28.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.788+0000 7f2b28e9c640 1 -- 172.21.15.19:0/3441259727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2406ca80 con 0x7f2b240ab870 2023-11-20T06:41:28.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.788+0000 7f2b1affd640 1 -- 172.21.15.19:0/3441259727 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2b0c013470 con 0x7f2b240ab870 2023-11-20T06:41:28.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.788+0000 7f2b1affd640 1 --2- 172.21.15.19:0/3441259727 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2b040664a0 0x7f2b04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:28.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.788+0000 7f2b1affd640 1 -- 172.21.15.19:0/3441259727 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2b0c084590 con 0x7f2b240ab870 2023-11-20T06:41:28.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.788+0000 7f2b2259c640 1 --2- 172.21.15.19:0/3441259727 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2b040664a0 0x7f2b04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:28.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.792+0000 7f2b2259c640 1 --2- 172.21.15.19:0/3441259727 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2b040664a0 0x7f2b04068960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2b14000f70 tx=0x7f2b14009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.792+0000 7f2b1affd640 1 -- 172.21.15.19:0/3441259727 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2b0c0516c0 con 0x7f2b240ab870 2023-11-20T06:41:28.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.948+0000 7f2b28e9c640 1 -- 172.21.15.19:0/3441259727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2b2404e170 con 0x7f2b240ab870 2023-11-20T06:41:28.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.948+0000 7f2b1affd640 1 -- 172.21.15.19:0/3441259727 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2b0c054ce0 con 0x7f2b240ab870 2023-11-20T06:41:28.955 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:41:28.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.952+0000 7f2b28e9c640 1 -- 172.21.15.19:0/3441259727 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2b040664a0 msgr2=0x7f2b04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:28.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.952+0000 7f2b28e9c640 1 --2- 172.21.15.19:0/3441259727 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2b040664a0 0x7f2b04068960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2b14000f70 tx=0x7f2b14009040 comp rx=0 tx=0).stop 2023-11-20T06:41:28.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.952+0000 7f2b28e9c640 1 -- 172.21.15.19:0/3441259727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b240ab870 msgr2=0x7f2b240cb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:28.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.952+0000 7f2b28e9c640 1 --2- 172.21.15.19:0/3441259727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b240ab870 0x7f2b240cb3b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00e930 tx=0x7f2b0c00edf0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.952+0000 7f2b28e9c640 1 -- 172.21.15.19:0/3441259727 shutdown_connections 2023-11-20T06:41:28.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.952+0000 7f2b28e9c640 1 --2- 172.21.15.19:0/3441259727 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2b040664a0 0x7f2b04068960 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.952+0000 7f2b28e9c640 1 --2- 172.21.15.19:0/3441259727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b2415cbc0 0x7f2b24144300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.952+0000 7f2b28e9c640 1 --2- 172.21.15.19:0/3441259727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b240ab870 0x7f2b240cb3b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.952+0000 7f2b28e9c640 1 --2- 172.21.15.19:0/3441259727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b2406a3d0 0x7f2b2415d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:28.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.952+0000 7f2b28e9c640 1 -- 172.21.15.19:0/3441259727 >> 172.21.15.19:0/3441259727 conn(0x7f2b240b0da0 msgr2=0x7f2b240abed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:28.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.952+0000 7f2b28e9c640 1 -- 172.21.15.19:0/3441259727 shutdown_connections 2023-11-20T06:41:28.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:28.952+0000 7f2b28e9c640 1 -- 172.21.15.19:0/3441259727 wait complete. 2023-11-20T06:41:28.976 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T06:41:29.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.116+0000 7f662dc68640 1 Processor -- start 2023-11-20T06:41:29.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.116+0000 7f662dc68640 1 -- start start 2023-11-20T06:41:29.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.116+0000 7f662dc68640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f662815ca70 0x7f66280d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:29.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.116+0000 7f662dc68640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f66280cf7a0 0x7f66280c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:29.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.116+0000 7f662dc68640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66280c65f0 con 0x7f66280d3550 2023-11-20T06:41:29.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.116+0000 7f662dc68640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66280ce820 con 0x7f66280cf7a0 2023-11-20T06:41:29.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.116+0000 7f662dc68640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66280cdf80 con 0x7f662815ca70 2023-11-20T06:41:29.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.116+0000 7f6626ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f66280d3550 0x7f66280cf090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:51254/0 (socket says 172.21.15.19:51254) 2023-11-20T06:41:29.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.116+0000 7f6626ffd640 1 -- 172.21.15.19:0/440044620 learned_addr learned my addr 172.21.15.19:0/440044620 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:29.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.116+0000 7f66277fe640 1 --2- 172.21.15.19:0/440044620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f662815ca70 0x7f66280d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:29.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.116+0000 7f6627fff640 1 --2- 172.21.15.19:0/440044620 >> v2:172.21.15.190:3300/0 conn(0x7f66280cf7a0 0x7f66280c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:29.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.120+0000 7f66267fc640 1 -- 172.21.15.19:0/440044620 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109136331 0 0) 0x7f66280c65f0 con 0x7f66280d3550 2023-11-20T06:41:29.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.120+0000 7f66267fc640 1 -- 172.21.15.19:0/440044620 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6610003530 con 0x7f66280d3550 2023-11-20T06:41:29.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.120+0000 7f66277fe640 1 -- 172.21.15.19:0/440044620 >> v2:172.21.15.190:3300/0 conn(0x7f66280cf7a0 msgr2=0x7f66280c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:29.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.120+0000 7f66277fe640 1 --2- 172.21.15.19:0/440044620 >> v2:172.21.15.190:3300/0 conn(0x7f66280cf7a0 0x7f66280c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:29.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.120+0000 7f66277fe640 1 -- 172.21.15.19:0/440044620 >> v1:172.21.15.19:6789/0 conn(0x7f66280d3550 legacy=0x7f66280cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:29.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.120+0000 7f66277fe640 1 -- 172.21.15.19:0/440044620 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66280ce260 con 0x7f662815ca70 2023-11-20T06:41:29.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.120+0000 7f66277fe640 1 --2- 172.21.15.19:0/440044620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f662815ca70 0x7f66280d3010 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f66180097a0 tx=0x7f661801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3cf76c363c1c8c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:29.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.120+0000 7f66267fc640 1 -- 172.21.15.19:0/440044620 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66180ad640 con 0x7f662815ca70 2023-11-20T06:41:29.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.120+0000 7f66267fc640 1 -- 172.21.15.19:0/440044620 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66180ad7a0 con 0x7f662815ca70 2023-11-20T06:41:29.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.120+0000 7f66267fc640 1 -- 172.21.15.19:0/440044620 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66180adb30 con 0x7f662815ca70 2023-11-20T06:41:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.120+0000 7f662dc68640 1 -- 172.21.15.19:0/440044620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f662815ca70 msgr2=0x7f66280d3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.120+0000 7f662dc68640 1 --2- 172.21.15.19:0/440044620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f662815ca70 0x7f66280d3010 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f66180097a0 tx=0x7f661801c430 comp rx=0 tx=0).stop 2023-11-20T06:41:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f662dc68640 1 -- 172.21.15.19:0/440044620 shutdown_connections 2023-11-20T06:41:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f662dc68640 1 --2- 172.21.15.19:0/440044620 >> v2:172.21.15.190:3300/0 conn(0x7f66280cf7a0 0x7f66280c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f662dc68640 1 --2- 172.21.15.19:0/440044620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f662815ca70 0x7f66280d3010 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f662dc68640 1 -- 172.21.15.19:0/440044620 >> 172.21.15.19:0/440044620 conn(0x7f662809bc50 msgr2=0x7f66280d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:29.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f662dc68640 1 -- 172.21.15.19:0/440044620 shutdown_connections 2023-11-20T06:41:29.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f662dc68640 1 -- 172.21.15.19:0/440044620 wait complete. 2023-11-20T06:41:29.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f662dc68640 1 Processor -- start 2023-11-20T06:41:29.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f662dc68640 1 -- start start 2023-11-20T06:41:29.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f662dc68640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66280cf7a0 0x7f662814e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:29.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f662dc68640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66280d3550 0x7f66280ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:29.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f662dc68640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f662815ca70 0x7f66280cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:29.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f662dc68640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66280ca2e0 con 0x7f662815ca70 2023-11-20T06:41:29.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f662dc68640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66280c99d0 con 0x7f66280cf7a0 2023-11-20T06:41:29.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f662dc68640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66280cc240 con 0x7f66280d3550 2023-11-20T06:41:29.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f6627fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f662815ca70 0x7f66280cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:29.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f6627fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f662815ca70 0x7f66280cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54282/0 (socket says 172.21.15.19:54282) 2023-11-20T06:41:29.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f6627fff640 1 -- 172.21.15.19:0/5842343 learned_addr learned my addr 172.21.15.19:0/5842343 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:29.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f66277fe640 1 --2- 172.21.15.19:0/5842343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66280cf7a0 0x7f662814e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:29.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f6626ffd640 1 --2- 172.21.15.19:0/5842343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66280d3550 0x7f66280ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:29.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f6627fff640 1 -- 172.21.15.19:0/5842343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66280d3550 msgr2=0x7f66280ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:29.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f6627fff640 1 --2- 172.21.15.19:0/5842343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66280d3550 0x7f66280ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:29.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f6627fff640 1 -- 172.21.15.19:0/5842343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66280cf7a0 msgr2=0x7f662814e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:29.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f6627fff640 1 --2- 172.21.15.19:0/5842343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66280cf7a0 0x7f662814e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:29.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f6627fff640 1 -- 172.21.15.19:0/5842343 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66180093b0 con 0x7f662815ca70 2023-11-20T06:41:29.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.124+0000 7f6627fff640 1 --2- 172.21.15.19:0/5842343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f662815ca70 0x7f66280cb8d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f662000ef90 tx=0x7f662000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:29.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.128+0000 7f660ffff640 1 -- 172.21.15.19:0/5842343 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620009ca0 con 0x7f662815ca70 2023-11-20T06:41:29.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.128+0000 7f660ffff640 1 -- 172.21.15.19:0/5842343 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662000f040 con 0x7f662815ca70 2023-11-20T06:41:29.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.128+0000 7f660ffff640 1 -- 172.21.15.19:0/5842343 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66200146c0 con 0x7f662815ca70 2023-11-20T06:41:29.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.128+0000 7f662dc68640 1 -- 172.21.15.19:0/5842343 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66280c9c20 con 0x7f662815ca70 2023-11-20T06:41:29.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.128+0000 7f662dc68640 1 -- 172.21.15.19:0/5842343 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66280cbe10 con 0x7f662815ca70 2023-11-20T06:41:29.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.128+0000 7f662dc68640 1 -- 172.21.15.19:0/5842343 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66280ca420 con 0x7f662815ca70 2023-11-20T06:41:29.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.128+0000 7f660ffff640 1 -- 172.21.15.19:0/5842343 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6620014820 con 0x7f662815ca70 2023-11-20T06:41:29.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.128+0000 7f660ffff640 1 --2- 172.21.15.19:0/5842343 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f66140664a0 0x7f6614068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:29.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.128+0000 7f660ffff640 1 -- 172.21.15.19:0/5842343 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6620085180 con 0x7f662815ca70 2023-11-20T06:41:29.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.128+0000 7f66277fe640 1 --2- 172.21.15.19:0/5842343 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f66140664a0 0x7f6614068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:29.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.132+0000 7f66277fe640 1 --2- 172.21.15.19:0/5842343 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f66140664a0 0x7f6614068960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f66180af000 tx=0x7f66180a7070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:29.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.132+0000 7f660ffff640 1 -- 172.21.15.19:0/5842343 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f66280ca420 con 0x7f662815ca70 2023-11-20T06:41:29.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.304+0000 7f662dc68640 1 -- 172.21.15.19:0/5842343 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f66280ca420 con 0x7f662815ca70 2023-11-20T06:41:29.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.304+0000 7f660ffff640 1 -- 172.21.15.19:0/5842343 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f66280ca420 con 0x7f662815ca70 2023-11-20T06:41:29.309 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2023-11-20T06:41:29.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.304+0000 7f662dc68640 1 -- 172.21.15.19:0/5842343 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f66140664a0 msgr2=0x7f6614068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:29.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.304+0000 7f662dc68640 1 --2- 172.21.15.19:0/5842343 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f66140664a0 0x7f6614068960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f66180af000 tx=0x7f66180a7070 comp rx=0 tx=0).stop 2023-11-20T06:41:29.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.304+0000 7f662dc68640 1 -- 172.21.15.19:0/5842343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f662815ca70 msgr2=0x7f66280cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:29.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.304+0000 7f662dc68640 1 --2- 172.21.15.19:0/5842343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f662815ca70 0x7f66280cb8d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f662000ef90 tx=0x7f662000c490 comp rx=0 tx=0).stop 2023-11-20T06:41:29.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.304+0000 7f662dc68640 1 -- 172.21.15.19:0/5842343 shutdown_connections 2023-11-20T06:41:29.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.304+0000 7f662dc68640 1 --2- 172.21.15.19:0/5842343 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f66140664a0 0x7f6614068960 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:29.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.304+0000 7f662dc68640 1 --2- 172.21.15.19:0/5842343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f662815ca70 0x7f66280cb8d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:29.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.304+0000 7f662dc68640 1 --2- 172.21.15.19:0/5842343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66280d3550 0x7f66280ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:29.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.304+0000 7f662dc68640 1 --2- 172.21.15.19:0/5842343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66280cf7a0 0x7f662814e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:29.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.304+0000 7f662dc68640 1 -- 172.21.15.19:0/5842343 >> 172.21.15.19:0/5842343 conn(0x7f662809bc50 msgr2=0x7f662806b210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:29.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.304+0000 7f662dc68640 1 -- 172.21.15.19:0/5842343 shutdown_connections 2023-11-20T06:41:29.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:29.304+0000 7f662dc68640 1 -- 172.21.15.19:0/5842343 wait complete. 2023-11-20T06:41:29.330 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi019.front.sepia.ceph.com... 2023-11-20T06:41:29.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:29.330 DEBUG:teuthology.orchestra.run.smithi019:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-11-20T06:41:29.359 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi019.stderr:ceph-fuse[44074]: fuse finished with error 0 and tester_r 0 2023-11-20T06:41:29.362 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:41:35.463 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2023-11-20T06:41:35.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:35.464 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-11-20T06:41:35.480 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:41:35.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc9a14ea640 1 Processor -- start 2023-11-20T06:41:35.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc9a14ea640 1 -- start start 2023-11-20T06:41:35.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc9a14ea640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc99c15cb90 0x7fc99c0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:35.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc9a14ea640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc99c0ce770 con 0x7fc99c0d3010 2023-11-20T06:41:35.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc9a14ea640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc99c0d0600 con 0x7fc99c0d15d0 2023-11-20T06:41:35.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc9a14ea640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99c0c6450 con 0x7fc99c15cb90 2023-11-20T06:41:35.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc993fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc99c0d3010 0x7fc99c0d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45884/0 (socket says 172.21.15.19:45884) 2023-11-20T06:41:35.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc993fff640 1 -- 172.21.15.19:0/733644552 learned_addr learned my addr 172.21.15.19:0/733644552 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:35.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc99affd640 1 --2- 172.21.15.19:0/733644552 >> v2:172.21.15.190:3300/0 conn(0x7fc99c15cb90 0x7fc99c0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:35.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc99a7fc640 1 -- 172.21.15.19:0/733644552 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3590491662 0 0) 0x7fc99c0ce770 con 0x7fc99c0d3010 2023-11-20T06:41:35.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc99a7fc640 1 -- 172.21.15.19:0/733644552 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc988003530 con 0x7fc99c0d3010 2023-11-20T06:41:35.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc99a7fc640 1 -- 172.21.15.19:0/733644552 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2222608788 0 0) 0x7fc988003530 con 0x7fc99c0d3010 2023-11-20T06:41:35.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc99a7fc640 1 -- 172.21.15.19:0/733644552 >> v2:172.21.15.190:3300/0 conn(0x7fc99c15cb90 msgr2=0x7fc99c0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:35.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc99a7fc640 1 --2- 172.21.15.19:0/733644552 >> v2:172.21.15.190:3300/0 conn(0x7fc99c15cb90 0x7fc99c0cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:35.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc99a7fc640 1 -- 172.21.15.19:0/733644552 >> v1:172.21.15.190:6789/0 conn(0x7fc99c0d15d0 legacy=0x7fc99c0c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:35.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc99a7fc640 1 -- 172.21.15.19:0/733644552 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c0d08a0 con 0x7fc99c0d3010 2023-11-20T06:41:35.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc99a7fc640 1 -- 172.21.15.19:0/733644552 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7fc9840016a0 con 0x7fc99c0d3010 2023-11-20T06:41:35.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc99a7fc640 1 -- 172.21.15.19:0/733644552 >> v1:172.21.15.19:6789/0 conn(0x7fc99c0d3010 legacy=0x7fc99c0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:35.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc99a7fc640 1 --2- 172.21.15.19:0/733644552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc988003980 0x7fc988003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:35.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc99a7fc640 1 --2- 172.21.15.19:0/733644552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9880047d0 0x7fc988004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:35.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc99a7fc640 1 --2- 172.21.15.19:0/733644552 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc988005190 0x7fc98800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:35.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc99a7fc640 1 -- 172.21.15.19:0/733644552 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c0c6450 con 0x7fc9880047d0 2023-11-20T06:41:35.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc99a7fc640 1 -- 172.21.15.19:0/733644552 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98800c130 con 0x7fc988003980 2023-11-20T06:41:35.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc99a7fc640 1 -- 172.21.15.19:0/733644552 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98800c2f0 con 0x7fc988005190 2023-11-20T06:41:35.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc993fff640 1 --2- 172.21.15.19:0/733644552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9880047d0 0x7fc988004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:35.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc99affd640 1 --2- 172.21.15.19:0/733644552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc988003980 0x7fc988003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:35.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.672+0000 7fc99b7fe640 1 --2- 172.21.15.19:0/733644552 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc988005190 0x7fc98800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:35.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.676+0000 7fc99affd640 1 -- 172.21.15.19:0/733644552 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc988005190 msgr2=0x7fc98800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:35.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.676+0000 7fc99affd640 1 --2- 172.21.15.19:0/733644552 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc988005190 0x7fc98800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:35.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.676+0000 7fc99affd640 1 -- 172.21.15.19:0/733644552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9880047d0 msgr2=0x7fc988004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:35.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.676+0000 7fc99affd640 1 --2- 172.21.15.19:0/733644552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9880047d0 0x7fc988004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:35.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.676+0000 7fc99affd640 1 -- 172.21.15.19:0/733644552 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc988003530 con 0x7fc988003980 2023-11-20T06:41:35.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.676+0000 7fc99b7fe640 1 -- 172.21.15.19:0/733644552 reap_dead start 2023-11-20T06:41:35.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.676+0000 7fc99affd640 1 --2- 172.21.15.19:0/733644552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc988003980 0x7fc988003da0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc98c009ac0 tx=0x7fc98c01ca20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5f38e5b9a42f21 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:35.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.676+0000 7fc99a7fc640 1 -- 172.21.15.19:0/733644552 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c0059a0 con 0x7fc988003980 2023-11-20T06:41:35.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.676+0000 7fc99a7fc640 1 -- 172.21.15.19:0/733644552 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98c005b00 con 0x7fc988003980 2023-11-20T06:41:35.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.676+0000 7fc99a7fc640 1 -- 172.21.15.19:0/733644552 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c0a56a0 con 0x7fc988003980 2023-11-20T06:41:35.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc9a14ea640 1 -- 172.21.15.19:0/733644552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc988003980 msgr2=0x7fc988003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:35.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc9a14ea640 1 --2- 172.21.15.19:0/733644552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc988003980 0x7fc988003da0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc98c009ac0 tx=0x7fc98c01ca20 comp rx=0 tx=0).stop 2023-11-20T06:41:35.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc9a14ea640 1 -- 172.21.15.19:0/733644552 shutdown_connections 2023-11-20T06:41:35.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc9a14ea640 1 --2- 172.21.15.19:0/733644552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc988003980 0x7fc988003da0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:35.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc9a14ea640 1 -- 172.21.15.19:0/733644552 >> 172.21.15.19:0/733644552 conn(0x7fc99c09bc50 msgr2=0x7fc99c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:35.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc9a14ea640 1 -- 172.21.15.19:0/733644552 shutdown_connections 2023-11-20T06:41:35.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc9a14ea640 1 -- 172.21.15.19:0/733644552 wait complete. 2023-11-20T06:41:35.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc9a14ea640 1 Processor -- start 2023-11-20T06:41:35.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc9a14ea640 1 -- start start 2023-11-20T06:41:35.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc9a14ea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc988003980 0x7fc99c0caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:35.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc9a14ea640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc99c0cc540 0x7fc99c155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:35.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc9a14ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc99c154c40 0x7fc99c155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:35.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc9a14ea640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c0ca480 con 0x7fc988003980 2023-11-20T06:41:35.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc9a14ea640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c153950 con 0x7fc99c0cc540 2023-11-20T06:41:35.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc9a14ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c0cc9d0 con 0x7fc99c154c40 2023-11-20T06:41:35.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc99affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc988003980 0x7fc99c0caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:35.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc99affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc988003980 0x7fc99c0caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48256/0 (socket says 172.21.15.19:48256) 2023-11-20T06:41:35.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc99affd640 1 -- 172.21.15.19:0/1769043004 learned_addr learned my addr 172.21.15.19:0/1769043004 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc993fff640 1 --2- 172.21.15.19:0/1769043004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc99c0cc540 0x7fc99c155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc99b7fe640 1 --2- 172.21.15.19:0/1769043004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc99c154c40 0x7fc99c155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc99affd640 1 -- 172.21.15.19:0/1769043004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc99c154c40 msgr2=0x7fc99c155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc99affd640 1 --2- 172.21.15.19:0/1769043004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc99c154c40 0x7fc99c155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc99affd640 1 -- 172.21.15.19:0/1769043004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc99c0cc540 msgr2=0x7fc99c155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc99affd640 1 --2- 172.21.15.19:0/1769043004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc99c0cc540 0x7fc99c155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.680+0000 7fc99affd640 1 -- 172.21.15.19:0/1769043004 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c0ca720 con 0x7fc988003980 2023-11-20T06:41:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.684+0000 7fc99affd640 1 --2- 172.21.15.19:0/1769043004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc988003980 0x7fc99c0caf20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc98c01c850 tx=0x7fc988005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.684+0000 7fc9937fe640 1 -- 172.21.15.19:0/1769043004 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c0be070 con 0x7fc988003980 2023-11-20T06:41:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.684+0000 7fc9937fe640 1 -- 172.21.15.19:0/1769043004 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98c00f000 con 0x7fc988003980 2023-11-20T06:41:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.684+0000 7fc9a14ea640 1 -- 172.21.15.19:0/1769043004 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99c0caa00 con 0x7fc988003980 2023-11-20T06:41:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.684+0000 7fc9937fe640 1 -- 172.21.15.19:0/1769043004 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c005e90 con 0x7fc988003980 2023-11-20T06:41:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.684+0000 7fc9a14ea640 1 -- 172.21.15.19:0/1769043004 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99c1563b0 con 0x7fc988003980 2023-11-20T06:41:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.684+0000 7fc9a14ea640 1 -- 172.21.15.19:0/1769043004 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99c156660 con 0x7fc988003980 2023-11-20T06:41:35.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.684+0000 7fc9937fe640 1 -- 172.21.15.19:0/1769043004 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc98c004020 con 0x7fc988003980 2023-11-20T06:41:35.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.684+0000 7fc9937fe640 1 --2- 172.21.15.19:0/1769043004 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc97c0664a0 0x7fc97c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:35.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.684+0000 7fc9937fe640 1 -- 172.21.15.19:0/1769043004 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc98c11eb00 con 0x7fc988003980 2023-11-20T06:41:35.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.684+0000 7fc993fff640 1 --2- 172.21.15.19:0/1769043004 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc97c0664a0 0x7fc97c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:35.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.688+0000 7fc993fff640 1 --2- 172.21.15.19:0/1769043004 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc97c0664a0 0x7fc97c068960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc99c1e9630 tx=0x7fc984009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.688+0000 7fc9937fe640 1 -- 172.21.15.19:0/1769043004 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc98c0ebd10 con 0x7fc988003980 2023-11-20T06:41:35.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.852+0000 7fc9a14ea640 1 -- 172.21.15.19:0/1769043004 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc99c074010 con 0x7fc988003980 2023-11-20T06:41:35.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.852+0000 7fc9937fe640 1 -- 172.21.15.19:0/1769043004 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18334 (secure 0 0 0) 0x7fc98c0ef330 con 0x7fc988003980 2023-11-20T06:41:35.856 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:35.857 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":25,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:20.306335+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:41:35.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.852+0000 7fc9a14ea640 1 -- 172.21.15.19:0/1769043004 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc97c0664a0 msgr2=0x7fc97c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:35.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.852+0000 7fc9a14ea640 1 --2- 172.21.15.19:0/1769043004 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc97c0664a0 0x7fc97c068960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc99c1e9630 tx=0x7fc984009040 comp rx=0 tx=0).stop 2023-11-20T06:41:35.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.852+0000 7fc9a14ea640 1 -- 172.21.15.19:0/1769043004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc988003980 msgr2=0x7fc99c0caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:35.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.852+0000 7fc9a14ea640 1 --2- 172.21.15.19:0/1769043004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc988003980 0x7fc99c0caf20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc98c01c850 tx=0x7fc988005800 comp rx=0 tx=0).stop 2023-11-20T06:41:35.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.852+0000 7fc9a14ea640 1 -- 172.21.15.19:0/1769043004 shutdown_connections 2023-11-20T06:41:35.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.852+0000 7fc9a14ea640 1 --2- 172.21.15.19:0/1769043004 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc97c0664a0 0x7fc97c068960 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:35.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.852+0000 7fc9a14ea640 1 --2- 172.21.15.19:0/1769043004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc99c154c40 0x7fc99c155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:35.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.852+0000 7fc9a14ea640 1 --2- 172.21.15.19:0/1769043004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc99c0cc540 0x7fc99c155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:35.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.852+0000 7fc9a14ea640 1 --2- 172.21.15.19:0/1769043004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc988003980 0x7fc99c0caf20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:35.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.852+0000 7fc9a14ea640 1 -- 172.21.15.19:0/1769043004 >> 172.21.15.19:0/1769043004 conn(0x7fc99c09bc50 msgr2=0x7fc99c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:35.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.852+0000 7fc9a14ea640 1 -- 172.21.15.19:0/1769043004 shutdown_connections 2023-11-20T06:41:35.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:35.852+0000 7fc9a14ea640 1 -- 172.21.15.19:0/1769043004 wait complete. 2023-11-20T06:41:35.878 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:41:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.016+0000 7ff6dfd3e640 1 Processor -- start 2023-11-20T06:41:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.016+0000 7ff6dfd3e640 1 -- start start 2023-11-20T06:41:36.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.016+0000 7ff6dfd3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6d81597c0 0x7ff6d80ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:36.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.016+0000 7ff6dfd3e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d80723d0 con 0x7ff6d8159ba0 2023-11-20T06:41:36.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.016+0000 7ff6dfd3e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d80717c0 con 0x7ff6d80adc10 2023-11-20T06:41:36.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.016+0000 7ff6dfd3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d8071aa0 con 0x7ff6d81597c0 2023-11-20T06:41:36.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.016+0000 7ff6dd2d9640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff6d8159ba0 0x7ff6d80cae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45898/0 (socket says 172.21.15.19:45898) 2023-11-20T06:41:36.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.016+0000 7ff6dd2d9640 1 -- 172.21.15.19:0/3704836981 learned_addr learned my addr 172.21.15.19:0/3704836981 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:36.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.020+0000 7ff6ddada640 1 --2- 172.21.15.19:0/3704836981 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6d81597c0 0x7ff6d80ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:36.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.020+0000 7ff6dcad8640 1 -- 172.21.15.19:0/3704836981 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446578470 0 0) 0x7ff6d80723d0 con 0x7ff6d8159ba0 2023-11-20T06:41:36.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.020+0000 7ff6dcad8640 1 -- 172.21.15.19:0/3704836981 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6c4003530 con 0x7ff6d8159ba0 2023-11-20T06:41:36.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.020+0000 7ff6dcad8640 1 -- 172.21.15.19:0/3704836981 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2399152714 0 0) 0x7ff6d80717c0 con 0x7ff6d80adc10 2023-11-20T06:41:36.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.020+0000 7ff6dcad8640 1 -- 172.21.15.19:0/3704836981 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6d80723d0 con 0x7ff6d80adc10 2023-11-20T06:41:36.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.020+0000 7ff6ddada640 1 -- 172.21.15.19:0/3704836981 >> v1:172.21.15.190:6789/0 conn(0x7ff6d80adc10 legacy=0x7ff6d815d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:36.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.020+0000 7ff6ddada640 1 -- 172.21.15.19:0/3704836981 >> v1:172.21.15.19:6789/0 conn(0x7ff6d8159ba0 legacy=0x7ff6d80cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:36.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.020+0000 7ff6ddada640 1 -- 172.21.15.19:0/3704836981 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d8071d80 con 0x7ff6d81597c0 2023-11-20T06:41:36.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.020+0000 7ff6ddada640 1 --2- 172.21.15.19:0/3704836981 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6d81597c0 0x7ff6d80ad6d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40097f0 tx=0x7ff6d401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ef5a5a7a6c73bf9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:36.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.020+0000 7ff6dcad8640 1 -- 172.21.15.19:0/3704836981 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d40a7070 con 0x7ff6d81597c0 2023-11-20T06:41:36.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.020+0000 7ff6dcad8640 1 -- 172.21.15.19:0/3704836981 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d40ab430 con 0x7ff6d81597c0 2023-11-20T06:41:36.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.020+0000 7ff6dcad8640 1 -- 172.21.15.19:0/3704836981 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d40ab7c0 con 0x7ff6d81597c0 2023-11-20T06:41:36.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6dfd3e640 1 -- 172.21.15.19:0/3704836981 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6d81597c0 msgr2=0x7ff6d80ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:36.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6dfd3e640 1 --2- 172.21.15.19:0/3704836981 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6d81597c0 0x7ff6d80ad6d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40097f0 tx=0x7ff6d401c490 comp rx=0 tx=0).stop 2023-11-20T06:41:36.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6dfd3e640 1 -- 172.21.15.19:0/3704836981 shutdown_connections 2023-11-20T06:41:36.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6dfd3e640 1 --2- 172.21.15.19:0/3704836981 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6d81597c0 0x7ff6d80ad6d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:36.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6dfd3e640 1 -- 172.21.15.19:0/3704836981 >> 172.21.15.19:0/3704836981 conn(0x7ff6d806c190 msgr2=0x7ff6d806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:36.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6dfd3e640 1 -- 172.21.15.19:0/3704836981 shutdown_connections 2023-11-20T06:41:36.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6dfd3e640 1 -- 172.21.15.19:0/3704836981 wait complete. 2023-11-20T06:41:36.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6dfd3e640 1 Processor -- start 2023-11-20T06:41:36.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6dfd3e640 1 -- start start 2023-11-20T06:41:36.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6dfd3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6d80adc10 0x7ff6d8149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:36.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6dfd3e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6d81597c0 0x7ff6d815a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:36.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6dfd3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d8159ba0 0x7ff6d815bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:36.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6dfd3e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d815ae60 con 0x7ff6d8159ba0 2023-11-20T06:41:36.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6dfd3e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d815b140 con 0x7ff6d81597c0 2023-11-20T06:41:36.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6dfd3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d815b420 con 0x7ff6d80adc10 2023-11-20T06:41:36.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6de2db640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d8159ba0 0x7ff6d815bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:36.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6de2db640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d8159ba0 0x7ff6d815bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48272/0 (socket says 172.21.15.19:48272) 2023-11-20T06:41:36.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6de2db640 1 -- 172.21.15.19:0/1329064830 learned_addr learned my addr 172.21.15.19:0/1329064830 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:36.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6ddada640 1 --2- 172.21.15.19:0/1329064830 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6d80adc10 0x7ff6d8149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:36.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6dd2d9640 1 --2- 172.21.15.19:0/1329064830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6d81597c0 0x7ff6d815a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:36.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6de2db640 1 -- 172.21.15.19:0/1329064830 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6d80adc10 msgr2=0x7ff6d8149290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:36.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6de2db640 1 --2- 172.21.15.19:0/1329064830 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6d80adc10 0x7ff6d8149290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:36.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6de2db640 1 -- 172.21.15.19:0/1329064830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6d81597c0 msgr2=0x7ff6d815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:36.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6de2db640 1 --2- 172.21.15.19:0/1329064830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6d81597c0 0x7ff6d815a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:36.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6de2db640 1 -- 172.21.15.19:0/1329064830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d4009420 con 0x7ff6d8159ba0 2023-11-20T06:41:36.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.024+0000 7ff6dd2d9640 1 --2- 172.21.15.19:0/1329064830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6d81597c0 0x7ff6d815a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:36.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.028+0000 7ff6de2db640 1 --2- 172.21.15.19:0/1329064830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d8159ba0 0x7ff6d815bf00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000c730 tx=0x7ff6d000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:36.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.028+0000 7ff6ce7fc640 1 -- 172.21.15.19:0/1329064830 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0003b80 con 0x7ff6d8159ba0 2023-11-20T06:41:36.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.028+0000 7ff6ce7fc640 1 -- 172.21.15.19:0/1329064830 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d0003ce0 con 0x7ff6d8159ba0 2023-11-20T06:41:36.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.028+0000 7ff6dfd3e640 1 -- 172.21.15.19:0/1329064830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d815b700 con 0x7ff6d8159ba0 2023-11-20T06:41:36.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.028+0000 7ff6ce7fc640 1 -- 172.21.15.19:0/1329064830 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d000aa90 con 0x7ff6d8159ba0 2023-11-20T06:41:36.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.028+0000 7ff6dfd3e640 1 -- 172.21.15.19:0/1329064830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d815ab70 con 0x7ff6d8159ba0 2023-11-20T06:41:36.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.028+0000 7ff6dfd3e640 1 -- 172.21.15.19:0/1329064830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d8074010 con 0x7ff6d8159ba0 2023-11-20T06:41:36.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.028+0000 7ff6ce7fc640 1 -- 172.21.15.19:0/1329064830 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff6d000abf0 con 0x7ff6d8159ba0 2023-11-20T06:41:36.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.028+0000 7ff6ce7fc640 1 --2- 172.21.15.19:0/1329064830 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6bc0664d0 0x7ff6bc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:36.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.028+0000 7ff6ce7fc640 1 -- 172.21.15.19:0/1329064830 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff6d0083ea0 con 0x7ff6d8159ba0 2023-11-20T06:41:36.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.028+0000 7ff6ddada640 1 --2- 172.21.15.19:0/1329064830 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6bc0664d0 0x7ff6bc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:36.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.032+0000 7ff6ddada640 1 --2- 172.21.15.19:0/1329064830 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6bc0664d0 0x7ff6bc068990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40af000 tx=0x7ff6d40a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:36.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.032+0000 7ff6ce7fc640 1 -- 172.21.15.19:0/1329064830 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff6d0051030 con 0x7ff6d8159ba0 2023-11-20T06:41:36.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.191+0000 7ff6dfd3e640 1 -- 172.21.15.19:0/1329064830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6d80ad6c0 con 0x7ff6d8159ba0 2023-11-20T06:41:36.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.191+0000 7ff6ce7fc640 1 -- 172.21.15.19:0/1329064830 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18334 (secure 0 0 0) 0x7ff6d0054650 con 0x7ff6d8159ba0 2023-11-20T06:41:36.198 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:36.198 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":25,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:20.306335+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:41:36.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.195+0000 7ff6dfd3e640 1 -- 172.21.15.19:0/1329064830 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6bc0664d0 msgr2=0x7ff6bc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:36.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.195+0000 7ff6dfd3e640 1 --2- 172.21.15.19:0/1329064830 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6bc0664d0 0x7ff6bc068990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40af000 tx=0x7ff6d40a7000 comp rx=0 tx=0).stop 2023-11-20T06:41:36.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.195+0000 7ff6dfd3e640 1 -- 172.21.15.19:0/1329064830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d8159ba0 msgr2=0x7ff6d815bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:36.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.195+0000 7ff6dfd3e640 1 --2- 172.21.15.19:0/1329064830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d8159ba0 0x7ff6d815bf00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000c730 tx=0x7ff6d000cbf0 comp rx=0 tx=0).stop 2023-11-20T06:41:36.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.195+0000 7ff6dfd3e640 1 -- 172.21.15.19:0/1329064830 shutdown_connections 2023-11-20T06:41:36.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.195+0000 7ff6dfd3e640 1 --2- 172.21.15.19:0/1329064830 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6bc0664d0 0x7ff6bc068990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:36.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.195+0000 7ff6dfd3e640 1 --2- 172.21.15.19:0/1329064830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d8159ba0 0x7ff6d815bf00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:36.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.195+0000 7ff6dfd3e640 1 --2- 172.21.15.19:0/1329064830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6d81597c0 0x7ff6d815a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:36.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.195+0000 7ff6dfd3e640 1 --2- 172.21.15.19:0/1329064830 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6d80adc10 0x7ff6d8149290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:36.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.195+0000 7ff6dfd3e640 1 -- 172.21.15.19:0/1329064830 >> 172.21.15.19:0/1329064830 conn(0x7ff6d806c190 msgr2=0x7ff6d815c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:36.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.195+0000 7ff6dfd3e640 1 -- 172.21.15.19:0/1329064830 shutdown_connections 2023-11-20T06:41:36.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.195+0000 7ff6dfd3e640 1 -- 172.21.15.19:0/1329064830 wait complete. 2023-11-20T06:41:36.219 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-20T06:41:36.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.359+0000 7ff48d29c640 1 Processor -- start 2023-11-20T06:41:36.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.359+0000 7ff48d29c640 1 -- start start 2023-11-20T06:41:36.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.363+0000 7ff48d29c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4880d0210 0x7ff4880d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:36.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.363+0000 7ff48d29c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff4880b84e0 0x7ff4880b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:36.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.363+0000 7ff48d29c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4880d1670 con 0x7ff48815cba0 2023-11-20T06:41:36.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.363+0000 7ff48d29c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4880d1460 con 0x7ff4880b84e0 2023-11-20T06:41:36.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.363+0000 7ff48d29c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880d1950 con 0x7ff4880d0210 2023-11-20T06:41:36.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.363+0000 7ff4877fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff4880b84e0 0x7ff4880b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:36.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.363+0000 7ff4877fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff4880b84e0 0x7ff4880b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48274/0 (socket says 172.21.15.19:48274) 2023-11-20T06:41:36.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.363+0000 7ff4877fe640 1 -- 172.21.15.19:0/2937842708 learned_addr learned my addr 172.21.15.19:0/2937842708 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:36.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.363+0000 7ff47ffff640 1 --2- 172.21.15.19:0/2937842708 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4880d0210 0x7ff4880d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:36.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.363+0000 7ff4877fe640 1 -- 172.21.15.19:0/2937842708 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4880d0210 msgr2=0x7ff4880d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:36.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.363+0000 7ff4877fe640 1 --2- 172.21.15.19:0/2937842708 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4880d0210 0x7ff4880d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:36.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.363+0000 7ff4877fe640 1 -- 172.21.15.19:0/2937842708 >> v1:172.21.15.190:6789/0 conn(0x7ff48815cba0 legacy=0x7ff4880cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:36.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.363+0000 7ff4877fe640 1 -- 172.21.15.19:0/2937842708 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4880d1c30 con 0x7ff4880b84e0 2023-11-20T06:41:36.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.363+0000 7ff4877fe640 1 --2- 172.21.15.19:0/2937842708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4880b84e0 0x7ff4880b5cf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff480009e50 tx=0x7ff48001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f086384c38cfb6 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:36.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.367+0000 7ff4867fc640 1 -- 172.21.15.19:0/2937842708 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4800a58e0 con 0x7ff4880b84e0 2023-11-20T06:41:36.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.367+0000 7ff4867fc640 1 -- 172.21.15.19:0/2937842708 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4800a5a40 con 0x7ff4880b84e0 2023-11-20T06:41:36.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.367+0000 7ff4867fc640 1 -- 172.21.15.19:0/2937842708 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4800a5dd0 con 0x7ff4880b84e0 2023-11-20T06:41:36.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.367+0000 7ff48d29c640 1 -- 172.21.15.19:0/2937842708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4880b84e0 msgr2=0x7ff4880b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:36.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.367+0000 7ff48d29c640 1 --2- 172.21.15.19:0/2937842708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4880b84e0 0x7ff4880b5cf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff480009e50 tx=0x7ff48001ca10 comp rx=0 tx=0).stop 2023-11-20T06:41:36.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.367+0000 7ff48d29c640 1 -- 172.21.15.19:0/2937842708 shutdown_connections 2023-11-20T06:41:36.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.367+0000 7ff48d29c640 1 --2- 172.21.15.19:0/2937842708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4880b84e0 0x7ff4880b5cf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:36.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.367+0000 7ff48d29c640 1 --2- 172.21.15.19:0/2937842708 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4880d0210 0x7ff4880d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:36.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.367+0000 7ff48d29c640 1 -- 172.21.15.19:0/2937842708 >> 172.21.15.19:0/2937842708 conn(0x7ff4880719c0 msgr2=0x7ff488071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:36.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff48d29c640 1 -- 172.21.15.19:0/2937842708 shutdown_connections 2023-11-20T06:41:36.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff48d29c640 1 -- 172.21.15.19:0/2937842708 wait complete. 2023-11-20T06:41:36.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff48d29c640 1 Processor -- start 2023-11-20T06:41:36.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff48d29c640 1 -- start start 2023-11-20T06:41:36.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff48d29c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4880b84e0 0x7ff488156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:36.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff48d29c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4880d0210 0x7ff488151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:36.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff48d29c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff48815cba0 0x7ff48815b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:36.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff48d29c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4881518d0 con 0x7ff4880b84e0 2023-11-20T06:41:36.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff48d29c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff488151b70 con 0x7ff48815cba0 2023-11-20T06:41:36.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff48d29c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff488151e50 con 0x7ff4880d0210 2023-11-20T06:41:36.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff486ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4880b84e0 0x7ff488156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:36.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff486ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4880b84e0 0x7ff488156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48282/0 (socket says 172.21.15.19:48282) 2023-11-20T06:41:36.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff486ffd640 1 -- 172.21.15.19:0/3061148343 learned_addr learned my addr 172.21.15.19:0/3061148343 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:36.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff47ffff640 1 --2- 172.21.15.19:0/3061148343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4880d0210 0x7ff488151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:36.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff4877fe640 1 --2- 172.21.15.19:0/3061148343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff48815cba0 0x7ff48815b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:36.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff486ffd640 1 -- 172.21.15.19:0/3061148343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4880d0210 msgr2=0x7ff488151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:36.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff486ffd640 1 --2- 172.21.15.19:0/3061148343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4880d0210 0x7ff488151390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:36.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff486ffd640 1 -- 172.21.15.19:0/3061148343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff48815cba0 msgr2=0x7ff48815b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:36.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff486ffd640 1 --2- 172.21.15.19:0/3061148343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff48815cba0 0x7ff48815b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:36.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff486ffd640 1 -- 172.21.15.19:0/3061148343 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff480009b30 con 0x7ff4880b84e0 2023-11-20T06:41:36.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff4877fe640 1 --2- 172.21.15.19:0/3061148343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff48815cba0 0x7ff48815b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:36.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.371+0000 7ff486ffd640 1 --2- 172.21.15.19:0/3061148343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4880b84e0 0x7ff488156fa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff47800c370 tx=0x7ff47800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:36.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.375+0000 7ff47f7fe640 1 -- 172.21.15.19:0/3061148343 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4780052d0 con 0x7ff4880b84e0 2023-11-20T06:41:36.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.375+0000 7ff47f7fe640 1 -- 172.21.15.19:0/3061148343 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff478005430 con 0x7ff4880b84e0 2023-11-20T06:41:36.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.375+0000 7ff48d29c640 1 -- 172.21.15.19:0/3061148343 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff488152130 con 0x7ff4880b84e0 2023-11-20T06:41:36.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.375+0000 7ff47f7fe640 1 -- 172.21.15.19:0/3061148343 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff478007260 con 0x7ff4880b84e0 2023-11-20T06:41:36.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.375+0000 7ff48d29c640 1 -- 172.21.15.19:0/3061148343 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48814a630 con 0x7ff4880b84e0 2023-11-20T06:41:36.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.375+0000 7ff48d29c640 1 -- 172.21.15.19:0/3061148343 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff48804e170 con 0x7ff4880b84e0 2023-11-20T06:41:36.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.375+0000 7ff47f7fe640 1 -- 172.21.15.19:0/3061148343 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff4780073c0 con 0x7ff4880b84e0 2023-11-20T06:41:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.375+0000 7ff47f7fe640 1 --2- 172.21.15.19:0/3061148343 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff4680664a0 0x7ff468068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.375+0000 7ff47f7fe640 1 -- 172.21.15.19:0/3061148343 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff4780835a0 con 0x7ff4880b84e0 2023-11-20T06:41:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.375+0000 7ff47ffff640 1 --2- 172.21.15.19:0/3061148343 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff4680664a0 0x7ff468068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.379+0000 7ff47ffff640 1 --2- 172.21.15.19:0/3061148343 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff4680664a0 0x7ff468068960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff48815b0d0 tx=0x7ff470009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:36.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.379+0000 7ff47f7fe640 1 -- 172.21.15.19:0/3061148343 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff4780506b0 con 0x7ff4880b84e0 2023-11-20T06:41:36.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:36.571+0000 7ff48d29c640 1 -- 172.21.15.19:0/3061148343 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff488156420 con 0x7ff4880b84e0 2023-11-20T06:41:37.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.375+0000 7ff47f7fe640 1 -- 172.21.15.19:0/3061148343 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff478053cd0 con 0x7ff4880b84e0 2023-11-20T06:41:37.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.375+0000 7ff48d29c640 1 -- 172.21.15.19:0/3061148343 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff4680664a0 msgr2=0x7ff468068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:37.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.375+0000 7ff48d29c640 1 --2- 172.21.15.19:0/3061148343 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff4680664a0 0x7ff468068960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff48815b0d0 tx=0x7ff470009190 comp rx=0 tx=0).stop 2023-11-20T06:41:37.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.375+0000 7ff48d29c640 1 -- 172.21.15.19:0/3061148343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4880b84e0 msgr2=0x7ff488156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:37.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.375+0000 7ff48d29c640 1 --2- 172.21.15.19:0/3061148343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4880b84e0 0x7ff488156fa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff47800c370 tx=0x7ff47800c830 comp rx=0 tx=0).stop 2023-11-20T06:41:37.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.375+0000 7ff48d29c640 1 -- 172.21.15.19:0/3061148343 shutdown_connections 2023-11-20T06:41:37.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.375+0000 7ff48d29c640 1 --2- 172.21.15.19:0/3061148343 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff4680664a0 0x7ff468068960 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:37.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.375+0000 7ff48d29c640 1 --2- 172.21.15.19:0/3061148343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff48815cba0 0x7ff48815b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:37.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.375+0000 7ff48d29c640 1 --2- 172.21.15.19:0/3061148343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4880d0210 0x7ff488151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:37.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.375+0000 7ff48d29c640 1 --2- 172.21.15.19:0/3061148343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4880b84e0 0x7ff488156fa0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:37.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.375+0000 7ff48d29c640 1 -- 172.21.15.19:0/3061148343 >> 172.21.15.19:0/3061148343 conn(0x7ff4880719c0 msgr2=0x7ff488153f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:37.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.375+0000 7ff48d29c640 1 -- 172.21.15.19:0/3061148343 shutdown_connections 2023-11-20T06:41:37.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.375+0000 7ff48d29c640 1 -- 172.21.15.19:0/3061148343 wait complete. 2023-11-20T06:41:37.407 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-11-20T06:41:37.408 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-20T06:41:37.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.551+0000 7f61a0e91640 1 Processor -- start 2023-11-20T06:41:37.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.551+0000 7f61a0e91640 1 -- start start 2023-11-20T06:41:37.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.555+0000 7f61a0e91640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f619c15cba0 0x7f619c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:37.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.555+0000 7f61a0e91640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f619c0d0210 0x7f619c0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:37.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.555+0000 7f61a0e91640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619c0d1670 con 0x7f619c0b84e0 2023-11-20T06:41:37.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.555+0000 7f61a0e91640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619c0d1460 con 0x7f619c0d0210 2023-11-20T06:41:37.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.555+0000 7f61a0e91640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619c0d1950 con 0x7f619c15cba0 2023-11-20T06:41:37.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.555+0000 7f619ad9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f619c0d0210 0x7f619c0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:37.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.555+0000 7f6199d9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f619c0b84e0 0x7f619c0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45906/0 (socket says 172.21.15.19:45906) 2023-11-20T06:41:37.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.555+0000 7f6199d9b640 1 -- 172.21.15.19:0/2300624390 learned_addr learned my addr 172.21.15.19:0/2300624390 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:37.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.555+0000 7f619a59c640 1 --2- 172.21.15.19:0/2300624390 >> v2:172.21.15.190:3300/0 conn(0x7f619c15cba0 0x7f619c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:37.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.555+0000 7f619ad9d640 1 -- 172.21.15.19:0/2300624390 >> v2:172.21.15.190:3300/0 conn(0x7f619c15cba0 msgr2=0x7f619c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:37.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.555+0000 7f619ad9d640 1 --2- 172.21.15.19:0/2300624390 >> v2:172.21.15.190:3300/0 conn(0x7f619c15cba0 0x7f619c0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:37.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.555+0000 7f619ad9d640 1 -- 172.21.15.19:0/2300624390 >> v1:172.21.15.19:6789/0 conn(0x7f619c0b84e0 legacy=0x7f619c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:37.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.555+0000 7f619ad9d640 1 -- 172.21.15.19:0/2300624390 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c0d1c30 con 0x7f619c0d0210 2023-11-20T06:41:37.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.555+0000 7f619959a640 1 -- 172.21.15.19:0/2300624390 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621563671 0 0) 0x7f619c0d1670 con 0x7f619c0b84e0 2023-11-20T06:41:37.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.559+0000 7f619ad9d640 1 --2- 172.21.15.19:0/2300624390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0d0210 0x7f619c0b5cf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f619c0b4890 tx=0x7f619401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05dc3d6f65569d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:37.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.559+0000 7f619959a640 1 -- 172.21.15.19:0/2300624390 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61940a5940 con 0x7f619c0d0210 2023-11-20T06:41:37.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.559+0000 7f619959a640 1 -- 172.21.15.19:0/2300624390 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61940a5aa0 con 0x7f619c0d0210 2023-11-20T06:41:37.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.559+0000 7f619959a640 1 -- 172.21.15.19:0/2300624390 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61940a5e30 con 0x7f619c0d0210 2023-11-20T06:41:37.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.559+0000 7f61a0e91640 1 -- 172.21.15.19:0/2300624390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0d0210 msgr2=0x7f619c0b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:37.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.559+0000 7f61a0e91640 1 --2- 172.21.15.19:0/2300624390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0d0210 0x7f619c0b5cf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f619c0b4890 tx=0x7f619401c880 comp rx=0 tx=0).stop 2023-11-20T06:41:37.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.559+0000 7f61a0e91640 1 -- 172.21.15.19:0/2300624390 shutdown_connections 2023-11-20T06:41:37.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.559+0000 7f61a0e91640 1 --2- 172.21.15.19:0/2300624390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0d0210 0x7f619c0b5cf0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:37.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.559+0000 7f61a0e91640 1 --2- 172.21.15.19:0/2300624390 >> v2:172.21.15.190:3300/0 conn(0x7f619c15cba0 0x7f619c0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:37.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.559+0000 7f61a0e91640 1 -- 172.21.15.19:0/2300624390 >> 172.21.15.19:0/2300624390 conn(0x7f619c0719c0 msgr2=0x7f619c071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:37.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.559+0000 7f61a0e91640 1 -- 172.21.15.19:0/2300624390 shutdown_connections 2023-11-20T06:41:37.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.559+0000 7f61a0e91640 1 -- 172.21.15.19:0/2300624390 wait complete. 2023-11-20T06:41:37.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.559+0000 7f61a0e91640 1 Processor -- start 2023-11-20T06:41:37.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.559+0000 7f61a0e91640 1 -- start start 2023-11-20T06:41:37.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f61a0e91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0b84e0 0x7f619c0c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:37.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f61a0e91640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f619c0d0210 0x7f619c0c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:37.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f61a0e91640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f619c15cba0 0x7f619c15a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:37.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f61a0e91640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619c0c48e0 con 0x7f619c0b84e0 2023-11-20T06:41:37.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f61a0e91640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619c0c8eb0 con 0x7f619c15cba0 2023-11-20T06:41:37.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f61a0e91640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619c0c3d30 con 0x7f619c0d0210 2023-11-20T06:41:37.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f619a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0b84e0 0x7f619c0c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:37.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f619a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0b84e0 0x7f619c0c4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48308/0 (socket says 172.21.15.19:48308) 2023-11-20T06:41:37.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f619a59c640 1 -- 172.21.15.19:0/405629200 learned_addr learned my addr 172.21.15.19:0/405629200 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:37.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f619ad9d640 1 --2- 172.21.15.19:0/405629200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f619c15cba0 0x7f619c15a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:37.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f6199d9b640 1 --2- 172.21.15.19:0/405629200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f619c0d0210 0x7f619c0c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:37.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f619a59c640 1 -- 172.21.15.19:0/405629200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f619c0d0210 msgr2=0x7f619c0c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:37.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f619a59c640 1 --2- 172.21.15.19:0/405629200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f619c0d0210 0x7f619c0c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:37.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f619a59c640 1 -- 172.21.15.19:0/405629200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f619c15cba0 msgr2=0x7f619c15a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:37.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f619a59c640 1 --2- 172.21.15.19:0/405629200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f619c15cba0 0x7f619c15a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:37.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f619a59c640 1 -- 172.21.15.19:0/405629200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6194009a70 con 0x7f619c0b84e0 2023-11-20T06:41:37.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f619a59c640 1 --2- 172.21.15.19:0/405629200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0b84e0 0x7f619c0c4d00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f618c00e870 tx=0x7f618c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:37.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f618affd640 1 -- 172.21.15.19:0/405629200 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c009510 con 0x7f619c0b84e0 2023-11-20T06:41:37.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f618affd640 1 -- 172.21.15.19:0/405629200 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618c00eec0 con 0x7f619c0b84e0 2023-11-20T06:41:37.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f61a0e91640 1 -- 172.21.15.19:0/405629200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619c0c3f40 con 0x7f619c0b84e0 2023-11-20T06:41:37.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f618affd640 1 -- 172.21.15.19:0/405629200 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c00cb40 con 0x7f619c0b84e0 2023-11-20T06:41:37.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f61a0e91640 1 -- 172.21.15.19:0/405629200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619c0c8a80 con 0x7f619c0b84e0 2023-11-20T06:41:37.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.563+0000 7f61a0e91640 1 -- 172.21.15.19:0/405629200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619c0c4330 con 0x7f619c0b84e0 2023-11-20T06:41:37.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.567+0000 7f618affd640 1 -- 172.21.15.19:0/405629200 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f618c00cca0 con 0x7f619c0b84e0 2023-11-20T06:41:37.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.567+0000 7f618affd640 1 --2- 172.21.15.19:0/405629200 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f617c0664a0 0x7f617c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:37.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.567+0000 7f618affd640 1 -- 172.21.15.19:0/405629200 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f618c0841f0 con 0x7f619c0b84e0 2023-11-20T06:41:37.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.567+0000 7f6199d9b640 1 --2- 172.21.15.19:0/405629200 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f617c0664a0 0x7f617c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:37.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.567+0000 7f6199d9b640 1 --2- 172.21.15.19:0/405629200 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f617c0664a0 0x7f617c068960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f619c15add0 tx=0x7f6190007d60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:37.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.571+0000 7f618affd640 1 -- 172.21.15.19:0/405629200 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f618c051430 con 0x7f619c0b84e0 2023-11-20T06:41:37.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:37.763+0000 7f61a0e91640 1 -- 172.21.15.19:0/405629200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f619c04e170 con 0x7f619c0b84e0 2023-11-20T06:41:38.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.391+0000 7f618affd640 1 -- 172.21.15.19:0/405629200 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f618c054a50 con 0x7f619c0b84e0 2023-11-20T06:41:38.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.391+0000 7f61a0e91640 1 -- 172.21.15.19:0/405629200 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f617c0664a0 msgr2=0x7f617c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:38.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.391+0000 7f61a0e91640 1 --2- 172.21.15.19:0/405629200 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f617c0664a0 0x7f617c068960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f619c15add0 tx=0x7f6190007d60 comp rx=0 tx=0).stop 2023-11-20T06:41:38.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.391+0000 7f61a0e91640 1 -- 172.21.15.19:0/405629200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0b84e0 msgr2=0x7f619c0c4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:38.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.391+0000 7f61a0e91640 1 --2- 172.21.15.19:0/405629200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0b84e0 0x7f619c0c4d00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f618c00e870 tx=0x7f618c00ec70 comp rx=0 tx=0).stop 2023-11-20T06:41:38.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.391+0000 7f61a0e91640 1 -- 172.21.15.19:0/405629200 shutdown_connections 2023-11-20T06:41:38.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.391+0000 7f61a0e91640 1 --2- 172.21.15.19:0/405629200 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f617c0664a0 0x7f617c068960 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:38.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.391+0000 7f61a0e91640 1 --2- 172.21.15.19:0/405629200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f619c15cba0 0x7f619c15a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:38.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.391+0000 7f61a0e91640 1 --2- 172.21.15.19:0/405629200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f619c0d0210 0x7f619c0c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:38.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.391+0000 7f61a0e91640 1 --2- 172.21.15.19:0/405629200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0b84e0 0x7f619c0c4d00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:38.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.391+0000 7f61a0e91640 1 -- 172.21.15.19:0/405629200 >> 172.21.15.19:0/405629200 conn(0x7f619c0719c0 msgr2=0x7f619c0b6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:38.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.391+0000 7f61a0e91640 1 -- 172.21.15.19:0/405629200 shutdown_connections 2023-11-20T06:41:38.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.391+0000 7f61a0e91640 1 -- 172.21.15.19:0/405629200 wait complete. 2023-11-20T06:41:38.420 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-20T06:41:38.421 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T06:41:38.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.563+0000 7fc246ff5640 1 Processor -- start 2023-11-20T06:41:38.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.563+0000 7fc246ff5640 1 -- start start 2023-11-20T06:41:38.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.563+0000 7fc246ff5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc24015cb90 0x7fc2400cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:38.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.563+0000 7fc246ff5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2400d3010 0x7fc2400d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:38.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.563+0000 7fc246ff5640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2400ce770 con 0x7fc2400d1400 2023-11-20T06:41:38.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.563+0000 7fc246ff5640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2400d1890 con 0x7fc24015cb90 2023-11-20T06:41:38.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.563+0000 7fc246ff5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2400d0600 con 0x7fc2400d3010 2023-11-20T06:41:38.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.563+0000 7fc244d91640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc24015cb90 0x7fc2400cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:38.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.563+0000 7fc245592640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc2400d1400 0x7fc2400cd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45912/0 (socket says 172.21.15.19:45912) 2023-11-20T06:41:38.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.563+0000 7fc245592640 1 -- 172.21.15.19:0/760076574 learned_addr learned my addr 172.21.15.19:0/760076574 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:38.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.563+0000 7fc23ffff640 1 --2- 172.21.15.19:0/760076574 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2400d3010 0x7fc2400d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:38.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.563+0000 7fc244d91640 1 -- 172.21.15.19:0/760076574 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2400d3010 msgr2=0x7fc2400d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:38.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.563+0000 7fc244d91640 1 --2- 172.21.15.19:0/760076574 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2400d3010 0x7fc2400d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:38.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.563+0000 7fc244d91640 1 -- 172.21.15.19:0/760076574 >> v1:172.21.15.19:6789/0 conn(0x7fc2400d1400 legacy=0x7fc2400cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:38.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.563+0000 7fc23f7fe640 1 -- 172.21.15.19:0/760076574 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397447851 0 0) 0x7fc2400ce770 con 0x7fc2400d1400 2023-11-20T06:41:38.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.563+0000 7fc244d91640 1 -- 172.21.15.19:0/760076574 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2400c6450 con 0x7fc24015cb90 2023-11-20T06:41:38.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.567+0000 7fc244d91640 1 --2- 172.21.15.19:0/760076574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc24015cb90 0x7fc2400cfb10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc2340097a0 tx=0x7fc23401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c86c0edf3ae502e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:38.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.567+0000 7fc23f7fe640 1 -- 172.21.15.19:0/760076574 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340ac600 con 0x7fc24015cb90 2023-11-20T06:41:38.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.567+0000 7fc23f7fe640 1 -- 172.21.15.19:0/760076574 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2340a8050 con 0x7fc24015cb90 2023-11-20T06:41:38.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.567+0000 7fc23f7fe640 1 -- 172.21.15.19:0/760076574 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340ac980 con 0x7fc24015cb90 2023-11-20T06:41:38.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.567+0000 7fc246ff5640 1 -- 172.21.15.19:0/760076574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc24015cb90 msgr2=0x7fc2400cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:38.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.567+0000 7fc246ff5640 1 --2- 172.21.15.19:0/760076574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc24015cb90 0x7fc2400cfb10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc2340097a0 tx=0x7fc23401c3a0 comp rx=0 tx=0).stop 2023-11-20T06:41:38.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.567+0000 7fc246ff5640 1 -- 172.21.15.19:0/760076574 shutdown_connections 2023-11-20T06:41:38.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.567+0000 7fc246ff5640 1 --2- 172.21.15.19:0/760076574 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2400d3010 0x7fc2400d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:38.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.567+0000 7fc246ff5640 1 --2- 172.21.15.19:0/760076574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc24015cb90 0x7fc2400cfb10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:38.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.567+0000 7fc246ff5640 1 -- 172.21.15.19:0/760076574 >> 172.21.15.19:0/760076574 conn(0x7fc24009bc50 msgr2=0x7fc2400d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:38.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.567+0000 7fc246ff5640 1 -- 172.21.15.19:0/760076574 shutdown_connections 2023-11-20T06:41:38.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.567+0000 7fc246ff5640 1 -- 172.21.15.19:0/760076574 wait complete. 2023-11-20T06:41:38.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc246ff5640 1 Processor -- start 2023-11-20T06:41:38.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc246ff5640 1 -- start start 2023-11-20T06:41:38.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc246ff5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2400d1400 0x7fc24014ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:38.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc246ff5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2400d3010 0x7fc2400b6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:38.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc246ff5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc24015cb90 0x7fc24014ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:38.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc246ff5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2400cccf0 con 0x7fc2400d1400 2023-11-20T06:41:38.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc246ff5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24014f3c0 con 0x7fc24015cb90 2023-11-20T06:41:38.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc246ff5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24014e9f0 con 0x7fc2400d3010 2023-11-20T06:41:38.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc244d91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2400d1400 0x7fc24014ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:38.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc244d91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2400d1400 0x7fc24014ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48314/0 (socket says 172.21.15.19:48314) 2023-11-20T06:41:38.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc244d91640 1 -- 172.21.15.19:0/73258819 learned_addr learned my addr 172.21.15.19:0/73258819 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:38.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc23ffff640 1 --2- 172.21.15.19:0/73258819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2400d3010 0x7fc2400b6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:38.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc245592640 1 --2- 172.21.15.19:0/73258819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc24015cb90 0x7fc24014ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:38.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc244d91640 1 -- 172.21.15.19:0/73258819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2400d3010 msgr2=0x7fc2400b6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:38.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc244d91640 1 --2- 172.21.15.19:0/73258819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2400d3010 0x7fc2400b6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:38.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc244d91640 1 -- 172.21.15.19:0/73258819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc24015cb90 msgr2=0x7fc24014ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:38.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc244d91640 1 --2- 172.21.15.19:0/73258819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc24015cb90 0x7fc24014ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:38.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc244d91640 1 -- 172.21.15.19:0/73258819 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2340093b0 con 0x7fc2400d1400 2023-11-20T06:41:38.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc244d91640 1 --2- 172.21.15.19:0/73258819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2400d1400 0x7fc24014ee80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc23401c880 tx=0x7fc23401abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:38.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc23d7fa640 1 -- 172.21.15.19:0/73258819 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234005ba0 con 0x7fc2400d1400 2023-11-20T06:41:38.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc23d7fa640 1 -- 172.21.15.19:0/73258819 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc234005d00 con 0x7fc2400d1400 2023-11-20T06:41:38.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc23d7fa640 1 -- 172.21.15.19:0/73258819 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234006230 con 0x7fc2400d1400 2023-11-20T06:41:38.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc246ff5640 1 -- 172.21.15.19:0/73258819 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2400cb900 con 0x7fc2400d1400 2023-11-20T06:41:38.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.571+0000 7fc246ff5640 1 -- 172.21.15.19:0/73258819 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2400cbec0 con 0x7fc2400d1400 2023-11-20T06:41:38.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.575+0000 7fc246ff5640 1 -- 172.21.15.19:0/73258819 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2400cc0b0 con 0x7fc2400d1400 2023-11-20T06:41:38.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.575+0000 7fc23d7fa640 1 -- 172.21.15.19:0/73258819 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc2340b3070 con 0x7fc2400d1400 2023-11-20T06:41:38.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.575+0000 7fc23d7fa640 1 --2- 172.21.15.19:0/73258819 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc2240664a0 0x7fc224068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:38.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.575+0000 7fc23d7fa640 1 -- 172.21.15.19:0/73258819 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc23411e4b0 con 0x7fc2400d1400 2023-11-20T06:41:38.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.575+0000 7fc23ffff640 1 --2- 172.21.15.19:0/73258819 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc2240664a0 0x7fc224068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:38.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.575+0000 7fc23ffff640 1 --2- 172.21.15.19:0/73258819 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc2240664a0 0x7fc224068960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc2400b3c40 tx=0x7fc22c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:38.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.579+0000 7fc23d7fa640 1 -- 172.21.15.19:0/73258819 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc2340eb590 con 0x7fc2400d1400 2023-11-20T06:41:38.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.767+0000 7fc246ff5640 1 -- 172.21.15.19:0/73258819 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc240074010 con 0x7fc2400d1400 2023-11-20T06:41:38.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.767+0000 7fc23d7fa640 1 -- 172.21.15.19:0/73258819 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fc2340eebb0 con 0x7fc2400d1400 2023-11-20T06:41:38.775 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:38.775 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/212787745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":212787745},{"type":"v1","addr":"172.21.15.190:6836","nonce":212787745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1874314285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1874314285},{"type":"v1","addr":"172.21.15.190:6837","nonce":1874314285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3845638593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3845638593},{"type":"v1","addr":"172.21.15.19:6833","nonce":3845638593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T06:41:13.620144+0000","modified":"2023-11-20T06:41:37.768410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/1973335825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1973335825},{"type":"v1","addr":"172.21.15.19:6835","nonce":1973335825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-20T06:41:38.776 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 9 2023-11-20T06:41:38.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.771+0000 7fc246ff5640 1 -- 172.21.15.19:0/73258819 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc2240664a0 msgr2=0x7fc224068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:38.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.771+0000 7fc246ff5640 1 --2- 172.21.15.19:0/73258819 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc2240664a0 0x7fc224068960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc2400b3c40 tx=0x7fc22c008040 comp rx=0 tx=0).stop 2023-11-20T06:41:38.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.771+0000 7fc246ff5640 1 -- 172.21.15.19:0/73258819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2400d1400 msgr2=0x7fc24014ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:38.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.771+0000 7fc246ff5640 1 --2- 172.21.15.19:0/73258819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2400d1400 0x7fc24014ee80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc23401c880 tx=0x7fc23401abe0 comp rx=0 tx=0).stop 2023-11-20T06:41:38.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.771+0000 7fc246ff5640 1 -- 172.21.15.19:0/73258819 shutdown_connections 2023-11-20T06:41:38.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.771+0000 7fc246ff5640 1 --2- 172.21.15.19:0/73258819 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc2240664a0 0x7fc224068960 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:38.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.771+0000 7fc246ff5640 1 --2- 172.21.15.19:0/73258819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc24015cb90 0x7fc24014ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:38.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.771+0000 7fc246ff5640 1 --2- 172.21.15.19:0/73258819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2400d3010 0x7fc2400b6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:38.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.771+0000 7fc246ff5640 1 --2- 172.21.15.19:0/73258819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2400d1400 0x7fc24014ee80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:38.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.771+0000 7fc246ff5640 1 -- 172.21.15.19:0/73258819 >> 172.21.15.19:0/73258819 conn(0x7fc24009bc50 msgr2=0x7fc24015bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:38.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.771+0000 7fc246ff5640 1 -- 172.21.15.19:0/73258819 shutdown_connections 2023-11-20T06:41:38.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.771+0000 7fc246ff5640 1 -- 172.21.15.19:0/73258819 wait complete. 2023-11-20T06:41:38.797 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:41:38.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.935+0000 7f226ce46640 1 Processor -- start 2023-11-20T06:41:38.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.935+0000 7f226ce46640 1 -- start start 2023-11-20T06:41:38.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.935+0000 7f226ce46640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f226815ca70 0x7f22680d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:38.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.935+0000 7f226ce46640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22680d3550 0x7f22680cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:38.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.935+0000 7f226ce46640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22680cfa00 con 0x7f22680cf5d0 2023-11-20T06:41:38.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.935+0000 7f226ce46640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22680ce820 con 0x7f22680d3550 2023-11-20T06:41:38.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.935+0000 7f226ce46640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22680c65f0 con 0x7f226815ca70 2023-11-20T06:41:38.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.935+0000 7f2265d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22680d3550 0x7f22680cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:38.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.935+0000 7f2266d9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f22680cf5d0 0x7f22680d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45920/0 (socket says 172.21.15.19:45920) 2023-11-20T06:41:38.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.935+0000 7f2266d9d640 1 -- 172.21.15.19:0/3446724588 learned_addr learned my addr 172.21.15.19:0/3446724588 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:38.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.935+0000 7f226659c640 1 --2- 172.21.15.19:0/3446724588 >> v2:172.21.15.190:3300/0 conn(0x7f226815ca70 0x7f22680d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:38.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.935+0000 7f2265d9b640 1 -- 172.21.15.19:0/3446724588 >> v2:172.21.15.190:3300/0 conn(0x7f226815ca70 msgr2=0x7f22680d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:38.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.935+0000 7f2265d9b640 1 --2- 172.21.15.19:0/3446724588 >> v2:172.21.15.190:3300/0 conn(0x7f226815ca70 0x7f22680d3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:38.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.935+0000 7f2265d9b640 1 -- 172.21.15.19:0/3446724588 >> v1:172.21.15.19:6789/0 conn(0x7f22680cf5d0 legacy=0x7f22680d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:38.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.935+0000 7f2265d9b640 1 -- 172.21.15.19:0/3446724588 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22680cdf80 con 0x7f22680d3550 2023-11-20T06:41:38.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.935+0000 7f226559a640 1 -- 172.21.15.19:0/3446724588 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242890035 0 0) 0x7f22680cfa00 con 0x7f22680cf5d0 2023-11-20T06:41:38.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.939+0000 7f2265d9b640 1 --2- 172.21.15.19:0/3446724588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22680d3550 0x7f22680cf090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f226808a880 tx=0x7f225c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4169b2ffff627f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:38.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.939+0000 7f226559a640 1 -- 172.21.15.19:0/3446724588 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c0a7070 con 0x7f22680d3550 2023-11-20T06:41:38.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.939+0000 7f226559a640 1 -- 172.21.15.19:0/3446724588 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c0ab430 con 0x7f22680d3550 2023-11-20T06:41:38.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.939+0000 7f226559a640 1 -- 172.21.15.19:0/3446724588 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c0ab7c0 con 0x7f22680d3550 2023-11-20T06:41:38.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.939+0000 7f226ce46640 1 -- 172.21.15.19:0/3446724588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22680d3550 msgr2=0x7f22680cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:38.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.939+0000 7f226ce46640 1 --2- 172.21.15.19:0/3446724588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22680d3550 0x7f22680cf090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f226808a880 tx=0x7f225c01c430 comp rx=0 tx=0).stop 2023-11-20T06:41:38.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.939+0000 7f226ce46640 1 -- 172.21.15.19:0/3446724588 shutdown_connections 2023-11-20T06:41:38.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.939+0000 7f226ce46640 1 --2- 172.21.15.19:0/3446724588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22680d3550 0x7f22680cf090 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:38.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.939+0000 7f226ce46640 1 --2- 172.21.15.19:0/3446724588 >> v2:172.21.15.190:3300/0 conn(0x7f226815ca70 0x7f22680d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:38.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.939+0000 7f226ce46640 1 -- 172.21.15.19:0/3446724588 >> 172.21.15.19:0/3446724588 conn(0x7f226809bc50 msgr2=0x7f22680d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:38.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.939+0000 7f226ce46640 1 -- 172.21.15.19:0/3446724588 shutdown_connections 2023-11-20T06:41:38.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.939+0000 7f226ce46640 1 -- 172.21.15.19:0/3446724588 wait complete. 2023-11-20T06:41:38.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f226ce46640 1 Processor -- start 2023-11-20T06:41:38.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f226ce46640 1 -- start start 2023-11-20T06:41:38.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f226ce46640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22680cf5d0 0x7f2268154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:38.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f226ce46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22680d3550 0x7f226815a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f226ce46640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f226815ca70 0x7f22680c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f226ce46640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22680cc750 con 0x7f226815ca70 2023-11-20T06:41:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f226ce46640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226815f900 con 0x7f22680cf5d0 2023-11-20T06:41:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f226ce46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22680cc9f0 con 0x7f22680d3550 2023-11-20T06:41:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f2266d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f226815ca70 0x7f22680c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f2266d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f226815ca70 0x7f22680c6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48328/0 (socket says 172.21.15.19:48328) 2023-11-20T06:41:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f2266d9d640 1 -- 172.21.15.19:0/3744348200 learned_addr learned my addr 172.21.15.19:0/3744348200 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f226659c640 1 --2- 172.21.15.19:0/3744348200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22680cf5d0 0x7f2268154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f2265d9b640 1 --2- 172.21.15.19:0/3744348200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22680d3550 0x7f226815a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f2266d9d640 1 -- 172.21.15.19:0/3744348200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22680d3550 msgr2=0x7f226815a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f2266d9d640 1 --2- 172.21.15.19:0/3744348200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22680d3550 0x7f226815a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f2266d9d640 1 -- 172.21.15.19:0/3744348200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22680cf5d0 msgr2=0x7f2268154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f2266d9d640 1 --2- 172.21.15.19:0/3744348200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22680cf5d0 0x7f2268154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f2266d9d640 1 -- 172.21.15.19:0/3744348200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c009420 con 0x7f226815ca70 2023-11-20T06:41:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f2266d9d640 1 --2- 172.21.15.19:0/3744348200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f226815ca70 0x7f22680c6f70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2260001570 tx=0x7f226000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f2256ffd640 1 -- 172.21.15.19:0/3744348200 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226000a640 con 0x7f226815ca70 2023-11-20T06:41:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f2256ffd640 1 -- 172.21.15.19:0/3744348200 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226000a7c0 con 0x7f226815ca70 2023-11-20T06:41:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f226ce46640 1 -- 172.21.15.19:0/3744348200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226815fba0 con 0x7f226815ca70 2023-11-20T06:41:38.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f2256ffd640 1 -- 172.21.15.19:0/3744348200 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226000ab70 con 0x7f226815ca70 2023-11-20T06:41:38.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f226ce46640 1 -- 172.21.15.19:0/3744348200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22680cccd0 con 0x7f226815ca70 2023-11-20T06:41:38.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.943+0000 7f226ce46640 1 -- 172.21.15.19:0/3744348200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226815f760 con 0x7f226815ca70 2023-11-20T06:41:38.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.947+0000 7f2256ffd640 1 -- 172.21.15.19:0/3744348200 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f226000acd0 con 0x7f226815ca70 2023-11-20T06:41:38.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.947+0000 7f2256ffd640 1 --2- 172.21.15.19:0/3744348200 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f22480664a0 0x7f2248068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:38.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.947+0000 7f2256ffd640 1 -- 172.21.15.19:0/3744348200 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2260083730 con 0x7f226815ca70 2023-11-20T06:41:38.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.947+0000 7f226659c640 1 --2- 172.21.15.19:0/3744348200 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f22480664a0 0x7f2248068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:38.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.947+0000 7f226659c640 1 --2- 172.21.15.19:0/3744348200 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f22480664a0 0x7f2248068960 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f22580079a0 tx=0x7f2258008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:38.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:38.951+0000 7f2256ffd640 1 -- 172.21.15.19:0/3744348200 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f226815f760 con 0x7f226815ca70 2023-11-20T06:41:39.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.111+0000 7f226ce46640 1 -- 172.21.15.19:0/3744348200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f226815f760 con 0x7f226815ca70 2023-11-20T06:41:39.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.111+0000 7f2256ffd640 1 -- 172.21.15.19:0/3744348200 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f226815f760 con 0x7f226815ca70 2023-11-20T06:41:39.117 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:39.117 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":25,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:20.306335+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:41:39.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.115+0000 7f226ce46640 1 -- 172.21.15.19:0/3744348200 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f22480664a0 msgr2=0x7f2248068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:39.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.115+0000 7f226ce46640 1 --2- 172.21.15.19:0/3744348200 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f22480664a0 0x7f2248068960 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f22580079a0 tx=0x7f2258008040 comp rx=0 tx=0).stop 2023-11-20T06:41:39.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.115+0000 7f226ce46640 1 -- 172.21.15.19:0/3744348200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f226815ca70 msgr2=0x7f22680c6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:39.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.115+0000 7f226ce46640 1 --2- 172.21.15.19:0/3744348200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f226815ca70 0x7f22680c6f70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2260001570 tx=0x7f226000cca0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.115+0000 7f226ce46640 1 -- 172.21.15.19:0/3744348200 shutdown_connections 2023-11-20T06:41:39.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.115+0000 7f226ce46640 1 --2- 172.21.15.19:0/3744348200 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f22480664a0 0x7f2248068960 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.115+0000 7f226ce46640 1 --2- 172.21.15.19:0/3744348200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f226815ca70 0x7f22680c6f70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.115+0000 7f226ce46640 1 --2- 172.21.15.19:0/3744348200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22680d3550 0x7f226815a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.115+0000 7f226ce46640 1 --2- 172.21.15.19:0/3744348200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22680cf5d0 0x7f2268154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.115+0000 7f226ce46640 1 -- 172.21.15.19:0/3744348200 >> 172.21.15.19:0/3744348200 conn(0x7f226809bc50 msgr2=0x7f2268158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:39.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.115+0000 7f226ce46640 1 -- 172.21.15.19:0/3744348200 shutdown_connections 2023-11-20T06:41:39.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.115+0000 7f226ce46640 1 -- 172.21.15.19:0/3744348200 wait complete. 2023-11-20T06:41:39.139 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-20T06:41:39.139 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T06:41:39.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.275+0000 7f1fb5879640 1 Processor -- start 2023-11-20T06:41:39.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.275+0000 7f1fb5879640 1 -- start start 2023-11-20T06:41:39.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.279+0000 7f1fb5879640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1fb015cb90 0x7f1fb00cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:39.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.279+0000 7f1fb5879640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb00ce770 con 0x7f1fb00d3010 2023-11-20T06:41:39.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.279+0000 7f1fb5879640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb00d0600 con 0x7f1fb00d15d0 2023-11-20T06:41:39.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.279+0000 7f1fb5879640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb00c6450 con 0x7f1fb015cb90 2023-11-20T06:41:39.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.279+0000 7f1faeffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1fb015cb90 0x7f1fb00cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:39.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.279+0000 7f1fa7fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1fb00d3010 0x7f1fb00d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45934/0 (socket says 172.21.15.19:45934) 2023-11-20T06:41:39.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.279+0000 7f1fa7fff640 1 -- 172.21.15.19:0/1234416981 learned_addr learned my addr 172.21.15.19:0/1234416981 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:39.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.279+0000 7f1faeffd640 1 -- 172.21.15.19:0/1234416981 >> v1:172.21.15.190:6789/0 conn(0x7f1fb00d15d0 legacy=0x7f1fb00c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:39.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.279+0000 7f1faeffd640 1 -- 172.21.15.19:0/1234416981 >> v1:172.21.15.19:6789/0 conn(0x7f1fb00d3010 legacy=0x7f1fb00d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:39.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.279+0000 7f1faeffd640 1 -- 172.21.15.19:0/1234416981 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb00d08a0 con 0x7f1fb015cb90 2023-11-20T06:41:39.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.279+0000 7f1fae7fc640 1 -- 172.21.15.19:0/1234416981 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268909474 0 0) 0x7f1fb00ce770 con 0x7f1fb00d3010 2023-11-20T06:41:39.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.283+0000 7f1faeffd640 1 --2- 172.21.15.19:0/1234416981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fb015cb90 0x7f1fb00cfb10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00097a0 tx=0x7f1fa001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19438110d8ca170 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:39.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.283+0000 7f1fae7fc640 1 -- 172.21.15.19:0/1234416981 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa00ac600 con 0x7f1fb015cb90 2023-11-20T06:41:39.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.283+0000 7f1fae7fc640 1 -- 172.21.15.19:0/1234416981 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa00a8050 con 0x7f1fb015cb90 2023-11-20T06:41:39.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.283+0000 7f1fae7fc640 1 -- 172.21.15.19:0/1234416981 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa00ac980 con 0x7f1fb015cb90 2023-11-20T06:41:39.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.283+0000 7f1fb5879640 1 -- 172.21.15.19:0/1234416981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fb015cb90 msgr2=0x7f1fb00cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:39.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.283+0000 7f1fb5879640 1 --2- 172.21.15.19:0/1234416981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fb015cb90 0x7f1fb00cfb10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00097a0 tx=0x7f1fa001c3a0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.283+0000 7f1fb5879640 1 -- 172.21.15.19:0/1234416981 shutdown_connections 2023-11-20T06:41:39.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.283+0000 7f1fb5879640 1 --2- 172.21.15.19:0/1234416981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fb015cb90 0x7f1fb00cfb10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.283+0000 7f1fb5879640 1 -- 172.21.15.19:0/1234416981 >> 172.21.15.19:0/1234416981 conn(0x7f1fb009bc50 msgr2=0x7f1fb00d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:39.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.283+0000 7f1fb5879640 1 -- 172.21.15.19:0/1234416981 shutdown_connections 2023-11-20T06:41:39.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.283+0000 7f1fb5879640 1 -- 172.21.15.19:0/1234416981 wait complete. 2023-11-20T06:41:39.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.283+0000 7f1fb5879640 1 Processor -- start 2023-11-20T06:41:39.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.283+0000 7f1fb5879640 1 -- start start 2023-11-20T06:41:39.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1fb5879640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fb00d15d0 0x7f1fb00a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:39.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1fb5879640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fb00d3010 0x7f1fb00b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:39.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1fb5879640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fb015cb90 0x7f1fb0153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:39.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1fb5879640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb00c99d0 con 0x7f1fb00d15d0 2023-11-20T06:41:39.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1fb5879640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb015b340 con 0x7f1fb00d3010 2023-11-20T06:41:39.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1fb5879640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb015b620 con 0x7f1fb015cb90 2023-11-20T06:41:39.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1faeffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fb00d15d0 0x7f1fb00a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:39.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1faeffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fb00d15d0 0x7f1fb00a0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48338/0 (socket says 172.21.15.19:48338) 2023-11-20T06:41:39.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1faeffd640 1 -- 172.21.15.19:0/2400657533 learned_addr learned my addr 172.21.15.19:0/2400657533 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:39.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1faf7fe640 1 --2- 172.21.15.19:0/2400657533 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fb015cb90 0x7f1fb0153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:39.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1faeffd640 1 -- 172.21.15.19:0/2400657533 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fb015cb90 msgr2=0x7f1fb0153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:39.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1faeffd640 1 --2- 172.21.15.19:0/2400657533 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fb015cb90 0x7f1fb0153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1faeffd640 1 -- 172.21.15.19:0/2400657533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fb00d3010 msgr2=0x7f1fb00b7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:39.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1faeffd640 1 --2- 172.21.15.19:0/2400657533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fb00d3010 0x7f1fb00b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1faeffd640 1 -- 172.21.15.19:0/2400657533 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa00093b0 con 0x7f1fb00d15d0 2023-11-20T06:41:39.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1faf7fe640 1 --2- 172.21.15.19:0/2400657533 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fb015cb90 0x7f1fb0153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:39.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1faeffd640 1 --2- 172.21.15.19:0/2400657533 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fb00d15d0 0x7f1fb00a0130 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00af040 tx=0x7f1fa001abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:39.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1facff9640 1 -- 172.21.15.19:0/2400657533 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa00b7620 con 0x7f1fb00d15d0 2023-11-20T06:41:39.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1facff9640 1 -- 172.21.15.19:0/2400657533 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa00b77a0 con 0x7f1fb00d15d0 2023-11-20T06:41:39.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1fb5879640 1 -- 172.21.15.19:0/2400657533 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb015b900 con 0x7f1fb00d15d0 2023-11-20T06:41:39.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1facff9640 1 -- 172.21.15.19:0/2400657533 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa00b7b50 con 0x7f1fb00d15d0 2023-11-20T06:41:39.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1fb5879640 1 -- 172.21.15.19:0/2400657533 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb00c9ec0 con 0x7f1fb00d15d0 2023-11-20T06:41:39.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1fb5879640 1 -- 172.21.15.19:0/2400657533 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb00ca0b0 con 0x7f1fb00d15d0 2023-11-20T06:41:39.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.287+0000 7f1facff9640 1 -- 172.21.15.19:0/2400657533 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1fa00b3040 con 0x7f1fb00d15d0 2023-11-20T06:41:39.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.291+0000 7f1facff9640 1 --2- 172.21.15.19:0/2400657533 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f1f900664a0 0x7f1f90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:39.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.291+0000 7f1facff9640 1 -- 172.21.15.19:0/2400657533 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1fa011e6d0 con 0x7f1fb00d15d0 2023-11-20T06:41:39.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.291+0000 7f1fa7fff640 1 --2- 172.21.15.19:0/2400657533 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f1f900664a0 0x7f1f90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:39.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.291+0000 7f1fa7fff640 1 --2- 172.21.15.19:0/2400657533 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f1f900664a0 0x7f1f90068960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1f98000c10 tx=0x7f1f98007a70 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:39.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.295+0000 7f1facff9640 1 -- 172.21.15.19:0/2400657533 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1fa00eba10 con 0x7f1fb00d15d0 2023-11-20T06:41:39.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.447+0000 7f1fb5879640 1 -- 172.21.15.19:0/2400657533 --> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1fb015cf70 con 0x7f1f900664a0 2023-11-20T06:41:39.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.459+0000 7f1facff9640 1 -- 172.21.15.19:0/2400657533 <== mgr.4109 v2:172.21.15.190:6832/142426253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345322 (secure 0 0 0) 0x7f1f980058c0 con 0x7f1f900664a0 2023-11-20T06:41:39.468 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:39.472 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-20T06:41:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.463+0000 7f1fb5879640 1 -- 172.21.15.19:0/2400657533 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f1f900664a0 msgr2=0x7f1f90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.463+0000 7f1fb5879640 1 --2- 172.21.15.19:0/2400657533 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f1f900664a0 0x7f1f90068960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1f98000c10 tx=0x7f1f98007a70 comp rx=0 tx=0).stop 2023-11-20T06:41:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.463+0000 7f1fb5879640 1 -- 172.21.15.19:0/2400657533 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fb00d15d0 msgr2=0x7f1fb00a0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.463+0000 7f1fb5879640 1 --2- 172.21.15.19:0/2400657533 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fb00d15d0 0x7f1fb00a0130 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00af040 tx=0x7f1fa001abe0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.463+0000 7f1fb5879640 1 -- 172.21.15.19:0/2400657533 shutdown_connections 2023-11-20T06:41:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.463+0000 7f1fb5879640 1 --2- 172.21.15.19:0/2400657533 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f1f900664a0 0x7f1f90068960 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.463+0000 7f1fb5879640 1 --2- 172.21.15.19:0/2400657533 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fb015cb90 0x7f1fb0153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.463+0000 7f1fb5879640 1 --2- 172.21.15.19:0/2400657533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fb00d3010 0x7f1fb00b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.463+0000 7f1fb5879640 1 --2- 172.21.15.19:0/2400657533 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fb00d15d0 0x7f1fb00a0130 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.463+0000 7f1fb5879640 1 -- 172.21.15.19:0/2400657533 >> 172.21.15.19:0/2400657533 conn(0x7f1fb009bc50 msgr2=0x7f1fb006bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.467+0000 7f1fb5879640 1 -- 172.21.15.19:0/2400657533 shutdown_connections 2023-11-20T06:41:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.467+0000 7f1fb5879640 1 -- 172.21.15.19:0/2400657533 wait complete. 2023-11-20T06:41:39.490 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-11-20T06:41:37.488332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219472,"kb_used_data":3300,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755248,"statfs":{"total":773094113280,"available":772869373952,"internally_reserved":0,"allocated":3379200,"data_stored":2043755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003104"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578685+0000","last_change":"2023-11-20T06:41:13.239285+0000","last_active":"2023-11-20T06:41:19.578685+0000","last_peered":"2023-11-20T06:41:19.578685+0000","last_clean":"2023-11-20T06:41:19.578685+0000","last_became_active":"2023-11-20T06:41:13.238954+0000","last_became_peered":"2023-11-20T06:41:13.238954+0000","last_unstale":"2023-11-20T06:41:19.578685+0000","last_undegraded":"2023-11-20T06:41:19.578685+0000","last_fullsized":"2023-11-20T06:41:19.578685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:47:01.655222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.584187+0000","last_change":"2023-11-20T06:41:14.261632+0000","last_active":"2023-11-20T06:41:19.584187+0000","last_peered":"2023-11-20T06:41:19.584187+0000","last_clean":"2023-11-20T06:41:19.584187+0000","last_became_active":"2023-11-20T06:41:14.261282+0000","last_became_peered":"2023-11-20T06:41:14.261282+0000","last_unstale":"2023-11-20T06:41:19.584187+0000","last_undegraded":"2023-11-20T06:41:19.584187+0000","last_fullsized":"2023-11-20T06:41:19.584187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:45:19.227613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.313252+0000","last_change":"2023-11-20T06:41:18.900797+0000","last_active":"2023-11-20T06:41:20.313252+0000","last_peered":"2023-11-20T06:41:20.313252+0000","last_clean":"2023-11-20T06:41:20.313252+0000","last_became_active":"2023-11-20T06:41:18.900345+0000","last_became_peered":"2023-11-20T06:41:18.900345+0000","last_unstale":"2023-11-20T06:41:20.313252+0000","last_undegraded":"2023-11-20T06:41:20.313252+0000","last_fullsized":"2023-11-20T06:41:20.313252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:58:31.638685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.584272+0000","last_change":"2023-11-20T06:41:13.239899+0000","last_active":"2023-11-20T06:41:19.584272+0000","last_peered":"2023-11-20T06:41:19.584272+0000","last_clean":"2023-11-20T06:41:19.584272+0000","last_became_active":"2023-11-20T06:41:13.239579+0000","last_became_peered":"2023-11-20T06:41:13.239579+0000","last_unstale":"2023-11-20T06:41:19.584272+0000","last_undegraded":"2023-11-20T06:41:19.584272+0000","last_fullsized":"2023-11-20T06:41:19.584272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:15:33.516237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578577+0000","last_change":"2023-11-20T06:41:14.262518+0000","last_active":"2023-11-20T06:41:19.578577+0000","last_peered":"2023-11-20T06:41:19.578577+0000","last_clean":"2023-11-20T06:41:19.578577+0000","last_became_active":"2023-11-20T06:41:14.260033+0000","last_became_peered":"2023-11-20T06:41:14.260033+0000","last_unstale":"2023-11-20T06:41:19.578577+0000","last_undegraded":"2023-11-20T06:41:19.578577+0000","last_fullsized":"2023-11-20T06:41:19.578577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:25.537288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.315596+0000","last_change":"2023-11-20T06:41:18.295727+0000","last_active":"2023-11-20T06:41:20.315596+0000","last_peered":"2023-11-20T06:41:20.315596+0000","last_clean":"2023-11-20T06:41:20.315596+0000","last_became_active":"2023-11-20T06:41:18.295305+0000","last_became_peered":"2023-11-20T06:41:18.295305+0000","last_unstale":"2023-11-20T06:41:20.315596+0000","last_undegraded":"2023-11-20T06:41:20.315596+0000","last_fullsized":"2023-11-20T06:41:20.315596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:45:54.333725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931461+0000","last_change":"2023-11-20T06:41:13.252932+0000","last_active":"2023-11-20T06:41:19.931461+0000","last_peered":"2023-11-20T06:41:19.931461+0000","last_clean":"2023-11-20T06:41:19.931461+0000","last_became_active":"2023-11-20T06:41:13.252621+0000","last_became_peered":"2023-11-20T06:41:13.252621+0000","last_unstale":"2023-11-20T06:41:19.931461+0000","last_undegraded":"2023-11-20T06:41:19.931461+0000","last_fullsized":"2023-11-20T06:41:19.931461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:20.467472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787860+0000","last_change":"2023-11-20T06:41:14.256127+0000","last_active":"2023-11-20T06:41:19.787860+0000","last_peered":"2023-11-20T06:41:19.787860+0000","last_clean":"2023-11-20T06:41:19.787860+0000","last_became_active":"2023-11-20T06:41:14.255819+0000","last_became_peered":"2023-11-20T06:41:14.255819+0000","last_unstale":"2023-11-20T06:41:19.787860+0000","last_undegraded":"2023-11-20T06:41:19.787860+0000","last_fullsized":"2023-11-20T06:41:19.787860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:45:19.227613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.315754+0000","last_change":"2023-11-20T06:41:18.301642+0000","last_active":"2023-11-20T06:41:20.315754+0000","last_peered":"2023-11-20T06:41:20.315754+0000","last_clean":"2023-11-20T06:41:20.315754+0000","last_became_active":"2023-11-20T06:41:18.301181+0000","last_became_peered":"2023-11-20T06:41:18.301181+0000","last_unstale":"2023-11-20T06:41:20.315754+0000","last_undegraded":"2023-11-20T06:41:20.315754+0000","last_fullsized":"2023-11-20T06:41:20.315754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:49.111361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931279+0000","last_change":"2023-11-20T06:41:13.254958+0000","last_active":"2023-11-20T06:41:19.931279+0000","last_peered":"2023-11-20T06:41:19.931279+0000","last_clean":"2023-11-20T06:41:19.931279+0000","last_became_active":"2023-11-20T06:41:13.254686+0000","last_became_peered":"2023-11-20T06:41:13.254686+0000","last_unstale":"2023-11-20T06:41:19.931279+0000","last_undegraded":"2023-11-20T06:41:19.931279+0000","last_fullsized":"2023-11-20T06:41:19.931279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:48:12.763247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.788059+0000","last_change":"2023-11-20T06:41:14.260659+0000","last_active":"2023-11-20T06:41:19.788059+0000","last_peered":"2023-11-20T06:41:19.788059+0000","last_clean":"2023-11-20T06:41:19.788059+0000","last_became_active":"2023-11-20T06:41:14.260375+0000","last_became_peered":"2023-11-20T06:41:14.260375+0000","last_unstale":"2023-11-20T06:41:19.788059+0000","last_undegraded":"2023-11-20T06:41:19.788059+0000","last_fullsized":"2023-11-20T06:41:19.788059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:20:01.827771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.315993+0000","last_change":"2023-11-20T06:41:18.289391+0000","last_active":"2023-11-20T06:41:20.315993+0000","last_peered":"2023-11-20T06:41:20.315993+0000","last_clean":"2023-11-20T06:41:20.315993+0000","last_became_active":"2023-11-20T06:41:18.288932+0000","last_became_peered":"2023-11-20T06:41:18.288932+0000","last_unstale":"2023-11-20T06:41:20.315993+0000","last_undegraded":"2023-11-20T06:41:20.315993+0000","last_fullsized":"2023-11-20T06:41:20.315993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:57:19.944479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314649+0000","last_change":"2023-11-20T06:41:14.270272+0000","last_active":"2023-11-20T06:41:19.314649+0000","last_peered":"2023-11-20T06:41:19.314649+0000","last_clean":"2023-11-20T06:41:19.314649+0000","last_became_active":"2023-11-20T06:41:14.269983+0000","last_became_peered":"2023-11-20T06:41:14.269983+0000","last_unstale":"2023-11-20T06:41:19.314649+0000","last_undegraded":"2023-11-20T06:41:19.314649+0000","last_fullsized":"2023-11-20T06:41:19.314649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:03:05.538623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931428+0000","last_change":"2023-11-20T06:41:13.252298+0000","last_active":"2023-11-20T06:41:19.931428+0000","last_peered":"2023-11-20T06:41:19.931428+0000","last_clean":"2023-11-20T06:41:19.931428+0000","last_became_active":"2023-11-20T06:41:13.252009+0000","last_became_peered":"2023-11-20T06:41:13.252009+0000","last_unstale":"2023-11-20T06:41:19.931428+0000","last_undegraded":"2023-11-20T06:41:19.931428+0000","last_fullsized":"2023-11-20T06:41:19.931428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:24.531185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.316395+0000","last_change":"2023-11-20T06:41:18.299248+0000","last_active":"2023-11-20T06:41:20.316395+0000","last_peered":"2023-11-20T06:41:20.316395+0000","last_clean":"2023-11-20T06:41:20.316395+0000","last_became_active":"2023-11-20T06:41:18.298935+0000","last_became_peered":"2023-11-20T06:41:18.298935+0000","last_unstale":"2023-11-20T06:41:20.316395+0000","last_undegraded":"2023-11-20T06:41:20.316395+0000","last_fullsized":"2023-11-20T06:41:20.316395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:00:16.728243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583729+0000","last_change":"2023-11-20T06:41:14.267951+0000","last_active":"2023-11-20T06:41:19.583729+0000","last_peered":"2023-11-20T06:41:19.583729+0000","last_clean":"2023-11-20T06:41:19.583729+0000","last_became_active":"2023-11-20T06:41:14.266970+0000","last_became_peered":"2023-11-20T06:41:14.266970+0000","last_unstale":"2023-11-20T06:41:19.583729+0000","last_undegraded":"2023-11-20T06:41:19.583729+0000","last_fullsized":"2023-11-20T06:41:19.583729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:35:30.568821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662297+0000","last_change":"2023-11-20T06:41:13.242711+0000","last_active":"2023-11-20T06:41:19.662297+0000","last_peered":"2023-11-20T06:41:19.662297+0000","last_clean":"2023-11-20T06:41:19.662297+0000","last_became_active":"2023-11-20T06:41:13.242342+0000","last_became_peered":"2023-11-20T06:41:13.242342+0000","last_unstale":"2023-11-20T06:41:19.662297+0000","last_undegraded":"2023-11-20T06:41:19.662297+0000","last_fullsized":"2023-11-20T06:41:19.662297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:47:01.655222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.317121+0000","last_change":"2023-11-20T06:41:18.301608+0000","last_active":"2023-11-20T06:41:20.317121+0000","last_peered":"2023-11-20T06:41:20.317121+0000","last_clean":"2023-11-20T06:41:20.317121+0000","last_became_active":"2023-11-20T06:41:18.301170+0000","last_became_peered":"2023-11-20T06:41:18.301170+0000","last_unstale":"2023-11-20T06:41:20.317121+0000","last_undegraded":"2023-11-20T06:41:20.317121+0000","last_fullsized":"2023-11-20T06:41:20.317121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:49:09.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583521+0000","last_change":"2023-11-20T06:41:14.269440+0000","last_active":"2023-11-20T06:41:19.583521+0000","last_peered":"2023-11-20T06:41:19.583521+0000","last_clean":"2023-11-20T06:41:19.583521+0000","last_became_active":"2023-11-20T06:41:14.269118+0000","last_became_peered":"2023-11-20T06:41:14.269118+0000","last_unstale":"2023-11-20T06:41:19.583521+0000","last_undegraded":"2023-11-20T06:41:19.583521+0000","last_fullsized":"2023-11-20T06:41:19.583521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:42:53.602834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.661987+0000","last_change":"2023-11-20T06:41:13.247696+0000","last_active":"2023-11-20T06:41:19.661987+0000","last_peered":"2023-11-20T06:41:19.661987+0000","last_clean":"2023-11-20T06:41:19.661987+0000","last_became_active":"2023-11-20T06:41:13.247416+0000","last_became_peered":"2023-11-20T06:41:13.247416+0000","last_unstale":"2023-11-20T06:41:19.661987+0000","last_undegraded":"2023-11-20T06:41:19.661987+0000","last_fullsized":"2023-11-20T06:41:19.661987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:36:43.073673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.743727+0000","last_change":"2023-11-20T06:41:18.897168+0000","last_active":"2023-11-20T06:41:20.743727+0000","last_peered":"2023-11-20T06:41:20.743727+0000","last_clean":"2023-11-20T06:41:20.743727+0000","last_became_active":"2023-11-20T06:41:18.896705+0000","last_became_peered":"2023-11-20T06:41:18.896705+0000","last_unstale":"2023-11-20T06:41:20.743727+0000","last_undegraded":"2023-11-20T06:41:20.743727+0000","last_fullsized":"2023-11-20T06:41:20.743727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:49:09.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.313398+0000","last_change":"2023-11-20T06:41:14.267054+0000","last_active":"2023-11-20T06:41:19.313398+0000","last_peered":"2023-11-20T06:41:19.313398+0000","last_clean":"2023-11-20T06:41:19.313398+0000","last_became_active":"2023-11-20T06:41:14.262005+0000","last_became_peered":"2023-11-20T06:41:14.262005+0000","last_unstale":"2023-11-20T06:41:19.313398+0000","last_undegraded":"2023-11-20T06:41:19.313398+0000","last_fullsized":"2023-11-20T06:41:19.313398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:52:49.697194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931076+0000","last_change":"2023-11-20T06:41:13.257483+0000","last_active":"2023-11-20T06:41:19.931076+0000","last_peered":"2023-11-20T06:41:19.931076+0000","last_clean":"2023-11-20T06:41:19.931076+0000","last_became_active":"2023-11-20T06:41:13.257122+0000","last_became_peered":"2023-11-20T06:41:13.257122+0000","last_unstale":"2023-11-20T06:41:19.931076+0000","last_undegraded":"2023-11-20T06:41:19.931076+0000","last_fullsized":"2023-11-20T06:41:19.931076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:15:33.516237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.317008+0000","last_change":"2023-11-20T06:41:18.302677+0000","last_active":"2023-11-20T06:41:20.317008+0000","last_peered":"2023-11-20T06:41:20.317008+0000","last_clean":"2023-11-20T06:41:20.317008+0000","last_became_active":"2023-11-20T06:41:18.301938+0000","last_became_peered":"2023-11-20T06:41:18.301938+0000","last_unstale":"2023-11-20T06:41:20.317008+0000","last_undegraded":"2023-11-20T06:41:20.317008+0000","last_fullsized":"2023-11-20T06:41:20.317008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:25:06.683699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578465+0000","last_change":"2023-11-20T06:41:14.264039+0000","last_active":"2023-11-20T06:41:19.578465+0000","last_peered":"2023-11-20T06:41:19.578465+0000","last_clean":"2023-11-20T06:41:19.578465+0000","last_became_active":"2023-11-20T06:41:14.262551+0000","last_became_peered":"2023-11-20T06:41:14.262551+0000","last_unstale":"2023-11-20T06:41:19.578465+0000","last_undegraded":"2023-11-20T06:41:19.578465+0000","last_fullsized":"2023-11-20T06:41:19.578465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:08:41.021374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315807+0000","last_change":"2023-11-20T06:41:13.251311+0000","last_active":"2023-11-20T06:41:19.315807+0000","last_peered":"2023-11-20T06:41:19.315807+0000","last_clean":"2023-11-20T06:41:19.315807+0000","last_became_active":"2023-11-20T06:41:13.251022+0000","last_became_peered":"2023-11-20T06:41:13.251022+0000","last_unstale":"2023-11-20T06:41:19.315807+0000","last_undegraded":"2023-11-20T06:41:19.315807+0000","last_fullsized":"2023-11-20T06:41:19.315807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:20.467472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.316272+0000","last_change":"2023-11-20T06:41:18.899620+0000","last_active":"2023-11-20T06:41:20.316272+0000","last_peered":"2023-11-20T06:41:20.316272+0000","last_clean":"2023-11-20T06:41:20.316272+0000","last_became_active":"2023-11-20T06:41:18.899201+0000","last_became_peered":"2023-11-20T06:41:18.899201+0000","last_unstale":"2023-11-20T06:41:20.316272+0000","last_undegraded":"2023-11-20T06:41:20.316272+0000","last_fullsized":"2023-11-20T06:41:20.316272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:16:52.140361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.584296+0000","last_change":"2023-11-20T06:41:14.270250+0000","last_active":"2023-11-20T06:41:19.584296+0000","last_peered":"2023-11-20T06:41:19.584296+0000","last_clean":"2023-11-20T06:41:19.584296+0000","last_became_active":"2023-11-20T06:41:14.269658+0000","last_became_peered":"2023-11-20T06:41:14.269658+0000","last_unstale":"2023-11-20T06:41:19.584296+0000","last_undegraded":"2023-11-20T06:41:19.584296+0000","last_fullsized":"2023-11-20T06:41:19.584296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:27:59.872035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.663105+0000","last_change":"2023-11-20T06:41:13.241077+0000","last_active":"2023-11-20T06:41:19.663105+0000","last_peered":"2023-11-20T06:41:19.663105+0000","last_clean":"2023-11-20T06:41:19.663105+0000","last_became_active":"2023-11-20T06:41:13.240478+0000","last_became_peered":"2023-11-20T06:41:13.240478+0000","last_unstale":"2023-11-20T06:41:19.663105+0000","last_undegraded":"2023-11-20T06:41:19.663105+0000","last_fullsized":"2023-11-20T06:41:19.663105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:16:12.804737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.313191+0000","last_change":"2023-11-20T06:41:18.899891+0000","last_active":"2023-11-20T06:41:20.313191+0000","last_peered":"2023-11-20T06:41:20.313191+0000","last_clean":"2023-11-20T06:41:20.313191+0000","last_became_active":"2023-11-20T06:41:18.899023+0000","last_became_peered":"2023-11-20T06:41:18.899023+0000","last_unstale":"2023-11-20T06:41:20.313191+0000","last_undegraded":"2023-11-20T06:41:20.313191+0000","last_fullsized":"2023-11-20T06:41:20.313191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:37:56.697790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662455+0000","last_change":"2023-11-20T06:41:14.257593+0000","last_active":"2023-11-20T06:41:19.662455+0000","last_peered":"2023-11-20T06:41:19.662455+0000","last_clean":"2023-11-20T06:41:19.662455+0000","last_became_active":"2023-11-20T06:41:14.257296+0000","last_became_peered":"2023-11-20T06:41:14.257296+0000","last_unstale":"2023-11-20T06:41:19.662455+0000","last_undegraded":"2023-11-20T06:41:19.662455+0000","last_fullsized":"2023-11-20T06:41:19.662455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:25.537288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931571+0000","last_change":"2023-11-20T06:41:13.253474+0000","last_active":"2023-11-20T06:41:19.931571+0000","last_peered":"2023-11-20T06:41:19.931571+0000","last_clean":"2023-11-20T06:41:19.931571+0000","last_became_active":"2023-11-20T06:41:13.253199+0000","last_became_peered":"2023-11-20T06:41:13.253199+0000","last_unstale":"2023-11-20T06:41:19.931571+0000","last_undegraded":"2023-11-20T06:41:19.931571+0000","last_fullsized":"2023-11-20T06:41:19.931571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:36:43.073673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.679008+0000","last_change":"2023-11-20T06:41:18.897668+0000","last_active":"2023-11-20T06:41:20.679008+0000","last_peered":"2023-11-20T06:41:20.679008+0000","last_clean":"2023-11-20T06:41:20.679008+0000","last_became_active":"2023-11-20T06:41:18.897265+0000","last_became_peered":"2023-11-20T06:41:18.897265+0000","last_unstale":"2023-11-20T06:41:20.679008+0000","last_undegraded":"2023-11-20T06:41:20.679008+0000","last_fullsized":"2023-11-20T06:41:20.679008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:00:16.728243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.788104+0000","last_change":"2023-11-20T06:41:14.277073+0000","last_active":"2023-11-20T06:41:19.788104+0000","last_peered":"2023-11-20T06:41:19.788104+0000","last_clean":"2023-11-20T06:41:19.788104+0000","last_became_active":"2023-11-20T06:41:14.276783+0000","last_became_peered":"2023-11-20T06:41:14.276783+0000","last_unstale":"2023-11-20T06:41:19.788104+0000","last_undegraded":"2023-11-20T06:41:19.788104+0000","last_fullsized":"2023-11-20T06:41:19.788104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:07:38.977327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662498+0000","last_change":"2023-11-20T06:41:13.244589+0000","last_active":"2023-11-20T06:41:19.662498+0000","last_peered":"2023-11-20T06:41:19.662498+0000","last_clean":"2023-11-20T06:41:19.662498+0000","last_became_active":"2023-11-20T06:41:13.244242+0000","last_became_peered":"2023-11-20T06:41:13.244242+0000","last_unstale":"2023-11-20T06:41:19.662498+0000","last_undegraded":"2023-11-20T06:41:19.662498+0000","last_fullsized":"2023-11-20T06:41:19.662498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:01:37.302430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.743291+0000","last_change":"2023-11-20T06:41:18.302053+0000","last_active":"2023-11-20T06:41:20.743291+0000","last_peered":"2023-11-20T06:41:20.743291+0000","last_clean":"2023-11-20T06:41:20.743291+0000","last_became_active":"2023-11-20T06:41:18.301615+0000","last_became_peered":"2023-11-20T06:41:18.301615+0000","last_unstale":"2023-11-20T06:41:20.743291+0000","last_undegraded":"2023-11-20T06:41:20.743291+0000","last_fullsized":"2023-11-20T06:41:20.743291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:16:52.140361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314736+0000","last_change":"2023-11-20T06:41:14.268552+0000","last_active":"2023-11-20T06:41:19.314736+0000","last_peered":"2023-11-20T06:41:19.314736+0000","last_clean":"2023-11-20T06:41:19.314736+0000","last_became_active":"2023-11-20T06:41:14.268201+0000","last_became_peered":"2023-11-20T06:41:14.268201+0000","last_unstale":"2023-11-20T06:41:19.314736+0000","last_undegraded":"2023-11-20T06:41:19.314736+0000","last_fullsized":"2023-11-20T06:41:19.314736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:13:30.790091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787765+0000","last_change":"2023-11-20T06:41:13.249876+0000","last_active":"2023-11-20T06:41:19.787765+0000","last_peered":"2023-11-20T06:41:19.787765+0000","last_clean":"2023-11-20T06:41:19.787765+0000","last_became_active":"2023-11-20T06:41:13.249316+0000","last_became_peered":"2023-11-20T06:41:13.249316+0000","last_unstale":"2023-11-20T06:41:19.787765+0000","last_undegraded":"2023-11-20T06:41:19.787765+0000","last_fullsized":"2023-11-20T06:41:19.787765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:20.467472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.743432+0000","last_change":"2023-11-20T06:41:18.298035+0000","last_active":"2023-11-20T06:41:20.743432+0000","last_peered":"2023-11-20T06:41:20.743432+0000","last_clean":"2023-11-20T06:41:20.743432+0000","last_became_active":"2023-11-20T06:41:18.297674+0000","last_became_peered":"2023-11-20T06:41:18.297674+0000","last_unstale":"2023-11-20T06:41:20.743432+0000","last_undegraded":"2023-11-20T06:41:20.743432+0000","last_fullsized":"2023-11-20T06:41:20.743432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:00:16.728243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662052+0000","last_change":"2023-11-20T06:41:14.258777+0000","last_active":"2023-11-20T06:41:19.662052+0000","last_peered":"2023-11-20T06:41:19.662052+0000","last_clean":"2023-11-20T06:41:19.662052+0000","last_became_active":"2023-11-20T06:41:14.258430+0000","last_became_peered":"2023-11-20T06:41:14.258430+0000","last_unstale":"2023-11-20T06:41:19.662052+0000","last_undegraded":"2023-11-20T06:41:19.662052+0000","last_fullsized":"2023-11-20T06:41:19.662052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:42:53.602834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.309513+0000","last_change":"2023-11-20T06:41:13.226120+0000","last_active":"2023-11-20T06:41:19.309513+0000","last_peered":"2023-11-20T06:41:19.309513+0000","last_clean":"2023-11-20T06:41:19.309513+0000","last_became_active":"2023-11-20T06:41:13.225814+0000","last_became_peered":"2023-11-20T06:41:13.225814+0000","last_unstale":"2023-11-20T06:41:19.309513+0000","last_undegraded":"2023-11-20T06:41:19.309513+0000","last_fullsized":"2023-11-20T06:41:19.309513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:54:25.014221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.743763+0000","last_change":"2023-11-20T06:41:18.294432+0000","last_active":"2023-11-20T06:41:20.743763+0000","last_peered":"2023-11-20T06:41:20.743763+0000","last_clean":"2023-11-20T06:41:20.743763+0000","last_became_active":"2023-11-20T06:41:18.293345+0000","last_became_peered":"2023-11-20T06:41:18.293345+0000","last_unstale":"2023-11-20T06:41:20.743763+0000","last_undegraded":"2023-11-20T06:41:20.743763+0000","last_fullsized":"2023-11-20T06:41:20.743763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:13:29.540284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578235+0000","last_change":"2023-11-20T06:41:14.250513+0000","last_active":"2023-11-20T06:41:19.578235+0000","last_peered":"2023-11-20T06:41:19.578235+0000","last_clean":"2023-11-20T06:41:19.578235+0000","last_became_active":"2023-11-20T06:41:14.250195+0000","last_became_peered":"2023-11-20T06:41:14.250195+0000","last_unstale":"2023-11-20T06:41:19.578235+0000","last_undegraded":"2023-11-20T06:41:19.578235+0000","last_fullsized":"2023-11-20T06:41:19.578235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:01:38.308533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931054+0000","last_change":"2023-11-20T06:41:13.255728+0000","last_active":"2023-11-20T06:41:19.931054+0000","last_peered":"2023-11-20T06:41:19.931054+0000","last_clean":"2023-11-20T06:41:19.931054+0000","last_became_active":"2023-11-20T06:41:13.255440+0000","last_became_peered":"2023-11-20T06:41:13.255440+0000","last_unstale":"2023-11-20T06:41:19.931054+0000","last_undegraded":"2023-11-20T06:41:19.931054+0000","last_fullsized":"2023-11-20T06:41:19.931054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:27:01.563513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.679449+0000","last_change":"2023-11-20T06:41:18.900803+0000","last_active":"2023-11-20T06:41:20.679449+0000","last_peered":"2023-11-20T06:41:20.679449+0000","last_clean":"2023-11-20T06:41:20.679449+0000","last_became_active":"2023-11-20T06:41:18.900347+0000","last_became_peered":"2023-11-20T06:41:18.900347+0000","last_unstale":"2023-11-20T06:41:20.679449+0000","last_undegraded":"2023-11-20T06:41:20.679449+0000","last_fullsized":"2023-11-20T06:41:20.679449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:32:07.244747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583650+0000","last_change":"2023-11-20T06:41:14.265573+0000","last_active":"2023-11-20T06:41:19.583650+0000","last_peered":"2023-11-20T06:41:19.583650+0000","last_clean":"2023-11-20T06:41:19.583650+0000","last_became_active":"2023-11-20T06:41:14.260035+0000","last_became_peered":"2023-11-20T06:41:14.260035+0000","last_unstale":"2023-11-20T06:41:19.583650+0000","last_undegraded":"2023-11-20T06:41:19.583650+0000","last_fullsized":"2023-11-20T06:41:19.583650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:25.537288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787737+0000","last_change":"2023-11-20T06:41:13.237196+0000","last_active":"2023-11-20T06:41:19.787737+0000","last_peered":"2023-11-20T06:41:19.787737+0000","last_clean":"2023-11-20T06:41:19.787737+0000","last_became_active":"2023-11-20T06:41:13.236793+0000","last_became_peered":"2023-11-20T06:41:13.236793+0000","last_unstale":"2023-11-20T06:41:19.787737+0000","last_undegraded":"2023-11-20T06:41:19.787737+0000","last_fullsized":"2023-11-20T06:41:19.787737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:44:08.985984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.930761+0000","last_change":"2023-11-20T06:41:03.783345+0000","last_active":"2023-11-20T06:41:19.930761+0000","last_peered":"2023-11-20T06:41:19.930761+0000","last_clean":"2023-11-20T06:41:19.930761+0000","last_became_active":"2023-11-20T06:41:03.782257+0000","last_became_peered":"2023-11-20T06:41:03.782257+0000","last_unstale":"2023-11-20T06:41:19.930761+0000","last_undegraded":"2023-11-20T06:41:19.930761+0000","last_fullsized":"2023-11-20T06:41:19.930761+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:01.979090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:01.979090+0000","last_clean_scrub_stamp":"2023-11-20T06:41:01.979090+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:20:41.084382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.746476+0000","last_change":"2023-11-20T06:41:18.903133+0000","last_active":"2023-11-20T06:41:20.746476+0000","last_peered":"2023-11-20T06:41:20.746476+0000","last_clean":"2023-11-20T06:41:20.746476+0000","last_became_active":"2023-11-20T06:41:18.902697+0000","last_became_peered":"2023-11-20T06:41:18.902697+0000","last_unstale":"2023-11-20T06:41:20.746476+0000","last_undegraded":"2023-11-20T06:41:20.746476+0000","last_fullsized":"2023-11-20T06:41:20.746476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:57:19.944479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931329+0000","last_change":"2023-11-20T06:41:14.263973+0000","last_active":"2023-11-20T06:41:19.931329+0000","last_peered":"2023-11-20T06:41:19.931329+0000","last_clean":"2023-11-20T06:41:19.931329+0000","last_became_active":"2023-11-20T06:41:14.263492+0000","last_became_peered":"2023-11-20T06:41:14.263492+0000","last_unstale":"2023-11-20T06:41:19.931329+0000","last_undegraded":"2023-11-20T06:41:19.931329+0000","last_fullsized":"2023-11-20T06:41:19.931329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:07:38.977327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.310124+0000","last_change":"2023-11-20T06:41:13.233779+0000","last_active":"2023-11-20T06:41:19.310124+0000","last_peered":"2023-11-20T06:41:19.310124+0000","last_clean":"2023-11-20T06:41:19.310124+0000","last_became_active":"2023-11-20T06:41:13.233388+0000","last_became_peered":"2023-11-20T06:41:13.233388+0000","last_unstale":"2023-11-20T06:41:19.310124+0000","last_undegraded":"2023-11-20T06:41:19.310124+0000","last_fullsized":"2023-11-20T06:41:19.310124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:52:48.691091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.746246+0000","last_change":"2023-11-20T06:41:18.899818+0000","last_active":"2023-11-20T06:41:20.746246+0000","last_peered":"2023-11-20T06:41:20.746246+0000","last_clean":"2023-11-20T06:41:20.746246+0000","last_became_active":"2023-11-20T06:41:18.899254+0000","last_became_peered":"2023-11-20T06:41:18.899254+0000","last_unstale":"2023-11-20T06:41:20.746246+0000","last_undegraded":"2023-11-20T06:41:20.746246+0000","last_fullsized":"2023-11-20T06:41:20.746246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:49:36.631359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787891+0000","last_change":"2023-11-20T06:41:14.277327+0000","last_active":"2023-11-20T06:41:19.787891+0000","last_peered":"2023-11-20T06:41:19.787891+0000","last_clean":"2023-11-20T06:41:19.787891+0000","last_became_active":"2023-11-20T06:41:14.276750+0000","last_became_peered":"2023-11-20T06:41:14.276750+0000","last_unstale":"2023-11-20T06:41:19.787891+0000","last_undegraded":"2023-11-20T06:41:19.787891+0000","last_fullsized":"2023-11-20T06:41:19.787891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:07:43.904895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662857+0000","last_change":"2023-11-20T06:41:13.237042+0000","last_active":"2023-11-20T06:41:19.662857+0000","last_peered":"2023-11-20T06:41:19.662857+0000","last_clean":"2023-11-20T06:41:19.662857+0000","last_became_active":"2023-11-20T06:41:13.236730+0000","last_became_peered":"2023-11-20T06:41:13.236730+0000","last_unstale":"2023-11-20T06:41:19.662857+0000","last_undegraded":"2023-11-20T06:41:19.662857+0000","last_fullsized":"2023-11-20T06:41:19.662857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:20.467472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.679071+0000","last_change":"2023-11-20T06:41:18.300034+0000","last_active":"2023-11-20T06:41:20.679071+0000","last_peered":"2023-11-20T06:41:20.679071+0000","last_clean":"2023-11-20T06:41:20.679071+0000","last_became_active":"2023-11-20T06:41:18.299636+0000","last_became_peered":"2023-11-20T06:41:18.299636+0000","last_unstale":"2023-11-20T06:41:20.679071+0000","last_undegraded":"2023-11-20T06:41:20.679071+0000","last_fullsized":"2023-11-20T06:41:20.679071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:25:06.683699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931760+0000","last_change":"2023-11-20T06:41:14.273791+0000","last_active":"2023-11-20T06:41:19.931760+0000","last_peered":"2023-11-20T06:41:19.931760+0000","last_clean":"2023-11-20T06:41:19.931760+0000","last_became_active":"2023-11-20T06:41:14.273507+0000","last_became_peered":"2023-11-20T06:41:14.273507+0000","last_unstale":"2023-11-20T06:41:19.931760+0000","last_undegraded":"2023-11-20T06:41:19.931760+0000","last_fullsized":"2023-11-20T06:41:19.931760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:00:12.676212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.310448+0000","last_change":"2023-11-20T06:41:13.243381+0000","last_active":"2023-11-20T06:41:19.310448+0000","last_peered":"2023-11-20T06:41:19.310448+0000","last_clean":"2023-11-20T06:41:19.310448+0000","last_became_active":"2023-11-20T06:41:13.242286+0000","last_became_peered":"2023-11-20T06:41:13.242286+0000","last_unstale":"2023-11-20T06:41:19.310448+0000","last_undegraded":"2023-11-20T06:41:19.310448+0000","last_fullsized":"2023-11-20T06:41:19.310448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:13:29.783988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.315374+0000","last_change":"2023-11-20T06:41:18.900675+0000","last_active":"2023-11-20T06:41:20.315374+0000","last_peered":"2023-11-20T06:41:20.315374+0000","last_clean":"2023-11-20T06:41:20.315374+0000","last_became_active":"2023-11-20T06:41:18.899705+0000","last_became_peered":"2023-11-20T06:41:18.899705+0000","last_unstale":"2023-11-20T06:41:20.315374+0000","last_undegraded":"2023-11-20T06:41:20.315374+0000","last_fullsized":"2023-11-20T06:41:20.315374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:49:09.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931619+0000","last_change":"2023-11-20T06:41:14.261198+0000","last_active":"2023-11-20T06:41:19.931619+0000","last_peered":"2023-11-20T06:41:19.931619+0000","last_clean":"2023-11-20T06:41:19.931619+0000","last_became_active":"2023-11-20T06:41:14.260837+0000","last_became_peered":"2023-11-20T06:41:14.260837+0000","last_unstale":"2023-11-20T06:41:19.931619+0000","last_undegraded":"2023-11-20T06:41:19.931619+0000","last_fullsized":"2023-11-20T06:41:19.931619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:57:15.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314546+0000","last_change":"2023-11-20T06:41:13.234116+0000","last_active":"2023-11-20T06:41:19.314546+0000","last_peered":"2023-11-20T06:41:19.314546+0000","last_clean":"2023-11-20T06:41:19.314546+0000","last_became_active":"2023-11-20T06:41:13.233691+0000","last_became_peered":"2023-11-20T06:41:13.233691+0000","last_unstale":"2023-11-20T06:41:19.314546+0000","last_undegraded":"2023-11-20T06:41:19.314546+0000","last_fullsized":"2023-11-20T06:41:19.314546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:44:08.985984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.315962+0000","last_change":"2023-11-20T06:41:18.295800+0000","last_active":"2023-11-20T06:41:20.315962+0000","last_peered":"2023-11-20T06:41:20.315962+0000","last_clean":"2023-11-20T06:41:20.315962+0000","last_became_active":"2023-11-20T06:41:18.295366+0000","last_became_peered":"2023-11-20T06:41:18.295366+0000","last_unstale":"2023-11-20T06:41:20.315962+0000","last_undegraded":"2023-11-20T06:41:20.315962+0000","last_fullsized":"2023-11-20T06:41:20.315962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:49:36.631359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931202+0000","last_change":"2023-11-20T06:41:14.274139+0000","last_active":"2023-11-20T06:41:19.931202+0000","last_peered":"2023-11-20T06:41:19.931202+0000","last_clean":"2023-11-20T06:41:19.931202+0000","last_became_active":"2023-11-20T06:41:14.273838+0000","last_became_peered":"2023-11-20T06:41:14.273838+0000","last_unstale":"2023-11-20T06:41:19.931202+0000","last_undegraded":"2023-11-20T06:41:19.931202+0000","last_fullsized":"2023-11-20T06:41:19.931202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:27:59.872035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.309437+0000","last_change":"2023-11-20T06:41:13.238251+0000","last_active":"2023-11-20T06:41:19.309437+0000","last_peered":"2023-11-20T06:41:19.309437+0000","last_clean":"2023-11-20T06:41:19.309437+0000","last_became_active":"2023-11-20T06:41:13.237920+0000","last_became_peered":"2023-11-20T06:41:13.237920+0000","last_unstale":"2023-11-20T06:41:19.309437+0000","last_undegraded":"2023-11-20T06:41:19.309437+0000","last_fullsized":"2023-11-20T06:41:19.309437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:44:08.985984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.679312+0000","last_change":"2023-11-20T06:41:18.292764+0000","last_active":"2023-11-20T06:41:20.679312+0000","last_peered":"2023-11-20T06:41:20.679312+0000","last_clean":"2023-11-20T06:41:20.679312+0000","last_became_active":"2023-11-20T06:41:18.292352+0000","last_became_peered":"2023-11-20T06:41:18.292352+0000","last_unstale":"2023-11-20T06:41:20.679312+0000","last_undegraded":"2023-11-20T06:41:20.679312+0000","last_fullsized":"2023-11-20T06:41:20.679312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:13:29.540284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314386+0000","last_change":"2023-11-20T06:41:14.273982+0000","last_active":"2023-11-20T06:41:19.314386+0000","last_peered":"2023-11-20T06:41:19.314386+0000","last_clean":"2023-11-20T06:41:19.314386+0000","last_became_active":"2023-11-20T06:41:14.273301+0000","last_became_peered":"2023-11-20T06:41:14.273301+0000","last_unstale":"2023-11-20T06:41:19.314386+0000","last_undegraded":"2023-11-20T06:41:19.314386+0000","last_fullsized":"2023-11-20T06:41:19.314386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:06:44.444162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314956+0000","last_change":"2023-11-20T06:41:13.246748+0000","last_active":"2023-11-20T06:41:19.314956+0000","last_peered":"2023-11-20T06:41:19.314956+0000","last_clean":"2023-11-20T06:41:19.314956+0000","last_became_active":"2023-11-20T06:41:13.246302+0000","last_became_peered":"2023-11-20T06:41:13.246302+0000","last_unstale":"2023-11-20T06:41:19.314956+0000","last_undegraded":"2023-11-20T06:41:19.314956+0000","last_fullsized":"2023-11-20T06:41:19.314956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:27:01.563513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.314405+0000","last_change":"2023-11-20T06:41:18.897842+0000","last_active":"2023-11-20T06:41:20.314405+0000","last_peered":"2023-11-20T06:41:20.314405+0000","last_clean":"2023-11-20T06:41:20.314405+0000","last_became_active":"2023-11-20T06:41:18.896898+0000","last_became_peered":"2023-11-20T06:41:18.896898+0000","last_unstale":"2023-11-20T06:41:20.314405+0000","last_undegraded":"2023-11-20T06:41:20.314405+0000","last_fullsized":"2023-11-20T06:41:20.314405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:18:24.107898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931464+0000","last_change":"2023-11-20T06:41:14.274131+0000","last_active":"2023-11-20T06:41:19.931464+0000","last_peered":"2023-11-20T06:41:19.931464+0000","last_clean":"2023-11-20T06:41:19.931464+0000","last_became_active":"2023-11-20T06:41:14.273690+0000","last_became_peered":"2023-11-20T06:41:14.273690+0000","last_unstale":"2023-11-20T06:41:19.931464+0000","last_undegraded":"2023-11-20T06:41:19.931464+0000","last_fullsized":"2023-11-20T06:41:19.931464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:49:32.579328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787724+0000","last_change":"2023-11-20T06:41:13.257423+0000","last_active":"2023-11-20T06:41:19.787724+0000","last_peered":"2023-11-20T06:41:19.787724+0000","last_clean":"2023-11-20T06:41:19.787724+0000","last_became_active":"2023-11-20T06:41:13.256548+0000","last_became_peered":"2023-11-20T06:41:13.256548+0000","last_unstale":"2023-11-20T06:41:19.787724+0000","last_undegraded":"2023-11-20T06:41:19.787724+0000","last_fullsized":"2023-11-20T06:41:19.787724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:56:08.376468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.313587+0000","last_change":"2023-11-20T06:41:18.898144+0000","last_active":"2023-11-20T06:41:20.313587+0000","last_peered":"2023-11-20T06:41:20.313587+0000","last_clean":"2023-11-20T06:41:20.313587+0000","last_became_active":"2023-11-20T06:41:18.897259+0000","last_became_peered":"2023-11-20T06:41:18.897259+0000","last_unstale":"2023-11-20T06:41:20.313587+0000","last_undegraded":"2023-11-20T06:41:20.313587+0000","last_fullsized":"2023-11-20T06:41:20.313587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:21:39.903978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578463+0000","last_change":"2023-11-20T06:41:14.265376+0000","last_active":"2023-11-20T06:41:19.578463+0000","last_peered":"2023-11-20T06:41:19.578463+0000","last_clean":"2023-11-20T06:41:19.578463+0000","last_became_active":"2023-11-20T06:41:14.264937+0000","last_became_peered":"2023-11-20T06:41:14.264937+0000","last_unstale":"2023-11-20T06:41:19.578463+0000","last_undegraded":"2023-11-20T06:41:19.578463+0000","last_fullsized":"2023-11-20T06:41:19.578463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:21.473575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578629+0000","last_change":"2023-11-20T06:41:13.239163+0000","last_active":"2023-11-20T06:41:19.578629+0000","last_peered":"2023-11-20T06:41:19.578629+0000","last_clean":"2023-11-20T06:41:19.578629+0000","last_became_active":"2023-11-20T06:41:13.238828+0000","last_became_peered":"2023-11-20T06:41:13.238828+0000","last_unstale":"2023-11-20T06:41:19.578629+0000","last_undegraded":"2023-11-20T06:41:19.578629+0000","last_fullsized":"2023-11-20T06:41:19.578629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:13:29.783988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.317093+0000","last_change":"2023-11-20T06:41:18.899795+0000","last_active":"2023-11-20T06:41:20.317093+0000","last_peered":"2023-11-20T06:41:20.317093+0000","last_clean":"2023-11-20T06:41:20.317093+0000","last_became_active":"2023-11-20T06:41:18.899270+0000","last_became_peered":"2023-11-20T06:41:18.899270+0000","last_unstale":"2023-11-20T06:41:20.317093+0000","last_undegraded":"2023-11-20T06:41:20.317093+0000","last_fullsized":"2023-11-20T06:41:20.317093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:13:29.540284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931226+0000","last_change":"2023-11-20T06:41:14.275627+0000","last_active":"2023-11-20T06:41:19.931226+0000","last_peered":"2023-11-20T06:41:19.931226+0000","last_clean":"2023-11-20T06:41:19.931226+0000","last_became_active":"2023-11-20T06:41:14.272890+0000","last_became_peered":"2023-11-20T06:41:14.272890+0000","last_unstale":"2023-11-20T06:41:19.931226+0000","last_undegraded":"2023-11-20T06:41:19.931226+0000","last_fullsized":"2023-11-20T06:41:19.931226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:20:01.827771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:29.363554+0000","last_change":"2023-11-20T06:41:13.245874+0000","last_active":"2023-11-20T06:41:29.363554+0000","last_peered":"2023-11-20T06:41:29.363554+0000","last_clean":"2023-11-20T06:41:29.363554+0000","last_became_active":"2023-11-20T06:41:13.245454+0000","last_became_peered":"2023-11-20T06:41:13.245454+0000","last_unstale":"2023-11-20T06:41:29.363554+0000","last_undegraded":"2023-11-20T06:41:29.363554+0000","last_fullsized":"2023-11-20T06:41:29.363554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:56:08.376468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.743578+0000","last_change":"2023-11-20T06:41:18.299146+0000","last_active":"2023-11-20T06:41:20.743578+0000","last_peered":"2023-11-20T06:41:20.743578+0000","last_clean":"2023-11-20T06:41:20.743578+0000","last_became_active":"2023-11-20T06:41:18.298722+0000","last_became_peered":"2023-11-20T06:41:18.298722+0000","last_unstale":"2023-11-20T06:41:20.743578+0000","last_undegraded":"2023-11-20T06:41:20.743578+0000","last_fullsized":"2023-11-20T06:41:20.743578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:25:06.683699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315269+0000","last_change":"2023-11-20T06:41:14.263229+0000","last_active":"2023-11-20T06:41:19.315269+0000","last_peered":"2023-11-20T06:41:19.315269+0000","last_clean":"2023-11-20T06:41:19.315269+0000","last_became_active":"2023-11-20T06:41:14.262970+0000","last_became_peered":"2023-11-20T06:41:14.262970+0000","last_unstale":"2023-11-20T06:41:19.315269+0000","last_undegraded":"2023-11-20T06:41:19.315269+0000","last_fullsized":"2023-11-20T06:41:19.315269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:15:34.522340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662861+0000","last_change":"2023-11-20T06:41:13.238315+0000","last_active":"2023-11-20T06:41:19.662861+0000","last_peered":"2023-11-20T06:41:19.662861+0000","last_clean":"2023-11-20T06:41:19.662861+0000","last_became_active":"2023-11-20T06:41:13.237159+0000","last_became_peered":"2023-11-20T06:41:13.237159+0000","last_unstale":"2023-11-20T06:41:19.662861+0000","last_undegraded":"2023-11-20T06:41:19.662861+0000","last_fullsized":"2023-11-20T06:41:19.662861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:56:08.376468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.316149+0000","last_change":"2023-11-20T06:41:18.301654+0000","last_active":"2023-11-20T06:41:20.316149+0000","last_peered":"2023-11-20T06:41:20.316149+0000","last_clean":"2023-11-20T06:41:20.316149+0000","last_became_active":"2023-11-20T06:41:18.301243+0000","last_became_peered":"2023-11-20T06:41:18.301243+0000","last_unstale":"2023-11-20T06:41:20.316149+0000","last_undegraded":"2023-11-20T06:41:20.316149+0000","last_fullsized":"2023-11-20T06:41:20.316149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:13:30.194807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578630+0000","last_change":"2023-11-20T06:41:14.251212+0000","last_active":"2023-11-20T06:41:19.578630+0000","last_peered":"2023-11-20T06:41:19.578630+0000","last_clean":"2023-11-20T06:41:19.578630+0000","last_became_active":"2023-11-20T06:41:14.250584+0000","last_became_peered":"2023-11-20T06:41:14.250584+0000","last_unstale":"2023-11-20T06:41:19.578630+0000","last_undegraded":"2023-11-20T06:41:19.578630+0000","last_fullsized":"2023-11-20T06:41:19.578630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:35:30.568821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.788069+0000","last_change":"2023-11-20T06:41:13.255026+0000","last_active":"2023-11-20T06:41:19.788069+0000","last_peered":"2023-11-20T06:41:19.788069+0000","last_clean":"2023-11-20T06:41:19.788069+0000","last_became_active":"2023-11-20T06:41:13.254057+0000","last_became_peered":"2023-11-20T06:41:13.254057+0000","last_unstale":"2023-11-20T06:41:19.788069+0000","last_undegraded":"2023-11-20T06:41:19.788069+0000","last_fullsized":"2023-11-20T06:41:19.788069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:01:37.302430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.313428+0000","last_change":"2023-11-20T06:41:18.295335+0000","last_active":"2023-11-20T06:41:20.313428+0000","last_peered":"2023-11-20T06:41:20.313428+0000","last_clean":"2023-11-20T06:41:20.313428+0000","last_became_active":"2023-11-20T06:41:18.294740+0000","last_became_peered":"2023-11-20T06:41:18.294740+0000","last_unstale":"2023-11-20T06:41:20.313428+0000","last_undegraded":"2023-11-20T06:41:20.313428+0000","last_fullsized":"2023-11-20T06:41:20.313428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:52:52.872039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.788050+0000","last_change":"2023-11-20T06:41:14.276548+0000","last_active":"2023-11-20T06:41:19.788050+0000","last_peered":"2023-11-20T06:41:19.788050+0000","last_clean":"2023-11-20T06:41:19.788050+0000","last_became_active":"2023-11-20T06:41:14.261629+0000","last_became_peered":"2023-11-20T06:41:14.261629+0000","last_unstale":"2023-11-20T06:41:19.788050+0000","last_undegraded":"2023-11-20T06:41:19.788050+0000","last_fullsized":"2023-11-20T06:41:19.788050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:49:32.579328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315706+0000","last_change":"2023-11-20T06:41:13.258736+0000","last_active":"2023-11-20T06:41:19.315706+0000","last_peered":"2023-11-20T06:41:19.315706+0000","last_clean":"2023-11-20T06:41:19.315706+0000","last_became_active":"2023-11-20T06:41:13.258459+0000","last_became_peered":"2023-11-20T06:41:13.258459+0000","last_unstale":"2023-11-20T06:41:19.315706+0000","last_undegraded":"2023-11-20T06:41:19.315706+0000","last_fullsized":"2023-11-20T06:41:19.315706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:16:12.804737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.313326+0000","last_change":"2023-11-20T06:41:18.897111+0000","last_active":"2023-11-20T06:41:20.313326+0000","last_peered":"2023-11-20T06:41:20.313326+0000","last_clean":"2023-11-20T06:41:20.313326+0000","last_became_active":"2023-11-20T06:41:18.896661+0000","last_became_peered":"2023-11-20T06:41:18.896661+0000","last_unstale":"2023-11-20T06:41:20.313326+0000","last_undegraded":"2023-11-20T06:41:20.313326+0000","last_fullsized":"2023-11-20T06:41:20.313326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:19:44.001789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.679176+0000","last_change":"2023-11-20T06:41:18.900073+0000","last_active":"2023-11-20T06:41:20.679176+0000","last_peered":"2023-11-20T06:41:20.679176+0000","last_clean":"2023-11-20T06:41:20.679176+0000","last_became_active":"2023-11-20T06:41:18.898514+0000","last_became_peered":"2023-11-20T06:41:18.898514+0000","last_unstale":"2023-11-20T06:41:20.679176+0000","last_undegraded":"2023-11-20T06:41:20.679176+0000","last_fullsized":"2023-11-20T06:41:20.679176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:49:09.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.661897+0000","last_change":"2023-11-20T06:41:14.264028+0000","last_active":"2023-11-20T06:41:19.661897+0000","last_peered":"2023-11-20T06:41:19.661897+0000","last_clean":"2023-11-20T06:41:19.661897+0000","last_became_active":"2023-11-20T06:41:14.263528+0000","last_became_peered":"2023-11-20T06:41:14.263528+0000","last_unstale":"2023-11-20T06:41:19.661897+0000","last_undegraded":"2023-11-20T06:41:19.661897+0000","last_fullsized":"2023-11-20T06:41:19.661897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:06:44.444162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787639+0000","last_change":"2023-11-20T06:41:13.247680+0000","last_active":"2023-11-20T06:41:19.787639+0000","last_peered":"2023-11-20T06:41:19.787639+0000","last_clean":"2023-11-20T06:41:19.787639+0000","last_became_active":"2023-11-20T06:41:13.247333+0000","last_became_peered":"2023-11-20T06:41:13.247333+0000","last_unstale":"2023-11-20T06:41:19.787639+0000","last_undegraded":"2023-11-20T06:41:19.787639+0000","last_fullsized":"2023-11-20T06:41:19.787639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:42:52.596731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.746665+0000","last_change":"2023-11-20T06:41:18.306274+0000","last_active":"2023-11-20T06:41:20.746665+0000","last_peered":"2023-11-20T06:41:20.746665+0000","last_clean":"2023-11-20T06:41:20.746665+0000","last_became_active":"2023-11-20T06:41:18.305628+0000","last_became_peered":"2023-11-20T06:41:18.305628+0000","last_unstale":"2023-11-20T06:41:20.746665+0000","last_undegraded":"2023-11-20T06:41:20.746665+0000","last_fullsized":"2023-11-20T06:41:20.746665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:13:30.194807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583459+0000","last_change":"2023-11-20T06:41:14.268805+0000","last_active":"2023-11-20T06:41:19.583459+0000","last_peered":"2023-11-20T06:41:19.583459+0000","last_clean":"2023-11-20T06:41:19.583459+0000","last_became_active":"2023-11-20T06:41:14.268489+0000","last_became_peered":"2023-11-20T06:41:14.268489+0000","last_unstale":"2023-11-20T06:41:19.583459+0000","last_undegraded":"2023-11-20T06:41:19.583459+0000","last_fullsized":"2023-11-20T06:41:19.583459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:06:44.444162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583458+0000","last_change":"2023-11-20T06:41:13.242442+0000","last_active":"2023-11-20T06:41:19.583458+0000","last_peered":"2023-11-20T06:41:19.583458+0000","last_clean":"2023-11-20T06:41:19.583458+0000","last_became_active":"2023-11-20T06:41:13.242113+0000","last_became_peered":"2023-11-20T06:41:13.242113+0000","last_unstale":"2023-11-20T06:41:19.583458+0000","last_undegraded":"2023-11-20T06:41:19.583458+0000","last_fullsized":"2023-11-20T06:41:19.583458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:54:25.014221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314850+0000","last_change":"2023-11-20T06:41:13.246961+0000","last_active":"2023-11-20T06:41:19.314850+0000","last_peered":"2023-11-20T06:41:19.314850+0000","last_clean":"2023-11-20T06:41:19.314850+0000","last_became_active":"2023-11-20T06:41:13.245832+0000","last_became_peered":"2023-11-20T06:41:13.245832+0000","last_unstale":"2023-11-20T06:41:19.314850+0000","last_undegraded":"2023-11-20T06:41:19.314850+0000","last_fullsized":"2023-11-20T06:41:19.314850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:01:37.302430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578545+0000","last_change":"2023-11-20T06:41:14.263883+0000","last_active":"2023-11-20T06:41:19.578545+0000","last_peered":"2023-11-20T06:41:19.578545+0000","last_clean":"2023-11-20T06:41:19.578545+0000","last_became_active":"2023-11-20T06:41:14.263575+0000","last_became_peered":"2023-11-20T06:41:14.263575+0000","last_unstale":"2023-11-20T06:41:19.578545+0000","last_undegraded":"2023-11-20T06:41:19.578545+0000","last_fullsized":"2023-11-20T06:41:19.578545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:03:05.538623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.590487+0000","last_change":"2023-11-20T06:41:18.306473+0000","last_active":"2023-11-20T06:41:20.590487+0000","last_peered":"2023-11-20T06:41:20.590487+0000","last_clean":"2023-11-20T06:41:20.590487+0000","last_became_active":"2023-11-20T06:41:18.305307+0000","last_became_peered":"2023-11-20T06:41:18.305307+0000","last_unstale":"2023-11-20T06:41:20.590487+0000","last_undegraded":"2023-11-20T06:41:20.590487+0000","last_fullsized":"2023-11-20T06:41:20.590487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:25.525606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583794+0000","last_change":"2023-11-20T06:41:13.244143+0000","last_active":"2023-11-20T06:41:19.583794+0000","last_peered":"2023-11-20T06:41:19.583794+0000","last_clean":"2023-11-20T06:41:19.583794+0000","last_became_active":"2023-11-20T06:41:13.242220+0000","last_became_peered":"2023-11-20T06:41:13.242220+0000","last_unstale":"2023-11-20T06:41:19.583794+0000","last_undegraded":"2023-11-20T06:41:19.583794+0000","last_fullsized":"2023-11-20T06:41:19.583794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:16:12.804737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.313569+0000","last_change":"2023-11-20T06:41:14.266403+0000","last_active":"2023-11-20T06:41:19.313569+0000","last_peered":"2023-11-20T06:41:19.313569+0000","last_clean":"2023-11-20T06:41:19.313569+0000","last_became_active":"2023-11-20T06:41:14.266135+0000","last_became_peered":"2023-11-20T06:41:14.266135+0000","last_unstale":"2023-11-20T06:41:19.313569+0000","last_undegraded":"2023-11-20T06:41:19.313569+0000","last_fullsized":"2023-11-20T06:41:19.313569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:48:13.769350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.314045+0000","last_change":"2023-11-20T06:41:18.299944+0000","last_active":"2023-11-20T06:41:20.314045+0000","last_peered":"2023-11-20T06:41:20.314045+0000","last_clean":"2023-11-20T06:41:20.314045+0000","last_became_active":"2023-11-20T06:41:18.298166+0000","last_became_peered":"2023-11-20T06:41:18.298166+0000","last_unstale":"2023-11-20T06:41:20.314045+0000","last_undegraded":"2023-11-20T06:41:20.314045+0000","last_fullsized":"2023-11-20T06:41:20.314045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:15:14.873283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314208+0000","last_change":"2023-11-20T06:41:14.274186+0000","last_active":"2023-11-20T06:41:19.314208+0000","last_peered":"2023-11-20T06:41:19.314208+0000","last_clean":"2023-11-20T06:41:19.314208+0000","last_became_active":"2023-11-20T06:41:14.273726+0000","last_became_peered":"2023-11-20T06:41:14.273726+0000","last_unstale":"2023-11-20T06:41:19.314208+0000","last_undegraded":"2023-11-20T06:41:19.314208+0000","last_fullsized":"2023-11-20T06:41:19.314208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:36:44.079776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.309592+0000","last_change":"2023-11-20T06:41:14.256793+0000","last_active":"2023-11-20T06:41:19.309592+0000","last_peered":"2023-11-20T06:41:19.309592+0000","last_clean":"2023-11-20T06:41:19.309592+0000","last_became_active":"2023-11-20T06:41:14.256478+0000","last_became_peered":"2023-11-20T06:41:14.256478+0000","last_unstale":"2023-11-20T06:41:19.309592+0000","last_undegraded":"2023-11-20T06:41:19.309592+0000","last_fullsized":"2023-11-20T06:41:19.309592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:15:34.522340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787630+0000","last_change":"2023-11-20T06:41:14.277266+0000","last_active":"2023-11-20T06:41:19.787630+0000","last_peered":"2023-11-20T06:41:19.787630+0000","last_clean":"2023-11-20T06:41:19.787630+0000","last_became_active":"2023-11-20T06:41:14.276909+0000","last_became_peered":"2023-11-20T06:41:14.276909+0000","last_unstale":"2023-11-20T06:41:19.787630+0000","last_undegraded":"2023-11-20T06:41:19.787630+0000","last_fullsized":"2023-11-20T06:41:19.787630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:27:59.872035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578469+0000","last_change":"2023-11-20T06:41:14.264602+0000","last_active":"2023-11-20T06:41:19.578469+0000","last_peered":"2023-11-20T06:41:19.578469+0000","last_clean":"2023-11-20T06:41:19.578469+0000","last_became_active":"2023-11-20T06:41:14.264256+0000","last_became_peered":"2023-11-20T06:41:14.264256+0000","last_unstale":"2023-11-20T06:41:19.578469+0000","last_undegraded":"2023-11-20T06:41:19.578469+0000","last_fullsized":"2023-11-20T06:41:19.578469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:06:44.444162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583903+0000","last_change":"2023-11-20T06:41:14.257660+0000","last_active":"2023-11-20T06:41:19.583903+0000","last_peered":"2023-11-20T06:41:19.583903+0000","last_clean":"2023-11-20T06:41:19.583903+0000","last_became_active":"2023-11-20T06:41:14.257461+0000","last_became_peered":"2023-11-20T06:41:14.257461+0000","last_unstale":"2023-11-20T06:41:19.583903+0000","last_undegraded":"2023-11-20T06:41:19.583903+0000","last_fullsized":"2023-11-20T06:41:19.583903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:55:30.603010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662377+0000","last_change":"2023-11-20T06:41:14.266691+0000","last_active":"2023-11-20T06:41:19.662377+0000","last_peered":"2023-11-20T06:41:19.662377+0000","last_clean":"2023-11-20T06:41:19.662377+0000","last_became_active":"2023-11-20T06:41:14.266401+0000","last_became_peered":"2023-11-20T06:41:14.266401+0000","last_unstale":"2023-11-20T06:41:19.662377+0000","last_undegraded":"2023-11-20T06:41:19.662377+0000","last_fullsized":"2023-11-20T06:41:19.662377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:08:41.021374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315058+0000","last_change":"2023-11-20T06:41:14.266874+0000","last_active":"2023-11-20T06:41:19.315058+0000","last_peered":"2023-11-20T06:41:19.315058+0000","last_clean":"2023-11-20T06:41:19.315058+0000","last_became_active":"2023-11-20T06:41:14.266564+0000","last_became_peered":"2023-11-20T06:41:14.266564+0000","last_unstale":"2023-11-20T06:41:19.315058+0000","last_undegraded":"2023-11-20T06:41:19.315058+0000","last_fullsized":"2023-11-20T06:41:19.315058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:35:30.568821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.584279+0000","last_change":"2023-11-20T06:41:14.258127+0000","last_active":"2023-11-20T06:41:19.584279+0000","last_peered":"2023-11-20T06:41:19.584279+0000","last_clean":"2023-11-20T06:41:19.584279+0000","last_became_active":"2023-11-20T06:41:14.257873+0000","last_became_peered":"2023-11-20T06:41:14.257873+0000","last_unstale":"2023-11-20T06:41:19.584279+0000","last_undegraded":"2023-11-20T06:41:19.584279+0000","last_fullsized":"2023-11-20T06:41:19.584279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:07:43.904895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787515+0000","last_change":"2023-11-20T06:41:14.271045+0000","last_active":"2023-11-20T06:41:19.787515+0000","last_peered":"2023-11-20T06:41:19.787515+0000","last_clean":"2023-11-20T06:41:19.787515+0000","last_became_active":"2023-11-20T06:41:14.265731+0000","last_became_peered":"2023-11-20T06:41:14.265731+0000","last_unstale":"2023-11-20T06:41:19.787515+0000","last_undegraded":"2023-11-20T06:41:19.787515+0000","last_fullsized":"2023-11-20T06:41:19.787515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:45.059330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583398+0000","last_change":"2023-11-20T06:41:14.259066+0000","last_active":"2023-11-20T06:41:19.583398+0000","last_peered":"2023-11-20T06:41:19.583398+0000","last_clean":"2023-11-20T06:41:19.583398+0000","last_became_active":"2023-11-20T06:41:14.258818+0000","last_became_peered":"2023-11-20T06:41:14.258818+0000","last_unstale":"2023-11-20T06:41:19.583398+0000","last_undegraded":"2023-11-20T06:41:19.583398+0000","last_fullsized":"2023-11-20T06:41:19.583398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:03:05.538623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787570+0000","last_change":"2023-11-20T06:41:14.275181+0000","last_active":"2023-11-20T06:41:19.787570+0000","last_peered":"2023-11-20T06:41:19.787570+0000","last_clean":"2023-11-20T06:41:19.787570+0000","last_became_active":"2023-11-20T06:41:14.268467+0000","last_became_peered":"2023-11-20T06:41:14.268467+0000","last_unstale":"2023-11-20T06:41:19.787570+0000","last_undegraded":"2023-11-20T06:41:19.787570+0000","last_fullsized":"2023-11-20T06:41:19.787570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:55:30.603010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578862+0000","last_change":"2023-11-20T06:41:14.270268+0000","last_active":"2023-11-20T06:41:19.578862+0000","last_peered":"2023-11-20T06:41:19.578862+0000","last_clean":"2023-11-20T06:41:19.578862+0000","last_became_active":"2023-11-20T06:41:14.270056+0000","last_became_peered":"2023-11-20T06:41:14.270056+0000","last_unstale":"2023-11-20T06:41:19.578862+0000","last_undegraded":"2023-11-20T06:41:19.578862+0000","last_fullsized":"2023-11-20T06:41:19.578862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:36:44.079776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315115+0000","last_change":"2023-11-20T06:41:14.269251+0000","last_active":"2023-11-20T06:41:19.315115+0000","last_peered":"2023-11-20T06:41:19.315115+0000","last_clean":"2023-11-20T06:41:19.315115+0000","last_became_active":"2023-11-20T06:41:14.267320+0000","last_became_peered":"2023-11-20T06:41:14.267320+0000","last_unstale":"2023-11-20T06:41:19.315115+0000","last_undegraded":"2023-11-20T06:41:19.315115+0000","last_fullsized":"2023-11-20T06:41:19.315115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:42:53.602834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931525+0000","last_change":"2023-11-20T06:41:14.273161+0000","last_active":"2023-11-20T06:41:19.931525+0000","last_peered":"2023-11-20T06:41:19.931525+0000","last_clean":"2023-11-20T06:41:19.931525+0000","last_became_active":"2023-11-20T06:41:14.272837+0000","last_became_peered":"2023-11-20T06:41:14.272837+0000","last_unstale":"2023-11-20T06:41:19.931525+0000","last_undegraded":"2023-11-20T06:41:19.931525+0000","last_fullsized":"2023-11-20T06:41:19.931525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:16:48.088330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.310361+0000","last_change":"2023-11-20T06:41:14.272286+0000","last_active":"2023-11-20T06:41:19.310361+0000","last_peered":"2023-11-20T06:41:19.310361+0000","last_clean":"2023-11-20T06:41:19.310361+0000","last_became_active":"2023-11-20T06:41:14.258570+0000","last_became_peered":"2023-11-20T06:41:14.258570+0000","last_unstale":"2023-11-20T06:41:19.310361+0000","last_undegraded":"2023-11-20T06:41:19.310361+0000","last_fullsized":"2023-11-20T06:41:19.310361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:27:02.569616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.788326+0000","last_change":"2023-11-20T06:41:14.275187+0000","last_active":"2023-11-20T06:41:19.788326+0000","last_peered":"2023-11-20T06:41:19.788326+0000","last_clean":"2023-11-20T06:41:19.788326+0000","last_became_active":"2023-11-20T06:41:14.270334+0000","last_became_peered":"2023-11-20T06:41:14.270334+0000","last_unstale":"2023-11-20T06:41:19.788326+0000","last_undegraded":"2023-11-20T06:41:19.788326+0000","last_fullsized":"2023-11-20T06:41:19.788326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:45:50.281694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787513+0000","last_change":"2023-11-20T06:41:14.272042+0000","last_active":"2023-11-20T06:41:19.787513+0000","last_peered":"2023-11-20T06:41:19.787513+0000","last_clean":"2023-11-20T06:41:19.787513+0000","last_became_active":"2023-11-20T06:41:14.271776+0000","last_became_peered":"2023-11-20T06:41:14.271776+0000","last_unstale":"2023-11-20T06:41:19.787513+0000","last_undegraded":"2023-11-20T06:41:19.787513+0000","last_fullsized":"2023-11-20T06:41:19.787513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:25.537288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662034+0000","last_change":"2023-11-20T06:41:14.265036+0000","last_active":"2023-11-20T06:41:19.662034+0000","last_peered":"2023-11-20T06:41:19.662034+0000","last_clean":"2023-11-20T06:41:19.662034+0000","last_became_active":"2023-11-20T06:41:14.264757+0000","last_became_peered":"2023-11-20T06:41:14.264757+0000","last_unstale":"2023-11-20T06:41:19.662034+0000","last_undegraded":"2023-11-20T06:41:19.662034+0000","last_fullsized":"2023-11-20T06:41:19.662034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:03:05.538623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578415+0000","last_change":"2023-11-20T06:41:14.263606+0000","last_active":"2023-11-20T06:41:19.578415+0000","last_peered":"2023-11-20T06:41:19.578415+0000","last_clean":"2023-11-20T06:41:19.578415+0000","last_became_active":"2023-11-20T06:41:14.263046+0000","last_became_peered":"2023-11-20T06:41:14.263046+0000","last_unstale":"2023-11-20T06:41:19.578415+0000","last_undegraded":"2023-11-20T06:41:19.578415+0000","last_fullsized":"2023-11-20T06:41:19.578415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:56:09.382571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583697+0000","last_change":"2023-11-20T06:41:14.261028+0000","last_active":"2023-11-20T06:41:19.583697+0000","last_peered":"2023-11-20T06:41:19.583697+0000","last_clean":"2023-11-20T06:41:19.583697+0000","last_became_active":"2023-11-20T06:41:14.257826+0000","last_became_peered":"2023-11-20T06:41:14.257826+0000","last_unstale":"2023-11-20T06:41:19.583697+0000","last_undegraded":"2023-11-20T06:41:19.583697+0000","last_fullsized":"2023-11-20T06:41:19.583697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:08:41.021374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315274+0000","last_change":"2023-11-20T06:41:14.269257+0000","last_active":"2023-11-20T06:41:19.315274+0000","last_peered":"2023-11-20T06:41:19.315274+0000","last_clean":"2023-11-20T06:41:19.315274+0000","last_became_active":"2023-11-20T06:41:14.264896+0000","last_became_peered":"2023-11-20T06:41:14.264896+0000","last_unstale":"2023-11-20T06:41:19.315274+0000","last_undegraded":"2023-11-20T06:41:19.315274+0000","last_fullsized":"2023-11-20T06:41:19.315274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:54:26.020324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315416+0000","last_change":"2023-11-20T06:41:14.282030+0000","last_active":"2023-11-20T06:41:19.315416+0000","last_peered":"2023-11-20T06:41:19.315416+0000","last_clean":"2023-11-20T06:41:19.315416+0000","last_became_active":"2023-11-20T06:41:14.281723+0000","last_became_peered":"2023-11-20T06:41:14.281723+0000","last_unstale":"2023-11-20T06:41:19.315416+0000","last_undegraded":"2023-11-20T06:41:19.315416+0000","last_fullsized":"2023-11-20T06:41:19.315416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:08:41.021374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314963+0000","last_change":"2023-11-20T06:41:14.281916+0000","last_active":"2023-11-20T06:41:19.314963+0000","last_peered":"2023-11-20T06:41:19.314963+0000","last_clean":"2023-11-20T06:41:19.314963+0000","last_became_active":"2023-11-20T06:41:14.281641+0000","last_became_peered":"2023-11-20T06:41:14.281641+0000","last_unstale":"2023-11-20T06:41:19.314963+0000","last_undegraded":"2023-11-20T06:41:19.314963+0000","last_fullsized":"2023-11-20T06:41:19.314963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:25.537288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931727+0000","last_change":"2023-11-20T06:41:14.284924+0000","last_active":"2023-11-20T06:41:19.931727+0000","last_peered":"2023-11-20T06:41:19.931727+0000","last_clean":"2023-11-20T06:41:19.931727+0000","last_became_active":"2023-11-20T06:41:14.284654+0000","last_became_peered":"2023-11-20T06:41:14.284654+0000","last_unstale":"2023-11-20T06:41:19.931727+0000","last_undegraded":"2023-11-20T06:41:19.931727+0000","last_fullsized":"2023-11-20T06:41:19.931727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:13:26.142776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583308+0000","last_change":"2023-11-20T06:41:14.271513+0000","last_active":"2023-11-20T06:41:19.583308+0000","last_peered":"2023-11-20T06:41:19.583308+0000","last_clean":"2023-11-20T06:41:19.583308+0000","last_became_active":"2023-11-20T06:41:14.271045+0000","last_became_peered":"2023-11-20T06:41:14.271045+0000","last_unstale":"2023-11-20T06:41:19.583308+0000","last_undegraded":"2023-11-20T06:41:19.583308+0000","last_fullsized":"2023-11-20T06:41:19.583308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:36:44.079776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931144+0000","last_change":"2023-11-20T06:41:14.269364+0000","last_active":"2023-11-20T06:41:19.931144+0000","last_peered":"2023-11-20T06:41:19.931144+0000","last_clean":"2023-11-20T06:41:19.931144+0000","last_became_active":"2023-11-20T06:41:14.269091+0000","last_became_peered":"2023-11-20T06:41:14.269091+0000","last_unstale":"2023-11-20T06:41:19.931144+0000","last_undegraded":"2023-11-20T06:41:19.931144+0000","last_fullsized":"2023-11-20T06:41:19.931144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:07:43.904895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787491+0000","last_change":"2023-11-20T06:41:14.275911+0000","last_active":"2023-11-20T06:41:19.787491+0000","last_peered":"2023-11-20T06:41:19.787491+0000","last_clean":"2023-11-20T06:41:19.787491+0000","last_became_active":"2023-11-20T06:41:14.275285+0000","last_became_peered":"2023-11-20T06:41:14.275285+0000","last_unstale":"2023-11-20T06:41:19.787491+0000","last_undegraded":"2023-11-20T06:41:19.787491+0000","last_fullsized":"2023-11-20T06:41:19.787491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:08:41.021374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931288+0000","last_change":"2023-11-20T06:41:14.271029+0000","last_active":"2023-11-20T06:41:19.931288+0000","last_peered":"2023-11-20T06:41:19.931288+0000","last_clean":"2023-11-20T06:41:19.931288+0000","last_became_active":"2023-11-20T06:41:14.269917+0000","last_became_peered":"2023-11-20T06:41:14.269917+0000","last_unstale":"2023-11-20T06:41:19.931288+0000","last_undegraded":"2023-11-20T06:41:19.931288+0000","last_fullsized":"2023-11-20T06:41:19.931288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:45.059330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787805+0000","last_change":"2023-11-20T06:41:14.277449+0000","last_active":"2023-11-20T06:41:19.787805+0000","last_peered":"2023-11-20T06:41:19.787805+0000","last_clean":"2023-11-20T06:41:19.787805+0000","last_became_active":"2023-11-20T06:41:14.277166+0000","last_became_peered":"2023-11-20T06:41:14.277166+0000","last_unstale":"2023-11-20T06:41:19.787805+0000","last_undegraded":"2023-11-20T06:41:19.787805+0000","last_fullsized":"2023-11-20T06:41:19.787805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:35:30.568821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578392+0000","last_change":"2023-11-20T06:41:14.253214+0000","last_active":"2023-11-20T06:41:19.578392+0000","last_peered":"2023-11-20T06:41:19.578392+0000","last_clean":"2023-11-20T06:41:19.578392+0000","last_became_active":"2023-11-20T06:41:14.252882+0000","last_became_peered":"2023-11-20T06:41:14.252882+0000","last_unstale":"2023-11-20T06:41:19.578392+0000","last_undegraded":"2023-11-20T06:41:19.578392+0000","last_fullsized":"2023-11-20T06:41:19.578392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:42:53.602834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.663050+0000","last_change":"2023-11-20T06:41:14.268127+0000","last_active":"2023-11-20T06:41:19.663050+0000","last_peered":"2023-11-20T06:41:19.663050+0000","last_clean":"2023-11-20T06:41:19.663050+0000","last_became_active":"2023-11-20T06:41:14.267318+0000","last_became_peered":"2023-11-20T06:41:14.267318+0000","last_unstale":"2023-11-20T06:41:19.663050+0000","last_undegraded":"2023-11-20T06:41:19.663050+0000","last_fullsized":"2023-11-20T06:41:19.663050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:35:30.568821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931671+0000","last_change":"2023-11-20T06:41:14.265577+0000","last_active":"2023-11-20T06:41:19.931671+0000","last_peered":"2023-11-20T06:41:19.931671+0000","last_clean":"2023-11-20T06:41:19.931671+0000","last_became_active":"2023-11-20T06:41:14.263538+0000","last_became_peered":"2023-11-20T06:41:14.263538+0000","last_unstale":"2023-11-20T06:41:19.931671+0000","last_undegraded":"2023-11-20T06:41:19.931671+0000","last_fullsized":"2023-11-20T06:41:19.931671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:45:50.281694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":697795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":110686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":106935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":106971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":110686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":106845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":696832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T06:41:39.497 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T06:41:39.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.667+0000 7f441fe9c640 1 Processor -- start 2023-11-20T06:41:39.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.667+0000 7f441fe9c640 1 -- start start 2023-11-20T06:41:39.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.667+0000 7f441fe9c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f44180b1750 0x7f44180b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.667+0000 7f441fe9c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4418069e90 0x7f441806a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.667+0000 7f441fe9c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441815aef0 con 0x7f441815ab10 2023-11-20T06:41:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.667+0000 7f441fe9c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441806a860 con 0x7f44180b1750 2023-11-20T06:41:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.667+0000 7f441fe9c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44180c9620 con 0x7f4418069e90 2023-11-20T06:41:39.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.671+0000 7f441e439640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4418069e90 0x7f441806a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:39.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.671+0000 7f441e439640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4418069e90 0x7f441806a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:41728/0 (socket says 172.21.15.19:41728) 2023-11-20T06:41:39.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.671+0000 7f441e439640 1 -- 172.21.15.19:0/2682283042 learned_addr learned my addr 172.21.15.19:0/2682283042 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:39.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.671+0000 7f441d437640 1 --2- 172.21.15.19:0/2682283042 >> v2:172.21.15.190:3300/0 conn(0x7f44180b1750 0x7f44180b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:39.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.671+0000 7f441e439640 1 -- 172.21.15.19:0/2682283042 >> v2:172.21.15.190:3300/0 conn(0x7f44180b1750 msgr2=0x7f44180b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:39.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.671+0000 7f441e439640 1 --2- 172.21.15.19:0/2682283042 >> v2:172.21.15.190:3300/0 conn(0x7f44180b1750 0x7f44180b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.671+0000 7f441cc36640 1 -- 172.21.15.19:0/2682283042 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273570788 0 0) 0x7f441815aef0 con 0x7f441815ab10 2023-11-20T06:41:39.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.671+0000 7f441e439640 1 -- 172.21.15.19:0/2682283042 >> v1:172.21.15.190:6789/0 conn(0x7f441815ab10 legacy=0x7f44180b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:39.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.671+0000 7f441e439640 1 -- 172.21.15.19:0/2682283042 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44180c9900 con 0x7f4418069e90 2023-11-20T06:41:39.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.671+0000 7f441e439640 1 --2- 172.21.15.19:0/2682283042 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4418069e90 0x7f441806a320 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4410009e50 tx=0x7f441001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b993440600638747 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:39.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441cc36640 1 -- 172.21.15.19:0/2682283042 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44100a5810 con 0x7f4418069e90 2023-11-20T06:41:39.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441cc36640 1 -- 172.21.15.19:0/2682283042 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44100a5970 con 0x7f4418069e90 2023-11-20T06:41:39.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441cc36640 1 -- 172.21.15.19:0/2682283042 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44100a5d00 con 0x7f4418069e90 2023-11-20T06:41:39.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441fe9c640 1 -- 172.21.15.19:0/2682283042 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4418069e90 msgr2=0x7f441806a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:39.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441fe9c640 1 --2- 172.21.15.19:0/2682283042 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4418069e90 0x7f441806a320 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4410009e50 tx=0x7f441001c950 comp rx=0 tx=0).stop 2023-11-20T06:41:39.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441fe9c640 1 -- 172.21.15.19:0/2682283042 shutdown_connections 2023-11-20T06:41:39.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441fe9c640 1 --2- 172.21.15.19:0/2682283042 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4418069e90 0x7f441806a320 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441fe9c640 1 --2- 172.21.15.19:0/2682283042 >> v2:172.21.15.190:3300/0 conn(0x7f44180b1750 0x7f44180b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441fe9c640 1 -- 172.21.15.19:0/2682283042 >> 172.21.15.19:0/2682283042 conn(0x7f44180b0d30 msgr2=0x7f44180ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:39.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441fe9c640 1 -- 172.21.15.19:0/2682283042 shutdown_connections 2023-11-20T06:41:39.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441fe9c640 1 -- 172.21.15.19:0/2682283042 wait complete. 2023-11-20T06:41:39.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441fe9c640 1 Processor -- start 2023-11-20T06:41:39.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441fe9c640 1 -- start start 2023-11-20T06:41:39.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441fe9c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4418069e90 0x7f44181515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:39.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441fe9c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44180b1750 0x7f44180af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:39.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441fe9c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f441815ab10 0x7f44180cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:39.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441fe9c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441814f560 con 0x7f44180b1750 2023-11-20T06:41:39.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441fe9c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44180afed0 con 0x7f441815ab10 2023-11-20T06:41:39.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441fe9c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4418153790 con 0x7f4418069e90 2023-11-20T06:41:39.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441d437640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44180b1750 0x7f44180af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:39.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441d437640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44180b1750 0x7f44180af990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48350/0 (socket says 172.21.15.19:48350) 2023-11-20T06:41:39.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441d437640 1 -- 172.21.15.19:0/2461580103 learned_addr learned my addr 172.21.15.19:0/2461580103 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:39.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441e439640 1 --2- 172.21.15.19:0/2461580103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f441815ab10 0x7f44180cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:39.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.675+0000 7f441dc38640 1 --2- 172.21.15.19:0/2461580103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4418069e90 0x7f44181515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:39.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.679+0000 7f441d437640 1 -- 172.21.15.19:0/2461580103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4418069e90 msgr2=0x7f44181515d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:39.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.679+0000 7f441d437640 1 --2- 172.21.15.19:0/2461580103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4418069e90 0x7f44181515d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.679+0000 7f441d437640 1 -- 172.21.15.19:0/2461580103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f441815ab10 msgr2=0x7f44180cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:39.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.679+0000 7f441d437640 1 --2- 172.21.15.19:0/2461580103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f441815ab10 0x7f44180cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.679+0000 7f441d437640 1 -- 172.21.15.19:0/2461580103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4410009b30 con 0x7f44180b1750 2023-11-20T06:41:39.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.679+0000 7f441d437640 1 --2- 172.21.15.19:0/2461580103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44180b1750 0x7f44180af990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f440800e930 tx=0x7f440800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:39.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.679+0000 7f440e7fc640 1 -- 172.21.15.19:0/2461580103 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4408009690 con 0x7f44180b1750 2023-11-20T06:41:39.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.679+0000 7f440e7fc640 1 -- 172.21.15.19:0/2461580103 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440800ca00 con 0x7f44180b1750 2023-11-20T06:41:39.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.679+0000 7f440e7fc640 1 -- 172.21.15.19:0/2461580103 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440800cd70 con 0x7f44180b1750 2023-11-20T06:41:39.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.679+0000 7f441fe9c640 1 -- 172.21.15.19:0/2461580103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4418156a40 con 0x7f44180b1750 2023-11-20T06:41:39.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.679+0000 7f441fe9c640 1 -- 172.21.15.19:0/2461580103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44181539e0 con 0x7f44180b1750 2023-11-20T06:41:39.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.679+0000 7f441fe9c640 1 -- 172.21.15.19:0/2461580103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4418156f60 con 0x7f44180b1750 2023-11-20T06:41:39.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.679+0000 7f440e7fc640 1 -- 172.21.15.19:0/2461580103 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4408013470 con 0x7f44180b1750 2023-11-20T06:41:39.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.679+0000 7f440e7fc640 1 --2- 172.21.15.19:0/2461580103 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f43fc0664d0 0x7f43fc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:39.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.679+0000 7f440e7fc640 1 -- 172.21.15.19:0/2461580103 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f44080842b0 con 0x7f44180b1750 2023-11-20T06:41:39.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.683+0000 7f441dc38640 1 --2- 172.21.15.19:0/2461580103 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f43fc0664d0 0x7f43fc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:39.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.683+0000 7f441dc38640 1 --2- 172.21.15.19:0/2461580103 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f43fc0664d0 0x7f43fc068990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4414000f70 tx=0x7f4414009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:39.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.683+0000 7f440e7fc640 1 -- 172.21.15.19:0/2461580103 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f44080515a0 con 0x7f44180b1750 2023-11-20T06:41:39.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.839+0000 7f441fe9c640 1 -- 172.21.15.19:0/2461580103 --> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44180b4650 con 0x7f43fc0664d0 2023-11-20T06:41:39.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.847+0000 7f440e7fc640 1 -- 172.21.15.19:0/2461580103 <== mgr.4109 v2:172.21.15.190:6832/142426253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345321 (secure 0 0 0) 0x7f441400f820 con 0x7f43fc0664d0 2023-11-20T06:41:39.857 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:39.859 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-20T06:41:39.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.851+0000 7f441fe9c640 1 -- 172.21.15.19:0/2461580103 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f43fc0664d0 msgr2=0x7f43fc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:39.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.851+0000 7f441fe9c640 1 --2- 172.21.15.19:0/2461580103 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f43fc0664d0 0x7f43fc068990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4414000f70 tx=0x7f4414009040 comp rx=0 tx=0).stop 2023-11-20T06:41:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.851+0000 7f441fe9c640 1 -- 172.21.15.19:0/2461580103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44180b1750 msgr2=0x7f44180af990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.851+0000 7f441fe9c640 1 --2- 172.21.15.19:0/2461580103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44180b1750 0x7f44180af990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f440800e930 tx=0x7f440800edf0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.851+0000 7f441fe9c640 1 -- 172.21.15.19:0/2461580103 shutdown_connections 2023-11-20T06:41:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.851+0000 7f441fe9c640 1 --2- 172.21.15.19:0/2461580103 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f43fc0664d0 0x7f43fc068990 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.851+0000 7f441fe9c640 1 --2- 172.21.15.19:0/2461580103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f441815ab10 0x7f44180cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.851+0000 7f441fe9c640 1 --2- 172.21.15.19:0/2461580103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44180b1750 0x7f44180af990 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.851+0000 7f441fe9c640 1 --2- 172.21.15.19:0/2461580103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4418069e90 0x7f44181515d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.851+0000 7f441fe9c640 1 -- 172.21.15.19:0/2461580103 >> 172.21.15.19:0/2461580103 conn(0x7f44180b0d30 msgr2=0x7f441806c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.851+0000 7f441fe9c640 1 -- 172.21.15.19:0/2461580103 shutdown_connections 2023-11-20T06:41:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:39.851+0000 7f441fe9c640 1 -- 172.21.15.19:0/2461580103 wait complete. 2023-11-20T06:41:39.877 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-11-20T06:41:39.488988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219472,"kb_used_data":3300,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755248,"statfs":{"total":773094113280,"available":772869373952,"internally_reserved":0,"allocated":3379200,"data_stored":2043755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003400"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578685+0000","last_change":"2023-11-20T06:41:13.239285+0000","last_active":"2023-11-20T06:41:19.578685+0000","last_peered":"2023-11-20T06:41:19.578685+0000","last_clean":"2023-11-20T06:41:19.578685+0000","last_became_active":"2023-11-20T06:41:13.238954+0000","last_became_peered":"2023-11-20T06:41:13.238954+0000","last_unstale":"2023-11-20T06:41:19.578685+0000","last_undegraded":"2023-11-20T06:41:19.578685+0000","last_fullsized":"2023-11-20T06:41:19.578685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:47:01.655222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.584187+0000","last_change":"2023-11-20T06:41:14.261632+0000","last_active":"2023-11-20T06:41:19.584187+0000","last_peered":"2023-11-20T06:41:19.584187+0000","last_clean":"2023-11-20T06:41:19.584187+0000","last_became_active":"2023-11-20T06:41:14.261282+0000","last_became_peered":"2023-11-20T06:41:14.261282+0000","last_unstale":"2023-11-20T06:41:19.584187+0000","last_undegraded":"2023-11-20T06:41:19.584187+0000","last_fullsized":"2023-11-20T06:41:19.584187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:45:19.227613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.313252+0000","last_change":"2023-11-20T06:41:18.900797+0000","last_active":"2023-11-20T06:41:20.313252+0000","last_peered":"2023-11-20T06:41:20.313252+0000","last_clean":"2023-11-20T06:41:20.313252+0000","last_became_active":"2023-11-20T06:41:18.900345+0000","last_became_peered":"2023-11-20T06:41:18.900345+0000","last_unstale":"2023-11-20T06:41:20.313252+0000","last_undegraded":"2023-11-20T06:41:20.313252+0000","last_fullsized":"2023-11-20T06:41:20.313252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:58:31.638685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.584272+0000","last_change":"2023-11-20T06:41:13.239899+0000","last_active":"2023-11-20T06:41:19.584272+0000","last_peered":"2023-11-20T06:41:19.584272+0000","last_clean":"2023-11-20T06:41:19.584272+0000","last_became_active":"2023-11-20T06:41:13.239579+0000","last_became_peered":"2023-11-20T06:41:13.239579+0000","last_unstale":"2023-11-20T06:41:19.584272+0000","last_undegraded":"2023-11-20T06:41:19.584272+0000","last_fullsized":"2023-11-20T06:41:19.584272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:15:33.516237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578577+0000","last_change":"2023-11-20T06:41:14.262518+0000","last_active":"2023-11-20T06:41:19.578577+0000","last_peered":"2023-11-20T06:41:19.578577+0000","last_clean":"2023-11-20T06:41:19.578577+0000","last_became_active":"2023-11-20T06:41:14.260033+0000","last_became_peered":"2023-11-20T06:41:14.260033+0000","last_unstale":"2023-11-20T06:41:19.578577+0000","last_undegraded":"2023-11-20T06:41:19.578577+0000","last_fullsized":"2023-11-20T06:41:19.578577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:25.537288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.315596+0000","last_change":"2023-11-20T06:41:18.295727+0000","last_active":"2023-11-20T06:41:20.315596+0000","last_peered":"2023-11-20T06:41:20.315596+0000","last_clean":"2023-11-20T06:41:20.315596+0000","last_became_active":"2023-11-20T06:41:18.295305+0000","last_became_peered":"2023-11-20T06:41:18.295305+0000","last_unstale":"2023-11-20T06:41:20.315596+0000","last_undegraded":"2023-11-20T06:41:20.315596+0000","last_fullsized":"2023-11-20T06:41:20.315596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:45:54.333725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931461+0000","last_change":"2023-11-20T06:41:13.252932+0000","last_active":"2023-11-20T06:41:19.931461+0000","last_peered":"2023-11-20T06:41:19.931461+0000","last_clean":"2023-11-20T06:41:19.931461+0000","last_became_active":"2023-11-20T06:41:13.252621+0000","last_became_peered":"2023-11-20T06:41:13.252621+0000","last_unstale":"2023-11-20T06:41:19.931461+0000","last_undegraded":"2023-11-20T06:41:19.931461+0000","last_fullsized":"2023-11-20T06:41:19.931461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:20.467472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787860+0000","last_change":"2023-11-20T06:41:14.256127+0000","last_active":"2023-11-20T06:41:19.787860+0000","last_peered":"2023-11-20T06:41:19.787860+0000","last_clean":"2023-11-20T06:41:19.787860+0000","last_became_active":"2023-11-20T06:41:14.255819+0000","last_became_peered":"2023-11-20T06:41:14.255819+0000","last_unstale":"2023-11-20T06:41:19.787860+0000","last_undegraded":"2023-11-20T06:41:19.787860+0000","last_fullsized":"2023-11-20T06:41:19.787860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:45:19.227613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.315754+0000","last_change":"2023-11-20T06:41:18.301642+0000","last_active":"2023-11-20T06:41:20.315754+0000","last_peered":"2023-11-20T06:41:20.315754+0000","last_clean":"2023-11-20T06:41:20.315754+0000","last_became_active":"2023-11-20T06:41:18.301181+0000","last_became_peered":"2023-11-20T06:41:18.301181+0000","last_unstale":"2023-11-20T06:41:20.315754+0000","last_undegraded":"2023-11-20T06:41:20.315754+0000","last_fullsized":"2023-11-20T06:41:20.315754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:49.111361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931279+0000","last_change":"2023-11-20T06:41:13.254958+0000","last_active":"2023-11-20T06:41:19.931279+0000","last_peered":"2023-11-20T06:41:19.931279+0000","last_clean":"2023-11-20T06:41:19.931279+0000","last_became_active":"2023-11-20T06:41:13.254686+0000","last_became_peered":"2023-11-20T06:41:13.254686+0000","last_unstale":"2023-11-20T06:41:19.931279+0000","last_undegraded":"2023-11-20T06:41:19.931279+0000","last_fullsized":"2023-11-20T06:41:19.931279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:48:12.763247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.788059+0000","last_change":"2023-11-20T06:41:14.260659+0000","last_active":"2023-11-20T06:41:19.788059+0000","last_peered":"2023-11-20T06:41:19.788059+0000","last_clean":"2023-11-20T06:41:19.788059+0000","last_became_active":"2023-11-20T06:41:14.260375+0000","last_became_peered":"2023-11-20T06:41:14.260375+0000","last_unstale":"2023-11-20T06:41:19.788059+0000","last_undegraded":"2023-11-20T06:41:19.788059+0000","last_fullsized":"2023-11-20T06:41:19.788059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:20:01.827771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.315993+0000","last_change":"2023-11-20T06:41:18.289391+0000","last_active":"2023-11-20T06:41:20.315993+0000","last_peered":"2023-11-20T06:41:20.315993+0000","last_clean":"2023-11-20T06:41:20.315993+0000","last_became_active":"2023-11-20T06:41:18.288932+0000","last_became_peered":"2023-11-20T06:41:18.288932+0000","last_unstale":"2023-11-20T06:41:20.315993+0000","last_undegraded":"2023-11-20T06:41:20.315993+0000","last_fullsized":"2023-11-20T06:41:20.315993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:57:19.944479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314649+0000","last_change":"2023-11-20T06:41:14.270272+0000","last_active":"2023-11-20T06:41:19.314649+0000","last_peered":"2023-11-20T06:41:19.314649+0000","last_clean":"2023-11-20T06:41:19.314649+0000","last_became_active":"2023-11-20T06:41:14.269983+0000","last_became_peered":"2023-11-20T06:41:14.269983+0000","last_unstale":"2023-11-20T06:41:19.314649+0000","last_undegraded":"2023-11-20T06:41:19.314649+0000","last_fullsized":"2023-11-20T06:41:19.314649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:03:05.538623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931428+0000","last_change":"2023-11-20T06:41:13.252298+0000","last_active":"2023-11-20T06:41:19.931428+0000","last_peered":"2023-11-20T06:41:19.931428+0000","last_clean":"2023-11-20T06:41:19.931428+0000","last_became_active":"2023-11-20T06:41:13.252009+0000","last_became_peered":"2023-11-20T06:41:13.252009+0000","last_unstale":"2023-11-20T06:41:19.931428+0000","last_undegraded":"2023-11-20T06:41:19.931428+0000","last_fullsized":"2023-11-20T06:41:19.931428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:24.531185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.316395+0000","last_change":"2023-11-20T06:41:18.299248+0000","last_active":"2023-11-20T06:41:20.316395+0000","last_peered":"2023-11-20T06:41:20.316395+0000","last_clean":"2023-11-20T06:41:20.316395+0000","last_became_active":"2023-11-20T06:41:18.298935+0000","last_became_peered":"2023-11-20T06:41:18.298935+0000","last_unstale":"2023-11-20T06:41:20.316395+0000","last_undegraded":"2023-11-20T06:41:20.316395+0000","last_fullsized":"2023-11-20T06:41:20.316395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:00:16.728243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583729+0000","last_change":"2023-11-20T06:41:14.267951+0000","last_active":"2023-11-20T06:41:19.583729+0000","last_peered":"2023-11-20T06:41:19.583729+0000","last_clean":"2023-11-20T06:41:19.583729+0000","last_became_active":"2023-11-20T06:41:14.266970+0000","last_became_peered":"2023-11-20T06:41:14.266970+0000","last_unstale":"2023-11-20T06:41:19.583729+0000","last_undegraded":"2023-11-20T06:41:19.583729+0000","last_fullsized":"2023-11-20T06:41:19.583729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:35:30.568821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662297+0000","last_change":"2023-11-20T06:41:13.242711+0000","last_active":"2023-11-20T06:41:19.662297+0000","last_peered":"2023-11-20T06:41:19.662297+0000","last_clean":"2023-11-20T06:41:19.662297+0000","last_became_active":"2023-11-20T06:41:13.242342+0000","last_became_peered":"2023-11-20T06:41:13.242342+0000","last_unstale":"2023-11-20T06:41:19.662297+0000","last_undegraded":"2023-11-20T06:41:19.662297+0000","last_fullsized":"2023-11-20T06:41:19.662297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:47:01.655222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.317121+0000","last_change":"2023-11-20T06:41:18.301608+0000","last_active":"2023-11-20T06:41:20.317121+0000","last_peered":"2023-11-20T06:41:20.317121+0000","last_clean":"2023-11-20T06:41:20.317121+0000","last_became_active":"2023-11-20T06:41:18.301170+0000","last_became_peered":"2023-11-20T06:41:18.301170+0000","last_unstale":"2023-11-20T06:41:20.317121+0000","last_undegraded":"2023-11-20T06:41:20.317121+0000","last_fullsized":"2023-11-20T06:41:20.317121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:49:09.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583521+0000","last_change":"2023-11-20T06:41:14.269440+0000","last_active":"2023-11-20T06:41:19.583521+0000","last_peered":"2023-11-20T06:41:19.583521+0000","last_clean":"2023-11-20T06:41:19.583521+0000","last_became_active":"2023-11-20T06:41:14.269118+0000","last_became_peered":"2023-11-20T06:41:14.269118+0000","last_unstale":"2023-11-20T06:41:19.583521+0000","last_undegraded":"2023-11-20T06:41:19.583521+0000","last_fullsized":"2023-11-20T06:41:19.583521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:42:53.602834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.661987+0000","last_change":"2023-11-20T06:41:13.247696+0000","last_active":"2023-11-20T06:41:19.661987+0000","last_peered":"2023-11-20T06:41:19.661987+0000","last_clean":"2023-11-20T06:41:19.661987+0000","last_became_active":"2023-11-20T06:41:13.247416+0000","last_became_peered":"2023-11-20T06:41:13.247416+0000","last_unstale":"2023-11-20T06:41:19.661987+0000","last_undegraded":"2023-11-20T06:41:19.661987+0000","last_fullsized":"2023-11-20T06:41:19.661987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:36:43.073673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.743727+0000","last_change":"2023-11-20T06:41:18.897168+0000","last_active":"2023-11-20T06:41:20.743727+0000","last_peered":"2023-11-20T06:41:20.743727+0000","last_clean":"2023-11-20T06:41:20.743727+0000","last_became_active":"2023-11-20T06:41:18.896705+0000","last_became_peered":"2023-11-20T06:41:18.896705+0000","last_unstale":"2023-11-20T06:41:20.743727+0000","last_undegraded":"2023-11-20T06:41:20.743727+0000","last_fullsized":"2023-11-20T06:41:20.743727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:49:09.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.313398+0000","last_change":"2023-11-20T06:41:14.267054+0000","last_active":"2023-11-20T06:41:19.313398+0000","last_peered":"2023-11-20T06:41:19.313398+0000","last_clean":"2023-11-20T06:41:19.313398+0000","last_became_active":"2023-11-20T06:41:14.262005+0000","last_became_peered":"2023-11-20T06:41:14.262005+0000","last_unstale":"2023-11-20T06:41:19.313398+0000","last_undegraded":"2023-11-20T06:41:19.313398+0000","last_fullsized":"2023-11-20T06:41:19.313398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:52:49.697194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931076+0000","last_change":"2023-11-20T06:41:13.257483+0000","last_active":"2023-11-20T06:41:19.931076+0000","last_peered":"2023-11-20T06:41:19.931076+0000","last_clean":"2023-11-20T06:41:19.931076+0000","last_became_active":"2023-11-20T06:41:13.257122+0000","last_became_peered":"2023-11-20T06:41:13.257122+0000","last_unstale":"2023-11-20T06:41:19.931076+0000","last_undegraded":"2023-11-20T06:41:19.931076+0000","last_fullsized":"2023-11-20T06:41:19.931076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:15:33.516237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.317008+0000","last_change":"2023-11-20T06:41:18.302677+0000","last_active":"2023-11-20T06:41:20.317008+0000","last_peered":"2023-11-20T06:41:20.317008+0000","last_clean":"2023-11-20T06:41:20.317008+0000","last_became_active":"2023-11-20T06:41:18.301938+0000","last_became_peered":"2023-11-20T06:41:18.301938+0000","last_unstale":"2023-11-20T06:41:20.317008+0000","last_undegraded":"2023-11-20T06:41:20.317008+0000","last_fullsized":"2023-11-20T06:41:20.317008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:25:06.683699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578465+0000","last_change":"2023-11-20T06:41:14.264039+0000","last_active":"2023-11-20T06:41:19.578465+0000","last_peered":"2023-11-20T06:41:19.578465+0000","last_clean":"2023-11-20T06:41:19.578465+0000","last_became_active":"2023-11-20T06:41:14.262551+0000","last_became_peered":"2023-11-20T06:41:14.262551+0000","last_unstale":"2023-11-20T06:41:19.578465+0000","last_undegraded":"2023-11-20T06:41:19.578465+0000","last_fullsized":"2023-11-20T06:41:19.578465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:08:41.021374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315807+0000","last_change":"2023-11-20T06:41:13.251311+0000","last_active":"2023-11-20T06:41:19.315807+0000","last_peered":"2023-11-20T06:41:19.315807+0000","last_clean":"2023-11-20T06:41:19.315807+0000","last_became_active":"2023-11-20T06:41:13.251022+0000","last_became_peered":"2023-11-20T06:41:13.251022+0000","last_unstale":"2023-11-20T06:41:19.315807+0000","last_undegraded":"2023-11-20T06:41:19.315807+0000","last_fullsized":"2023-11-20T06:41:19.315807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:20.467472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.316272+0000","last_change":"2023-11-20T06:41:18.899620+0000","last_active":"2023-11-20T06:41:20.316272+0000","last_peered":"2023-11-20T06:41:20.316272+0000","last_clean":"2023-11-20T06:41:20.316272+0000","last_became_active":"2023-11-20T06:41:18.899201+0000","last_became_peered":"2023-11-20T06:41:18.899201+0000","last_unstale":"2023-11-20T06:41:20.316272+0000","last_undegraded":"2023-11-20T06:41:20.316272+0000","last_fullsized":"2023-11-20T06:41:20.316272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:16:52.140361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.584296+0000","last_change":"2023-11-20T06:41:14.270250+0000","last_active":"2023-11-20T06:41:19.584296+0000","last_peered":"2023-11-20T06:41:19.584296+0000","last_clean":"2023-11-20T06:41:19.584296+0000","last_became_active":"2023-11-20T06:41:14.269658+0000","last_became_peered":"2023-11-20T06:41:14.269658+0000","last_unstale":"2023-11-20T06:41:19.584296+0000","last_undegraded":"2023-11-20T06:41:19.584296+0000","last_fullsized":"2023-11-20T06:41:19.584296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:27:59.872035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.663105+0000","last_change":"2023-11-20T06:41:13.241077+0000","last_active":"2023-11-20T06:41:19.663105+0000","last_peered":"2023-11-20T06:41:19.663105+0000","last_clean":"2023-11-20T06:41:19.663105+0000","last_became_active":"2023-11-20T06:41:13.240478+0000","last_became_peered":"2023-11-20T06:41:13.240478+0000","last_unstale":"2023-11-20T06:41:19.663105+0000","last_undegraded":"2023-11-20T06:41:19.663105+0000","last_fullsized":"2023-11-20T06:41:19.663105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:16:12.804737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.313191+0000","last_change":"2023-11-20T06:41:18.899891+0000","last_active":"2023-11-20T06:41:20.313191+0000","last_peered":"2023-11-20T06:41:20.313191+0000","last_clean":"2023-11-20T06:41:20.313191+0000","last_became_active":"2023-11-20T06:41:18.899023+0000","last_became_peered":"2023-11-20T06:41:18.899023+0000","last_unstale":"2023-11-20T06:41:20.313191+0000","last_undegraded":"2023-11-20T06:41:20.313191+0000","last_fullsized":"2023-11-20T06:41:20.313191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:37:56.697790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662455+0000","last_change":"2023-11-20T06:41:14.257593+0000","last_active":"2023-11-20T06:41:19.662455+0000","last_peered":"2023-11-20T06:41:19.662455+0000","last_clean":"2023-11-20T06:41:19.662455+0000","last_became_active":"2023-11-20T06:41:14.257296+0000","last_became_peered":"2023-11-20T06:41:14.257296+0000","last_unstale":"2023-11-20T06:41:19.662455+0000","last_undegraded":"2023-11-20T06:41:19.662455+0000","last_fullsized":"2023-11-20T06:41:19.662455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:25.537288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931571+0000","last_change":"2023-11-20T06:41:13.253474+0000","last_active":"2023-11-20T06:41:19.931571+0000","last_peered":"2023-11-20T06:41:19.931571+0000","last_clean":"2023-11-20T06:41:19.931571+0000","last_became_active":"2023-11-20T06:41:13.253199+0000","last_became_peered":"2023-11-20T06:41:13.253199+0000","last_unstale":"2023-11-20T06:41:19.931571+0000","last_undegraded":"2023-11-20T06:41:19.931571+0000","last_fullsized":"2023-11-20T06:41:19.931571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:36:43.073673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.679008+0000","last_change":"2023-11-20T06:41:18.897668+0000","last_active":"2023-11-20T06:41:20.679008+0000","last_peered":"2023-11-20T06:41:20.679008+0000","last_clean":"2023-11-20T06:41:20.679008+0000","last_became_active":"2023-11-20T06:41:18.897265+0000","last_became_peered":"2023-11-20T06:41:18.897265+0000","last_unstale":"2023-11-20T06:41:20.679008+0000","last_undegraded":"2023-11-20T06:41:20.679008+0000","last_fullsized":"2023-11-20T06:41:20.679008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:00:16.728243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.788104+0000","last_change":"2023-11-20T06:41:14.277073+0000","last_active":"2023-11-20T06:41:19.788104+0000","last_peered":"2023-11-20T06:41:19.788104+0000","last_clean":"2023-11-20T06:41:19.788104+0000","last_became_active":"2023-11-20T06:41:14.276783+0000","last_became_peered":"2023-11-20T06:41:14.276783+0000","last_unstale":"2023-11-20T06:41:19.788104+0000","last_undegraded":"2023-11-20T06:41:19.788104+0000","last_fullsized":"2023-11-20T06:41:19.788104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:07:38.977327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662498+0000","last_change":"2023-11-20T06:41:13.244589+0000","last_active":"2023-11-20T06:41:19.662498+0000","last_peered":"2023-11-20T06:41:19.662498+0000","last_clean":"2023-11-20T06:41:19.662498+0000","last_became_active":"2023-11-20T06:41:13.244242+0000","last_became_peered":"2023-11-20T06:41:13.244242+0000","last_unstale":"2023-11-20T06:41:19.662498+0000","last_undegraded":"2023-11-20T06:41:19.662498+0000","last_fullsized":"2023-11-20T06:41:19.662498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:01:37.302430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.743291+0000","last_change":"2023-11-20T06:41:18.302053+0000","last_active":"2023-11-20T06:41:20.743291+0000","last_peered":"2023-11-20T06:41:20.743291+0000","last_clean":"2023-11-20T06:41:20.743291+0000","last_became_active":"2023-11-20T06:41:18.301615+0000","last_became_peered":"2023-11-20T06:41:18.301615+0000","last_unstale":"2023-11-20T06:41:20.743291+0000","last_undegraded":"2023-11-20T06:41:20.743291+0000","last_fullsized":"2023-11-20T06:41:20.743291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:16:52.140361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314736+0000","last_change":"2023-11-20T06:41:14.268552+0000","last_active":"2023-11-20T06:41:19.314736+0000","last_peered":"2023-11-20T06:41:19.314736+0000","last_clean":"2023-11-20T06:41:19.314736+0000","last_became_active":"2023-11-20T06:41:14.268201+0000","last_became_peered":"2023-11-20T06:41:14.268201+0000","last_unstale":"2023-11-20T06:41:19.314736+0000","last_undegraded":"2023-11-20T06:41:19.314736+0000","last_fullsized":"2023-11-20T06:41:19.314736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:13:30.790091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787765+0000","last_change":"2023-11-20T06:41:13.249876+0000","last_active":"2023-11-20T06:41:19.787765+0000","last_peered":"2023-11-20T06:41:19.787765+0000","last_clean":"2023-11-20T06:41:19.787765+0000","last_became_active":"2023-11-20T06:41:13.249316+0000","last_became_peered":"2023-11-20T06:41:13.249316+0000","last_unstale":"2023-11-20T06:41:19.787765+0000","last_undegraded":"2023-11-20T06:41:19.787765+0000","last_fullsized":"2023-11-20T06:41:19.787765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:20.467472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.743432+0000","last_change":"2023-11-20T06:41:18.298035+0000","last_active":"2023-11-20T06:41:20.743432+0000","last_peered":"2023-11-20T06:41:20.743432+0000","last_clean":"2023-11-20T06:41:20.743432+0000","last_became_active":"2023-11-20T06:41:18.297674+0000","last_became_peered":"2023-11-20T06:41:18.297674+0000","last_unstale":"2023-11-20T06:41:20.743432+0000","last_undegraded":"2023-11-20T06:41:20.743432+0000","last_fullsized":"2023-11-20T06:41:20.743432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:00:16.728243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662052+0000","last_change":"2023-11-20T06:41:14.258777+0000","last_active":"2023-11-20T06:41:19.662052+0000","last_peered":"2023-11-20T06:41:19.662052+0000","last_clean":"2023-11-20T06:41:19.662052+0000","last_became_active":"2023-11-20T06:41:14.258430+0000","last_became_peered":"2023-11-20T06:41:14.258430+0000","last_unstale":"2023-11-20T06:41:19.662052+0000","last_undegraded":"2023-11-20T06:41:19.662052+0000","last_fullsized":"2023-11-20T06:41:19.662052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:42:53.602834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.309513+0000","last_change":"2023-11-20T06:41:13.226120+0000","last_active":"2023-11-20T06:41:19.309513+0000","last_peered":"2023-11-20T06:41:19.309513+0000","last_clean":"2023-11-20T06:41:19.309513+0000","last_became_active":"2023-11-20T06:41:13.225814+0000","last_became_peered":"2023-11-20T06:41:13.225814+0000","last_unstale":"2023-11-20T06:41:19.309513+0000","last_undegraded":"2023-11-20T06:41:19.309513+0000","last_fullsized":"2023-11-20T06:41:19.309513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:54:25.014221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.743763+0000","last_change":"2023-11-20T06:41:18.294432+0000","last_active":"2023-11-20T06:41:20.743763+0000","last_peered":"2023-11-20T06:41:20.743763+0000","last_clean":"2023-11-20T06:41:20.743763+0000","last_became_active":"2023-11-20T06:41:18.293345+0000","last_became_peered":"2023-11-20T06:41:18.293345+0000","last_unstale":"2023-11-20T06:41:20.743763+0000","last_undegraded":"2023-11-20T06:41:20.743763+0000","last_fullsized":"2023-11-20T06:41:20.743763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:13:29.540284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578235+0000","last_change":"2023-11-20T06:41:14.250513+0000","last_active":"2023-11-20T06:41:19.578235+0000","last_peered":"2023-11-20T06:41:19.578235+0000","last_clean":"2023-11-20T06:41:19.578235+0000","last_became_active":"2023-11-20T06:41:14.250195+0000","last_became_peered":"2023-11-20T06:41:14.250195+0000","last_unstale":"2023-11-20T06:41:19.578235+0000","last_undegraded":"2023-11-20T06:41:19.578235+0000","last_fullsized":"2023-11-20T06:41:19.578235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:01:38.308533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931054+0000","last_change":"2023-11-20T06:41:13.255728+0000","last_active":"2023-11-20T06:41:19.931054+0000","last_peered":"2023-11-20T06:41:19.931054+0000","last_clean":"2023-11-20T06:41:19.931054+0000","last_became_active":"2023-11-20T06:41:13.255440+0000","last_became_peered":"2023-11-20T06:41:13.255440+0000","last_unstale":"2023-11-20T06:41:19.931054+0000","last_undegraded":"2023-11-20T06:41:19.931054+0000","last_fullsized":"2023-11-20T06:41:19.931054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:27:01.563513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.679449+0000","last_change":"2023-11-20T06:41:18.900803+0000","last_active":"2023-11-20T06:41:20.679449+0000","last_peered":"2023-11-20T06:41:20.679449+0000","last_clean":"2023-11-20T06:41:20.679449+0000","last_became_active":"2023-11-20T06:41:18.900347+0000","last_became_peered":"2023-11-20T06:41:18.900347+0000","last_unstale":"2023-11-20T06:41:20.679449+0000","last_undegraded":"2023-11-20T06:41:20.679449+0000","last_fullsized":"2023-11-20T06:41:20.679449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:32:07.244747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583650+0000","last_change":"2023-11-20T06:41:14.265573+0000","last_active":"2023-11-20T06:41:19.583650+0000","last_peered":"2023-11-20T06:41:19.583650+0000","last_clean":"2023-11-20T06:41:19.583650+0000","last_became_active":"2023-11-20T06:41:14.260035+0000","last_became_peered":"2023-11-20T06:41:14.260035+0000","last_unstale":"2023-11-20T06:41:19.583650+0000","last_undegraded":"2023-11-20T06:41:19.583650+0000","last_fullsized":"2023-11-20T06:41:19.583650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:25.537288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787737+0000","last_change":"2023-11-20T06:41:13.237196+0000","last_active":"2023-11-20T06:41:19.787737+0000","last_peered":"2023-11-20T06:41:19.787737+0000","last_clean":"2023-11-20T06:41:19.787737+0000","last_became_active":"2023-11-20T06:41:13.236793+0000","last_became_peered":"2023-11-20T06:41:13.236793+0000","last_unstale":"2023-11-20T06:41:19.787737+0000","last_undegraded":"2023-11-20T06:41:19.787737+0000","last_fullsized":"2023-11-20T06:41:19.787737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:44:08.985984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.930761+0000","last_change":"2023-11-20T06:41:03.783345+0000","last_active":"2023-11-20T06:41:19.930761+0000","last_peered":"2023-11-20T06:41:19.930761+0000","last_clean":"2023-11-20T06:41:19.930761+0000","last_became_active":"2023-11-20T06:41:03.782257+0000","last_became_peered":"2023-11-20T06:41:03.782257+0000","last_unstale":"2023-11-20T06:41:19.930761+0000","last_undegraded":"2023-11-20T06:41:19.930761+0000","last_fullsized":"2023-11-20T06:41:19.930761+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:01.979090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:01.979090+0000","last_clean_scrub_stamp":"2023-11-20T06:41:01.979090+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:20:41.084382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.746476+0000","last_change":"2023-11-20T06:41:18.903133+0000","last_active":"2023-11-20T06:41:20.746476+0000","last_peered":"2023-11-20T06:41:20.746476+0000","last_clean":"2023-11-20T06:41:20.746476+0000","last_became_active":"2023-11-20T06:41:18.902697+0000","last_became_peered":"2023-11-20T06:41:18.902697+0000","last_unstale":"2023-11-20T06:41:20.746476+0000","last_undegraded":"2023-11-20T06:41:20.746476+0000","last_fullsized":"2023-11-20T06:41:20.746476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:57:19.944479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931329+0000","last_change":"2023-11-20T06:41:14.263973+0000","last_active":"2023-11-20T06:41:19.931329+0000","last_peered":"2023-11-20T06:41:19.931329+0000","last_clean":"2023-11-20T06:41:19.931329+0000","last_became_active":"2023-11-20T06:41:14.263492+0000","last_became_peered":"2023-11-20T06:41:14.263492+0000","last_unstale":"2023-11-20T06:41:19.931329+0000","last_undegraded":"2023-11-20T06:41:19.931329+0000","last_fullsized":"2023-11-20T06:41:19.931329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:07:38.977327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.310124+0000","last_change":"2023-11-20T06:41:13.233779+0000","last_active":"2023-11-20T06:41:19.310124+0000","last_peered":"2023-11-20T06:41:19.310124+0000","last_clean":"2023-11-20T06:41:19.310124+0000","last_became_active":"2023-11-20T06:41:13.233388+0000","last_became_peered":"2023-11-20T06:41:13.233388+0000","last_unstale":"2023-11-20T06:41:19.310124+0000","last_undegraded":"2023-11-20T06:41:19.310124+0000","last_fullsized":"2023-11-20T06:41:19.310124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:52:48.691091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.746246+0000","last_change":"2023-11-20T06:41:18.899818+0000","last_active":"2023-11-20T06:41:20.746246+0000","last_peered":"2023-11-20T06:41:20.746246+0000","last_clean":"2023-11-20T06:41:20.746246+0000","last_became_active":"2023-11-20T06:41:18.899254+0000","last_became_peered":"2023-11-20T06:41:18.899254+0000","last_unstale":"2023-11-20T06:41:20.746246+0000","last_undegraded":"2023-11-20T06:41:20.746246+0000","last_fullsized":"2023-11-20T06:41:20.746246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:49:36.631359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787891+0000","last_change":"2023-11-20T06:41:14.277327+0000","last_active":"2023-11-20T06:41:19.787891+0000","last_peered":"2023-11-20T06:41:19.787891+0000","last_clean":"2023-11-20T06:41:19.787891+0000","last_became_active":"2023-11-20T06:41:14.276750+0000","last_became_peered":"2023-11-20T06:41:14.276750+0000","last_unstale":"2023-11-20T06:41:19.787891+0000","last_undegraded":"2023-11-20T06:41:19.787891+0000","last_fullsized":"2023-11-20T06:41:19.787891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:07:43.904895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662857+0000","last_change":"2023-11-20T06:41:13.237042+0000","last_active":"2023-11-20T06:41:19.662857+0000","last_peered":"2023-11-20T06:41:19.662857+0000","last_clean":"2023-11-20T06:41:19.662857+0000","last_became_active":"2023-11-20T06:41:13.236730+0000","last_became_peered":"2023-11-20T06:41:13.236730+0000","last_unstale":"2023-11-20T06:41:19.662857+0000","last_undegraded":"2023-11-20T06:41:19.662857+0000","last_fullsized":"2023-11-20T06:41:19.662857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:20.467472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.679071+0000","last_change":"2023-11-20T06:41:18.300034+0000","last_active":"2023-11-20T06:41:20.679071+0000","last_peered":"2023-11-20T06:41:20.679071+0000","last_clean":"2023-11-20T06:41:20.679071+0000","last_became_active":"2023-11-20T06:41:18.299636+0000","last_became_peered":"2023-11-20T06:41:18.299636+0000","last_unstale":"2023-11-20T06:41:20.679071+0000","last_undegraded":"2023-11-20T06:41:20.679071+0000","last_fullsized":"2023-11-20T06:41:20.679071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:25:06.683699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931760+0000","last_change":"2023-11-20T06:41:14.273791+0000","last_active":"2023-11-20T06:41:19.931760+0000","last_peered":"2023-11-20T06:41:19.931760+0000","last_clean":"2023-11-20T06:41:19.931760+0000","last_became_active":"2023-11-20T06:41:14.273507+0000","last_became_peered":"2023-11-20T06:41:14.273507+0000","last_unstale":"2023-11-20T06:41:19.931760+0000","last_undegraded":"2023-11-20T06:41:19.931760+0000","last_fullsized":"2023-11-20T06:41:19.931760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:00:12.676212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.310448+0000","last_change":"2023-11-20T06:41:13.243381+0000","last_active":"2023-11-20T06:41:19.310448+0000","last_peered":"2023-11-20T06:41:19.310448+0000","last_clean":"2023-11-20T06:41:19.310448+0000","last_became_active":"2023-11-20T06:41:13.242286+0000","last_became_peered":"2023-11-20T06:41:13.242286+0000","last_unstale":"2023-11-20T06:41:19.310448+0000","last_undegraded":"2023-11-20T06:41:19.310448+0000","last_fullsized":"2023-11-20T06:41:19.310448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:13:29.783988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.315374+0000","last_change":"2023-11-20T06:41:18.900675+0000","last_active":"2023-11-20T06:41:20.315374+0000","last_peered":"2023-11-20T06:41:20.315374+0000","last_clean":"2023-11-20T06:41:20.315374+0000","last_became_active":"2023-11-20T06:41:18.899705+0000","last_became_peered":"2023-11-20T06:41:18.899705+0000","last_unstale":"2023-11-20T06:41:20.315374+0000","last_undegraded":"2023-11-20T06:41:20.315374+0000","last_fullsized":"2023-11-20T06:41:20.315374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:49:09.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931619+0000","last_change":"2023-11-20T06:41:14.261198+0000","last_active":"2023-11-20T06:41:19.931619+0000","last_peered":"2023-11-20T06:41:19.931619+0000","last_clean":"2023-11-20T06:41:19.931619+0000","last_became_active":"2023-11-20T06:41:14.260837+0000","last_became_peered":"2023-11-20T06:41:14.260837+0000","last_unstale":"2023-11-20T06:41:19.931619+0000","last_undegraded":"2023-11-20T06:41:19.931619+0000","last_fullsized":"2023-11-20T06:41:19.931619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:57:15.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314546+0000","last_change":"2023-11-20T06:41:13.234116+0000","last_active":"2023-11-20T06:41:19.314546+0000","last_peered":"2023-11-20T06:41:19.314546+0000","last_clean":"2023-11-20T06:41:19.314546+0000","last_became_active":"2023-11-20T06:41:13.233691+0000","last_became_peered":"2023-11-20T06:41:13.233691+0000","last_unstale":"2023-11-20T06:41:19.314546+0000","last_undegraded":"2023-11-20T06:41:19.314546+0000","last_fullsized":"2023-11-20T06:41:19.314546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:44:08.985984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.315962+0000","last_change":"2023-11-20T06:41:18.295800+0000","last_active":"2023-11-20T06:41:20.315962+0000","last_peered":"2023-11-20T06:41:20.315962+0000","last_clean":"2023-11-20T06:41:20.315962+0000","last_became_active":"2023-11-20T06:41:18.295366+0000","last_became_peered":"2023-11-20T06:41:18.295366+0000","last_unstale":"2023-11-20T06:41:20.315962+0000","last_undegraded":"2023-11-20T06:41:20.315962+0000","last_fullsized":"2023-11-20T06:41:20.315962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:49:36.631359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931202+0000","last_change":"2023-11-20T06:41:14.274139+0000","last_active":"2023-11-20T06:41:19.931202+0000","last_peered":"2023-11-20T06:41:19.931202+0000","last_clean":"2023-11-20T06:41:19.931202+0000","last_became_active":"2023-11-20T06:41:14.273838+0000","last_became_peered":"2023-11-20T06:41:14.273838+0000","last_unstale":"2023-11-20T06:41:19.931202+0000","last_undegraded":"2023-11-20T06:41:19.931202+0000","last_fullsized":"2023-11-20T06:41:19.931202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:27:59.872035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.309437+0000","last_change":"2023-11-20T06:41:13.238251+0000","last_active":"2023-11-20T06:41:19.309437+0000","last_peered":"2023-11-20T06:41:19.309437+0000","last_clean":"2023-11-20T06:41:19.309437+0000","last_became_active":"2023-11-20T06:41:13.237920+0000","last_became_peered":"2023-11-20T06:41:13.237920+0000","last_unstale":"2023-11-20T06:41:19.309437+0000","last_undegraded":"2023-11-20T06:41:19.309437+0000","last_fullsized":"2023-11-20T06:41:19.309437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:44:08.985984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.679312+0000","last_change":"2023-11-20T06:41:18.292764+0000","last_active":"2023-11-20T06:41:20.679312+0000","last_peered":"2023-11-20T06:41:20.679312+0000","last_clean":"2023-11-20T06:41:20.679312+0000","last_became_active":"2023-11-20T06:41:18.292352+0000","last_became_peered":"2023-11-20T06:41:18.292352+0000","last_unstale":"2023-11-20T06:41:20.679312+0000","last_undegraded":"2023-11-20T06:41:20.679312+0000","last_fullsized":"2023-11-20T06:41:20.679312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:13:29.540284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314386+0000","last_change":"2023-11-20T06:41:14.273982+0000","last_active":"2023-11-20T06:41:19.314386+0000","last_peered":"2023-11-20T06:41:19.314386+0000","last_clean":"2023-11-20T06:41:19.314386+0000","last_became_active":"2023-11-20T06:41:14.273301+0000","last_became_peered":"2023-11-20T06:41:14.273301+0000","last_unstale":"2023-11-20T06:41:19.314386+0000","last_undegraded":"2023-11-20T06:41:19.314386+0000","last_fullsized":"2023-11-20T06:41:19.314386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:06:44.444162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314956+0000","last_change":"2023-11-20T06:41:13.246748+0000","last_active":"2023-11-20T06:41:19.314956+0000","last_peered":"2023-11-20T06:41:19.314956+0000","last_clean":"2023-11-20T06:41:19.314956+0000","last_became_active":"2023-11-20T06:41:13.246302+0000","last_became_peered":"2023-11-20T06:41:13.246302+0000","last_unstale":"2023-11-20T06:41:19.314956+0000","last_undegraded":"2023-11-20T06:41:19.314956+0000","last_fullsized":"2023-11-20T06:41:19.314956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:27:01.563513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.314405+0000","last_change":"2023-11-20T06:41:18.897842+0000","last_active":"2023-11-20T06:41:20.314405+0000","last_peered":"2023-11-20T06:41:20.314405+0000","last_clean":"2023-11-20T06:41:20.314405+0000","last_became_active":"2023-11-20T06:41:18.896898+0000","last_became_peered":"2023-11-20T06:41:18.896898+0000","last_unstale":"2023-11-20T06:41:20.314405+0000","last_undegraded":"2023-11-20T06:41:20.314405+0000","last_fullsized":"2023-11-20T06:41:20.314405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:18:24.107898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931464+0000","last_change":"2023-11-20T06:41:14.274131+0000","last_active":"2023-11-20T06:41:19.931464+0000","last_peered":"2023-11-20T06:41:19.931464+0000","last_clean":"2023-11-20T06:41:19.931464+0000","last_became_active":"2023-11-20T06:41:14.273690+0000","last_became_peered":"2023-11-20T06:41:14.273690+0000","last_unstale":"2023-11-20T06:41:19.931464+0000","last_undegraded":"2023-11-20T06:41:19.931464+0000","last_fullsized":"2023-11-20T06:41:19.931464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:49:32.579328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787724+0000","last_change":"2023-11-20T06:41:13.257423+0000","last_active":"2023-11-20T06:41:19.787724+0000","last_peered":"2023-11-20T06:41:19.787724+0000","last_clean":"2023-11-20T06:41:19.787724+0000","last_became_active":"2023-11-20T06:41:13.256548+0000","last_became_peered":"2023-11-20T06:41:13.256548+0000","last_unstale":"2023-11-20T06:41:19.787724+0000","last_undegraded":"2023-11-20T06:41:19.787724+0000","last_fullsized":"2023-11-20T06:41:19.787724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:56:08.376468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.313587+0000","last_change":"2023-11-20T06:41:18.898144+0000","last_active":"2023-11-20T06:41:20.313587+0000","last_peered":"2023-11-20T06:41:20.313587+0000","last_clean":"2023-11-20T06:41:20.313587+0000","last_became_active":"2023-11-20T06:41:18.897259+0000","last_became_peered":"2023-11-20T06:41:18.897259+0000","last_unstale":"2023-11-20T06:41:20.313587+0000","last_undegraded":"2023-11-20T06:41:20.313587+0000","last_fullsized":"2023-11-20T06:41:20.313587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:21:39.903978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578463+0000","last_change":"2023-11-20T06:41:14.265376+0000","last_active":"2023-11-20T06:41:19.578463+0000","last_peered":"2023-11-20T06:41:19.578463+0000","last_clean":"2023-11-20T06:41:19.578463+0000","last_became_active":"2023-11-20T06:41:14.264937+0000","last_became_peered":"2023-11-20T06:41:14.264937+0000","last_unstale":"2023-11-20T06:41:19.578463+0000","last_undegraded":"2023-11-20T06:41:19.578463+0000","last_fullsized":"2023-11-20T06:41:19.578463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:21.473575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578629+0000","last_change":"2023-11-20T06:41:13.239163+0000","last_active":"2023-11-20T06:41:19.578629+0000","last_peered":"2023-11-20T06:41:19.578629+0000","last_clean":"2023-11-20T06:41:19.578629+0000","last_became_active":"2023-11-20T06:41:13.238828+0000","last_became_peered":"2023-11-20T06:41:13.238828+0000","last_unstale":"2023-11-20T06:41:19.578629+0000","last_undegraded":"2023-11-20T06:41:19.578629+0000","last_fullsized":"2023-11-20T06:41:19.578629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:13:29.783988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.317093+0000","last_change":"2023-11-20T06:41:18.899795+0000","last_active":"2023-11-20T06:41:20.317093+0000","last_peered":"2023-11-20T06:41:20.317093+0000","last_clean":"2023-11-20T06:41:20.317093+0000","last_became_active":"2023-11-20T06:41:18.899270+0000","last_became_peered":"2023-11-20T06:41:18.899270+0000","last_unstale":"2023-11-20T06:41:20.317093+0000","last_undegraded":"2023-11-20T06:41:20.317093+0000","last_fullsized":"2023-11-20T06:41:20.317093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:13:29.540284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931226+0000","last_change":"2023-11-20T06:41:14.275627+0000","last_active":"2023-11-20T06:41:19.931226+0000","last_peered":"2023-11-20T06:41:19.931226+0000","last_clean":"2023-11-20T06:41:19.931226+0000","last_became_active":"2023-11-20T06:41:14.272890+0000","last_became_peered":"2023-11-20T06:41:14.272890+0000","last_unstale":"2023-11-20T06:41:19.931226+0000","last_undegraded":"2023-11-20T06:41:19.931226+0000","last_fullsized":"2023-11-20T06:41:19.931226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:20:01.827771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:29.363554+0000","last_change":"2023-11-20T06:41:13.245874+0000","last_active":"2023-11-20T06:41:29.363554+0000","last_peered":"2023-11-20T06:41:29.363554+0000","last_clean":"2023-11-20T06:41:29.363554+0000","last_became_active":"2023-11-20T06:41:13.245454+0000","last_became_peered":"2023-11-20T06:41:13.245454+0000","last_unstale":"2023-11-20T06:41:29.363554+0000","last_undegraded":"2023-11-20T06:41:29.363554+0000","last_fullsized":"2023-11-20T06:41:29.363554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:56:08.376468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.743578+0000","last_change":"2023-11-20T06:41:18.299146+0000","last_active":"2023-11-20T06:41:20.743578+0000","last_peered":"2023-11-20T06:41:20.743578+0000","last_clean":"2023-11-20T06:41:20.743578+0000","last_became_active":"2023-11-20T06:41:18.298722+0000","last_became_peered":"2023-11-20T06:41:18.298722+0000","last_unstale":"2023-11-20T06:41:20.743578+0000","last_undegraded":"2023-11-20T06:41:20.743578+0000","last_fullsized":"2023-11-20T06:41:20.743578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:25:06.683699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315269+0000","last_change":"2023-11-20T06:41:14.263229+0000","last_active":"2023-11-20T06:41:19.315269+0000","last_peered":"2023-11-20T06:41:19.315269+0000","last_clean":"2023-11-20T06:41:19.315269+0000","last_became_active":"2023-11-20T06:41:14.262970+0000","last_became_peered":"2023-11-20T06:41:14.262970+0000","last_unstale":"2023-11-20T06:41:19.315269+0000","last_undegraded":"2023-11-20T06:41:19.315269+0000","last_fullsized":"2023-11-20T06:41:19.315269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:15:34.522340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662861+0000","last_change":"2023-11-20T06:41:13.238315+0000","last_active":"2023-11-20T06:41:19.662861+0000","last_peered":"2023-11-20T06:41:19.662861+0000","last_clean":"2023-11-20T06:41:19.662861+0000","last_became_active":"2023-11-20T06:41:13.237159+0000","last_became_peered":"2023-11-20T06:41:13.237159+0000","last_unstale":"2023-11-20T06:41:19.662861+0000","last_undegraded":"2023-11-20T06:41:19.662861+0000","last_fullsized":"2023-11-20T06:41:19.662861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:56:08.376468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.316149+0000","last_change":"2023-11-20T06:41:18.301654+0000","last_active":"2023-11-20T06:41:20.316149+0000","last_peered":"2023-11-20T06:41:20.316149+0000","last_clean":"2023-11-20T06:41:20.316149+0000","last_became_active":"2023-11-20T06:41:18.301243+0000","last_became_peered":"2023-11-20T06:41:18.301243+0000","last_unstale":"2023-11-20T06:41:20.316149+0000","last_undegraded":"2023-11-20T06:41:20.316149+0000","last_fullsized":"2023-11-20T06:41:20.316149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:13:30.194807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578630+0000","last_change":"2023-11-20T06:41:14.251212+0000","last_active":"2023-11-20T06:41:19.578630+0000","last_peered":"2023-11-20T06:41:19.578630+0000","last_clean":"2023-11-20T06:41:19.578630+0000","last_became_active":"2023-11-20T06:41:14.250584+0000","last_became_peered":"2023-11-20T06:41:14.250584+0000","last_unstale":"2023-11-20T06:41:19.578630+0000","last_undegraded":"2023-11-20T06:41:19.578630+0000","last_fullsized":"2023-11-20T06:41:19.578630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:35:30.568821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.788069+0000","last_change":"2023-11-20T06:41:13.255026+0000","last_active":"2023-11-20T06:41:19.788069+0000","last_peered":"2023-11-20T06:41:19.788069+0000","last_clean":"2023-11-20T06:41:19.788069+0000","last_became_active":"2023-11-20T06:41:13.254057+0000","last_became_peered":"2023-11-20T06:41:13.254057+0000","last_unstale":"2023-11-20T06:41:19.788069+0000","last_undegraded":"2023-11-20T06:41:19.788069+0000","last_fullsized":"2023-11-20T06:41:19.788069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:01:37.302430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.313428+0000","last_change":"2023-11-20T06:41:18.295335+0000","last_active":"2023-11-20T06:41:20.313428+0000","last_peered":"2023-11-20T06:41:20.313428+0000","last_clean":"2023-11-20T06:41:20.313428+0000","last_became_active":"2023-11-20T06:41:18.294740+0000","last_became_peered":"2023-11-20T06:41:18.294740+0000","last_unstale":"2023-11-20T06:41:20.313428+0000","last_undegraded":"2023-11-20T06:41:20.313428+0000","last_fullsized":"2023-11-20T06:41:20.313428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:52:52.872039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.788050+0000","last_change":"2023-11-20T06:41:14.276548+0000","last_active":"2023-11-20T06:41:19.788050+0000","last_peered":"2023-11-20T06:41:19.788050+0000","last_clean":"2023-11-20T06:41:19.788050+0000","last_became_active":"2023-11-20T06:41:14.261629+0000","last_became_peered":"2023-11-20T06:41:14.261629+0000","last_unstale":"2023-11-20T06:41:19.788050+0000","last_undegraded":"2023-11-20T06:41:19.788050+0000","last_fullsized":"2023-11-20T06:41:19.788050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:49:32.579328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315706+0000","last_change":"2023-11-20T06:41:13.258736+0000","last_active":"2023-11-20T06:41:19.315706+0000","last_peered":"2023-11-20T06:41:19.315706+0000","last_clean":"2023-11-20T06:41:19.315706+0000","last_became_active":"2023-11-20T06:41:13.258459+0000","last_became_peered":"2023-11-20T06:41:13.258459+0000","last_unstale":"2023-11-20T06:41:19.315706+0000","last_undegraded":"2023-11-20T06:41:19.315706+0000","last_fullsized":"2023-11-20T06:41:19.315706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:16:12.804737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.313326+0000","last_change":"2023-11-20T06:41:18.897111+0000","last_active":"2023-11-20T06:41:20.313326+0000","last_peered":"2023-11-20T06:41:20.313326+0000","last_clean":"2023-11-20T06:41:20.313326+0000","last_became_active":"2023-11-20T06:41:18.896661+0000","last_became_peered":"2023-11-20T06:41:18.896661+0000","last_unstale":"2023-11-20T06:41:20.313326+0000","last_undegraded":"2023-11-20T06:41:20.313326+0000","last_fullsized":"2023-11-20T06:41:20.313326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:19:44.001789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.679176+0000","last_change":"2023-11-20T06:41:18.900073+0000","last_active":"2023-11-20T06:41:20.679176+0000","last_peered":"2023-11-20T06:41:20.679176+0000","last_clean":"2023-11-20T06:41:20.679176+0000","last_became_active":"2023-11-20T06:41:18.898514+0000","last_became_peered":"2023-11-20T06:41:18.898514+0000","last_unstale":"2023-11-20T06:41:20.679176+0000","last_undegraded":"2023-11-20T06:41:20.679176+0000","last_fullsized":"2023-11-20T06:41:20.679176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:49:09.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.661897+0000","last_change":"2023-11-20T06:41:14.264028+0000","last_active":"2023-11-20T06:41:19.661897+0000","last_peered":"2023-11-20T06:41:19.661897+0000","last_clean":"2023-11-20T06:41:19.661897+0000","last_became_active":"2023-11-20T06:41:14.263528+0000","last_became_peered":"2023-11-20T06:41:14.263528+0000","last_unstale":"2023-11-20T06:41:19.661897+0000","last_undegraded":"2023-11-20T06:41:19.661897+0000","last_fullsized":"2023-11-20T06:41:19.661897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:06:44.444162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787639+0000","last_change":"2023-11-20T06:41:13.247680+0000","last_active":"2023-11-20T06:41:19.787639+0000","last_peered":"2023-11-20T06:41:19.787639+0000","last_clean":"2023-11-20T06:41:19.787639+0000","last_became_active":"2023-11-20T06:41:13.247333+0000","last_became_peered":"2023-11-20T06:41:13.247333+0000","last_unstale":"2023-11-20T06:41:19.787639+0000","last_undegraded":"2023-11-20T06:41:19.787639+0000","last_fullsized":"2023-11-20T06:41:19.787639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:42:52.596731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.746665+0000","last_change":"2023-11-20T06:41:18.306274+0000","last_active":"2023-11-20T06:41:20.746665+0000","last_peered":"2023-11-20T06:41:20.746665+0000","last_clean":"2023-11-20T06:41:20.746665+0000","last_became_active":"2023-11-20T06:41:18.305628+0000","last_became_peered":"2023-11-20T06:41:18.305628+0000","last_unstale":"2023-11-20T06:41:20.746665+0000","last_undegraded":"2023-11-20T06:41:20.746665+0000","last_fullsized":"2023-11-20T06:41:20.746665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:13:30.194807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583459+0000","last_change":"2023-11-20T06:41:14.268805+0000","last_active":"2023-11-20T06:41:19.583459+0000","last_peered":"2023-11-20T06:41:19.583459+0000","last_clean":"2023-11-20T06:41:19.583459+0000","last_became_active":"2023-11-20T06:41:14.268489+0000","last_became_peered":"2023-11-20T06:41:14.268489+0000","last_unstale":"2023-11-20T06:41:19.583459+0000","last_undegraded":"2023-11-20T06:41:19.583459+0000","last_fullsized":"2023-11-20T06:41:19.583459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:06:44.444162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583458+0000","last_change":"2023-11-20T06:41:13.242442+0000","last_active":"2023-11-20T06:41:19.583458+0000","last_peered":"2023-11-20T06:41:19.583458+0000","last_clean":"2023-11-20T06:41:19.583458+0000","last_became_active":"2023-11-20T06:41:13.242113+0000","last_became_peered":"2023-11-20T06:41:13.242113+0000","last_unstale":"2023-11-20T06:41:19.583458+0000","last_undegraded":"2023-11-20T06:41:19.583458+0000","last_fullsized":"2023-11-20T06:41:19.583458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:54:25.014221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314850+0000","last_change":"2023-11-20T06:41:13.246961+0000","last_active":"2023-11-20T06:41:19.314850+0000","last_peered":"2023-11-20T06:41:19.314850+0000","last_clean":"2023-11-20T06:41:19.314850+0000","last_became_active":"2023-11-20T06:41:13.245832+0000","last_became_peered":"2023-11-20T06:41:13.245832+0000","last_unstale":"2023-11-20T06:41:19.314850+0000","last_undegraded":"2023-11-20T06:41:19.314850+0000","last_fullsized":"2023-11-20T06:41:19.314850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:01:37.302430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578545+0000","last_change":"2023-11-20T06:41:14.263883+0000","last_active":"2023-11-20T06:41:19.578545+0000","last_peered":"2023-11-20T06:41:19.578545+0000","last_clean":"2023-11-20T06:41:19.578545+0000","last_became_active":"2023-11-20T06:41:14.263575+0000","last_became_peered":"2023-11-20T06:41:14.263575+0000","last_unstale":"2023-11-20T06:41:19.578545+0000","last_undegraded":"2023-11-20T06:41:19.578545+0000","last_fullsized":"2023-11-20T06:41:19.578545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:03:05.538623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.590487+0000","last_change":"2023-11-20T06:41:18.306473+0000","last_active":"2023-11-20T06:41:20.590487+0000","last_peered":"2023-11-20T06:41:20.590487+0000","last_clean":"2023-11-20T06:41:20.590487+0000","last_became_active":"2023-11-20T06:41:18.305307+0000","last_became_peered":"2023-11-20T06:41:18.305307+0000","last_unstale":"2023-11-20T06:41:20.590487+0000","last_undegraded":"2023-11-20T06:41:20.590487+0000","last_fullsized":"2023-11-20T06:41:20.590487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:25.525606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583794+0000","last_change":"2023-11-20T06:41:13.244143+0000","last_active":"2023-11-20T06:41:19.583794+0000","last_peered":"2023-11-20T06:41:19.583794+0000","last_clean":"2023-11-20T06:41:19.583794+0000","last_became_active":"2023-11-20T06:41:13.242220+0000","last_became_peered":"2023-11-20T06:41:13.242220+0000","last_unstale":"2023-11-20T06:41:19.583794+0000","last_undegraded":"2023-11-20T06:41:19.583794+0000","last_fullsized":"2023-11-20T06:41:19.583794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:16:12.804737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.313569+0000","last_change":"2023-11-20T06:41:14.266403+0000","last_active":"2023-11-20T06:41:19.313569+0000","last_peered":"2023-11-20T06:41:19.313569+0000","last_clean":"2023-11-20T06:41:19.313569+0000","last_became_active":"2023-11-20T06:41:14.266135+0000","last_became_peered":"2023-11-20T06:41:14.266135+0000","last_unstale":"2023-11-20T06:41:19.313569+0000","last_undegraded":"2023-11-20T06:41:19.313569+0000","last_fullsized":"2023-11-20T06:41:19.313569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:48:13.769350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.314045+0000","last_change":"2023-11-20T06:41:18.299944+0000","last_active":"2023-11-20T06:41:20.314045+0000","last_peered":"2023-11-20T06:41:20.314045+0000","last_clean":"2023-11-20T06:41:20.314045+0000","last_became_active":"2023-11-20T06:41:18.298166+0000","last_became_peered":"2023-11-20T06:41:18.298166+0000","last_unstale":"2023-11-20T06:41:20.314045+0000","last_undegraded":"2023-11-20T06:41:20.314045+0000","last_fullsized":"2023-11-20T06:41:20.314045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:15:14.873283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314208+0000","last_change":"2023-11-20T06:41:14.274186+0000","last_active":"2023-11-20T06:41:19.314208+0000","last_peered":"2023-11-20T06:41:19.314208+0000","last_clean":"2023-11-20T06:41:19.314208+0000","last_became_active":"2023-11-20T06:41:14.273726+0000","last_became_peered":"2023-11-20T06:41:14.273726+0000","last_unstale":"2023-11-20T06:41:19.314208+0000","last_undegraded":"2023-11-20T06:41:19.314208+0000","last_fullsized":"2023-11-20T06:41:19.314208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:36:44.079776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.309592+0000","last_change":"2023-11-20T06:41:14.256793+0000","last_active":"2023-11-20T06:41:19.309592+0000","last_peered":"2023-11-20T06:41:19.309592+0000","last_clean":"2023-11-20T06:41:19.309592+0000","last_became_active":"2023-11-20T06:41:14.256478+0000","last_became_peered":"2023-11-20T06:41:14.256478+0000","last_unstale":"2023-11-20T06:41:19.309592+0000","last_undegraded":"2023-11-20T06:41:19.309592+0000","last_fullsized":"2023-11-20T06:41:19.309592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:15:34.522340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787630+0000","last_change":"2023-11-20T06:41:14.277266+0000","last_active":"2023-11-20T06:41:19.787630+0000","last_peered":"2023-11-20T06:41:19.787630+0000","last_clean":"2023-11-20T06:41:19.787630+0000","last_became_active":"2023-11-20T06:41:14.276909+0000","last_became_peered":"2023-11-20T06:41:14.276909+0000","last_unstale":"2023-11-20T06:41:19.787630+0000","last_undegraded":"2023-11-20T06:41:19.787630+0000","last_fullsized":"2023-11-20T06:41:19.787630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:27:59.872035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578469+0000","last_change":"2023-11-20T06:41:14.264602+0000","last_active":"2023-11-20T06:41:19.578469+0000","last_peered":"2023-11-20T06:41:19.578469+0000","last_clean":"2023-11-20T06:41:19.578469+0000","last_became_active":"2023-11-20T06:41:14.264256+0000","last_became_peered":"2023-11-20T06:41:14.264256+0000","last_unstale":"2023-11-20T06:41:19.578469+0000","last_undegraded":"2023-11-20T06:41:19.578469+0000","last_fullsized":"2023-11-20T06:41:19.578469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:06:44.444162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583903+0000","last_change":"2023-11-20T06:41:14.257660+0000","last_active":"2023-11-20T06:41:19.583903+0000","last_peered":"2023-11-20T06:41:19.583903+0000","last_clean":"2023-11-20T06:41:19.583903+0000","last_became_active":"2023-11-20T06:41:14.257461+0000","last_became_peered":"2023-11-20T06:41:14.257461+0000","last_unstale":"2023-11-20T06:41:19.583903+0000","last_undegraded":"2023-11-20T06:41:19.583903+0000","last_fullsized":"2023-11-20T06:41:19.583903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:55:30.603010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662377+0000","last_change":"2023-11-20T06:41:14.266691+0000","last_active":"2023-11-20T06:41:19.662377+0000","last_peered":"2023-11-20T06:41:19.662377+0000","last_clean":"2023-11-20T06:41:19.662377+0000","last_became_active":"2023-11-20T06:41:14.266401+0000","last_became_peered":"2023-11-20T06:41:14.266401+0000","last_unstale":"2023-11-20T06:41:19.662377+0000","last_undegraded":"2023-11-20T06:41:19.662377+0000","last_fullsized":"2023-11-20T06:41:19.662377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:08:41.021374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315058+0000","last_change":"2023-11-20T06:41:14.266874+0000","last_active":"2023-11-20T06:41:19.315058+0000","last_peered":"2023-11-20T06:41:19.315058+0000","last_clean":"2023-11-20T06:41:19.315058+0000","last_became_active":"2023-11-20T06:41:14.266564+0000","last_became_peered":"2023-11-20T06:41:14.266564+0000","last_unstale":"2023-11-20T06:41:19.315058+0000","last_undegraded":"2023-11-20T06:41:19.315058+0000","last_fullsized":"2023-11-20T06:41:19.315058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:35:30.568821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.584279+0000","last_change":"2023-11-20T06:41:14.258127+0000","last_active":"2023-11-20T06:41:19.584279+0000","last_peered":"2023-11-20T06:41:19.584279+0000","last_clean":"2023-11-20T06:41:19.584279+0000","last_became_active":"2023-11-20T06:41:14.257873+0000","last_became_peered":"2023-11-20T06:41:14.257873+0000","last_unstale":"2023-11-20T06:41:19.584279+0000","last_undegraded":"2023-11-20T06:41:19.584279+0000","last_fullsized":"2023-11-20T06:41:19.584279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:07:43.904895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787515+0000","last_change":"2023-11-20T06:41:14.271045+0000","last_active":"2023-11-20T06:41:19.787515+0000","last_peered":"2023-11-20T06:41:19.787515+0000","last_clean":"2023-11-20T06:41:19.787515+0000","last_became_active":"2023-11-20T06:41:14.265731+0000","last_became_peered":"2023-11-20T06:41:14.265731+0000","last_unstale":"2023-11-20T06:41:19.787515+0000","last_undegraded":"2023-11-20T06:41:19.787515+0000","last_fullsized":"2023-11-20T06:41:19.787515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:45.059330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583398+0000","last_change":"2023-11-20T06:41:14.259066+0000","last_active":"2023-11-20T06:41:19.583398+0000","last_peered":"2023-11-20T06:41:19.583398+0000","last_clean":"2023-11-20T06:41:19.583398+0000","last_became_active":"2023-11-20T06:41:14.258818+0000","last_became_peered":"2023-11-20T06:41:14.258818+0000","last_unstale":"2023-11-20T06:41:19.583398+0000","last_undegraded":"2023-11-20T06:41:19.583398+0000","last_fullsized":"2023-11-20T06:41:19.583398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:03:05.538623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787570+0000","last_change":"2023-11-20T06:41:14.275181+0000","last_active":"2023-11-20T06:41:19.787570+0000","last_peered":"2023-11-20T06:41:19.787570+0000","last_clean":"2023-11-20T06:41:19.787570+0000","last_became_active":"2023-11-20T06:41:14.268467+0000","last_became_peered":"2023-11-20T06:41:14.268467+0000","last_unstale":"2023-11-20T06:41:19.787570+0000","last_undegraded":"2023-11-20T06:41:19.787570+0000","last_fullsized":"2023-11-20T06:41:19.787570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:55:30.603010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578862+0000","last_change":"2023-11-20T06:41:14.270268+0000","last_active":"2023-11-20T06:41:19.578862+0000","last_peered":"2023-11-20T06:41:19.578862+0000","last_clean":"2023-11-20T06:41:19.578862+0000","last_became_active":"2023-11-20T06:41:14.270056+0000","last_became_peered":"2023-11-20T06:41:14.270056+0000","last_unstale":"2023-11-20T06:41:19.578862+0000","last_undegraded":"2023-11-20T06:41:19.578862+0000","last_fullsized":"2023-11-20T06:41:19.578862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:36:44.079776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315115+0000","last_change":"2023-11-20T06:41:14.269251+0000","last_active":"2023-11-20T06:41:19.315115+0000","last_peered":"2023-11-20T06:41:19.315115+0000","last_clean":"2023-11-20T06:41:19.315115+0000","last_became_active":"2023-11-20T06:41:14.267320+0000","last_became_peered":"2023-11-20T06:41:14.267320+0000","last_unstale":"2023-11-20T06:41:19.315115+0000","last_undegraded":"2023-11-20T06:41:19.315115+0000","last_fullsized":"2023-11-20T06:41:19.315115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:42:53.602834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931525+0000","last_change":"2023-11-20T06:41:14.273161+0000","last_active":"2023-11-20T06:41:19.931525+0000","last_peered":"2023-11-20T06:41:19.931525+0000","last_clean":"2023-11-20T06:41:19.931525+0000","last_became_active":"2023-11-20T06:41:14.272837+0000","last_became_peered":"2023-11-20T06:41:14.272837+0000","last_unstale":"2023-11-20T06:41:19.931525+0000","last_undegraded":"2023-11-20T06:41:19.931525+0000","last_fullsized":"2023-11-20T06:41:19.931525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:16:48.088330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.310361+0000","last_change":"2023-11-20T06:41:14.272286+0000","last_active":"2023-11-20T06:41:19.310361+0000","last_peered":"2023-11-20T06:41:19.310361+0000","last_clean":"2023-11-20T06:41:19.310361+0000","last_became_active":"2023-11-20T06:41:14.258570+0000","last_became_peered":"2023-11-20T06:41:14.258570+0000","last_unstale":"2023-11-20T06:41:19.310361+0000","last_undegraded":"2023-11-20T06:41:19.310361+0000","last_fullsized":"2023-11-20T06:41:19.310361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:27:02.569616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.788326+0000","last_change":"2023-11-20T06:41:14.275187+0000","last_active":"2023-11-20T06:41:19.788326+0000","last_peered":"2023-11-20T06:41:19.788326+0000","last_clean":"2023-11-20T06:41:19.788326+0000","last_became_active":"2023-11-20T06:41:14.270334+0000","last_became_peered":"2023-11-20T06:41:14.270334+0000","last_unstale":"2023-11-20T06:41:19.788326+0000","last_undegraded":"2023-11-20T06:41:19.788326+0000","last_fullsized":"2023-11-20T06:41:19.788326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:45:50.281694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787513+0000","last_change":"2023-11-20T06:41:14.272042+0000","last_active":"2023-11-20T06:41:19.787513+0000","last_peered":"2023-11-20T06:41:19.787513+0000","last_clean":"2023-11-20T06:41:19.787513+0000","last_became_active":"2023-11-20T06:41:14.271776+0000","last_became_peered":"2023-11-20T06:41:14.271776+0000","last_unstale":"2023-11-20T06:41:19.787513+0000","last_undegraded":"2023-11-20T06:41:19.787513+0000","last_fullsized":"2023-11-20T06:41:19.787513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:25.537288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662034+0000","last_change":"2023-11-20T06:41:14.265036+0000","last_active":"2023-11-20T06:41:19.662034+0000","last_peered":"2023-11-20T06:41:19.662034+0000","last_clean":"2023-11-20T06:41:19.662034+0000","last_became_active":"2023-11-20T06:41:14.264757+0000","last_became_peered":"2023-11-20T06:41:14.264757+0000","last_unstale":"2023-11-20T06:41:19.662034+0000","last_undegraded":"2023-11-20T06:41:19.662034+0000","last_fullsized":"2023-11-20T06:41:19.662034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:03:05.538623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578415+0000","last_change":"2023-11-20T06:41:14.263606+0000","last_active":"2023-11-20T06:41:19.578415+0000","last_peered":"2023-11-20T06:41:19.578415+0000","last_clean":"2023-11-20T06:41:19.578415+0000","last_became_active":"2023-11-20T06:41:14.263046+0000","last_became_peered":"2023-11-20T06:41:14.263046+0000","last_unstale":"2023-11-20T06:41:19.578415+0000","last_undegraded":"2023-11-20T06:41:19.578415+0000","last_fullsized":"2023-11-20T06:41:19.578415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:56:09.382571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583697+0000","last_change":"2023-11-20T06:41:14.261028+0000","last_active":"2023-11-20T06:41:19.583697+0000","last_peered":"2023-11-20T06:41:19.583697+0000","last_clean":"2023-11-20T06:41:19.583697+0000","last_became_active":"2023-11-20T06:41:14.257826+0000","last_became_peered":"2023-11-20T06:41:14.257826+0000","last_unstale":"2023-11-20T06:41:19.583697+0000","last_undegraded":"2023-11-20T06:41:19.583697+0000","last_fullsized":"2023-11-20T06:41:19.583697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:08:41.021374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315274+0000","last_change":"2023-11-20T06:41:14.269257+0000","last_active":"2023-11-20T06:41:19.315274+0000","last_peered":"2023-11-20T06:41:19.315274+0000","last_clean":"2023-11-20T06:41:19.315274+0000","last_became_active":"2023-11-20T06:41:14.264896+0000","last_became_peered":"2023-11-20T06:41:14.264896+0000","last_unstale":"2023-11-20T06:41:19.315274+0000","last_undegraded":"2023-11-20T06:41:19.315274+0000","last_fullsized":"2023-11-20T06:41:19.315274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:54:26.020324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315416+0000","last_change":"2023-11-20T06:41:14.282030+0000","last_active":"2023-11-20T06:41:19.315416+0000","last_peered":"2023-11-20T06:41:19.315416+0000","last_clean":"2023-11-20T06:41:19.315416+0000","last_became_active":"2023-11-20T06:41:14.281723+0000","last_became_peered":"2023-11-20T06:41:14.281723+0000","last_unstale":"2023-11-20T06:41:19.315416+0000","last_undegraded":"2023-11-20T06:41:19.315416+0000","last_fullsized":"2023-11-20T06:41:19.315416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:08:41.021374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314963+0000","last_change":"2023-11-20T06:41:14.281916+0000","last_active":"2023-11-20T06:41:19.314963+0000","last_peered":"2023-11-20T06:41:19.314963+0000","last_clean":"2023-11-20T06:41:19.314963+0000","last_became_active":"2023-11-20T06:41:14.281641+0000","last_became_peered":"2023-11-20T06:41:14.281641+0000","last_unstale":"2023-11-20T06:41:19.314963+0000","last_undegraded":"2023-11-20T06:41:19.314963+0000","last_fullsized":"2023-11-20T06:41:19.314963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:25.537288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931727+0000","last_change":"2023-11-20T06:41:14.284924+0000","last_active":"2023-11-20T06:41:19.931727+0000","last_peered":"2023-11-20T06:41:19.931727+0000","last_clean":"2023-11-20T06:41:19.931727+0000","last_became_active":"2023-11-20T06:41:14.284654+0000","last_became_peered":"2023-11-20T06:41:14.284654+0000","last_unstale":"2023-11-20T06:41:19.931727+0000","last_undegraded":"2023-11-20T06:41:19.931727+0000","last_fullsized":"2023-11-20T06:41:19.931727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:13:26.142776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583308+0000","last_change":"2023-11-20T06:41:14.271513+0000","last_active":"2023-11-20T06:41:19.583308+0000","last_peered":"2023-11-20T06:41:19.583308+0000","last_clean":"2023-11-20T06:41:19.583308+0000","last_became_active":"2023-11-20T06:41:14.271045+0000","last_became_peered":"2023-11-20T06:41:14.271045+0000","last_unstale":"2023-11-20T06:41:19.583308+0000","last_undegraded":"2023-11-20T06:41:19.583308+0000","last_fullsized":"2023-11-20T06:41:19.583308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:36:44.079776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931144+0000","last_change":"2023-11-20T06:41:14.269364+0000","last_active":"2023-11-20T06:41:19.931144+0000","last_peered":"2023-11-20T06:41:19.931144+0000","last_clean":"2023-11-20T06:41:19.931144+0000","last_became_active":"2023-11-20T06:41:14.269091+0000","last_became_peered":"2023-11-20T06:41:14.269091+0000","last_unstale":"2023-11-20T06:41:19.931144+0000","last_undegraded":"2023-11-20T06:41:19.931144+0000","last_fullsized":"2023-11-20T06:41:19.931144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:07:43.904895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787491+0000","last_change":"2023-11-20T06:41:14.275911+0000","last_active":"2023-11-20T06:41:19.787491+0000","last_peered":"2023-11-20T06:41:19.787491+0000","last_clean":"2023-11-20T06:41:19.787491+0000","last_became_active":"2023-11-20T06:41:14.275285+0000","last_became_peered":"2023-11-20T06:41:14.275285+0000","last_unstale":"2023-11-20T06:41:19.787491+0000","last_undegraded":"2023-11-20T06:41:19.787491+0000","last_fullsized":"2023-11-20T06:41:19.787491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:08:41.021374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931288+0000","last_change":"2023-11-20T06:41:14.271029+0000","last_active":"2023-11-20T06:41:19.931288+0000","last_peered":"2023-11-20T06:41:19.931288+0000","last_clean":"2023-11-20T06:41:19.931288+0000","last_became_active":"2023-11-20T06:41:14.269917+0000","last_became_peered":"2023-11-20T06:41:14.269917+0000","last_unstale":"2023-11-20T06:41:19.931288+0000","last_undegraded":"2023-11-20T06:41:19.931288+0000","last_fullsized":"2023-11-20T06:41:19.931288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:45.059330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787805+0000","last_change":"2023-11-20T06:41:14.277449+0000","last_active":"2023-11-20T06:41:19.787805+0000","last_peered":"2023-11-20T06:41:19.787805+0000","last_clean":"2023-11-20T06:41:19.787805+0000","last_became_active":"2023-11-20T06:41:14.277166+0000","last_became_peered":"2023-11-20T06:41:14.277166+0000","last_unstale":"2023-11-20T06:41:19.787805+0000","last_undegraded":"2023-11-20T06:41:19.787805+0000","last_fullsized":"2023-11-20T06:41:19.787805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:35:30.568821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578392+0000","last_change":"2023-11-20T06:41:14.253214+0000","last_active":"2023-11-20T06:41:19.578392+0000","last_peered":"2023-11-20T06:41:19.578392+0000","last_clean":"2023-11-20T06:41:19.578392+0000","last_became_active":"2023-11-20T06:41:14.252882+0000","last_became_peered":"2023-11-20T06:41:14.252882+0000","last_unstale":"2023-11-20T06:41:19.578392+0000","last_undegraded":"2023-11-20T06:41:19.578392+0000","last_fullsized":"2023-11-20T06:41:19.578392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:42:53.602834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.663050+0000","last_change":"2023-11-20T06:41:14.268127+0000","last_active":"2023-11-20T06:41:19.663050+0000","last_peered":"2023-11-20T06:41:19.663050+0000","last_clean":"2023-11-20T06:41:19.663050+0000","last_became_active":"2023-11-20T06:41:14.267318+0000","last_became_peered":"2023-11-20T06:41:14.267318+0000","last_unstale":"2023-11-20T06:41:19.663050+0000","last_undegraded":"2023-11-20T06:41:19.663050+0000","last_fullsized":"2023-11-20T06:41:19.663050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:35:30.568821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931671+0000","last_change":"2023-11-20T06:41:14.265577+0000","last_active":"2023-11-20T06:41:19.931671+0000","last_peered":"2023-11-20T06:41:19.931671+0000","last_clean":"2023-11-20T06:41:19.931671+0000","last_became_active":"2023-11-20T06:41:14.263538+0000","last_became_peered":"2023-11-20T06:41:14.263538+0000","last_unstale":"2023-11-20T06:41:19.931671+0000","last_undegraded":"2023-11-20T06:41:19.931671+0000","last_fullsized":"2023-11-20T06:41:19.931671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:45:50.281694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":697795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":110686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":106935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":106971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":110686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":106845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":696832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T06:41:39.882 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-20T06:41:39.883 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-20T06:41:39.883 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-20T06:41:39.883 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-20T06:41:39.883 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-20T06:41:40.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.059+0000 7f5704246640 1 Processor -- start 2023-11-20T06:41:40.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.059+0000 7f5704246640 1 -- start start 2023-11-20T06:41:40.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.059+0000 7f5704246640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f56fc0ad960 0x7f56fc0ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:40.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.059+0000 7f5704246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56fc0b07f0 0x7f56fc0cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:40.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.059+0000 7f5704246640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56fc0c96f0 con 0x7f56fc164520 2023-11-20T06:41:40.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.059+0000 7f5704246640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56fc164900 con 0x7f56fc0ad960 2023-11-20T06:41:40.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.059+0000 7f5704246640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc0cb950 con 0x7f56fc0b07f0 2023-11-20T06:41:40.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.059+0000 7f57017e1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f56fc0ad960 0x7f56fc0ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:40.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.059+0000 7f5701fe2640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f56fc164520 0x7f56fc0b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45938/0 (socket says 172.21.15.19:45938) 2023-11-20T06:41:40.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.059+0000 7f5701fe2640 1 -- 172.21.15.19:0/3191432241 learned_addr learned my addr 172.21.15.19:0/3191432241 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:40.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.063+0000 7f57027e3640 1 --2- 172.21.15.19:0/3191432241 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56fc0b07f0 0x7f56fc0cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:40.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.063+0000 7f57017e1640 1 -- 172.21.15.19:0/3191432241 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56fc0b07f0 msgr2=0x7f56fc0cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:40.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.063+0000 7f57017e1640 1 --2- 172.21.15.19:0/3191432241 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56fc0b07f0 0x7f56fc0cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.063+0000 7f57017e1640 1 -- 172.21.15.19:0/3191432241 >> v1:172.21.15.19:6789/0 conn(0x7f56fc164520 legacy=0x7f56fc0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:40.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.063+0000 7f57017e1640 1 -- 172.21.15.19:0/3191432241 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56fc0cbed0 con 0x7f56fc0ad960 2023-11-20T06:41:40.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.063+0000 7f5700fe0640 1 -- 172.21.15.19:0/3191432241 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2385715943 0 0) 0x7f56fc0c96f0 con 0x7f56fc164520 2023-11-20T06:41:40.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.063+0000 7f57017e1640 1 --2- 172.21.15.19:0/3191432241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56fc0ad960 0x7f56fc0ce010 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0097c0 tx=0x7f56ec01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35bf69187c51370 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:40.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.063+0000 7f5700fe0640 1 -- 172.21.15.19:0/3191432241 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec0ab670 con 0x7f56fc0ad960 2023-11-20T06:41:40.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.063+0000 7f5700fe0640 1 -- 172.21.15.19:0/3191432241 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ec0ab7d0 con 0x7f56fc0ad960 2023-11-20T06:41:40.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.063+0000 7f5700fe0640 1 -- 172.21.15.19:0/3191432241 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec0abb60 con 0x7f56fc0ad960 2023-11-20T06:41:40.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.063+0000 7f5704246640 1 -- 172.21.15.19:0/3191432241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56fc0ad960 msgr2=0x7f56fc0ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:40.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.063+0000 7f5704246640 1 --2- 172.21.15.19:0/3191432241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56fc0ad960 0x7f56fc0ce010 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0097c0 tx=0x7f56ec01c450 comp rx=0 tx=0).stop 2023-11-20T06:41:40.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5704246640 1 -- 172.21.15.19:0/3191432241 shutdown_connections 2023-11-20T06:41:40.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5704246640 1 --2- 172.21.15.19:0/3191432241 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56fc0b07f0 0x7f56fc0cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5704246640 1 --2- 172.21.15.19:0/3191432241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56fc0ad960 0x7f56fc0ce010 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5704246640 1 -- 172.21.15.19:0/3191432241 >> 172.21.15.19:0/3191432241 conn(0x7f56fc06c190 msgr2=0x7f56fc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:40.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5704246640 1 -- 172.21.15.19:0/3191432241 shutdown_connections 2023-11-20T06:41:40.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5704246640 1 -- 172.21.15.19:0/3191432241 wait complete. 2023-11-20T06:41:40.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5704246640 1 Processor -- start 2023-11-20T06:41:40.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5704246640 1 -- start start 2023-11-20T06:41:40.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5704246640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56fc0ad960 0x7f56fc0b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:40.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5704246640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56fc0b07f0 0x7f56fc0b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:40.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5704246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56fc164520 0x7f56fc0c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:40.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5704246640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc0b2f50 con 0x7f56fc0ad960 2023-11-20T06:41:40.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5704246640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc0b1970 con 0x7f56fc0b07f0 2023-11-20T06:41:40.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5704246640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc0b1c50 con 0x7f56fc164520 2023-11-20T06:41:40.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5701fe2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56fc0ad960 0x7f56fc0b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:40.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5701fe2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56fc0ad960 0x7f56fc0b2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48372/0 (socket says 172.21.15.19:48372) 2023-11-20T06:41:40.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5701fe2640 1 -- 172.21.15.19:0/2509052703 learned_addr learned my addr 172.21.15.19:0/2509052703 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:40.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f57027e3640 1 --2- 172.21.15.19:0/2509052703 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56fc164520 0x7f56fc0c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:40.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f57017e1640 1 --2- 172.21.15.19:0/2509052703 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56fc0b07f0 0x7f56fc0b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:40.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5701fe2640 1 -- 172.21.15.19:0/2509052703 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56fc164520 msgr2=0x7f56fc0c25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:40.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5701fe2640 1 --2- 172.21.15.19:0/2509052703 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56fc164520 0x7f56fc0c25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5701fe2640 1 -- 172.21.15.19:0/2509052703 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56fc0b07f0 msgr2=0x7f56fc0b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:40.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5701fe2640 1 --2- 172.21.15.19:0/2509052703 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56fc0b07f0 0x7f56fc0b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5701fe2640 1 -- 172.21.15.19:0/2509052703 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec009420 con 0x7f56fc0ad960 2023-11-20T06:41:40.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.067+0000 7f5701fe2640 1 --2- 172.21.15.19:0/2509052703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56fc0ad960 0x7f56fc0b2a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f56f800c480 tx=0x7f56f800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:40.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.071+0000 7f56f27fc640 1 -- 172.21.15.19:0/2509052703 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f80074e0 con 0x7f56fc0ad960 2023-11-20T06:41:40.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.071+0000 7f56f27fc640 1 -- 172.21.15.19:0/2509052703 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f8007660 con 0x7f56fc0ad960 2023-11-20T06:41:40.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.071+0000 7f56f27fc640 1 -- 172.21.15.19:0/2509052703 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f8004a30 con 0x7f56fc0ad960 2023-11-20T06:41:40.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.071+0000 7f5704246640 1 -- 172.21.15.19:0/2509052703 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56fc0b1f30 con 0x7f56fc0ad960 2023-11-20T06:41:40.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.071+0000 7f5704246640 1 -- 172.21.15.19:0/2509052703 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56fc0b24f0 con 0x7f56fc0ad960 2023-11-20T06:41:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.071+0000 7f5704246640 1 -- 172.21.15.19:0/2509052703 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56fc0cc8e0 con 0x7f56fc0ad960 2023-11-20T06:41:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.071+0000 7f56f27fc640 1 -- 172.21.15.19:0/2509052703 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f56f8004b90 con 0x7f56fc0ad960 2023-11-20T06:41:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.071+0000 7f56f27fc640 1 --2- 172.21.15.19:0/2509052703 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f56e00664a0 0x7f56e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:40.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.071+0000 7f56f27fc640 1 -- 172.21.15.19:0/2509052703 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f56f8083360 con 0x7f56fc0ad960 2023-11-20T06:41:40.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.071+0000 7f57017e1640 1 --2- 172.21.15.19:0/2509052703 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f56e00664a0 0x7f56e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:40.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.075+0000 7f57017e1640 1 --2- 172.21.15.19:0/2509052703 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f56e00664a0 0x7f56e0068960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0af000 tx=0x7f56ec0a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:40.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.075+0000 7f56f27fc640 1 -- 172.21.15.19:0/2509052703 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f56f8053f70 con 0x7f56fc0ad960 2023-11-20T06:41:40.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.271+0000 7f5704246640 1 -- 172.21.15.19:0/2509052703 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f56fc074010 con 0x7f56fc0ad960 2023-11-20T06:41:40.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.275+0000 7f56f27fc640 1 -- 172.21.15.19:0/2509052703 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164434 (secure 0 0 0) 0x7f56f8053b00 con 0x7f56fc0ad960 2023-11-20T06:41:40.281 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:40.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.275+0000 7f5704246640 1 -- 172.21.15.19:0/2509052703 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f56e00664a0 msgr2=0x7f56e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:40.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.275+0000 7f5704246640 1 --2- 172.21.15.19:0/2509052703 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f56e00664a0 0x7f56e0068960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0af000 tx=0x7f56ec0a7000 comp rx=0 tx=0).stop 2023-11-20T06:41:40.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.275+0000 7f5704246640 1 -- 172.21.15.19:0/2509052703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56fc0ad960 msgr2=0x7f56fc0b2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:40.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.275+0000 7f5704246640 1 --2- 172.21.15.19:0/2509052703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56fc0ad960 0x7f56fc0b2a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f56f800c480 tx=0x7f56f800c940 comp rx=0 tx=0).stop 2023-11-20T06:41:40.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.275+0000 7f5704246640 1 -- 172.21.15.19:0/2509052703 shutdown_connections 2023-11-20T06:41:40.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.275+0000 7f5704246640 1 --2- 172.21.15.19:0/2509052703 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f56e00664a0 0x7f56e0068960 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.275+0000 7f5704246640 1 --2- 172.21.15.19:0/2509052703 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56fc164520 0x7f56fc0c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.275+0000 7f5704246640 1 --2- 172.21.15.19:0/2509052703 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56fc0b07f0 0x7f56fc0b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.275+0000 7f5704246640 1 --2- 172.21.15.19:0/2509052703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56fc0ad960 0x7f56fc0b2a10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.275+0000 7f5704246640 1 -- 172.21.15.19:0/2509052703 >> 172.21.15.19:0/2509052703 conn(0x7f56fc06c190 msgr2=0x7f56fc1630f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:40.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.275+0000 7f5704246640 1 -- 172.21.15.19:0/2509052703 shutdown_connections 2023-11-20T06:41:40.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.275+0000 7f5704246640 1 -- 172.21.15.19:0/2509052703 wait complete. 2023-11-20T06:41:40.302 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"active_gid":4109,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":142426253},{"type":"v1","addr":"172.21.15.190:6833","nonce":142426253}]},"active_addr":"172.21.15.190:6833/142426253","active_change":"2023-11-20T06:40:53.462253+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.190:0","nonce":1185300069}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.190:0","nonce":3483582087}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.190:0","nonce":1864187171}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.190:0","nonce":3686957929}]}]} 2023-11-20T06:41:40.307 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-20T06:41:40.307 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-20T06:41:40.307 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:41:40.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.443+0000 7f0d61867640 1 Processor -- start 2023-11-20T06:41:40.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.447+0000 7f0d61867640 1 -- start start 2023-11-20T06:41:40.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.447+0000 7f0d61867640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0d5c0d1490 0x7f0d5c06af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:40.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.447+0000 7f0d61867640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0d5c15cd60 0x7f0d5c0b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:40.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.447+0000 7f0d61867640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5c0d3510 con 0x7f0d5c15c980 2023-11-20T06:41:40.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.447+0000 7f0d61867640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5c0cd2b0 con 0x7f0d5c15cd60 2023-11-20T06:41:40.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.447+0000 7f0d61867640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5c0d2f50 con 0x7f0d5c0d1490 2023-11-20T06:41:40.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.447+0000 7f0d60865640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0d5c15c980 0x7f0d5c0d0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45950/0 (socket says 172.21.15.19:45950) 2023-11-20T06:41:40.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.447+0000 7f0d60865640 1 -- 172.21.15.19:0/604007721 learned_addr learned my addr 172.21.15.19:0/604007721 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:40.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.447+0000 7f0d61066640 1 --2- 172.21.15.19:0/604007721 >> v2:172.21.15.19:3300/0 conn(0x7f0d5c15cd60 0x7f0d5c0b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:40.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.447+0000 7f0d5bfff640 1 --2- 172.21.15.19:0/604007721 >> v2:172.21.15.190:3300/0 conn(0x7f0d5c0d1490 0x7f0d5c06af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:40.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.447+0000 7f0d5b7fe640 1 -- 172.21.15.19:0/604007721 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779546527 0 0) 0x7f0d500012a0 con 0x7f0d5c15c980 2023-11-20T06:41:40.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.447+0000 7f0d5b7fe640 1 -- 172.21.15.19:0/604007721 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d4c003530 con 0x7f0d5c15c980 2023-11-20T06:41:40.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.447+0000 7f0d61066640 1 -- 172.21.15.19:0/604007721 >> v2:172.21.15.190:3300/0 conn(0x7f0d5c0d1490 msgr2=0x7f0d5c06af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:40.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.447+0000 7f0d61066640 1 --2- 172.21.15.19:0/604007721 >> v2:172.21.15.190:3300/0 conn(0x7f0d5c0d1490 0x7f0d5c06af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.447+0000 7f0d61066640 1 -- 172.21.15.19:0/604007721 >> v1:172.21.15.19:6789/0 conn(0x7f0d5c15c980 legacy=0x7f0d5c0d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:40.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.447+0000 7f0d61066640 1 -- 172.21.15.19:0/604007721 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c0d3230 con 0x7f0d5c15cd60 2023-11-20T06:41:40.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.447+0000 7f0d5bfff640 1 --2- 172.21.15.19:0/604007721 >> v2:172.21.15.190:3300/0 conn(0x7f0d5c0d1490 0x7f0d5c06af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:41:40.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.451+0000 7f0d61066640 1 --2- 172.21.15.19:0/604007721 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d5c15cd60 0x7f0d5c0b1b90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0d1900 tx=0x7f0d5401d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97714efb422dee16 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:40.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.451+0000 7f0d5b7fe640 1 -- 172.21.15.19:0/604007721 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d540a5850 con 0x7f0d5c15cd60 2023-11-20T06:41:40.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.451+0000 7f0d5b7fe640 1 -- 172.21.15.19:0/604007721 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d540a59b0 con 0x7f0d5c15cd60 2023-11-20T06:41:40.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.451+0000 7f0d5b7fe640 1 -- 172.21.15.19:0/604007721 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d540a5d40 con 0x7f0d5c15cd60 2023-11-20T06:41:40.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.451+0000 7f0d61867640 1 -- 172.21.15.19:0/604007721 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d5c15cd60 msgr2=0x7f0d5c0b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:40.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.451+0000 7f0d61867640 1 --2- 172.21.15.19:0/604007721 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d5c15cd60 0x7f0d5c0b1b90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0d1900 tx=0x7f0d5401d2e0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.451+0000 7f0d61867640 1 -- 172.21.15.19:0/604007721 shutdown_connections 2023-11-20T06:41:40.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.451+0000 7f0d61867640 1 --2- 172.21.15.19:0/604007721 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d5c15cd60 0x7f0d5c0b1b90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.451+0000 7f0d61867640 1 --2- 172.21.15.19:0/604007721 >> v2:172.21.15.190:3300/0 conn(0x7f0d5c0d1490 0x7f0d5c06af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.451+0000 7f0d61867640 1 -- 172.21.15.19:0/604007721 >> 172.21.15.19:0/604007721 conn(0x7f0d5c09ba80 msgr2=0x7f0d5c0d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:40.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.451+0000 7f0d61867640 1 -- 172.21.15.19:0/604007721 shutdown_connections 2023-11-20T06:41:40.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.451+0000 7f0d61867640 1 -- 172.21.15.19:0/604007721 wait complete. 2023-11-20T06:41:40.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.451+0000 7f0d61867640 1 Processor -- start 2023-11-20T06:41:40.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.451+0000 7f0d61867640 1 -- start start 2023-11-20T06:41:40.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d61867640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d5c0d1490 0x7f0d5c0c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:40.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d61867640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d5c15c980 0x7f0d5c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:40.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d61867640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d5c15cd60 0x7f0d5c06c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:40.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d61867640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c0c68e0 con 0x7f0d5c0d1490 2023-11-20T06:41:40.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d61867640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c0c6bc0 con 0x7f0d5c15cd60 2023-11-20T06:41:40.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d61867640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c0c6ea0 con 0x7f0d5c15c980 2023-11-20T06:41:40.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d60865640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d5c0d1490 0x7f0d5c0c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:40.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d60865640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d5c0d1490 0x7f0d5c0c6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48392/0 (socket says 172.21.15.19:48392) 2023-11-20T06:41:40.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d60865640 1 -- 172.21.15.19:0/120298230 learned_addr learned my addr 172.21.15.19:0/120298230 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:40.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d5bfff640 1 --2- 172.21.15.19:0/120298230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d5c15c980 0x7f0d5c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:40.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d61066640 1 --2- 172.21.15.19:0/120298230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d5c15cd60 0x7f0d5c06c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:40.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d60865640 1 -- 172.21.15.19:0/120298230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d5c15c980 msgr2=0x7f0d5c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:40.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d60865640 1 --2- 172.21.15.19:0/120298230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d5c15c980 0x7f0d5c06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d60865640 1 -- 172.21.15.19:0/120298230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d5c15cd60 msgr2=0x7f0d5c06c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:40.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d60865640 1 --2- 172.21.15.19:0/120298230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d5c15cd60 0x7f0d5c06c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d60865640 1 -- 172.21.15.19:0/120298230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d48009420 con 0x7f0d5c0d1490 2023-11-20T06:41:40.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d5bfff640 1 --2- 172.21.15.19:0/120298230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d5c15c980 0x7f0d5c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:40.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d60865640 1 --2- 172.21.15.19:0/120298230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d5c0d1490 0x7f0d5c0c6250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000c4d0 tx=0x7f0d5000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:40.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d597fa640 1 -- 172.21.15.19:0/120298230 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d50007480 con 0x7f0d5c0d1490 2023-11-20T06:41:40.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d597fa640 1 -- 172.21.15.19:0/120298230 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d500075e0 con 0x7f0d5c0d1490 2023-11-20T06:41:40.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d61867640 1 -- 172.21.15.19:0/120298230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d54009a70 con 0x7f0d5c0d1490 2023-11-20T06:41:40.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d597fa640 1 -- 172.21.15.19:0/120298230 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d500059d0 con 0x7f0d5c0d1490 2023-11-20T06:41:40.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d61867640 1 -- 172.21.15.19:0/120298230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5c0c7460 con 0x7f0d5c0d1490 2023-11-20T06:41:40.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.455+0000 7f0d61867640 1 -- 172.21.15.19:0/120298230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5c04e9c0 con 0x7f0d5c0d1490 2023-11-20T06:41:40.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.459+0000 7f0d597fa640 1 -- 172.21.15.19:0/120298230 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0d50005b30 con 0x7f0d5c0d1490 2023-11-20T06:41:40.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.459+0000 7f0d597fa640 1 --2- 172.21.15.19:0/120298230 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0d400664a0 0x7f0d40068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:40.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.459+0000 7f0d597fa640 1 -- 172.21.15.19:0/120298230 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0d500836a0 con 0x7f0d5c0d1490 2023-11-20T06:41:40.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.459+0000 7f0d5bfff640 1 --2- 172.21.15.19:0/120298230 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0d400664a0 0x7f0d40068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:40.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.459+0000 7f0d5bfff640 1 --2- 172.21.15.19:0/120298230 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0d400664a0 0x7f0d40068960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0b82e0 tx=0x7f0d48008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:40.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.463+0000 7f0d597fa640 1 -- 172.21.15.19:0/120298230 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0d500507b0 con 0x7f0d5c0d1490 2023-11-20T06:41:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.619+0000 7f0d61867640 1 -- 172.21.15.19:0/120298230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d5c0cff00 con 0x7f0d5c0d1490 2023-11-20T06:41:40.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.623+0000 7f0d597fa640 1 -- 172.21.15.19:0/120298230 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f0d50017020 con 0x7f0d5c0d1490 2023-11-20T06:41:40.628 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:40.628 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":25,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:20.306335+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:41:40.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.623+0000 7f0d61867640 1 -- 172.21.15.19:0/120298230 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0d400664a0 msgr2=0x7f0d40068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:40.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.623+0000 7f0d61867640 1 --2- 172.21.15.19:0/120298230 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0d400664a0 0x7f0d40068960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0b82e0 tx=0x7f0d48008040 comp rx=0 tx=0).stop 2023-11-20T06:41:40.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.623+0000 7f0d61867640 1 -- 172.21.15.19:0/120298230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d5c0d1490 msgr2=0x7f0d5c0c6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:40.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.623+0000 7f0d61867640 1 --2- 172.21.15.19:0/120298230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d5c0d1490 0x7f0d5c0c6250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000c4d0 tx=0x7f0d5000c990 comp rx=0 tx=0).stop 2023-11-20T06:41:40.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.623+0000 7f0d61867640 1 -- 172.21.15.19:0/120298230 shutdown_connections 2023-11-20T06:41:40.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.623+0000 7f0d61867640 1 --2- 172.21.15.19:0/120298230 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0d400664a0 0x7f0d40068960 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.623+0000 7f0d61867640 1 --2- 172.21.15.19:0/120298230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d5c15cd60 0x7f0d5c06c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.623+0000 7f0d61867640 1 --2- 172.21.15.19:0/120298230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d5c15c980 0x7f0d5c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.623+0000 7f0d61867640 1 --2- 172.21.15.19:0/120298230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d5c0d1490 0x7f0d5c0c6250 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.623+0000 7f0d61867640 1 -- 172.21.15.19:0/120298230 >> 172.21.15.19:0/120298230 conn(0x7f0d5c09ba80 msgr2=0x7f0d5c15b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:40.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.623+0000 7f0d61867640 1 -- 172.21.15.19:0/120298230 shutdown_connections 2023-11-20T06:41:40.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.623+0000 7f0d61867640 1 -- 172.21.15.19:0/120298230 wait complete. 2023-11-20T06:41:40.650 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-20T06:41:40.651 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:41:40.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.787+0000 7f56ecd3e640 1 Processor -- start 2023-11-20T06:41:40.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.787+0000 7f56ecd3e640 1 -- start start 2023-11-20T06:41:40.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.791+0000 7f56ecd3e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f56e815ca70 0x7f56e80d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:40.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.791+0000 7f56ecd3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56e80cf7a0 0x7f56e80c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:40.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.791+0000 7f56ecd3e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e80c65f0 con 0x7f56e80d3550 2023-11-20T06:41:40.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.791+0000 7f56ecd3e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e80ce820 con 0x7f56e815ca70 2023-11-20T06:41:40.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.791+0000 7f56ecd3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e80cdf80 con 0x7f56e80cf7a0 2023-11-20T06:41:40.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.791+0000 7f56e6d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56e80cf7a0 0x7f56e80c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:40.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.791+0000 7f56e659c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f56e815ca70 0x7f56e80d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:40.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.791+0000 7f56dffff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f56e80d3550 0x7f56e80cf090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:58110/0 (socket says 172.21.15.19:58110) 2023-11-20T06:41:40.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.791+0000 7f56e6d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56e80cf7a0 0x7f56e80c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:41766/0 (socket says 172.21.15.19:41766) 2023-11-20T06:41:40.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.791+0000 7f56dffff640 1 -- 172.21.15.19:0/2454328782 learned_addr learned my addr 172.21.15.19:0/2454328782 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:40.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.791+0000 7f56e5d9b640 1 -- 172.21.15.19:0/2454328782 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112992816 0 0) 0x7f56e80c65f0 con 0x7f56e80d3550 2023-11-20T06:41:40.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.791+0000 7f56e5d9b640 1 -- 172.21.15.19:0/2454328782 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56d4003530 con 0x7f56e80d3550 2023-11-20T06:41:40.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.791+0000 7f56e6d9d640 1 -- 172.21.15.19:0/2454328782 >> v2:172.21.15.190:3300/0 conn(0x7f56e815ca70 msgr2=0x7f56e80d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:40.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.791+0000 7f56e6d9d640 1 --2- 172.21.15.19:0/2454328782 >> v2:172.21.15.190:3300/0 conn(0x7f56e815ca70 0x7f56e80d3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.791+0000 7f56e6d9d640 1 -- 172.21.15.19:0/2454328782 >> v1:172.21.15.190:6789/0 conn(0x7f56e80d3550 legacy=0x7f56e80cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:40.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.791+0000 7f56e6d9d640 1 -- 172.21.15.19:0/2454328782 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e80ce260 con 0x7f56e80cf7a0 2023-11-20T06:41:40.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.791+0000 7f56e659c640 1 --2- 172.21.15.19:0/2454328782 >> v2:172.21.15.190:3300/0 conn(0x7f56e815ca70 0x7f56e80d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:41:40.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.795+0000 7f56e6d9d640 1 --2- 172.21.15.19:0/2454328782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56e80cf7a0 0x7f56e80c6ad0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009d90 tx=0x7f56e001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c99e12482b1210a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:40.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.795+0000 7f56e5d9b640 1 -- 172.21.15.19:0/2454328782 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e00a5940 con 0x7f56e80cf7a0 2023-11-20T06:41:40.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.795+0000 7f56e5d9b640 1 -- 172.21.15.19:0/2454328782 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e00a5aa0 con 0x7f56e80cf7a0 2023-11-20T06:41:40.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.795+0000 7f56e5d9b640 1 -- 172.21.15.19:0/2454328782 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e00a5e30 con 0x7f56e80cf7a0 2023-11-20T06:41:40.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.795+0000 7f56ecd3e640 1 -- 172.21.15.19:0/2454328782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56e80cf7a0 msgr2=0x7f56e80c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:40.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.795+0000 7f56ecd3e640 1 --2- 172.21.15.19:0/2454328782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56e80cf7a0 0x7f56e80c6ad0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009d90 tx=0x7f56e001c920 comp rx=0 tx=0).stop 2023-11-20T06:41:40.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.795+0000 7f56ecd3e640 1 -- 172.21.15.19:0/2454328782 shutdown_connections 2023-11-20T06:41:40.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.795+0000 7f56ecd3e640 1 --2- 172.21.15.19:0/2454328782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56e80cf7a0 0x7f56e80c6ad0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.795+0000 7f56ecd3e640 1 --2- 172.21.15.19:0/2454328782 >> v2:172.21.15.190:3300/0 conn(0x7f56e815ca70 0x7f56e80d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.795+0000 7f56ecd3e640 1 -- 172.21.15.19:0/2454328782 >> 172.21.15.19:0/2454328782 conn(0x7f56e809bc50 msgr2=0x7f56e80d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:40.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.795+0000 7f56ecd3e640 1 -- 172.21.15.19:0/2454328782 shutdown_connections 2023-11-20T06:41:40.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.795+0000 7f56ecd3e640 1 -- 172.21.15.19:0/2454328782 wait complete. 2023-11-20T06:41:40.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.795+0000 7f56ecd3e640 1 Processor -- start 2023-11-20T06:41:40.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.795+0000 7f56ecd3e640 1 -- start start 2023-11-20T06:41:40.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.795+0000 7f56ecd3e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56e80cf7a0 0x7f56e80b8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:40.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.795+0000 7f56ecd3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56e80d3550 0x7f56e80b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:40.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.795+0000 7f56ecd3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e815ca70 0x7f56e80d2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:40.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.795+0000 7f56ecd3e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e80b7ed0 con 0x7f56e815ca70 2023-11-20T06:41:40.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.795+0000 7f56ecd3e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e80b72c0 con 0x7f56e80cf7a0 2023-11-20T06:41:40.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.795+0000 7f56ecd3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e80b75a0 con 0x7f56e80d3550 2023-11-20T06:41:40.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.799+0000 7f56e6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e815ca70 0x7f56e80d2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:40.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.799+0000 7f56e6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e815ca70 0x7f56e80d2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48402/0 (socket says 172.21.15.19:48402) 2023-11-20T06:41:40.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.799+0000 7f56e6d9d640 1 -- 172.21.15.19:0/4071211429 learned_addr learned my addr 172.21.15.19:0/4071211429 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:40.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.799+0000 7f56e659c640 1 --2- 172.21.15.19:0/4071211429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56e80cf7a0 0x7f56e80b8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:40.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.799+0000 7f56dffff640 1 --2- 172.21.15.19:0/4071211429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56e80d3550 0x7f56e80b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:40.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.799+0000 7f56e6d9d640 1 -- 172.21.15.19:0/4071211429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56e80d3550 msgr2=0x7f56e80b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:40.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.799+0000 7f56e6d9d640 1 --2- 172.21.15.19:0/4071211429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56e80d3550 0x7f56e80b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.799+0000 7f56e6d9d640 1 -- 172.21.15.19:0/4071211429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56e80cf7a0 msgr2=0x7f56e80b8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:40.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.799+0000 7f56e6d9d640 1 --2- 172.21.15.19:0/4071211429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56e80cf7a0 0x7f56e80b8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.799+0000 7f56e6d9d640 1 -- 172.21.15.19:0/4071211429 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d80093b0 con 0x7f56e815ca70 2023-11-20T06:41:40.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.799+0000 7f56e6d9d640 1 --2- 172.21.15.19:0/4071211429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e815ca70 0x7f56e80d2aa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f56e001a550 tx=0x7f56e00196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:40.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.799+0000 7f56deffd640 1 -- 172.21.15.19:0/4071211429 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e00aec30 con 0x7f56e815ca70 2023-11-20T06:41:40.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.799+0000 7f56deffd640 1 -- 172.21.15.19:0/4071211429 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e00aed90 con 0x7f56e815ca70 2023-11-20T06:41:40.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.799+0000 7f56deffd640 1 -- 172.21.15.19:0/4071211429 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e00b7650 con 0x7f56e815ca70 2023-11-20T06:41:40.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.799+0000 7f56ecd3e640 1 -- 172.21.15.19:0/4071211429 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e0009a70 con 0x7f56e815ca70 2023-11-20T06:41:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.799+0000 7f56ecd3e640 1 -- 172.21.15.19:0/4071211429 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e80b7b60 con 0x7f56e815ca70 2023-11-20T06:41:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.799+0000 7f56ecd3e640 1 -- 172.21.15.19:0/4071211429 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e80b8040 con 0x7f56e815ca70 2023-11-20T06:41:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.799+0000 7f56deffd640 1 -- 172.21.15.19:0/4071211429 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f56e00b4050 con 0x7f56e815ca70 2023-11-20T06:41:40.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.803+0000 7f56deffd640 1 --2- 172.21.15.19:0/4071211429 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f56c80664a0 0x7f56c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:40.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.803+0000 7f56deffd640 1 -- 172.21.15.19:0/4071211429 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f56e011eff0 con 0x7f56e815ca70 2023-11-20T06:41:40.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.803+0000 7f56e659c640 1 --2- 172.21.15.19:0/4071211429 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f56c80664a0 0x7f56c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:40.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.803+0000 7f56e659c640 1 --2- 172.21.15.19:0/4071211429 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f56c80664a0 0x7f56c8068960 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009c30 tx=0x7f56d8006f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:40.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.807+0000 7f56deffd640 1 -- 172.21.15.19:0/4071211429 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f56e00ec1b0 con 0x7f56e815ca70 2023-11-20T06:41:40.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.963+0000 7f56ecd3e640 1 -- 172.21.15.19:0/4071211429 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56e8074010 con 0x7f56e815ca70 2023-11-20T06:41:40.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.967+0000 7f56deffd640 1 -- 172.21.15.19:0/4071211429 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f56e00b2090 con 0x7f56e815ca70 2023-11-20T06:41:40.971 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:40.971 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":25,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:20.306335+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:41:40.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.967+0000 7f56ecd3e640 1 -- 172.21.15.19:0/4071211429 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f56c80664a0 msgr2=0x7f56c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:40.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.967+0000 7f56ecd3e640 1 --2- 172.21.15.19:0/4071211429 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f56c80664a0 0x7f56c8068960 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009c30 tx=0x7f56d8006f90 comp rx=0 tx=0).stop 2023-11-20T06:41:40.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.967+0000 7f56ecd3e640 1 -- 172.21.15.19:0/4071211429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e815ca70 msgr2=0x7f56e80d2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:40.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.967+0000 7f56ecd3e640 1 --2- 172.21.15.19:0/4071211429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e815ca70 0x7f56e80d2aa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f56e001a550 tx=0x7f56e00196c0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.967+0000 7f56ecd3e640 1 -- 172.21.15.19:0/4071211429 shutdown_connections 2023-11-20T06:41:40.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.967+0000 7f56ecd3e640 1 --2- 172.21.15.19:0/4071211429 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f56c80664a0 0x7f56c8068960 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.967+0000 7f56ecd3e640 1 --2- 172.21.15.19:0/4071211429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e815ca70 0x7f56e80d2aa0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.967+0000 7f56ecd3e640 1 --2- 172.21.15.19:0/4071211429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56e80d3550 0x7f56e80b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.967+0000 7f56ecd3e640 1 --2- 172.21.15.19:0/4071211429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56e80cf7a0 0x7f56e80b8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:40.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.967+0000 7f56ecd3e640 1 -- 172.21.15.19:0/4071211429 >> 172.21.15.19:0/4071211429 conn(0x7f56e809bc50 msgr2=0x7f56e806b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:40.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.967+0000 7f56ecd3e640 1 -- 172.21.15.19:0/4071211429 shutdown_connections 2023-11-20T06:41:40.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:40.967+0000 7f56ecd3e640 1 -- 172.21.15.19:0/4071211429 wait complete. 2023-11-20T06:41:40.993 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-20T06:41:40.993 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-20T06:41:40.993 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-20T06:41:40.994 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-20T06:41:40.994 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-20T06:41:40.995 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-20T06:41:40.995 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-20T06:41:40.995 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-20T06:41:41.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.235+0000 7f98bce46640 1 Processor -- start 2023-11-20T06:41:41.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.235+0000 7f98bce46640 1 -- start start 2023-11-20T06:41:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.235+0000 7f98bce46640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f98b0006340 0x7f98b00067d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.235+0000 7f98bce46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98b0006d10 0x7f98b0007140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.235+0000 7f98bce46640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b0038aa0 con 0x7f98b0053a50 2023-11-20T06:41:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.235+0000 7f98bce46640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b0057d70 con 0x7f98b0006340 2023-11-20T06:41:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.235+0000 7f98bce46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b0058050 con 0x7f98b0006d10 2023-11-20T06:41:41.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.239+0000 7f98b5d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f98b0006340 0x7f98b00067d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.239+0000 7f98b5d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f98b0006340 0x7f98b00067d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48408/0 (socket says 172.21.15.19:48408) 2023-11-20T06:41:41.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.239+0000 7f98b5d9b640 1 -- 172.21.15.19:0/4031531614 learned_addr learned my addr 172.21.15.19:0/4031531614 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.239+0000 7f98b5d9b640 1 -- 172.21.15.19:0/4031531614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98b0006d10 msgr2=0x7f98b0007140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.239+0000 7f98b5d9b640 1 --2- 172.21.15.19:0/4031531614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98b0006d10 0x7f98b0007140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.239+0000 7f98b5d9b640 1 -- 172.21.15.19:0/4031531614 >> v1:172.21.15.19:6789/0 conn(0x7f98b0053a50 legacy=0x7f98b0053e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.239+0000 7f98b5d9b640 1 -- 172.21.15.19:0/4031531614 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b0058330 con 0x7f98b0006340 2023-11-20T06:41:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.239+0000 7fcf23371640 1 Processor -- start 2023-11-20T06:41:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7fcf23371640 1 -- start start 2023-11-20T06:41:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7fcf23371640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcf1c0afd90 0x7fcf1c1652a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7fcf23371640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcf1c0b0170 0x7fcf1c0cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7fcf23371640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1c161180 con 0x7fcf1c161c40 2023-11-20T06:41:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7fcf23371640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c161820 con 0x7fcf1c0b0170 2023-11-20T06:41:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7fcf23371640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c0c9270 con 0x7fcf1c0afd90 2023-11-20T06:41:41.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7fcf21b6e640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fcf1c161c40 0x7fcf1c0c8a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:58126/0 (socket says 172.21.15.19:58126) 2023-11-20T06:41:41.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7fcf21b6e640 1 -- 172.21.15.19:0/1875964821 learned_addr learned my addr 172.21.15.19:0/1875964821 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:41.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.239+0000 7f2b8a371640 1 Processor -- start 2023-11-20T06:41:41.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7f2b8a371640 1 -- start start 2023-11-20T06:41:41.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7f2b8a371640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b7c0e6890 0x7f2b7c03ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7f2b8a371640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b7c006cd0 0x7f2b7c053e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7f2b8936f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b7c0e6890 0x7f2b7c03ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7f2b8936f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b7c0e6890 0x7f2b7c03ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:41804/0 (socket says 172.21.15.19:41804) 2023-11-20T06:41:41.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7f2b88b6e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b7c006cd0 0x7f2b7c053e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7f2b88b6e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b7c006cd0 0x7f2b7c053e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48424/0 (socket says 172.21.15.19:48424) 2023-11-20T06:41:41.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7f2b8936f640 1 -- 172.21.15.19:0/3296338884 learned_addr learned my addr 172.21.15.19:0/3296338884 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7fcf2236f640 1 --2- 172.21.15.19:0/1875964821 >> v2:172.21.15.190:3300/0 conn(0x7fcf1c0afd90 0x7fcf1c1652a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7f2b8a371640 1 --2- 172.21.15.19:0/3296338884 >> v2:172.21.15.190:3300/0 conn(0x7f2b7c054340 0x7f2b7c0e6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7f2b8a371640 1 -- 172.21.15.19:0/3296338884 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7c0547d0 con 0x7f2b7c006cd0 2023-11-20T06:41:41.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7f2b8a371640 1 -- 172.21.15.19:0/3296338884 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7c0577a0 con 0x7f2b7c054340 2023-11-20T06:41:41.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.243+0000 7f2b8a371640 1 -- 172.21.15.19:0/3296338884 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c057470 con 0x7f2b7c0e6890 2023-11-20T06:41:41.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.247+0000 7fcf2236f640 1 -- 172.21.15.19:0/1875964821 >> v2:172.21.15.19:3300/0 conn(0x7fcf1c0b0170 msgr2=0x7fcf1c0cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.247+0000 7fcf2236f640 1 --2- 172.21.15.19:0/1875964821 >> v2:172.21.15.19:3300/0 conn(0x7fcf1c0b0170 0x7fcf1c0cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.247+0000 7fcf2236f640 1 -- 172.21.15.19:0/1875964821 >> v1:172.21.15.190:6789/0 conn(0x7fcf1c161c40 legacy=0x7fcf1c0c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.247+0000 7fcf2136d640 1 -- 172.21.15.19:0/1875964821 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246474645 0 0) 0x7fcf1c161180 con 0x7fcf1c161c40 2023-11-20T06:41:41.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.247+0000 7f2b89b70640 1 --2- 172.21.15.19:0/3296338884 >> v2:172.21.15.190:3300/0 conn(0x7f2b7c054340 0x7f2b7c0e6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.247+0000 7f2b8936f640 1 -- 172.21.15.19:0/3296338884 >> v2:172.21.15.190:3300/0 conn(0x7f2b7c054340 msgr2=0x7f2b7c0e6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.247+0000 7f2b8936f640 1 --2- 172.21.15.19:0/3296338884 >> v2:172.21.15.190:3300/0 conn(0x7f2b7c054340 0x7f2b7c0e6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.247+0000 7f2b8936f640 1 -- 172.21.15.19:0/3296338884 >> v2:172.21.15.19:3300/0 conn(0x7f2b7c006cd0 msgr2=0x7f2b7c053e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.247+0000 7f2b8936f640 1 --2- 172.21.15.19:0/3296338884 >> v2:172.21.15.19:3300/0 conn(0x7f2b7c006cd0 0x7f2b7c053e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.247+0000 7f2b8936f640 1 -- 172.21.15.19:0/3296338884 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c007520 con 0x7f2b7c0e6890 2023-11-20T06:41:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.247+0000 7fcf2236f640 1 -- 172.21.15.19:0/1875964821 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c0c9550 con 0x7fcf1c0afd90 2023-11-20T06:41:41.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.247+0000 7f98b5d9b640 1 --2- 172.21.15.19:0/4031531614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98b0006340 0x7f98b00067d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f98ac009870 tx=0x7f98ac01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eaf044b2dcbaa84 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.247+0000 7f98b559a640 1 -- 172.21.15.19:0/4031531614 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac0a89b0 con 0x7f98b0006340 2023-11-20T06:41:41.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.247+0000 7f98b559a640 1 -- 172.21.15.19:0/4031531614 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac0a8b10 con 0x7f98b0006340 2023-11-20T06:41:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.247+0000 7f98b559a640 1 -- 172.21.15.19:0/4031531614 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac0a89b0 con 0x7f98b0006340 2023-11-20T06:41:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f98bce46640 1 -- 172.21.15.19:0/4031531614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98b0006340 msgr2=0x7f98b00067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f98bce46640 1 --2- 172.21.15.19:0/4031531614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98b0006340 0x7f98b00067d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f98ac009870 tx=0x7f98ac01ed10 comp rx=0 tx=0).stop 2023-11-20T06:41:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f98bce46640 1 -- 172.21.15.19:0/4031531614 shutdown_connections 2023-11-20T06:41:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f98bce46640 1 --2- 172.21.15.19:0/4031531614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98b0006d10 0x7f98b0007140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f98bce46640 1 --2- 172.21.15.19:0/4031531614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98b0006340 0x7f98b00067d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f98bce46640 1 -- 172.21.15.19:0/4031531614 >> 172.21.15.19:0/4031531614 conn(0x7f98b00591f0 msgr2=0x7f98b0059600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f98bce46640 1 -- 172.21.15.19:0/4031531614 shutdown_connections 2023-11-20T06:41:41.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f2b8936f640 1 --2- 172.21.15.19:0/3296338884 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b7c0e6890 0x7f2b7c03ed00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c03abb0 tx=0x7f2b8001c0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dff694b06b60c2bd server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f98bce46640 1 -- 172.21.15.19:0/4031531614 wait complete. 2023-11-20T06:41:41.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f2b7bfff640 1 -- 172.21.15.19:0/3296338884 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b800ab600 con 0x7f2b7c0e6890 2023-11-20T06:41:41.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f2b7bfff640 1 -- 172.21.15.19:0/3296338884 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b800a7050 con 0x7f2b7c0e6890 2023-11-20T06:41:41.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f2b7bfff640 1 -- 172.21.15.19:0/3296338884 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b800ab980 con 0x7f2b7c0e6890 2023-11-20T06:41:41.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f8a7bfff640 1 Processor -- start 2023-11-20T06:41:41.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f2b8a371640 1 -- 172.21.15.19:0/3296338884 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b7c0e6890 msgr2=0x7f2b7c03ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f2b8a371640 1 --2- 172.21.15.19:0/3296338884 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b7c0e6890 0x7f2b7c03ed00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c03abb0 tx=0x7f2b8001c0f0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f98bce46640 1 Processor -- start 2023-11-20T06:41:41.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f98bce46640 1 -- start start 2023-11-20T06:41:41.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7fcf2236f640 1 --2- 172.21.15.19:0/1875964821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf1c0afd90 0x7fcf1c1652a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c06d0e0 tx=0x7fcf0c01c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10dca314473af460 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f2b8a371640 1 -- 172.21.15.19:0/3296338884 shutdown_connections 2023-11-20T06:41:41.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f2b8a371640 1 --2- 172.21.15.19:0/3296338884 >> v2:172.21.15.190:3300/0 conn(0x7f2b7c054340 0x7f2b7c0e6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f2b8a371640 1 --2- 172.21.15.19:0/3296338884 >> v2:172.21.15.19:3300/0 conn(0x7f2b7c006cd0 0x7f2b7c053e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f2b8a371640 1 --2- 172.21.15.19:0/3296338884 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b7c0e6890 0x7f2b7c03ed00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f2b8a371640 1 -- 172.21.15.19:0/3296338884 >> 172.21.15.19:0/3296338884 conn(0x7f2b7c059130 msgr2=0x7f2b7c059540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f2b8a371640 1 -- 172.21.15.19:0/3296338884 shutdown_connections 2023-11-20T06:41:41.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f2b8a371640 1 -- 172.21.15.19:0/3296338884 wait complete. 2023-11-20T06:41:41.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7ff845688640 1 Processor -- start 2023-11-20T06:41:41.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7ff845688640 1 -- start start 2023-11-20T06:41:41.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.251+0000 7f8a7bfff640 1 -- start start 2023-11-20T06:41:41.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7fcf2136d640 1 -- 172.21.15.19:0/1875964821 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c0ab600 con 0x7fcf1c0afd90 2023-11-20T06:41:41.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7fcf2136d640 1 -- 172.21.15.19:0/1875964821 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0c0a7050 con 0x7fcf1c0afd90 2023-11-20T06:41:41.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7fcf2136d640 1 -- 172.21.15.19:0/1875964821 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c0ab980 con 0x7fcf1c0afd90 2023-11-20T06:41:41.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f8a7bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8a74053d90 0x7f8a74054170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7ff845688640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8380e3190 0x7ff83803a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7ff845688640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff838053a00 0x7ff83804f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7ff845688640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838006320 con 0x7ff83804fe30 2023-11-20T06:41:41.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7ff845688640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8380502c0 con 0x7ff838053a00 2023-11-20T06:41:41.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7ff845688640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff838005ff0 con 0x7ff8380e3190 2023-11-20T06:41:41.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f98bce46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98b0006340 0x7f98b00d8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7fcf23371640 1 -- 172.21.15.19:0/1875964821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf1c0afd90 msgr2=0x7fcf1c1652a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7fcf23371640 1 --2- 172.21.15.19:0/1875964821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf1c0afd90 0x7fcf1c1652a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c06d0e0 tx=0x7fcf0c01c460 comp rx=0 tx=0).stop 2023-11-20T06:41:41.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f98bce46640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98b0006d10 0x7f98b00d8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f98bce46640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98b0053a50 0x7f98b004f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f98bce46640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b004eb70 con 0x7f98b0006d10 2023-11-20T06:41:41.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f98bce46640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b004dad0 con 0x7f98b0053a50 2023-11-20T06:41:41.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f98bce46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b004ddb0 con 0x7f98b0006340 2023-11-20T06:41:41.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f98b659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98b0053a50 0x7f98b004f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f98b659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98b0053a50 0x7f98b004f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:38744/0 (socket says 172.21.15.19:38744) 2023-11-20T06:41:41.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f98b659c640 1 -- 172.21.15.19:0/3869448781 learned_addr learned my addr 172.21.15.19:0/3869448781 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f2b8a371640 1 Processor -- start 2023-11-20T06:41:41.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f2b8a371640 1 -- start start 2023-11-20T06:41:41.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7ff83f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff838053a00 0x7ff83804f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7ff83f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff838053a00 0x7ff83804f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48440/0 (socket says 172.21.15.19:48440) 2023-11-20T06:41:41.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7ff83f7fe640 1 -- 172.21.15.19:0/2386096182 learned_addr learned my addr 172.21.15.19:0/2386096182 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7ff83ffff640 1 --2- 172.21.15.19:0/2386096182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8380e3190 0x7ff83803a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f8a7bfff640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a740546b0 con 0x7f8a740583c0 2023-11-20T06:41:41.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f8a7a7fc640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f8a740e33f0 0x7f8a7403e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:58128/0 (socket says 172.21.15.19:58128) 2023-11-20T06:41:41.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f8a7a7fc640 1 -- 172.21.15.19:0/3561889361 learned_addr learned my addr 172.21.15.19:0/3561889361 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:41.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f8a7affd640 1 --2- 172.21.15.19:0/3561889361 >> v2:172.21.15.19:3300/0 conn(0x7f8a74053d90 0x7f8a74054170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f8a7bfff640 1 -- 172.21.15.19:0/3561889361 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a74057040 con 0x7f8a740e33f0 2023-11-20T06:41:41.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7fcf23371640 1 -- 172.21.15.19:0/1875964821 shutdown_connections 2023-11-20T06:41:41.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7fcf23371640 1 --2- 172.21.15.19:0/1875964821 >> v2:172.21.15.19:3300/0 conn(0x7fcf1c0b0170 0x7fcf1c0cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7fcf23371640 1 --2- 172.21.15.19:0/1875964821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf1c0afd90 0x7fcf1c1652a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f8a7bfff640 1 -- 172.21.15.19:0/3561889361 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a7403eff0 con 0x7f8a74053d90 2023-11-20T06:41:41.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7fcf23371640 1 -- 172.21.15.19:0/1875964821 >> 172.21.15.19:0/1875964821 conn(0x7fcf1c06a4f0 msgr2=0x7fcf1c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7fcf23371640 1 -- 172.21.15.19:0/1875964821 shutdown_connections 2023-11-20T06:41:41.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f8a79ffb640 1 -- 172.21.15.19:0/3561889361 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931843109 0 0) 0x7f8a74057040 con 0x7f8a740e33f0 2023-11-20T06:41:41.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f8a79ffb640 1 -- 172.21.15.19:0/3561889361 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a64003530 con 0x7f8a740e33f0 2023-11-20T06:41:41.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f98b759e640 1 --2- 172.21.15.19:0/3869448781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98b0006340 0x7f98b00d8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f98b5d9b640 1 --2- 172.21.15.19:0/3869448781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98b0006d10 0x7f98b00d8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f98b659c640 1 -- 172.21.15.19:0/3869448781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98b0006340 msgr2=0x7f98b00d8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f98b659c640 1 --2- 172.21.15.19:0/3869448781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98b0006340 0x7f98b00d8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f98b659c640 1 -- 172.21.15.19:0/3869448781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98b0006d10 msgr2=0x7f98b00d8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f98b659c640 1 --2- 172.21.15.19:0/3869448781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98b0006d10 0x7f98b00d8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f98b659c640 1 -- 172.21.15.19:0/3869448781 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac0094d0 con 0x7f98b0053a50 2023-11-20T06:41:41.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f8a79ffb640 1 -- 172.21.15.19:0/3561889361 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1335534697 0 0) 0x7f8a64003530 con 0x7f8a740e33f0 2023-11-20T06:41:41.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f8a79ffb640 1 -- 172.21.15.19:0/3561889361 >> v2:172.21.15.19:3300/0 conn(0x7f8a74053d90 msgr2=0x7f8a74054170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f8a79ffb640 1 --2- 172.21.15.19:0/3561889361 >> v2:172.21.15.19:3300/0 conn(0x7f8a74053d90 0x7f8a74054170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f8a79ffb640 1 -- 172.21.15.19:0/3561889361 >> v1:172.21.15.19:6789/0 conn(0x7f8a740583c0 legacy=0x7f8a7403c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f98b759e640 1 --2- 172.21.15.19:0/3869448781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98b0006340 0x7f98b00d8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:41.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f98b659c640 1 --2- 172.21.15.19:0/3869448781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98b0053a50 0x7f98b004f0c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f98b8066a90 tx=0x7f98b8072520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f8a79ffb640 1 -- 172.21.15.19:0/3561889361 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a74057320 con 0x7f8a740e33f0 2023-11-20T06:41:41.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7f8a79ffb640 1 -- 172.21.15.19:0/3561889361 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7f8a70001680 con 0x7f8a740e33f0 2023-11-20T06:41:41.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f8a79ffb640 1 -- 172.21.15.19:0/3561889361 >> v1:172.21.15.190:6789/0 conn(0x7f8a740e33f0 legacy=0x7f8a7403e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f8a79ffb640 1 --2- 172.21.15.19:0/3561889361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a64003980 0x7f8a64003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f8a79ffb640 1 --2- 172.21.15.19:0/3561889361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a640047d0 0x7f8a64004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f8a79ffb640 1 --2- 172.21.15.19:0/3561889361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a64005190 0x7f8a6400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f8a79ffb640 1 -- 172.21.15.19:0/3561889361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7403eff0 con 0x7f8a64003980 2023-11-20T06:41:41.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f8a79ffb640 1 -- 172.21.15.19:0/3561889361 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6400bf50 con 0x7f8a64005190 2023-11-20T06:41:41.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f8a79ffb640 1 -- 172.21.15.19:0/3561889361 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6400c110 con 0x7f8a640047d0 2023-11-20T06:41:41.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f98a6ffd640 1 -- 172.21.15.19:0/3869448781 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8072a20 con 0x7f98b0053a50 2023-11-20T06:41:41.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f98a6ffd640 1 -- 172.21.15.19:0/3869448781 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b8072b80 con 0x7f98b0053a50 2023-11-20T06:41:41.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f98a6ffd640 1 -- 172.21.15.19:0/3869448781 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8072f70 con 0x7f98b0053a50 2023-11-20T06:41:41.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7ff83f7fe640 1 -- 172.21.15.19:0/2386096182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8380e3190 msgr2=0x7ff83803a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7ff83f7fe640 1 --2- 172.21.15.19:0/2386096182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8380e3190 0x7ff83803a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7ff83f7fe640 1 -- 172.21.15.19:0/2386096182 >> v1:172.21.15.19:6789/0 conn(0x7ff83804fe30 legacy=0x7ff8380e6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7ff83f7fe640 1 -- 172.21.15.19:0/2386096182 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8380e3570 con 0x7ff838053a00 2023-11-20T06:41:41.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f8a7a7fc640 1 --2- 172.21.15.19:0/3561889361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a640047d0 0x7f8a64004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f8a7b7fe640 1 --2- 172.21.15.19:0/3561889361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a64005190 0x7f8a6400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f8a7a7fc640 1 -- 172.21.15.19:0/3561889361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a64005190 msgr2=0x7f8a6400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f8a7affd640 1 --2- 172.21.15.19:0/3561889361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a64003980 0x7f8a64003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f8a7a7fc640 1 --2- 172.21.15.19:0/3561889361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a64005190 0x7f8a6400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f8a7a7fc640 1 -- 172.21.15.19:0/3561889361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a64003980 msgr2=0x7f8a64003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f8a7a7fc640 1 --2- 172.21.15.19:0/3561889361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a64003980 0x7f8a64003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f2b8a371640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b7c006cd0 0x7f2b7c04ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f2b8a371640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b7c054340 0x7f2b7c17ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f2b8a371640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b7c0e6890 0x7f2b7c038310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f2b88b6e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b7c054340 0x7f2b7c17ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f2b88b6e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b7c054340 0x7f2b7c17ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:41826/0 (socket says 172.21.15.19:41826) 2023-11-20T06:41:41.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f2b8936f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b7c006cd0 0x7f2b7c04ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f8a7a7fc640 1 -- 172.21.15.19:0/3561889361 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a74057320 con 0x7f8a640047d0 2023-11-20T06:41:41.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f2b8936f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b7c006cd0 0x7f2b7c04ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48470/0 (socket says 172.21.15.19:48470) 2023-11-20T06:41:41.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f98bce46640 1 -- 172.21.15.19:0/3869448781 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b004e090 con 0x7f98b0053a50 2023-11-20T06:41:41.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f98bce46640 1 -- 172.21.15.19:0/3869448781 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b004e650 con 0x7f98b0053a50 2023-11-20T06:41:41.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f8a7b7fe640 1 --2- 172.21.15.19:0/3561889361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a64005190 0x7f8a6400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:41.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f8a7b7fe640 1 -- 172.21.15.19:0/3561889361 reap_dead start 2023-11-20T06:41:41.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f8a7affd640 1 --2- 172.21.15.19:0/3561889361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a64003980 0x7f8a64003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:41.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f98b5d9b640 1 --2- 172.21.15.19:0/3869448781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98b0006d10 0x7f98b00d8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:41.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.255+0000 7fcf23371640 1 -- 172.21.15.19:0/1875964821 wait complete. 2023-11-20T06:41:41.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f2b88b6e640 1 -- 172.21.15.19:0/2024117866 learned_addr learned my addr 172.21.15.19:0/2024117866 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7fcf23371640 1 Processor -- start 2023-11-20T06:41:41.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f2b8a371640 1 -- 172.21.15.19:0/2024117866 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c1804f0 con 0x7f2b7c006cd0 2023-11-20T06:41:41.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f2b8a371640 1 -- 172.21.15.19:0/2024117866 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0dcb50 con 0x7f2b7c0e6890 2023-11-20T06:41:41.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f2b8a371640 1 -- 172.21.15.19:0/2024117866 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c038850 con 0x7f2b7c054340 2023-11-20T06:41:41.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f2b89b70640 1 --2- 172.21.15.19:0/2024117866 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b7c0e6890 0x7f2b7c038310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f98bce46640 1 -- 172.21.15.19:0/3869448781 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98b00588f0 con 0x7f98b0053a50 2023-11-20T06:41:41.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f2b88b6e640 1 -- 172.21.15.19:0/2024117866 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b7c0e6890 msgr2=0x7f2b7c038310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f2b88b6e640 1 --2- 172.21.15.19:0/2024117866 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b7c0e6890 0x7f2b7c038310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f379c980640 1 Processor -- start 2023-11-20T06:41:41.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f2b88b6e640 1 -- 172.21.15.19:0/2024117866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b7c006cd0 msgr2=0x7f2b7c04ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f2b88b6e640 1 --2- 172.21.15.19:0/2024117866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b7c006cd0 0x7f2b7c04ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f2b88b6e640 1 -- 172.21.15.19:0/2024117866 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b800094d0 con 0x7f2b7c054340 2023-11-20T06:41:41.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7f379c980640 1 -- start start 2023-11-20T06:41:41.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7fad9df3e640 1 Processor -- start 2023-11-20T06:41:41.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7fad9df3e640 1 -- start start 2023-11-20T06:41:41.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.259+0000 7fcf23371640 1 -- start start 2023-11-20T06:41:41.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f2b88b6e640 1 --2- 172.21.15.19:0/2024117866 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b7c054340 0x7f2b7c17ffb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400d830 tx=0x7f2b7400dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fcf23371640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf1c0afd90 0x7fcf1c0c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fcf23371640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf1c0b0170 0x7fcf1c15bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fcf23371640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf1c161c40 0x7fcf1c1598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fcf23371640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c0c76f0 con 0x7fcf1c161c40 2023-11-20T06:41:41.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fcf23371640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c0af0b0 con 0x7fcf1c0afd90 2023-11-20T06:41:41.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fcf23371640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c0af2c0 con 0x7fcf1c0b0170 2023-11-20T06:41:41.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fcf2236f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf1c0afd90 0x7fcf1c0c4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fcf2236f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf1c0afd90 0x7fcf1c0c4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:38770/0 (socket says 172.21.15.19:38770) 2023-11-20T06:41:41.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fcf2236f640 1 -- 172.21.15.19:0/3193398802 learned_addr learned my addr 172.21.15.19:0/3193398802 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fcf22b70640 1 --2- 172.21.15.19:0/3193398802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf1c161c40 0x7fcf1c1598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f2b79ffb640 1 -- 172.21.15.19:0/2024117866 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b740096a0 con 0x7f2b7c054340 2023-11-20T06:41:41.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f2b8a371640 1 -- 172.21.15.19:0/2024117866 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7c0db350 con 0x7f2b7c054340 2023-11-20T06:41:41.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f2b8a371640 1 -- 172.21.15.19:0/2024117866 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7c04d0f0 con 0x7f2b7c054340 2023-11-20T06:41:41.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f2b79ffb640 1 -- 172.21.15.19:0/2024117866 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b74009800 con 0x7f2b7c054340 2023-11-20T06:41:41.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f2b79ffb640 1 -- 172.21.15.19:0/2024117866 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74009b70 con 0x7f2b7c054340 2023-11-20T06:41:41.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fad9df3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad980caee0 0x7fad980b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fad977fe640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fad9815a8b0 0x7fad9815edd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:58140/0 (socket says 172.21.15.19:58140) 2023-11-20T06:41:41.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fad977fe640 1 -- 172.21.15.19:0/3057108412 learned_addr learned my addr 172.21.15.19:0/3057108412 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:41.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fad9df3e640 1 -- 172.21.15.19:0/3057108412 --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad980ce310 con 0x7fad980b2700 2023-11-20T06:41:41.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fad9df3e640 1 -- 172.21.15.19:0/3057108412 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad980ce5f0 con 0x7fad9815a8b0 2023-11-20T06:41:41.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fad96ffd640 1 --2- 172.21.15.19:0/3057108412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad980caee0 0x7fad980b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fad9df3e640 1 -- 172.21.15.19:0/3057108412 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad980b63d0 con 0x7fad980caee0 2023-11-20T06:41:41.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f98a6ffd640 1 -- 172.21.15.19:0/3869448781 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f98b808f020 con 0x7f98b0053a50 2023-11-20T06:41:41.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fcf21b6e640 1 --2- 172.21.15.19:0/3193398802 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf1c0b0170 0x7fcf1c15bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f2b8a371640 1 -- 172.21.15.19:0/2024117866 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2b64000fd0 con 0x7f2b7c054340 2023-11-20T06:41:41.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fad967fc640 1 -- 172.21.15.19:0/3057108412 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060388629 0 0) 0x7fad980ce5f0 con 0x7fad9815a8b0 2023-11-20T06:41:41.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fad967fc640 1 -- 172.21.15.19:0/3057108412 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad80003530 con 0x7fad9815a8b0 2023-11-20T06:41:41.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fad96ffd640 1 -- 172.21.15.19:0/3057108412 >> v1:172.21.15.190:6789/0 conn(0x7fad9815a8b0 legacy=0x7fad9815edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fad96ffd640 1 -- 172.21.15.19:0/3057108412 >> v1:172.21.15.19:6789/0 conn(0x7fad980b2700 legacy=0x7fad980cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f379c980640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f379815cb90 0x7f37980cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f379c980640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37980d3010 0x7f37980d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f379c980640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37980d1850 con 0x7f37980d1400 2023-11-20T06:41:41.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f379c980640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37980ce770 con 0x7f37980d3010 2023-11-20T06:41:41.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f379c980640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37980d0600 con 0x7f379815cb90 2023-11-20T06:41:41.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f8a7a7fc640 1 --2- 172.21.15.19:0/3561889361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a640047d0 0x7f8a64004c50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000c290 tx=0x7f8a7001cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4741259aef147f7e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fcf22b70640 1 -- 172.21.15.19:0/3193398802 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf1c0b0170 msgr2=0x7fcf1c15bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fcf22b70640 1 --2- 172.21.15.19:0/3193398802 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf1c0b0170 0x7fcf1c15bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fcf22b70640 1 -- 172.21.15.19:0/3193398802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf1c0afd90 msgr2=0x7fcf1c0c4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f379659c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f379815cb90 0x7f37980cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f379659c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f379815cb90 0x7f37980cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:38772/0 (socket says 172.21.15.19:38772) 2023-11-20T06:41:41.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fad96ffd640 1 -- 172.21.15.19:0/3057108412 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9815ac90 con 0x7fad980caee0 2023-11-20T06:41:41.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f379659c640 1 -- 172.21.15.19:0/3107248500 learned_addr learned my addr 172.21.15.19:0/3107248500 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fcf22b70640 1 --2- 172.21.15.19:0/3193398802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf1c0afd90 0x7fcf1c0c4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f27ef868640 1 Processor -- start 2023-11-20T06:41:41.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f98a6ffd640 1 --2- 172.21.15.19:0/3869448781 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f98980664a0 0x7f9898068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f98a6ffd640 1 -- 172.21.15.19:0/3869448781 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f98b80fd660 con 0x7f98b0053a50 2023-11-20T06:41:41.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f98b759e640 1 --2- 172.21.15.19:0/3869448781 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f98980664a0 0x7f9898068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f98a6ffd640 1 --2- 172.21.15.19:0/3869448781 >> [v2:172.21.15.19:6816/404837676,v1:172.21.15.19:6817/404837676] conn(0x7f989806fae0 0x7f9898071f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f98a6ffd640 1 -- 172.21.15.19:0/3869448781 --> [v2:172.21.15.19:6816/404837676,v1:172.21.15.19:6817/404837676] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f98980725f0 con 0x7f989806fae0 2023-11-20T06:41:41.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f98a6ffd640 1 -- 172.21.15.19:0/3869448781 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98b80ffc80 con 0x7f98b0053a50 2023-11-20T06:41:41.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7fcf22b70640 1 -- 172.21.15.19:0/3193398802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c009420 con 0x7fcf1c161c40 2023-11-20T06:41:41.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f8a79ffb640 1 -- 172.21.15.19:0/3561889361 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a70005ae0 con 0x7f8a640047d0 2023-11-20T06:41:41.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7fcf2236f640 1 --2- 172.21.15.19:0/3193398802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf1c0afd90 0x7fcf1c0c4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:41:41.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f8a79ffb640 1 -- 172.21.15.19:0/3561889361 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a70005c40 con 0x7f8a640047d0 2023-11-20T06:41:41.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f27ef868640 1 -- start start 2023-11-20T06:41:41.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f379659c640 1 -- 172.21.15.19:0/3107248500 >> v2:172.21.15.19:3300/0 conn(0x7f37980d3010 msgr2=0x7f37980d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f379659c640 1 --2- 172.21.15.19:0/3107248500 >> v2:172.21.15.19:3300/0 conn(0x7f37980d3010 0x7f37980d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f98b5d9b640 1 --2- 172.21.15.19:0/3869448781 >> [v2:172.21.15.19:6816/404837676,v1:172.21.15.19:6817/404837676] conn(0x7f989806fae0 0x7f9898071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7ff83f7fe640 1 --2- 172.21.15.19:0/2386096182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff838053a00 0x7ff83804f8f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009870 tx=0x7ff82c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54766fae0563af88 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f379659c640 1 -- 172.21.15.19:0/3107248500 >> v1:172.21.15.190:6789/0 conn(0x7f37980d1400 legacy=0x7f37980cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.263+0000 7f379659c640 1 -- 172.21.15.19:0/3107248500 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37980c6450 con 0x7f379815cb90 2023-11-20T06:41:41.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f2b79ffb640 1 -- 172.21.15.19:0/2024117866 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2b74009cd0 con 0x7f2b7c054340 2023-11-20T06:41:41.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f8a79ffb640 1 -- 172.21.15.19:0/3561889361 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a70007070 con 0x7f8a640047d0 2023-11-20T06:41:41.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7fcf22b70640 1 --2- 172.21.15.19:0/3193398802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf1c161c40 0x7fcf1c1598f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcf1400be20 tx=0x7fcf1400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f8a7bfff640 1 -- 172.21.15.19:0/3561889361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a640047d0 msgr2=0x7f8a64004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f98b759e640 1 --2- 172.21.15.19:0/3869448781 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f98980664a0 0x7f9898068960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f98b003be80 tx=0x7f98a8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7ff83effd640 1 -- 172.21.15.19:0/2386096182 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c0ac410 con 0x7ff838053a00 2023-11-20T06:41:41.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f8a7bfff640 1 --2- 172.21.15.19:0/3561889361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a640047d0 0x7f8a64004c50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000c290 tx=0x7f8a7001cbe0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f27ef868640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f27e8164520 0x7f27e80ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f98b5d9b640 1 --2- 172.21.15.19:0/3869448781 >> [v2:172.21.15.19:6816/404837676,v1:172.21.15.19:6817/404837676] conn(0x7f989806fae0 0x7f9898071f20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.302 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T06:41:41.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7fcf12ffd640 1 -- 172.21.15.19:0/3193398802 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1400ce70 con 0x7fcf1c161c40 2023-11-20T06:41:41.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7fcf23371640 1 -- 172.21.15.19:0/3193398802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1c0b1140 con 0x7fcf1c161c40 2023-11-20T06:41:41.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f2b79ffb640 1 --2- 172.21.15.19:0/2024117866 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2b68066570 0x7f2b68068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7ff83effd640 1 -- 172.21.15.19:0/2386096182 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c0ac570 con 0x7ff838053a00 2023-11-20T06:41:41.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7fcf23371640 1 -- 172.21.15.19:0/3193398802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c0b1700 con 0x7fcf1c161c40 2023-11-20T06:41:41.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f8a7bfff640 1 -- 172.21.15.19:0/3561889361 shutdown_connections 2023-11-20T06:41:41.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f8a7bfff640 1 --2- 172.21.15.19:0/3561889361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a640047d0 0x7f8a64004c50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f8a7bfff640 1 -- 172.21.15.19:0/3561889361 >> 172.21.15.19:0/3561889361 conn(0x7f8a74055a40 msgr2=0x7f8a74055e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f8a7bfff640 1 -- 172.21.15.19:0/3561889361 shutdown_connections 2023-11-20T06:41:41.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f2b79ffb640 1 -- 172.21.15.19:0/2024117866 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2b740847e0 con 0x7f2b7c054340 2023-11-20T06:41:41.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f2b8936f640 1 --2- 172.21.15.19:0/2024117866 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2b68066570 0x7f2b68068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f27ef868640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f27e80b07f0 0x7f27e80cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f27ef868640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e80c96f0 con 0x7f27e80ad960 2023-11-20T06:41:41.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f27ef868640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e8164900 con 0x7f27e8164520 2023-11-20T06:41:41.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f27ef868640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e80cb950 con 0x7f27e80b07f0 2023-11-20T06:41:41.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f8a7bfff640 1 -- 172.21.15.19:0/3561889361 wait complete. 2023-11-20T06:41:41.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f27ede05640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f27e80b07f0 0x7f27e80cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7ff83effd640 1 -- 172.21.15.19:0/2386096182 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c0ac900 con 0x7ff838053a00 2023-11-20T06:41:41.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7fcf23371640 1 -- 172.21.15.19:0/3193398802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcf1c0c19f0 con 0x7fcf1c161c40 2023-11-20T06:41:41.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f27ede05640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f27e80b07f0 0x7f27e80cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:38774/0 (socket says 172.21.15.19:38774) 2023-11-20T06:41:41.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.267+0000 7f27ede05640 1 -- 172.21.15.19:0/2609796156 learned_addr learned my addr 172.21.15.19:0/2609796156 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f98a6ffd640 1 -- 172.21.15.19:0/3869448781 <== osd.0 v2:172.21.15.19:6816/404837676 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f98980725f0 con 0x7f989806fae0 2023-11-20T06:41:41.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7fad96ffd640 1 --2- 172.21.15.19:0/3057108412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad980caee0 0x7fad980b21c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fad8800f9e0 tx=0x7fad88020770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fec2ef1de4b95021 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7ff845688640 1 -- 172.21.15.19:0/2386096182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff838053a00 msgr2=0x7ff83804f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7ff845688640 1 --2- 172.21.15.19:0/2386096182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff838053a00 0x7ff83804f8f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009870 tx=0x7ff82c01c4d0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7ff845688640 1 -- 172.21.15.19:0/2386096182 shutdown_connections 2023-11-20T06:41:41.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7fad967fc640 1 -- 172.21.15.19:0/3057108412 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad880a9550 con 0x7fad980caee0 2023-11-20T06:41:41.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7fad967fc640 1 -- 172.21.15.19:0/3057108412 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad880a96b0 con 0x7fad980caee0 2023-11-20T06:41:41.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f2b79ffb640 1 --2- 172.21.15.19:0/2024117866 >> [v2:172.21.15.19:6808/427773025,v1:172.21.15.19:6809/427773025] conn(0x7f2b6806fbb0 0x7f2b68071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f2b79ffb640 1 -- 172.21.15.19:0/2024117866 --> [v2:172.21.15.19:6808/427773025,v1:172.21.15.19:6809/427773025] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b680726c0 con 0x7f2b6806fbb0 2023-11-20T06:41:41.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f2b79ffb640 1 -- 172.21.15.19:0/2024117866 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b740892a0 con 0x7f2b7c054340 2023-11-20T06:41:41.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f2b8936f640 1 --2- 172.21.15.19:0/2024117866 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2b68066570 0x7f2b68068a30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2b800ad000 tx=0x7f2b800a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f2b89b70640 1 --2- 172.21.15.19:0/2024117866 >> [v2:172.21.15.19:6808/427773025,v1:172.21.15.19:6809/427773025] conn(0x7f2b6806fbb0 0x7f2b68071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7fcf12ffd640 1 -- 172.21.15.19:0/3193398802 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf140097f0 con 0x7fcf1c161c40 2023-11-20T06:41:41.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7fcf12ffd640 1 -- 172.21.15.19:0/3193398802 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1401e640 con 0x7fcf1c161c40 2023-11-20T06:41:41.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7fad9df3e640 1 -- 172.21.15.19:0/3057108412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad980caee0 msgr2=0x7fad980b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7fad967fc640 1 -- 172.21.15.19:0/3057108412 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad880a9550 con 0x7fad980caee0 2023-11-20T06:41:41.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7fad9df3e640 1 --2- 172.21.15.19:0/3057108412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad980caee0 0x7fad980b21c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fad8800f9e0 tx=0x7fad88020770 comp rx=0 tx=0).stop 2023-11-20T06:41:41.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f2b89b70640 1 --2- 172.21.15.19:0/2024117866 >> [v2:172.21.15.19:6808/427773025,v1:172.21.15.19:6809/427773025] conn(0x7f2b6806fbb0 0x7f2b68071ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7fad9df3e640 1 -- 172.21.15.19:0/3057108412 shutdown_connections 2023-11-20T06:41:41.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7fad9df3e640 1 --2- 172.21.15.19:0/3057108412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad980caee0 0x7fad980b21c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7fad9df3e640 1 -- 172.21.15.19:0/3057108412 >> 172.21.15.19:0/3057108412 conn(0x7fad980cd1c0 msgr2=0x7fad980cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7fad9df3e640 1 -- 172.21.15.19:0/3057108412 shutdown_connections 2023-11-20T06:41:41.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7ff845688640 1 --2- 172.21.15.19:0/2386096182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff838053a00 0x7ff83804f8f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7ff845688640 1 --2- 172.21.15.19:0/2386096182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8380e3190 0x7ff83803a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7ff845688640 1 -- 172.21.15.19:0/2386096182 >> 172.21.15.19:0/2386096182 conn(0x7ff838054c20 msgr2=0x7ff838055030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7fad9df3e640 1 -- 172.21.15.19:0/3057108412 wait complete. 2023-11-20T06:41:41.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f8a7bfff640 1 Processor -- start 2023-11-20T06:41:41.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f27ed604640 1 --2- 172.21.15.19:0/2609796156 >> v2:172.21.15.19:3300/0 conn(0x7f27e8164520 0x7f27e80ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f379659c640 1 --2- 172.21.15.19:0/3107248500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f379815cb90 0x7f37980cfb10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f379808ba70 tx=0x7f378801c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f2a77841d71b84 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7ff845688640 1 -- 172.21.15.19:0/2386096182 shutdown_connections 2023-11-20T06:41:41.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f8a7bfff640 1 -- start start 2023-11-20T06:41:41.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f2b79ffb640 1 -- 172.21.15.19:0/2024117866 <== osd.2 v2:172.21.15.19:6808/427773025 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f2b680726c0 con 0x7f2b6806fbb0 2023-11-20T06:41:41.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f8a7bfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a640047d0 0x7f8a7417c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f8a7bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a74180c50 0x7f8a74052610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f8a7bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a740e5e10 0x7f8a74037b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f8a7bfff640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a740e3a00 con 0x7f8a740e5e10 2023-11-20T06:41:41.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f8a7bfff640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a740d7cf0 con 0x7f8a640047d0 2023-11-20T06:41:41.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f8a7bfff640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a740e5980 con 0x7f8a74180c50 2023-11-20T06:41:41.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7fad9df3e640 1 Processor -- start 2023-11-20T06:41:41.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7fcf12ffd640 1 -- 172.21.15.19:0/3193398802 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcf1401e7a0 con 0x7fcf1c161c40 2023-11-20T06:41:41.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f27ede05640 1 -- 172.21.15.19:0/2609796156 >> v2:172.21.15.19:3300/0 conn(0x7f27e8164520 msgr2=0x7f27e80ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f27ede05640 1 --2- 172.21.15.19:0/2609796156 >> v2:172.21.15.19:3300/0 conn(0x7f27e8164520 0x7f27e80ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f27ede05640 1 -- 172.21.15.19:0/2609796156 >> v1:172.21.15.190:6789/0 conn(0x7f27e80ad960 legacy=0x7f27e80b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7f27ede05640 1 -- 172.21.15.19:0/2609796156 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e80cbed0 con 0x7f27e80b07f0 2023-11-20T06:41:41.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f8a7affd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a640047d0 0x7f8a7417c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f8a7affd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a640047d0 0x7f8a7417c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:38776/0 (socket says 172.21.15.19:38776) 2023-11-20T06:41:41.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f8a7affd640 1 -- 172.21.15.19:0/2569729274 learned_addr learned my addr 172.21.15.19:0/2569729274 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f8a7a7fc640 1 --2- 172.21.15.19:0/2569729274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a74180c50 0x7f8a74052610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f8a7b7fe640 1 --2- 172.21.15.19:0/2569729274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a740e5e10 0x7f8a74037b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f379559a640 1 -- 172.21.15.19:0/3107248500 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37880ab600 con 0x7f379815cb90 2023-11-20T06:41:41.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.271+0000 7ff845688640 1 -- 172.21.15.19:0/2386096182 wait complete. 2023-11-20T06:41:41.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f8a7a7fc640 1 -- 172.21.15.19:0/2569729274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a640047d0 msgr2=0x7f8a7417c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f8a7a7fc640 1 --2- 172.21.15.19:0/2569729274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a640047d0 0x7f8a7417c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f8a7a7fc640 1 -- 172.21.15.19:0/2569729274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a740e5e10 msgr2=0x7f8a74037b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f8a7a7fc640 1 --2- 172.21.15.19:0/2569729274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a740e5e10 0x7f8a74037b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f8a7a7fc640 1 -- 172.21.15.19:0/2569729274 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a740e4dd0 con 0x7f8a74180c50 2023-11-20T06:41:41.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f379559a640 1 -- 172.21.15.19:0/3107248500 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37880ab760 con 0x7f379815cb90 2023-11-20T06:41:41.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f379559a640 1 -- 172.21.15.19:0/3107248500 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37880ab600 con 0x7f379815cb90 2023-11-20T06:41:41.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7ff845688640 1 Processor -- start 2023-11-20T06:41:41.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7fcf12ffd640 1 --2- 172.21.15.19:0/3193398802 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fcf000664d0 0x7fcf00068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7fcf12ffd640 1 -- 172.21.15.19:0/3193398802 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcf14085100 con 0x7fcf1c161c40 2023-11-20T06:41:41.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7fcf12ffd640 1 --2- 172.21.15.19:0/3193398802 >> [v2:172.21.15.19:6800/2544072609,v1:172.21.15.19:6801/2544072609] conn(0x7fcf0006fa90 0x7fcf00071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7fcf12ffd640 1 -- 172.21.15.19:0/3193398802 --> [v2:172.21.15.19:6800/2544072609,v1:172.21.15.19:6801/2544072609] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf000725a0 con 0x7fcf0006fa90 2023-11-20T06:41:41.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7fcf12ffd640 1 -- 172.21.15.19:0/3193398802 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf14085470 con 0x7fcf1c161c40 2023-11-20T06:41:41.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f8a7a7fc640 1 --2- 172.21.15.19:0/2569729274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a74180c50 0x7f8a74052610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009000 tx=0x7f8a64005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f8a637fe640 1 -- 172.21.15.19:0/2569729274 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a700b4070 con 0x7f8a74180c50 2023-11-20T06:41:41.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f8a637fe640 1 -- 172.21.15.19:0/2569729274 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a700a56c0 con 0x7f8a74180c50 2023-11-20T06:41:41.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f8a637fe640 1 -- 172.21.15.19:0/2569729274 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a700a5a70 con 0x7f8a74180c50 2023-11-20T06:41:41.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f8a7bfff640 1 -- 172.21.15.19:0/2569729274 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a740e5050 con 0x7f8a74180c50 2023-11-20T06:41:41.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7fcf2236f640 1 --2- 172.21.15.19:0/3193398802 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fcf000664d0 0x7fcf00068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f379c980640 1 -- 172.21.15.19:0/3107248500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f379815cb90 msgr2=0x7f37980cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f379c980640 1 --2- 172.21.15.19:0/3107248500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f379815cb90 0x7f37980cfb10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f379808ba70 tx=0x7f378801c400 comp rx=0 tx=0).stop 2023-11-20T06:41:41.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f27ede05640 1 --2- 172.21.15.19:0/2609796156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27e80b07f0 0x7f27e80cc870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f27e80c2120 tx=0x7f27e001c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7b748a9a52d6ce7 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7fad9df3e640 1 -- start start 2023-11-20T06:41:41.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7fad9df3e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad980b2700 0x7fad980c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7fad9df3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad980caee0 0x7fad98151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7fad9df3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad9815a8b0 0x7fad980c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7fad9df3e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad980c5450 con 0x7fad980caee0 2023-11-20T06:41:41.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7fad9df3e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad980c47d0 con 0x7fad980b2700 2023-11-20T06:41:41.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7fad9df3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad980c4ab0 con 0x7fad9815a8b0 2023-11-20T06:41:41.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7fcf2236f640 1 --2- 172.21.15.19:0/3193398802 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fcf000664d0 0x7fcf00068990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c01c4a0 tx=0x7fcf0c0a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7ff845688640 1 -- start start 2023-11-20T06:41:41.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f27dffff640 1 -- 172.21.15.19:0/2609796156 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e00a5880 con 0x7f27e80b07f0 2023-11-20T06:41:41.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.275+0000 7f8a7bfff640 1 -- 172.21.15.19:0/2569729274 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a740e5610 con 0x7f8a74180c50 2023-11-20T06:41:41.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f8a7bfff640 1 -- 172.21.15.19:0/2569729274 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8a740578e0 con 0x7f8a74180c50 2023-11-20T06:41:41.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f27dffff640 1 -- 172.21.15.19:0/2609796156 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e00a59e0 con 0x7f27e80b07f0 2023-11-20T06:41:41.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f27dffff640 1 -- 172.21.15.19:0/2609796156 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e00a5d70 con 0x7f27e80b07f0 2023-11-20T06:41:41.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7fad97fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad9815a8b0 0x7fad980c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f379c980640 1 -- 172.21.15.19:0/3107248500 shutdown_connections 2023-11-20T06:41:41.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f379c980640 1 --2- 172.21.15.19:0/3107248500 >> v2:172.21.15.19:3300/0 conn(0x7f37980d3010 0x7f37980d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f379c980640 1 --2- 172.21.15.19:0/3107248500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f379815cb90 0x7f37980cfb10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f379c980640 1 -- 172.21.15.19:0/3107248500 >> 172.21.15.19:0/3107248500 conn(0x7f379809bc50 msgr2=0x7f37980d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7ff845688640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff83804fe30 0x7ff83818ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7ff845688640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff838053a00 0x7ff838189a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7ff845688640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8380e3190 0x7ff838048db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7ff845688640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff838049aa0 con 0x7ff838053a00 2023-11-20T06:41:41.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7ff845688640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff838189fb0 con 0x7ff8380e3190 2023-11-20T06:41:41.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7ff845688640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83818b330 con 0x7ff83804fe30 2023-11-20T06:41:41.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7fcf21b6e640 1 --2- 172.21.15.19:0/3193398802 >> [v2:172.21.15.19:6800/2544072609,v1:172.21.15.19:6801/2544072609] conn(0x7fcf0006fa90 0x7fcf00071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7fad97fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad9815a8b0 0x7fad980c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:41864/0 (socket says 172.21.15.19:41864) 2023-11-20T06:41:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7fad97fff640 1 -- 172.21.15.19:0/1217929288 learned_addr learned my addr 172.21.15.19:0/1217929288 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7fad977fe640 1 --2- 172.21.15.19:0/1217929288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad980b2700 0x7fad980c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7fad97fff640 1 -- 172.21.15.19:0/1217929288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad980b2700 msgr2=0x7fad980c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f379c980640 1 -- 172.21.15.19:0/3107248500 shutdown_connections 2023-11-20T06:41:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f379c980640 1 -- 172.21.15.19:0/3107248500 wait complete. 2023-11-20T06:41:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7fad97fff640 1 --2- 172.21.15.19:0/1217929288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad980b2700 0x7fad980c3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7fad97fff640 1 -- 172.21.15.19:0/1217929288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad980caee0 msgr2=0x7fad98151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7fad97fff640 1 --2- 172.21.15.19:0/1217929288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad980caee0 0x7fad98151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f27ef868640 1 -- 172.21.15.19:0/2609796156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27e80b07f0 msgr2=0x7f27e80cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7ff844e87640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8380e3190 0x7ff838048db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7ff844e87640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8380e3190 0x7ff838048db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:38798/0 (socket says 172.21.15.19:38798) 2023-11-20T06:41:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7ff844e87640 1 -- 172.21.15.19:0/2312389134 learned_addr learned my addr 172.21.15.19:0/2312389134 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7ff83ffff640 1 --2- 172.21.15.19:0/2312389134 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff83804fe30 0x7ff83818ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7ff844e87640 1 -- 172.21.15.19:0/2312389134 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff83804fe30 msgr2=0x7ff83818ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7ff844e87640 1 --2- 172.21.15.19:0/2312389134 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff83804fe30 0x7ff83818ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7ff844e87640 1 -- 172.21.15.19:0/2312389134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff838053a00 msgr2=0x7ff838189a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7ff844e87640 1 --2- 172.21.15.19:0/2312389134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff838053a00 0x7ff838189a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7ff844e87640 1 -- 172.21.15.19:0/2312389134 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c0094d0 con 0x7ff8380e3190 2023-11-20T06:41:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7fad97fff640 1 -- 172.21.15.19:0/1217929288 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8800f610 con 0x7fad9815a8b0 2023-11-20T06:41:41.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f27ef868640 1 --2- 172.21.15.19:0/2609796156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27e80b07f0 0x7f27e80cc870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f27e80c2120 tx=0x7f27e001c9e0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f27ef868640 1 -- 172.21.15.19:0/2609796156 shutdown_connections 2023-11-20T06:41:41.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f27ef868640 1 --2- 172.21.15.19:0/2609796156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27e80b07f0 0x7f27e80cc870 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f27ef868640 1 --2- 172.21.15.19:0/2609796156 >> v2:172.21.15.19:3300/0 conn(0x7f27e8164520 0x7f27e80ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f27ef868640 1 -- 172.21.15.19:0/2609796156 >> 172.21.15.19:0/2609796156 conn(0x7f27e806c190 msgr2=0x7f27e806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7fad97fff640 1 --2- 172.21.15.19:0/1217929288 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad9815a8b0 0x7fad980c9e50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00c410 tx=0x7fad8c00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7ff844e87640 1 --2- 172.21.15.19:0/2312389134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8380e3190 0x7ff838048db0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff840066bd0 tx=0x7ff840072520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7ff83cff9640 1 -- 172.21.15.19:0/2312389134 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff840060ab0 con 0x7ff8380e3190 2023-11-20T06:41:41.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7fad7ffff640 1 -- 172.21.15.19:0/1217929288 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c003600 con 0x7fad9815a8b0 2023-11-20T06:41:41.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7fad7ffff640 1 -- 172.21.15.19:0/1217929288 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c003760 con 0x7fad9815a8b0 2023-11-20T06:41:41.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7fad7ffff640 1 -- 172.21.15.19:0/1217929288 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c003b10 con 0x7fad9815a8b0 2023-11-20T06:41:41.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7ff845688640 1 -- 172.21.15.19:0/2312389134 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83818b610 con 0x7ff8380e3190 2023-11-20T06:41:41.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7fad977fe640 1 --2- 172.21.15.19:0/1217929288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad980b2700 0x7fad980c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:41.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f27ef868640 1 -- 172.21.15.19:0/2609796156 shutdown_connections 2023-11-20T06:41:41.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f379c980640 1 Processor -- start 2023-11-20T06:41:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7fcf21b6e640 1 --2- 172.21.15.19:0/3193398802 >> [v2:172.21.15.19:6800/2544072609,v1:172.21.15.19:6801/2544072609] conn(0x7fcf0006fa90 0x7fcf00071ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7ff83cff9640 1 -- 172.21.15.19:0/2312389134 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84008d070 con 0x7ff8380e3190 2023-11-20T06:41:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7ff83cff9640 1 -- 172.21.15.19:0/2312389134 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff840060ab0 con 0x7ff8380e3190 2023-11-20T06:41:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7ff845688640 1 -- 172.21.15.19:0/2312389134 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83818bbd0 con 0x7ff8380e3190 2023-11-20T06:41:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f8a637fe640 1 -- 172.21.15.19:0/2569729274 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8a700a5bd0 con 0x7f8a74180c50 2023-11-20T06:41:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f8a637fe640 1 --2- 172.21.15.19:0/2569729274 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8a68066520 0x7f8a680689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7fad9df3e640 1 -- 172.21.15.19:0/1217929288 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad980c4d90 con 0x7fad9815a8b0 2023-11-20T06:41:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f27ef868640 1 -- 172.21.15.19:0/2609796156 wait complete. 2023-11-20T06:41:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.279+0000 7f379c980640 1 -- start start 2023-11-20T06:41:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7fad9df3e640 1 -- 172.21.15.19:0/1217929288 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad980c44c0 con 0x7fad9815a8b0 2023-11-20T06:41:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7f8a7affd640 1 --2- 172.21.15.19:0/2569729274 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8a68066520 0x7f8a680689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7fcf12ffd640 1 -- 172.21.15.19:0/3193398802 <== osd.1 v2:172.21.15.19:6800/2544072609 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fcf000725a0 con 0x7fcf0006fa90 2023-11-20T06:41:41.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7ff845688640 1 -- 172.21.15.19:0/2312389134 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff838037d50 con 0x7ff8380e3190 2023-11-20T06:41:41.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7f8a637fe640 1 -- 172.21.15.19:0/2569729274 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8a700ef060 con 0x7f8a74180c50 2023-11-20T06:41:41.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7f8a637fe640 1 --2- 172.21.15.19:0/2569729274 >> [v2:172.21.15.190:6808/4085939700,v1:172.21.15.190:6809/4085939700] conn(0x7f8a68070880 0x7f8a68072d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7f8a637fe640 1 -- 172.21.15.19:0/2569729274 --> [v2:172.21.15.190:6808/4085939700,v1:172.21.15.190:6809/4085939700] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a680733f0 con 0x7f8a68070880 2023-11-20T06:41:41.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7f8a637fe640 1 -- 172.21.15.19:0/2569729274 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a700a5e80 con 0x7f8a74180c50 2023-11-20T06:41:41.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7f379c980640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37980d1400 0x7f3798152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7f379c980640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37980d3010 0x7f37980c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7f379c980640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f379815cb90 0x7f37981548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7f8a7b7fe640 1 --2- 172.21.15.19:0/2569729274 >> [v2:172.21.15.190:6808/4085939700,v1:172.21.15.190:6809/4085939700] conn(0x7f8a68070880 0x7f8a68072d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7f8a7affd640 1 --2- 172.21.15.19:0/2569729274 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8a68066520 0x7f8a680689e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c009ac0 tx=0x7f8a6c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7f379659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37980d1400 0x7f3798152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7f379c980640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37980cc990 con 0x7f37980d3010 2023-11-20T06:41:41.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7f379c980640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37981556e0 con 0x7f37980d1400 2023-11-20T06:41:41.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7f379c980640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3798155ca0 con 0x7f379815cb90 2023-11-20T06:41:41.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7f8a7b7fe640 1 --2- 172.21.15.19:0/2569729274 >> [v2:172.21.15.190:6808/4085939700,v1:172.21.15.190:6809/4085939700] conn(0x7f8a68070880 0x7f8a68072d20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7f3796d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f379815cb90 0x7f37981548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7f27ef868640 1 Processor -- start 2023-11-20T06:41:41.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7f3796d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f379815cb90 0x7f37981548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:41882/0 (socket says 172.21.15.19:41882) 2023-11-20T06:41:41.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7f3796d9d640 1 -- 172.21.15.19:0/3588177083 learned_addr learned my addr 172.21.15.19:0/3588177083 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7fad9df3e640 1 -- 172.21.15.19:0/1217929288 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fad980cb9d0 con 0x7fad9815a8b0 2023-11-20T06:41:41.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7fad7ffff640 1 -- 172.21.15.19:0/1217929288 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fad8c003c70 con 0x7fad9815a8b0 2023-11-20T06:41:41.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7f3795d9b640 1 --2- 172.21.15.19:0/3588177083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37980d3010 0x7f37980c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.283+0000 7ff83cff9640 1 -- 172.21.15.19:0/2312389134 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff840060c90 con 0x7ff8380e3190 2023-11-20T06:41:41.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f3796d9d640 1 -- 172.21.15.19:0/3588177083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37980d1400 msgr2=0x7f3798152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f3796d9d640 1 --2- 172.21.15.19:0/3588177083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37980d1400 0x7f3798152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f3796d9d640 1 -- 172.21.15.19:0/3588177083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37980d3010 msgr2=0x7f37980c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f3796d9d640 1 --2- 172.21.15.19:0/3588177083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37980d3010 0x7f37980c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f3796d9d640 1 -- 172.21.15.19:0/3588177083 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3788009480 con 0x7f379815cb90 2023-11-20T06:41:41.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f3796d9d640 1 --2- 172.21.15.19:0/3588177083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f379815cb90 0x7f37981548f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f379000b970 tx=0x7f379000be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7ff83cff9640 1 --2- 172.21.15.19:0/2312389134 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff824066500 0x7ff8240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7ff83cff9640 1 -- 172.21.15.19:0/2312389134 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff8400fd500 con 0x7ff8380e3190 2023-11-20T06:41:41.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f3795d9b640 1 --2- 172.21.15.19:0/3588177083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37980d3010 0x7f37980c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:41.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7fad7ffff640 1 --2- 172.21.15.19:0/1217929288 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fad84066570 0x7fad84068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7ff83cff9640 1 --2- 172.21.15.19:0/2312389134 >> [v2:172.21.15.19:6824/2577618590,v1:172.21.15.19:6825/2577618590] conn(0x7ff82406fac0 0x7ff824071f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7ff83cff9640 1 -- 172.21.15.19:0/2312389134 --> [v2:172.21.15.19:6824/2577618590,v1:172.21.15.19:6825/2577618590] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8240725d0 con 0x7ff82406fac0 2023-11-20T06:41:41.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7ff83cff9640 1 -- 172.21.15.19:0/2312389134 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8400fd950 con 0x7ff8380e3190 2023-11-20T06:41:41.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7fad7ffff640 1 -- 172.21.15.19:0/1217929288 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fad8c083740 con 0x7fad9815a8b0 2023-11-20T06:41:41.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f3786ffd640 1 -- 172.21.15.19:0/3588177083 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379000cb40 con 0x7f379815cb90 2023-11-20T06:41:41.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7fad977fe640 1 --2- 172.21.15.19:0/1217929288 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fad84066570 0x7fad84068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7fad7ffff640 1 --2- 172.21.15.19:0/1217929288 >> [v2:172.21.15.190:6816/1335226039,v1:172.21.15.190:6817/1335226039] conn(0x7fad8406fb30 0x7fad84071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7fad7ffff640 1 -- 172.21.15.19:0/1217929288 --> [v2:172.21.15.190:6816/1335226039,v1:172.21.15.190:6817/1335226039] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad84072640 con 0x7fad8406fb30 2023-11-20T06:41:41.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f8a637fe640 1 -- 172.21.15.19:0/2569729274 <== osd.4 v2:172.21.15.190:6808/4085939700 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f8a680733f0 con 0x7f8a68070880 2023-11-20T06:41:41.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f3786ffd640 1 -- 172.21.15.19:0/3588177083 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379000ccc0 con 0x7f379815cb90 2023-11-20T06:41:41.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f3786ffd640 1 -- 172.21.15.19:0/3588177083 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790014680 con 0x7f379815cb90 2023-11-20T06:41:41.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f27ef868640 1 -- start start 2023-11-20T06:41:41.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7ff83f7fe640 1 --2- 172.21.15.19:0/2312389134 >> [v2:172.21.15.19:6824/2577618590,v1:172.21.15.19:6825/2577618590] conn(0x7ff82406fac0 0x7ff824071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7ff83ffff640 1 --2- 172.21.15.19:0/2312389134 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff824066500 0x7ff8240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f379c980640 1 -- 172.21.15.19:0/3588177083 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3798152c50 con 0x7f379815cb90 2023-11-20T06:41:41.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f379c980640 1 -- 172.21.15.19:0/3588177083 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37980ca4e0 con 0x7f379815cb90 2023-11-20T06:41:41.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7fad7ffff640 1 -- 172.21.15.19:0/1217929288 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad8c050700 con 0x7fad9815a8b0 2023-11-20T06:41:41.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7ff83ffff640 1 --2- 172.21.15.19:0/2312389134 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff824066500 0x7ff8240689c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff834009a50 tx=0x7ff834008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7ff83f7fe640 1 --2- 172.21.15.19:0/2312389134 >> [v2:172.21.15.19:6824/2577618590,v1:172.21.15.19:6825/2577618590] conn(0x7ff82406fac0 0x7ff824071f00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7fad977fe640 1 --2- 172.21.15.19:0/1217929288 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fad84066570 0x7fad84068a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fad90001570 tx=0x7fad90009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f27ef868640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27e80ad960 0x7f27e80c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f379c980640 1 -- 172.21.15.19:0/3588177083 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f379815cf70 con 0x7f379815cb90 2023-11-20T06:41:41.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f27ef868640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27e80b07f0 0x7f27e8151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f27ef868640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27e8164520 0x7f27e80c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f27ef868640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e80c3b30 con 0x7f27e80b07f0 2023-11-20T06:41:41.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f27ef868640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e80c2fc0 con 0x7f27e80ad960 2023-11-20T06:41:41.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.287+0000 7f27ef868640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e80c3290 con 0x7f27e8164520 2023-11-20T06:41:41.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7f27ede05640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27e8164520 0x7f27e80c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7f27ede05640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27e8164520 0x7f27e80c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:41884/0 (socket says 172.21.15.19:41884) 2023-11-20T06:41:41.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7f27ede05640 1 -- 172.21.15.19:0/2964770858 learned_addr learned my addr 172.21.15.19:0/2964770858 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7f27ed604640 1 --2- 172.21.15.19:0/2964770858 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27e80ad960 0x7f27e80c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7f27ece03640 1 --2- 172.21.15.19:0/2964770858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27e80b07f0 0x7f27e8151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7fad96ffd640 1 --2- 172.21.15.19:0/1217929288 >> [v2:172.21.15.190:6816/1335226039,v1:172.21.15.190:6817/1335226039] conn(0x7fad8406fb30 0x7fad84071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7ff83cff9640 1 -- 172.21.15.19:0/2312389134 <== osd.3 v2:172.21.15.19:6824/2577618590 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ff8240725d0 con 0x7ff82406fac0 2023-11-20T06:41:41.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7f27ede05640 1 -- 172.21.15.19:0/2964770858 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27e80ad960 msgr2=0x7f27e80c2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7f27ede05640 1 --2- 172.21.15.19:0/2964770858 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27e80ad960 0x7f27e80c2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7f27ede05640 1 -- 172.21.15.19:0/2964770858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27e80b07f0 msgr2=0x7f27e8151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7f27ede05640 1 --2- 172.21.15.19:0/2964770858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27e80b07f0 0x7f27e8151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7f27ede05640 1 -- 172.21.15.19:0/2964770858 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e0009b30 con 0x7f27e8164520 2023-11-20T06:41:41.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7fad96ffd640 1 --2- 172.21.15.19:0/1217929288 >> [v2:172.21.15.190:6816/1335226039,v1:172.21.15.190:6817/1335226039] conn(0x7fad8406fb30 0x7fad84071f70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7f27ede05640 1 --2- 172.21.15.19:0/2964770858 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27e8164520 0x7f27e80c7ed0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f27e00af040 tx=0x7f27e0019780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7f27ddffb640 1 -- 172.21.15.19:0/2964770858 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e00b8670 con 0x7f27e8164520 2023-11-20T06:41:41.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7f27ddffb640 1 -- 172.21.15.19:0/2964770858 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e00b87f0 con 0x7f27e8164520 2023-11-20T06:41:41.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7f27ddffb640 1 -- 172.21.15.19:0/2964770858 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e00b8ba0 con 0x7f27e8164520 2023-11-20T06:41:41.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7f27ef868640 1 -- 172.21.15.19:0/2964770858 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e80c3570 con 0x7f27e8164520 2023-11-20T06:41:41.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7f27ef868640 1 -- 172.21.15.19:0/2964770858 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e80c58d0 con 0x7f27e8164520 2023-11-20T06:41:41.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7f3786ffd640 1 -- 172.21.15.19:0/3588177083 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3790003980 con 0x7f379815cb90 2023-11-20T06:41:41.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7fad7ffff640 1 -- 172.21.15.19:0/1217929288 <== osd.5 v2:172.21.15.190:6816/1335226039 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fad84072640 con 0x7fad8406fb30 2023-11-20T06:41:41.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7f27ef868640 1 -- 172.21.15.19:0/2964770858 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f27e816de20 con 0x7f27e8164520 2023-11-20T06:41:41.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7f3786ffd640 1 --2- 172.21.15.19:0/3588177083 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f3778066520 0x7f37780689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.291+0000 7f3786ffd640 1 -- 172.21.15.19:0/3588177083 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f37900840b0 con 0x7f379815cb90 2023-11-20T06:41:41.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.295+0000 7f3786ffd640 1 --2- 172.21.15.19:0/3588177083 >> [v2:172.21.15.190:6800/1124210179,v1:172.21.15.190:6801/1124210179] conn(0x7f377806fb60 0x7f3778071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.295+0000 7f3786ffd640 1 -- 172.21.15.19:0/3588177083 --> [v2:172.21.15.190:6800/1124210179,v1:172.21.15.190:6801/1124210179] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3778072670 con 0x7f377806fb60 2023-11-20T06:41:41.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.295+0000 7f3786ffd640 1 -- 172.21.15.19:0/3588177083 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3790084420 con 0x7f379815cb90 2023-11-20T06:41:41.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.295+0000 7f379659c640 1 --2- 172.21.15.19:0/3588177083 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f3778066520 0x7f37780689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.295+0000 7f27ddffb640 1 -- 172.21.15.19:0/2964770858 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f27e00b8d00 con 0x7f27e8164520 2023-11-20T06:41:41.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.295+0000 7f379659c640 1 --2- 172.21.15.19:0/3588177083 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f3778066520 0x7f37780689e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f37880af000 tx=0x7f37880a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.295+0000 7f27ddffb640 1 --2- 172.21.15.19:0/2964770858 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f27cc0664f0 0x7f27cc0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.295+0000 7f27ddffb640 1 -- 172.21.15.19:0/2964770858 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f27e011fd00 con 0x7f27e8164520 2023-11-20T06:41:41.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.295+0000 7f27ddffb640 1 --2- 172.21.15.19:0/2964770858 >> [v2:172.21.15.190:6824/2641951692,v1:172.21.15.190:6825/2641951692] conn(0x7f27cc06fb30 0x7f27cc071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.295+0000 7f27ddffb640 1 -- 172.21.15.19:0/2964770858 --> [v2:172.21.15.190:6824/2641951692,v1:172.21.15.190:6825/2641951692] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27cc072640 con 0x7f27cc06fb30 2023-11-20T06:41:41.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.295+0000 7f27ddffb640 1 -- 172.21.15.19:0/2964770858 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27e01201a0 con 0x7f27e8164520 2023-11-20T06:41:41.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.295+0000 7f27ed604640 1 --2- 172.21.15.19:0/2964770858 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f27cc0664f0 0x7f27cc0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.295+0000 7f27ece03640 1 --2- 172.21.15.19:0/2964770858 >> [v2:172.21.15.190:6824/2641951692,v1:172.21.15.190:6825/2641951692] conn(0x7f27cc06fb30 0x7f27cc071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.295+0000 7f27ed604640 1 --2- 172.21.15.19:0/2964770858 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f27cc0664f0 0x7f27cc0689b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f27d80096f0 tx=0x7f27d8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.295+0000 7f27ece03640 1 --2- 172.21.15.19:0/2964770858 >> [v2:172.21.15.190:6824/2641951692,v1:172.21.15.190:6825/2641951692] conn(0x7f27cc06fb30 0x7f27cc071f70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.299+0000 7f3795d9b640 1 --2- 172.21.15.19:0/3588177083 >> [v2:172.21.15.190:6800/1124210179,v1:172.21.15.190:6801/1124210179] conn(0x7f377806fb60 0x7f3778071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.299+0000 7f27ddffb640 1 -- 172.21.15.19:0/2964770858 <== osd.6 v2:172.21.15.190:6824/2641951692 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f27cc072640 con 0x7f27cc06fb30 2023-11-20T06:41:41.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.303+0000 7f3795d9b640 1 --2- 172.21.15.19:0/3588177083 >> [v2:172.21.15.190:6800/1124210179,v1:172.21.15.190:6801/1124210179] conn(0x7f377806fb60 0x7f3778071fa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.303+0000 7f3786ffd640 1 -- 172.21.15.19:0/3588177083 <== osd.7 v2:172.21.15.190:6800/1124210179 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f3778072670 con 0x7f377806fb60 2023-11-20T06:41:41.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.307+0000 7f98bce46640 1 -- 172.21.15.19:0/3869448781 --> [v2:172.21.15.19:6816/404837676,v1:172.21.15.19:6817/404837676] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f98b0058610 con 0x7f989806fae0 2023-11-20T06:41:41.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.307+0000 7f2b8a371640 1 -- 172.21.15.19:0/2024117866 --> [v2:172.21.15.19:6808/427773025,v1:172.21.15.19:6809/427773025] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2b64002cc0 con 0x7f2b6806fbb0 2023-11-20T06:41:41.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.307+0000 7f98a6ffd640 1 -- 172.21.15.19:0/3869448781 <== osd.0 v2:172.21.15.19:6816/404837676 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f98ac004040 con 0x7f989806fae0 2023-11-20T06:41:41.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.307+0000 7f2b79ffb640 1 -- 172.21.15.19:0/2024117866 <== osd.2 v2:172.21.15.19:6808/427773025 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2b64002cc0 con 0x7f2b6806fbb0 2023-11-20T06:41:41.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.307+0000 7f98bce46640 1 -- 172.21.15.19:0/3869448781 >> [v2:172.21.15.19:6816/404837676,v1:172.21.15.19:6817/404837676] conn(0x7f989806fae0 msgr2=0x7f9898071f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.307+0000 7f98bce46640 1 --2- 172.21.15.19:0/3869448781 >> [v2:172.21.15.19:6816/404837676,v1:172.21.15.19:6817/404837676] conn(0x7f989806fae0 0x7f9898071f20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7f98bce46640 1 -- 172.21.15.19:0/3869448781 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f98980664a0 msgr2=0x7f9898068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7f98bce46640 1 --2- 172.21.15.19:0/3869448781 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f98980664a0 0x7f9898068960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f98b003be80 tx=0x7f98a8008040 comp rx=0 tx=0).stop 2023-11-20T06:41:41.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.307+0000 7f2b8a371640 1 -- 172.21.15.19:0/2024117866 >> [v2:172.21.15.19:6808/427773025,v1:172.21.15.19:6809/427773025] conn(0x7f2b6806fbb0 msgr2=0x7f2b68071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.307+0000 7f2b8a371640 1 --2- 172.21.15.19:0/2024117866 >> [v2:172.21.15.19:6808/427773025,v1:172.21.15.19:6809/427773025] conn(0x7f2b6806fbb0 0x7f2b68071ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7f98bce46640 1 -- 172.21.15.19:0/3869448781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98b0053a50 msgr2=0x7f98b004f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7f98bce46640 1 --2- 172.21.15.19:0/3869448781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98b0053a50 0x7f98b004f0c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f98b8066a90 tx=0x7f98b8072520 comp rx=0 tx=0).stop 2023-11-20T06:41:41.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7f98b659c640 1 -- 172.21.15.19:0/3869448781 reap_dead start 2023-11-20T06:41:41.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7f2b8a371640 1 -- 172.21.15.19:0/2024117866 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2b68066570 msgr2=0x7f2b68068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7f2b8a371640 1 --2- 172.21.15.19:0/2024117866 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2b68066570 0x7f2b68068a30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2b800ad000 tx=0x7f2b800a6000 comp rx=0 tx=0).stop 2023-11-20T06:41:41.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7f2b8a371640 1 -- 172.21.15.19:0/2024117866 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b7c054340 msgr2=0x7f2b7c17ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7f2b8a371640 1 --2- 172.21.15.19:0/2024117866 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b7c054340 0x7f2b7c17ffb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400d830 tx=0x7f2b7400dcf0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7f2b89b70640 1 -- 172.21.15.19:0/2024117866 reap_dead start 2023-11-20T06:41:41.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7f2b8a371640 1 -- 172.21.15.19:0/2024117866 shutdown_connections 2023-11-20T06:41:41.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7f2b8a371640 1 -- 172.21.15.19:0/2024117866 >> 172.21.15.19:0/2024117866 conn(0x7f2b7c059130 msgr2=0x7f2b7c0e2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7f98bce46640 1 -- 172.21.15.19:0/3869448781 shutdown_connections 2023-11-20T06:41:41.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7f98bce46640 1 -- 172.21.15.19:0/3869448781 >> 172.21.15.19:0/3869448781 conn(0x7f98b00591f0 msgr2=0x7f98b003e760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7f2b8a371640 1 -- 172.21.15.19:0/2024117866 shutdown_connections 2023-11-20T06:41:41.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7f2b8a371640 1 -- 172.21.15.19:0/2024117866 wait complete. 2023-11-20T06:41:41.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7f98bce46640 1 -- 172.21.15.19:0/3869448781 shutdown_connections 2023-11-20T06:41:41.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7f98bce46640 1 -- 172.21.15.19:0/3869448781 wait complete. 2023-11-20T06:41:41.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7ff845688640 1 -- 172.21.15.19:0/2312389134 --> [v2:172.21.15.19:6824/2577618590,v1:172.21.15.19:6825/2577618590] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff838054810 con 0x7ff82406fac0 2023-11-20T06:41:41.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7fcf23371640 1 -- 172.21.15.19:0/3193398802 --> [v2:172.21.15.19:6800/2544072609,v1:172.21.15.19:6801/2544072609] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcf1c0b1910 con 0x7fcf0006fa90 2023-11-20T06:41:41.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.311+0000 7fcf12ffd640 1 -- 172.21.15.19:0/3193398802 <== osd.1 v2:172.21.15.19:6800/2544072609 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcf1c0b1910 con 0x7fcf0006fa90 2023-11-20T06:41:41.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.315+0000 7fcf23371640 1 -- 172.21.15.19:0/3193398802 >> [v2:172.21.15.19:6800/2544072609,v1:172.21.15.19:6801/2544072609] conn(0x7fcf0006fa90 msgr2=0x7fcf00071ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.315+0000 7fcf23371640 1 --2- 172.21.15.19:0/3193398802 >> [v2:172.21.15.19:6800/2544072609,v1:172.21.15.19:6801/2544072609] conn(0x7fcf0006fa90 0x7fcf00071ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.315+0000 7ff83cff9640 1 -- 172.21.15.19:0/2312389134 <== osd.3 v2:172.21.15.19:6824/2577618590 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff82c004040 con 0x7ff82406fac0 2023-11-20T06:41:41.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.315+0000 7fcf23371640 1 -- 172.21.15.19:0/3193398802 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fcf000664d0 msgr2=0x7fcf00068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.315+0000 7fcf23371640 1 --2- 172.21.15.19:0/3193398802 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fcf000664d0 0x7fcf00068990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c01c4a0 tx=0x7fcf0c0a6000 comp rx=0 tx=0).stop 2023-11-20T06:41:41.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.315+0000 7fcf23371640 1 -- 172.21.15.19:0/3193398802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf1c161c40 msgr2=0x7fcf1c1598f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.315+0000 7fcf23371640 1 --2- 172.21.15.19:0/3193398802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf1c161c40 0x7fcf1c1598f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcf1400be20 tx=0x7fcf1400bf10 comp rx=0 tx=0).stop 2023-11-20T06:41:41.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.315+0000 7fcf22b70640 1 -- 172.21.15.19:0/3193398802 reap_dead start 2023-11-20T06:41:41.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.315+0000 7fcf23371640 1 -- 172.21.15.19:0/3193398802 shutdown_connections 2023-11-20T06:41:41.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.315+0000 7fcf23371640 1 -- 172.21.15.19:0/3193398802 >> 172.21.15.19:0/3193398802 conn(0x7fcf1c06a4f0 msgr2=0x7fcf1c0b38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.315+0000 7fcf23371640 1 -- 172.21.15.19:0/3193398802 shutdown_connections 2023-11-20T06:41:41.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.315+0000 7fcf23371640 1 -- 172.21.15.19:0/3193398802 wait complete. 2023-11-20T06:41:41.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.319+0000 7ff845688640 1 -- 172.21.15.19:0/2312389134 >> [v2:172.21.15.19:6824/2577618590,v1:172.21.15.19:6825/2577618590] conn(0x7ff82406fac0 msgr2=0x7ff824071f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.319+0000 7ff845688640 1 --2- 172.21.15.19:0/2312389134 >> [v2:172.21.15.19:6824/2577618590,v1:172.21.15.19:6825/2577618590] conn(0x7ff82406fac0 0x7ff824071f00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.319+0000 7f8a7bfff640 1 -- 172.21.15.19:0/2569729274 --> [v2:172.21.15.190:6808/4085939700,v1:172.21.15.190:6809/4085939700] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8a74057600 con 0x7f8a68070880 2023-11-20T06:41:41.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.319+0000 7ff845688640 1 -- 172.21.15.19:0/2312389134 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff824066500 msgr2=0x7ff8240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.319+0000 7ff845688640 1 --2- 172.21.15.19:0/2312389134 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff824066500 0x7ff8240689c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff834009a50 tx=0x7ff834008040 comp rx=0 tx=0).stop 2023-11-20T06:41:41.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.319+0000 7ff845688640 1 -- 172.21.15.19:0/2312389134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8380e3190 msgr2=0x7ff838048db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.319+0000 7ff845688640 1 --2- 172.21.15.19:0/2312389134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8380e3190 0x7ff838048db0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff840066bd0 tx=0x7ff840072520 comp rx=0 tx=0).stop 2023-11-20T06:41:41.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.319+0000 7ff844e87640 1 -- 172.21.15.19:0/2312389134 reap_dead start 2023-11-20T06:41:41.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.319+0000 7f8a637fe640 1 -- 172.21.15.19:0/2569729274 <== osd.4 v2:172.21.15.190:6808/4085939700 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8a7c090040 con 0x7f8a68070880 2023-11-20T06:41:41.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.319+0000 7ff845688640 1 -- 172.21.15.19:0/2312389134 shutdown_connections 2023-11-20T06:41:41.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.319+0000 7ff845688640 1 -- 172.21.15.19:0/2312389134 >> 172.21.15.19:0/2312389134 conn(0x7ff838054c20 msgr2=0x7ff838050aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.319+0000 7f8a7bfff640 1 -- 172.21.15.19:0/2569729274 >> [v2:172.21.15.190:6808/4085939700,v1:172.21.15.190:6809/4085939700] conn(0x7f8a68070880 msgr2=0x7f8a68072d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.319+0000 7f8a7bfff640 1 --2- 172.21.15.19:0/2569729274 >> [v2:172.21.15.190:6808/4085939700,v1:172.21.15.190:6809/4085939700] conn(0x7f8a68070880 0x7f8a68072d20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.323+0000 7ff845688640 1 -- 172.21.15.19:0/2312389134 shutdown_connections 2023-11-20T06:41:41.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.323+0000 7f8a7bfff640 1 -- 172.21.15.19:0/2569729274 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8a68066520 msgr2=0x7f8a680689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.323+0000 7ff845688640 1 -- 172.21.15.19:0/2312389134 wait complete. 2023-11-20T06:41:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.323+0000 7f8a7bfff640 1 --2- 172.21.15.19:0/2569729274 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8a68066520 0x7f8a680689e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c009ac0 tx=0x7f8a6c008040 comp rx=0 tx=0).stop 2023-11-20T06:41:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.323+0000 7f8a7bfff640 1 -- 172.21.15.19:0/2569729274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a74180c50 msgr2=0x7f8a74052610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.323+0000 7f8a7bfff640 1 --2- 172.21.15.19:0/2569729274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a74180c50 0x7f8a74052610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009000 tx=0x7f8a64005800 comp rx=0 tx=0).stop 2023-11-20T06:41:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.323+0000 7f8a7b7fe640 1 -- 172.21.15.19:0/2569729274 reap_dead start 2023-11-20T06:41:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.323+0000 7f8a7bfff640 1 -- 172.21.15.19:0/2569729274 shutdown_connections 2023-11-20T06:41:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.323+0000 7f8a7bfff640 1 -- 172.21.15.19:0/2569729274 >> 172.21.15.19:0/2569729274 conn(0x7f8a74055a40 msgr2=0x7f8a740e2450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.323+0000 7f8a7bfff640 1 -- 172.21.15.19:0/2569729274 shutdown_connections 2023-11-20T06:41:41.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.323+0000 7f8a7bfff640 1 -- 172.21.15.19:0/2569729274 wait complete. 2023-11-20T06:41:41.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.323+0000 7fad9df3e640 1 -- 172.21.15.19:0/1217929288 --> [v2:172.21.15.190:6816/1335226039,v1:172.21.15.190:6817/1335226039] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fad980c5590 con 0x7fad8406fb30 2023-11-20T06:41:41.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.323+0000 7fad7ffff640 1 -- 172.21.15.19:0/1217929288 <== osd.5 v2:172.21.15.190:6816/1335226039 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fad980c5590 con 0x7fad8406fb30 2023-11-20T06:41:41.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.323+0000 7fad9df3e640 1 -- 172.21.15.19:0/1217929288 >> [v2:172.21.15.190:6816/1335226039,v1:172.21.15.190:6817/1335226039] conn(0x7fad8406fb30 msgr2=0x7fad84071f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.327+0000 7fad9df3e640 1 --2- 172.21.15.19:0/1217929288 >> [v2:172.21.15.190:6816/1335226039,v1:172.21.15.190:6817/1335226039] conn(0x7fad8406fb30 0x7fad84071f70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.327+0000 7fad9df3e640 1 -- 172.21.15.19:0/1217929288 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fad84066570 msgr2=0x7fad84068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.327+0000 7fad9df3e640 1 --2- 172.21.15.19:0/1217929288 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fad84066570 0x7fad84068a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fad90001570 tx=0x7fad90009040 comp rx=0 tx=0).stop 2023-11-20T06:41:41.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.327+0000 7fad9df3e640 1 -- 172.21.15.19:0/1217929288 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad9815a8b0 msgr2=0x7fad980c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.327+0000 7fad9df3e640 1 --2- 172.21.15.19:0/1217929288 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad9815a8b0 0x7fad980c9e50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00c410 tx=0x7fad8c00c8d0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.327+0000 7f379c980640 1 -- 172.21.15.19:0/3588177083 --> [v2:172.21.15.190:6800/1124210179,v1:172.21.15.190:6801/1124210179] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f37980c66f0 con 0x7f377806fb60 2023-11-20T06:41:41.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.327+0000 7fad97fff640 1 -- 172.21.15.19:0/1217929288 reap_dead start 2023-11-20T06:41:41.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.327+0000 7fad9df3e640 1 -- 172.21.15.19:0/1217929288 shutdown_connections 2023-11-20T06:41:41.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.327+0000 7fad9df3e640 1 -- 172.21.15.19:0/1217929288 >> 172.21.15.19:0/1217929288 conn(0x7fad980cd1c0 msgr2=0x7fad980cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.327+0000 7fad9df3e640 1 -- 172.21.15.19:0/1217929288 shutdown_connections 2023-11-20T06:41:41.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.327+0000 7fad9df3e640 1 -- 172.21.15.19:0/1217929288 wait complete. 2023-11-20T06:41:41.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.327+0000 7f3786ffd640 1 -- 172.21.15.19:0/3588177083 <== osd.7 v2:172.21.15.190:6800/1124210179 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f378c00a4c0 con 0x7f377806fb60 2023-11-20T06:41:41.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.327+0000 7f27ef868640 1 -- 172.21.15.19:0/2964770858 --> [v2:172.21.15.190:6824/2641951692,v1:172.21.15.190:6825/2641951692] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f27e80c5730 con 0x7f27cc06fb30 2023-11-20T06:41:41.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.327+0000 7f3784ff9640 1 -- 172.21.15.19:0/3588177083 >> [v2:172.21.15.190:6800/1124210179,v1:172.21.15.190:6801/1124210179] conn(0x7f377806fb60 msgr2=0x7f3778071fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.327+0000 7f3784ff9640 1 --2- 172.21.15.19:0/3588177083 >> [v2:172.21.15.190:6800/1124210179,v1:172.21.15.190:6801/1124210179] conn(0x7f377806fb60 0x7f3778071fa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.327+0000 7f27ddffb640 1 -- 172.21.15.19:0/2964770858 <== osd.6 v2:172.21.15.190:6824/2641951692 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f27e80c5730 con 0x7f27cc06fb30 2023-11-20T06:41:41.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.327+0000 7f27ef868640 1 -- 172.21.15.19:0/2964770858 >> [v2:172.21.15.190:6824/2641951692,v1:172.21.15.190:6825/2641951692] conn(0x7f27cc06fb30 msgr2=0x7f27cc071f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.327+0000 7f27ef868640 1 --2- 172.21.15.19:0/2964770858 >> [v2:172.21.15.190:6824/2641951692,v1:172.21.15.190:6825/2641951692] conn(0x7f27cc06fb30 0x7f27cc071f70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.331+0000 7f27ef868640 1 -- 172.21.15.19:0/2964770858 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f27cc0664f0 msgr2=0x7f27cc0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.331+0000 7f27ef868640 1 --2- 172.21.15.19:0/2964770858 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f27cc0664f0 0x7f27cc0689b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f27d80096f0 tx=0x7f27d8008040 comp rx=0 tx=0).stop 2023-11-20T06:41:41.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.331+0000 7f27ef868640 1 -- 172.21.15.19:0/2964770858 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27e8164520 msgr2=0x7f27e80c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.331+0000 7f27ef868640 1 --2- 172.21.15.19:0/2964770858 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27e8164520 0x7f27e80c7ed0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f27e00af040 tx=0x7f27e0019780 comp rx=0 tx=0).stop 2023-11-20T06:41:41.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.331+0000 7f27ede05640 1 -- 172.21.15.19:0/2964770858 reap_dead start 2023-11-20T06:41:41.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.331+0000 7f27ef868640 1 -- 172.21.15.19:0/2964770858 shutdown_connections 2023-11-20T06:41:41.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.331+0000 7f27ef868640 1 -- 172.21.15.19:0/2964770858 >> 172.21.15.19:0/2964770858 conn(0x7f27e806c190 msgr2=0x7f27e8161a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.335+0000 7f27ef868640 1 -- 172.21.15.19:0/2964770858 shutdown_connections 2023-11-20T06:41:41.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.335+0000 7f3784ff9640 1 -- 172.21.15.19:0/3588177083 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f3778066520 msgr2=0x7f37780689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.335+0000 7f3784ff9640 1 --2- 172.21.15.19:0/3588177083 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f3778066520 0x7f37780689e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f37880af000 tx=0x7f37880a7000 comp rx=0 tx=0).stop 2023-11-20T06:41:41.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.335+0000 7f3784ff9640 1 -- 172.21.15.19:0/3588177083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f379815cb90 msgr2=0x7f37981548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.335+0000 7f3784ff9640 1 --2- 172.21.15.19:0/3588177083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f379815cb90 0x7f37981548f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f379000b970 tx=0x7f379000be30 comp rx=0 tx=0).stop 2023-11-20T06:41:41.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.335+0000 7f3796d9d640 1 -- 172.21.15.19:0/3588177083 reap_dead start 2023-11-20T06:41:41.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.335+0000 7f3784ff9640 1 -- 172.21.15.19:0/3588177083 shutdown_connections 2023-11-20T06:41:41.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.335+0000 7f3784ff9640 1 -- 172.21.15.19:0/3588177083 >> 172.21.15.19:0/3588177083 conn(0x7f379809bc50 msgr2=0x7f379815bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.335+0000 7f27ef868640 1 -- 172.21.15.19:0/2964770858 wait complete. 2023-11-20T06:41:41.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.335+0000 7f3784ff9640 1 -- 172.21.15.19:0/3588177083 shutdown_connections 2023-11-20T06:41:41.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.335+0000 7f3784ff9640 1 -- 172.21.15.19:0/3588177083 wait complete. 2023-11-20T06:41:41.393 INFO:teuthology.orchestra.run.smithi019.stdout:55834574858 2023-11-20T06:41:41.393 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-20T06:41:41.394 INFO:teuthology.orchestra.run.smithi019.stdout:55834574857 2023-11-20T06:41:41.395 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-20T06:41:41.395 INFO:teuthology.orchestra.run.smithi019.stdout:55834574860 2023-11-20T06:41:41.396 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-20T06:41:41.397 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T06:41:41.397 INFO:teuthology.orchestra.run.smithi019.stdout:55834574857 2023-11-20T06:41:41.398 INFO:teuthology.orchestra.run.smithi019.stdout:55834574857 2023-11-20T06:41:41.399 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-20T06:41:41.399 INFO:teuthology.orchestra.run.smithi019.stdout:55834574858 2023-11-20T06:41:41.399 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-20T06:41:41.400 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-20T06:41:41.401 INFO:teuthology.orchestra.run.smithi019.stdout:55834574859 2023-11-20T06:41:41.401 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-20T06:41:41.402 INFO:teuthology.orchestra.run.smithi019.stdout:55834574859 2023-11-20T06:41:41.402 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-20T06:41:41.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.655+0000 7fe8d759e640 1 Processor -- start 2023-11-20T06:41:41.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.655+0000 7fe8d759e640 1 -- start start 2023-11-20T06:41:41.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.659+0000 7fe8d759e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8d8071e30 0x7fe8d80ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.659+0000 7fe8d759e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe8d806c9f0 0x7fe8d80caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.659+0000 7fe8d6d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe8d806c9f0 0x7fe8d80caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.659+0000 7fe8d6d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe8d806c9f0 0x7fe8d80caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48564/0 (socket says 172.21.15.19:48564) 2023-11-20T06:41:41.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.659+0000 7fe8d659c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8d8071e30 0x7fe8d80ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.659+0000 7fe8d5d9b640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fe8d80c9a80 0x7fe8d806c2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:58174/0 (socket says 172.21.15.19:58174) 2023-11-20T06:41:41.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.659+0000 7fe8d6d9d640 1 -- 172.21.15.19:0/4253356509 learned_addr learned my addr 172.21.15.19:0/4253356509 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.659+0000 7fe8d759e640 1 -- 172.21.15.19:0/4253356509 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d806d010 con 0x7fe8d80c9a80 2023-11-20T06:41:41.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.659+0000 7fe8d759e640 1 -- 172.21.15.19:0/4253356509 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d80cb470 con 0x7fe8d806c9f0 2023-11-20T06:41:41.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.659+0000 7fe8d759e640 1 -- 172.21.15.19:0/4253356509 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80c8cc0 con 0x7fe8d8071e30 2023-11-20T06:41:41.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.659+0000 7f8611446640 1 Processor -- start 2023-11-20T06:41:41.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.663+0000 7f8611446640 1 -- start start 2023-11-20T06:41:41.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.663+0000 7fe8d659c640 1 -- 172.21.15.19:0/4253356509 >> v2:172.21.15.19:3300/0 conn(0x7fe8d806c9f0 msgr2=0x7fe8d80caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.663+0000 7fe8d659c640 1 --2- 172.21.15.19:0/4253356509 >> v2:172.21.15.19:3300/0 conn(0x7fe8d806c9f0 0x7fe8d80caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.663+0000 7fe8d659c640 1 -- 172.21.15.19:0/4253356509 >> v1:172.21.15.190:6789/0 conn(0x7fe8d80c9a80 legacy=0x7fe8d806c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.663+0000 7fe8d659c640 1 -- 172.21.15.19:0/4253356509 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d80c8fa0 con 0x7fe8d8071e30 2023-11-20T06:41:41.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.663+0000 7f7db259d640 1 Processor -- start 2023-11-20T06:41:41.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.663+0000 7f8611446640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8604034110 0x7f8604007580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.663+0000 7f8611446640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f86040528b0 0x7f86040540c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.663+0000 7f8611446640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f860404fc20 0x7f8604050090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.663+0000 7f8611446640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86040505d0 con 0x7f86040528b0 2023-11-20T06:41:41.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.663+0000 7f860a7fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f86040528b0 0x7f86040540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.663+0000 7f8611446640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86040dfad0 con 0x7f8604034110 2023-11-20T06:41:41.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.663+0000 7f8611446640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8604052d60 con 0x7f860404fc20 2023-11-20T06:41:41.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.663+0000 7f860bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f860404fc20 0x7f8604050090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.663+0000 7f860bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f860404fc20 0x7f8604050090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:41904/0 (socket says 172.21.15.19:41904) 2023-11-20T06:41:41.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.663+0000 7f860bfff640 1 -- 172.21.15.19:0/3440729729 learned_addr learned my addr 172.21.15.19:0/3440729729 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.663+0000 7f7db259d640 1 -- start start 2023-11-20T06:41:41.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.663+0000 7f860bfff640 1 -- 172.21.15.19:0/3440729729 >> v2:172.21.15.190:3300/0 conn(0x7f8604034110 msgr2=0x7f8604007580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.667+0000 7f860affd640 1 --2- 172.21.15.19:0/3440729729 >> v2:172.21.15.190:3300/0 conn(0x7f8604034110 0x7f8604007580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.667+0000 7f860bfff640 1 --2- 172.21.15.19:0/3440729729 >> v2:172.21.15.190:3300/0 conn(0x7f8604034110 0x7f8604007580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.667+0000 7f860bfff640 1 -- 172.21.15.19:0/3440729729 >> v2:172.21.15.19:3300/0 conn(0x7f86040528b0 msgr2=0x7f86040540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.667+0000 7f860bfff640 1 --2- 172.21.15.19:0/3440729729 >> v2:172.21.15.19:3300/0 conn(0x7f86040528b0 0x7f86040540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.667+0000 7f860bfff640 1 -- 172.21.15.19:0/3440729729 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8604053020 con 0x7f860404fc20 2023-11-20T06:41:41.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.667+0000 7f860affd640 1 --2- 172.21.15.19:0/3440729729 >> v2:172.21.15.190:3300/0 conn(0x7f8604034110 0x7f8604007580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:41.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.667+0000 7fe8d659c640 1 --2- 172.21.15.19:0/4253356509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8d8071e30 0x7fe8d80ca9f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009d90 tx=0x7fe8d001c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a11613e7dc93e9d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.667+0000 7f7db259d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dac0ca640 0x7f7dac0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.667+0000 7f7db259d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dac0c9e10 con 0x7f7dac0ce830 2023-11-20T06:41:41.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.667+0000 7fe8d559a640 1 -- 172.21.15.19:0/4253356509 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d00a57e0 con 0x7fe8d8071e30 2023-11-20T06:41:41.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.667+0000 7fe8d559a640 1 -- 172.21.15.19:0/4253356509 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d00a5940 con 0x7fe8d8071e30 2023-11-20T06:41:41.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.667+0000 7fe8d559a640 1 -- 172.21.15.19:0/4253356509 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d00a5cd0 con 0x7fe8d8071e30 2023-11-20T06:41:41.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.667+0000 7fe8d759e640 1 -- 172.21.15.19:0/4253356509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8d8071e30 msgr2=0x7fe8d80ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.667+0000 7fe8d759e640 1 --2- 172.21.15.19:0/4253356509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8d8071e30 0x7fe8d80ca9f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009d90 tx=0x7fe8d001c830 comp rx=0 tx=0).stop 2023-11-20T06:41:41.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.667+0000 7f7db259d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dac0c9850 con 0x7f7dac15a8d0 2023-11-20T06:41:41.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.667+0000 7f7db259d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac0ceca0 con 0x7f7dac0ca640 2023-11-20T06:41:41.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.667+0000 7f7dabfff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f7dac15a8d0 0x7f7dac0c8f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:58176/0 (socket says 172.21.15.19:58176) 2023-11-20T06:41:41.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.667+0000 7f7dabfff640 1 -- 172.21.15.19:0/2741664329 learned_addr learned my addr 172.21.15.19:0/2741664329 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:41.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7dab7fe640 1 --2- 172.21.15.19:0/2741664329 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dac0ca640 0x7f7dac0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f860bfff640 1 --2- 172.21.15.19:0/3440729729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f860404fc20 0x7f8604050090 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f860c02cb50 tx=0x7f860c0988b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac38443b9330e98b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7daaffd640 1 -- 172.21.15.19:0/2741664329 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3784864940 0 0) 0x7f7dac0c9850 con 0x7f7dac15a8d0 2023-11-20T06:41:41.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7daaffd640 1 -- 172.21.15.19:0/2741664329 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d94003530 con 0x7f7dac15a8d0 2023-11-20T06:41:41.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f8609ffb640 1 -- 172.21.15.19:0/3440729729 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c072040 con 0x7f860404fc20 2023-11-20T06:41:41.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f8609ffb640 1 -- 172.21.15.19:0/3440729729 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860c124660 con 0x7f860404fc20 2023-11-20T06:41:41.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f8609ffb640 1 -- 172.21.15.19:0/3440729729 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c124a50 con 0x7f860404fc20 2023-11-20T06:41:41.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7daaffd640 1 -- 172.21.15.19:0/2741664329 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3817596059 0 0) 0x7f7d94003530 con 0x7f7dac15a8d0 2023-11-20T06:41:41.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7daaffd640 1 -- 172.21.15.19:0/2741664329 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dac0ca640 msgr2=0x7f7dac0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7daaffd640 1 --2- 172.21.15.19:0/2741664329 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dac0ca640 0x7f7dac0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7daaffd640 1 -- 172.21.15.19:0/2741664329 >> v1:172.21.15.19:6789/0 conn(0x7f7dac0ce830 legacy=0x7f7dac0b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7daaffd640 1 -- 172.21.15.19:0/2741664329 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac0c9b30 con 0x7f7dac15a8d0 2023-11-20T06:41:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7daaffd640 1 -- 172.21.15.19:0/2741664329 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7f7da0001660 con 0x7f7dac15a8d0 2023-11-20T06:41:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7daaffd640 1 -- 172.21.15.19:0/2741664329 >> v1:172.21.15.190:6789/0 conn(0x7f7dac15a8d0 legacy=0x7f7dac0c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7daaffd640 1 --2- 172.21.15.19:0/2741664329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d94003a10 0x7f7d94003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7daaffd640 1 --2- 172.21.15.19:0/2741664329 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d940047d0 0x7f7d94004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7daaffd640 1 --2- 172.21.15.19:0/2741664329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d940051e0 0x7f7d9400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7daaffd640 1 -- 172.21.15.19:0/2741664329 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac0ceca0 con 0x7f7d940051e0 2023-11-20T06:41:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7daaffd640 1 -- 172.21.15.19:0/2741664329 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9400c170 con 0x7f7d94003a10 2023-11-20T06:41:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7daaffd640 1 -- 172.21.15.19:0/2741664329 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9400c330 con 0x7f7d940047d0 2023-11-20T06:41:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7dab7fe640 1 --2- 172.21.15.19:0/2741664329 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dac0ca640 0x7f7dac0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:41.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f8611446640 1 -- 172.21.15.19:0/3440729729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f860404fc20 msgr2=0x7f8604050090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f8611446640 1 --2- 172.21.15.19:0/3440729729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f860404fc20 0x7f8604050090 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f860c02cb50 tx=0x7f860c0988b0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7dabfff640 1 --2- 172.21.15.19:0/2741664329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d94003a10 0x7f7d94003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7dab7fe640 1 --2- 172.21.15.19:0/2741664329 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d940047d0 0x7f7d94004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7fe8d759e640 1 -- 172.21.15.19:0/4253356509 shutdown_connections 2023-11-20T06:41:41.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7fe8d759e640 1 --2- 172.21.15.19:0/4253356509 >> v2:172.21.15.19:3300/0 conn(0x7fe8d806c9f0 0x7fe8d80caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7fe8d759e640 1 --2- 172.21.15.19:0/4253356509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8d8071e30 0x7fe8d80ca9f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7fe8d759e640 1 -- 172.21.15.19:0/4253356509 >> 172.21.15.19:0/4253356509 conn(0x7fe8d80afe60 msgr2=0x7fe8d80b0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f0d89cc9640 1 Processor -- start 2023-11-20T06:41:41.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7db0b3a640 1 --2- 172.21.15.19:0/2741664329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d940051e0 0x7f7d9400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7fe8d759e640 1 -- 172.21.15.19:0/4253356509 shutdown_connections 2023-11-20T06:41:41.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f8611446640 1 -- 172.21.15.19:0/3440729729 shutdown_connections 2023-11-20T06:41:41.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f0d89cc9640 1 -- start start 2023-11-20T06:41:41.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f8611446640 1 --2- 172.21.15.19:0/3440729729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f860404fc20 0x7f8604050090 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f8611446640 1 --2- 172.21.15.19:0/3440729729 >> v2:172.21.15.19:3300/0 conn(0x7f86040528b0 0x7f86040540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f8611446640 1 --2- 172.21.15.19:0/3440729729 >> v2:172.21.15.190:3300/0 conn(0x7f8604034110 0x7f8604007580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7dab7fe640 1 -- 172.21.15.19:0/2741664329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d94003a10 msgr2=0x7f7d94003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f8611446640 1 -- 172.21.15.19:0/3440729729 >> 172.21.15.19:0/3440729729 conn(0x7f8604054ce0 msgr2=0x7f86040550f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f8611446640 1 -- 172.21.15.19:0/3440729729 shutdown_connections 2023-11-20T06:41:41.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f8611446640 1 -- 172.21.15.19:0/3440729729 wait complete. 2023-11-20T06:41:41.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7fe8d759e640 1 -- 172.21.15.19:0/4253356509 wait complete. 2023-11-20T06:41:41.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7fe8d759e640 1 Processor -- start 2023-11-20T06:41:41.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7fe8d759e640 1 -- start start 2023-11-20T06:41:41.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f8611446640 1 Processor -- start 2023-11-20T06:41:41.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7dab7fe640 1 --2- 172.21.15.19:0/2741664329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d94003a10 0x7f7d94003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7dab7fe640 1 -- 172.21.15.19:0/2741664329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d940051e0 msgr2=0x7f7d9400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7dab7fe640 1 --2- 172.21.15.19:0/2741664329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d940051e0 0x7f7d9400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.671+0000 7f7dab7fe640 1 -- 172.21.15.19:0/2741664329 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac0c9b30 con 0x7f7d940047d0 2023-11-20T06:41:41.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f7db0b3a640 1 --2- 172.21.15.19:0/2741664329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d940051e0 0x7f7d9400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:41:41.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f0d89cc9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0d7c033d10 0x7f0d7c0eb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f0d89cc9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d7c048200 0x7f0d7c0eb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f0d89cc9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0d7c047bd0 0x7f0d7c005ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f0d89cc9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7c0ec020 con 0x7f0d7c047bd0 2023-11-20T06:41:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f0d89cc9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7c04f200 con 0x7f0d7c033d10 2023-11-20T06:41:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f0d89cc9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c04f4e0 con 0x7f0d7c048200 2023-11-20T06:41:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f0d837fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0d7c033d10 0x7f0d7c0eb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f0d837fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0d7c033d10 0x7f0d7c0eb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:38846/0 (socket says 172.21.15.19:38846) 2023-11-20T06:41:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f0d837fe640 1 -- 172.21.15.19:0/2883809167 learned_addr learned my addr 172.21.15.19:0/2883809167 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f0d82ffd640 1 --2- 172.21.15.19:0/2883809167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d7c048200 0x7f0d7c0eb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f0d837fe640 1 -- 172.21.15.19:0/2883809167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d7c048200 msgr2=0x7f0d7c0eb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f0d837fe640 1 --2- 172.21.15.19:0/2883809167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d7c048200 0x7f0d7c0eb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f0d837fe640 1 -- 172.21.15.19:0/2883809167 >> v2:172.21.15.19:3300/0 conn(0x7f0d7c047bd0 msgr2=0x7f0d7c005ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f0d837fe640 1 --2- 172.21.15.19:0/2883809167 >> v2:172.21.15.19:3300/0 conn(0x7f0d7c047bd0 0x7f0d7c005ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f0d837fe640 1 -- 172.21.15.19:0/2883809167 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c054100 con 0x7f0d7c033d10 2023-11-20T06:41:41.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f3766e17640 1 Processor -- start 2023-11-20T06:41:41.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f3766e17640 1 -- start start 2023-11-20T06:41:41.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f8611446640 1 -- start start 2023-11-20T06:41:41.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f7dabfff640 1 --2- 172.21.15.19:0/2741664329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d94003a10 0x7f7d94003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:41:41.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f6a0530f640 1 Processor -- start 2023-11-20T06:41:41.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7f6a0530f640 1 -- start start 2023-11-20T06:41:41.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f3766e17640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37600b0340 0x7f376015e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f3766e17640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37600b0720 0x7f37600b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f3766e17640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376015f350 con 0x7f37600c8cb0 2023-11-20T06:41:41.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7fe8d759e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8d806c9f0 0x7fe8d80abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7fe8d759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8d8071e30 0x7fe8d81f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7fe8d759e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8d80c9a80 0x7fe8d814f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7fe8d759e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d81f6800 con 0x7fe8d8071e30 2023-11-20T06:41:41.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7fe8d759e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d814f660 con 0x7fe8d806c9f0 2023-11-20T06:41:41.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.675+0000 7fe8d759e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80ac390 con 0x7fe8d80c9a80 2023-11-20T06:41:41.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7fe8d6d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8d80c9a80 0x7fe8d814f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7fe8d6d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8d80c9a80 0x7fe8d814f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:41946/0 (socket says 172.21.15.19:41946) 2023-11-20T06:41:41.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7fe8d6d9d640 1 -- 172.21.15.19:0/2200646990 learned_addr learned my addr 172.21.15.19:0/2200646990 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7fe8d659c640 1 --2- 172.21.15.19:0/2200646990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8d806c9f0 0x7fe8d80abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7fe8d6d9d640 1 -- 172.21.15.19:0/2200646990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8d806c9f0 msgr2=0x7fe8d80abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f3766e17640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376015b080 con 0x7f37600b0720 2023-11-20T06:41:41.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f3766e17640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376015eab0 con 0x7f37600b0340 2023-11-20T06:41:41.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7fe8d6d9d640 1 --2- 172.21.15.19:0/2200646990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8d806c9f0 0x7fe8d80abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7fe8d6d9d640 1 -- 172.21.15.19:0/2200646990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8d8071e30 msgr2=0x7fe8d81f62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7fe8d6d9d640 1 --2- 172.21.15.19:0/2200646990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8d8071e30 0x7fe8d81f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f8611446640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8604034110 0x7f860404a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7fe8d6d9d640 1 -- 172.21.15.19:0/2200646990 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d0009a70 con 0x7fe8d80c9a80 2023-11-20T06:41:41.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7fe8d659c640 1 --2- 172.21.15.19:0/2200646990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8d806c9f0 0x7fe8d80abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:41:41.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f7dab7fe640 1 --2- 172.21.15.19:0/2741664329 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d940047d0 0x7f7d94004c50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0caa80 tx=0x7f7da4020ff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bca077eb23c2fb40 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f37653b4640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f37600c8cb0 0x7f376015b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:58178/0 (socket says 172.21.15.19:58178) 2023-11-20T06:41:41.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f37653b4640 1 -- 172.21.15.19:0/1524235754 learned_addr learned my addr 172.21.15.19:0/1524235754 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:41.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f3764bb3640 1 --2- 172.21.15.19:0/1524235754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37600b0340 0x7f376015e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7fe8d6d9d640 1 --2- 172.21.15.19:0/2200646990 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8d80c9a80 0x7fe8d814f120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000b3f0 tx=0x7fe8c000b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f6a0530f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a0015eaf0 0x7f6a001655f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f6a0530f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a001625e0 con 0x7f6a000cf270 2023-11-20T06:41:41.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f6a0530f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a00162020 con 0x7f6a000ccfb0 2023-11-20T06:41:41.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f6a0530f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a00162300 con 0x7f6a0015eaf0 2023-11-20T06:41:41.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f8611446640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f860404fc20 0x7f8604039ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f8611446640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86040528b0 0x7f860403a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7fe8ceffd640 1 -- 172.21.15.19:0/2200646990 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c002a070 con 0x7fe8d80c9a80 2023-11-20T06:41:41.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7fe8ceffd640 1 -- 172.21.15.19:0/2200646990 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c0014120 con 0x7fe8d80c9a80 2023-11-20T06:41:41.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7fe8ceffd640 1 -- 172.21.15.19:0/2200646990 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0014a50 con 0x7fe8d80c9a80 2023-11-20T06:41:41.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f69fe7fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6a000cf270 0x7f6a00161740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46014/0 (socket says 172.21.15.19:46014) 2023-11-20T06:41:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f69fe7fc640 1 -- 172.21.15.19:0/4262367168 learned_addr learned my addr 172.21.15.19:0/4262367168 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f69feffd640 1 --2- 172.21.15.19:0/4262367168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a0015eaf0 0x7f6a001655f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f3764bb3640 1 -- 172.21.15.19:0/1524235754 >> v2:172.21.15.19:3300/0 conn(0x7f37600b0720 msgr2=0x7f37600b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7fe8d759e640 1 -- 172.21.15.19:0/2200646990 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d80ac670 con 0x7fe8d80c9a80 2023-11-20T06:41:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7fe8d759e640 1 -- 172.21.15.19:0/2200646990 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d80acc30 con 0x7fe8d80c9a80 2023-11-20T06:41:41.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f860a7fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f860404fc20 0x7f8604039ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f860a7fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f860404fc20 0x7f8604039ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:41970/0 (socket says 172.21.15.19:41970) 2023-11-20T06:41:41.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f3764bb3640 1 --2- 172.21.15.19:0/1524235754 >> v2:172.21.15.19:3300/0 conn(0x7f37600b0720 0x7f37600b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f3764bb3640 1 -- 172.21.15.19:0/1524235754 >> v1:172.21.15.190:6789/0 conn(0x7f37600c8cb0 legacy=0x7f376015b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f375f7fe640 1 -- 172.21.15.19:0/1524235754 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541691915 0 0) 0x7f376015f350 con 0x7f37600c8cb0 2023-11-20T06:41:41.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f3764bb3640 1 -- 172.21.15.19:0/1524235754 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376015ed90 con 0x7f37600b0340 2023-11-20T06:41:41.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f69feffd640 1 -- 172.21.15.19:0/4262367168 >> v1:172.21.15.190:6789/0 conn(0x7f6a000ccfb0 legacy=0x7f6a000cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f860a7fc640 1 -- 172.21.15.19:0/858586502 learned_addr learned my addr 172.21.15.19:0/858586502 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f8611446640 1 -- 172.21.15.19:0/858586502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86040e29e0 con 0x7f8604034110 2023-11-20T06:41:41.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f69fdffb640 1 -- 172.21.15.19:0/4262367168 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183739261 0 0) 0x7f6a001625e0 con 0x7f6a000cf270 2023-11-20T06:41:41.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f7daaffd640 1 -- 172.21.15.19:0/2741664329 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da40039a0 con 0x7f7d940047d0 2023-11-20T06:41:41.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f860bfff640 1 --2- 172.21.15.19:0/858586502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86040528b0 0x7f860403a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f8611446640 1 -- 172.21.15.19:0/858586502 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860404bdb0 con 0x7f86040528b0 2023-11-20T06:41:41.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f8611446640 1 -- 172.21.15.19:0/858586502 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860404c090 con 0x7f860404fc20 2023-11-20T06:41:41.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f69feffd640 1 -- 172.21.15.19:0/4262367168 >> v1:172.21.15.19:6789/0 conn(0x7f6a000cf270 legacy=0x7f6a00161740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f7554165640 1 Processor -- start 2023-11-20T06:41:41.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.679+0000 7f7554165640 1 -- start start 2023-11-20T06:41:41.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f860bfff640 1 -- 172.21.15.19:0/858586502 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f860404fc20 msgr2=0x7f8604039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f860bfff640 1 --2- 172.21.15.19:0/858586502 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f860404fc20 0x7f8604039ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f860bfff640 1 -- 172.21.15.19:0/858586502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8604034110 msgr2=0x7f860404a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f860bfff640 1 --2- 172.21.15.19:0/858586502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8604034110 0x7f860404a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f860bfff640 1 -- 172.21.15.19:0/858586502 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c04f100 con 0x7f86040528b0 2023-11-20T06:41:41.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f7daaffd640 1 -- 172.21.15.19:0/2741664329 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da40ac030 con 0x7f7d940047d0 2023-11-20T06:41:41.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f860bfff640 1 --2- 172.21.15.19:0/858586502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86040528b0 0x7f860403a1e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f860c063a60 tx=0x7f860c095750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7fe8d759e640 1 -- 172.21.15.19:0/2200646990 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8bc005260 con 0x7fe8d80c9a80 2023-11-20T06:41:41.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f7daaffd640 1 -- 172.21.15.19:0/2741664329 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da40039a0 con 0x7f7d940047d0 2023-11-20T06:41:41.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f69feffd640 1 -- 172.21.15.19:0/4262367168 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a00164df0 con 0x7f6a0015eaf0 2023-11-20T06:41:41.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f0d837fe640 1 --2- 172.21.15.19:0/2883809167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d7c033d10 0x7f0d7c0eb150 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009870 tx=0x7f0d7801c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39ee08eb0d5f93a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f85f37fe640 1 -- 172.21.15.19:0/858586502 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c13a070 con 0x7f86040528b0 2023-11-20T06:41:41.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f85f37fe640 1 -- 172.21.15.19:0/858586502 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860c132040 con 0x7f86040528b0 2023-11-20T06:41:41.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f85f37fe640 1 -- 172.21.15.19:0/858586502 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c12c400 con 0x7f86040528b0 2023-11-20T06:41:41.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f8611446640 1 -- 172.21.15.19:0/858586502 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860404c370 con 0x7f86040528b0 2023-11-20T06:41:41.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f7db259d640 1 -- 172.21.15.19:0/2741664329 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d940047d0 msgr2=0x7f7d94004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f7db259d640 1 --2- 172.21.15.19:0/2741664329 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d940047d0 0x7f7d94004c50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0caa80 tx=0x7f7da4020ff0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f7db0b3a640 1 -- 172.21.15.19:0/2741664329 reap_dead start 2023-11-20T06:41:41.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f8611446640 1 -- 172.21.15.19:0/858586502 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860404ad90 con 0x7f86040528b0 2023-11-20T06:41:41.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f7554165640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f754c15cf00 0x7f754c0cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f7554165640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f754c0cdee0 0x7f754c0d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f7554165640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f754c0ce340 con 0x7f754c0d1240 2023-11-20T06:41:41.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f7554165640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f754c15d2e0 con 0x7f754c15cf00 2023-11-20T06:41:41.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f7554165640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c0d16d0 con 0x7f754c0cdee0 2023-11-20T06:41:41.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f7db259d640 1 -- 172.21.15.19:0/2741664329 shutdown_connections 2023-11-20T06:41:41.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f7db259d640 1 -- 172.21.15.19:0/2741664329 >> 172.21.15.19:0/2741664329 conn(0x7f7dac06a290 msgr2=0x7f7dac06a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7fe8ceffd640 1 -- 172.21.15.19:0/2200646990 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe8c00144b0 con 0x7fe8d80c9a80 2023-11-20T06:41:41.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f0d827fc640 1 -- 172.21.15.19:0/2883809167 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d780ab600 con 0x7f0d7c033d10 2023-11-20T06:41:41.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f0d827fc640 1 -- 172.21.15.19:0/2883809167 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d780a7050 con 0x7f0d7c033d10 2023-11-20T06:41:41.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f0d827fc640 1 -- 172.21.15.19:0/2883809167 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d780ab980 con 0x7f0d7c033d10 2023-11-20T06:41:41.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f7551f01640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f754c15cf00 0x7f754c0cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f7551f01640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f754c15cf00 0x7f754c0cd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48636/0 (socket says 172.21.15.19:48636) 2023-11-20T06:41:41.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f7551f01640 1 -- 172.21.15.19:0/3025230879 learned_addr learned my addr 172.21.15.19:0/3025230879 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f7db259d640 1 -- 172.21.15.19:0/2741664329 shutdown_connections 2023-11-20T06:41:41.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f8611446640 1 -- 172.21.15.19:0/858586502 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ec005260 con 0x7f86040528b0 2023-11-20T06:41:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f0d89cc9640 1 -- 172.21.15.19:0/2883809167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d7c033d10 msgr2=0x7f0d7c0eb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f0d89cc9640 1 --2- 172.21.15.19:0/2883809167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d7c033d10 0x7f0d7c0eb150 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009870 tx=0x7f0d7801c490 comp rx=0 tx=0).stop 2023-11-20T06:41:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f7551f01640 1 -- 172.21.15.19:0/3025230879 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f754c0cdee0 msgr2=0x7f754c0d0d00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-20T06:41:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f7551f01640 1 --2- 172.21.15.19:0/3025230879 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f754c0cdee0 0x7f754c0d0d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f7db259d640 1 -- 172.21.15.19:0/2741664329 wait complete. 2023-11-20T06:41:41.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7fe8ceffd640 1 --2- 172.21.15.19:0/2200646990 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe8b80664d0 0x7fe8b8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.683+0000 7f7551f01640 1 -- 172.21.15.19:0/3025230879 >> v1:172.21.15.19:6789/0 conn(0x7f754c0d1240 legacy=0x7f754c06ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f7551f01640 1 -- 172.21.15.19:0/3025230879 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c0d1930 con 0x7f754c15cf00 2023-11-20T06:41:41.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7fe8ceffd640 1 -- 172.21.15.19:0/2200646990 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe8c0094b00 con 0x7fe8d80c9a80 2023-11-20T06:41:41.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7fe8d659c640 1 --2- 172.21.15.19:0/2200646990 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe8b80664d0 0x7fe8b8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f85f37fe640 1 -- 172.21.15.19:0/858586502 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f860c12c560 con 0x7f86040528b0 2023-11-20T06:41:41.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f0d89cc9640 1 -- 172.21.15.19:0/2883809167 shutdown_connections 2023-11-20T06:41:41.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f0d89cc9640 1 --2- 172.21.15.19:0/2883809167 >> v2:172.21.15.19:3300/0 conn(0x7f0d7c047bd0 0x7f0d7c005ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f0d89cc9640 1 --2- 172.21.15.19:0/2883809167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d7c048200 0x7f0d7c0eb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f0d89cc9640 1 --2- 172.21.15.19:0/2883809167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d7c033d10 0x7f0d7c0eb150 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f0d89cc9640 1 -- 172.21.15.19:0/2883809167 >> 172.21.15.19:0/2883809167 conn(0x7f0d7c054b10 msgr2=0x7f0d7c054f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f3764bb3640 1 --2- 172.21.15.19:0/1524235754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37600b0340 0x7f376015e4d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f37500097c0 tx=0x7f375001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b11faf926a0a674 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f0d89cc9640 1 -- 172.21.15.19:0/2883809167 shutdown_connections 2023-11-20T06:41:41.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f69feffd640 1 --2- 172.21.15.19:0/4262367168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a0015eaf0 0x7f6a001655f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f69f00097f0 tx=0x7f69f001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d1e29c55a1a904c server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f0d89cc9640 1 -- 172.21.15.19:0/2883809167 wait complete. 2023-11-20T06:41:41.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7fe8d659c640 1 --2- 172.21.15.19:0/2200646990 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe8b80664d0 0x7fe8b8068990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00af000 tx=0x7fe8d00a7070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f7db259d640 1 Processor -- start 2023-11-20T06:41:41.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f9a2ebd3640 1 Processor -- start 2023-11-20T06:41:41.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f7db259d640 1 -- start start 2023-11-20T06:41:41.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f85f37fe640 1 --2- 172.21.15.19:0/858586502 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f85f80664f0 0x7f85f80689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f85f37fe640 1 -- 172.21.15.19:0/858586502 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f860c199f10 con 0x7f86040528b0 2023-11-20T06:41:41.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f9a2ebd3640 1 -- start start 2023-11-20T06:41:41.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.687+0000 7f860affd640 1 --2- 172.21.15.19:0/858586502 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f85f80664f0 0x7f85f80689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7551f01640 1 --2- 172.21.15.19:0/3025230879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f754c15cf00 0x7f754c0cd9a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7544009e50 tx=0x7f754401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115692744ff9d09 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f860affd640 1 --2- 172.21.15.19:0/858586502 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f85f80664f0 0x7f85f80689b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00a890 tx=0x7f85fc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7db259d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d940047d0 0x7f7dac0c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f9a2ebd3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a2815a7f0 0x7f9a280b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f9a2ebd3640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9a2815abd0 0x7f9a280b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7db259d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dac0c5e60 0x7f7dac0c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7550eff640 1 -- 172.21.15.19:0/3025230879 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75440a5860 con 0x7f754c15cf00 2023-11-20T06:41:41.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7550eff640 1 -- 172.21.15.19:0/3025230879 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75440a59c0 con 0x7f754c15cf00 2023-11-20T06:41:41.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7550eff640 1 -- 172.21.15.19:0/3025230879 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75440a5860 con 0x7f754c15cf00 2023-11-20T06:41:41.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f9a2ebd3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a280c9e90 con 0x7f9a280705d0 2023-11-20T06:41:41.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f9a2ebd3640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a280c9280 con 0x7f9a2815abd0 2023-11-20T06:41:41.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f9a2ebd3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a280c9560 con 0x7f9a2815a7f0 2023-11-20T06:41:41.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7dabfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d940047d0 0x7f7dac0c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7dabfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d940047d0 0x7f7dac0c3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48648/0 (socket says 172.21.15.19:48648) 2023-11-20T06:41:41.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7dabfff640 1 -- 172.21.15.19:0/1331079099 learned_addr learned my addr 172.21.15.19:0/1331079099 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f375f7fe640 1 -- 172.21.15.19:0/1524235754 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37500ab400 con 0x7f37600b0340 2023-11-20T06:41:41.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f375f7fe640 1 -- 172.21.15.19:0/1524235754 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37500a7050 con 0x7f37600b0340 2023-11-20T06:41:41.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f375f7fe640 1 -- 172.21.15.19:0/1524235754 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37500ab780 con 0x7f37600b0340 2023-11-20T06:41:41.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f69fdffb640 1 -- 172.21.15.19:0/4262367168 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f00ab600 con 0x7f6a0015eaf0 2023-11-20T06:41:41.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7db259d640 1 --2- 172.21.15.19:0/1331079099 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dac1f6140 0x7f7dac1f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7db259d640 1 -- 172.21.15.19:0/1331079099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac155130 con 0x7f7d940047d0 2023-11-20T06:41:41.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7db259d640 1 -- 172.21.15.19:0/1331079099 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac0c4080 con 0x7f7dac0c5e60 2023-11-20T06:41:41.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7db259d640 1 -- 172.21.15.19:0/1331079099 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac1f6b00 con 0x7f7dac1f6140 2023-11-20T06:41:41.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f69fdffb640 1 -- 172.21.15.19:0/4262367168 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f00a7050 con 0x7f6a0015eaf0 2023-11-20T06:41:41.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f69fdffb640 1 -- 172.21.15.19:0/4262367168 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f00ab980 con 0x7f6a0015eaf0 2023-11-20T06:41:41.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f9a1ffff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9a2815abd0 0x7f9a280b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f9a1ffff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9a2815abd0 0x7f9a280b0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:38880/0 (socket says 172.21.15.19:38880) 2023-11-20T06:41:41.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f9a1ffff640 1 -- 172.21.15.19:0/2534948066 learned_addr learned my addr 172.21.15.19:0/2534948066 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f9a2c96f640 1 --2- 172.21.15.19:0/2534948066 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a2815a7f0 0x7f9a280b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7fe8ceffd640 1 -- 172.21.15.19:0/2200646990 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe8c0061c80 con 0x7fe8d80c9a80 2023-11-20T06:41:41.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7db0b3a640 1 --2- 172.21.15.19:0/1331079099 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dac1f6140 0x7f7dac1f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7dab7fe640 1 --2- 172.21.15.19:0/1331079099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dac0c5e60 0x7f7dac0c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7dabfff640 1 -- 172.21.15.19:0/1331079099 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dac1f6140 msgr2=0x7f7dac1f65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7dabfff640 1 --2- 172.21.15.19:0/1331079099 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dac1f6140 0x7f7dac1f65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7dabfff640 1 -- 172.21.15.19:0/1331079099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dac0c5e60 msgr2=0x7f7dac0c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7dabfff640 1 --2- 172.21.15.19:0/1331079099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dac0c5e60 0x7f7dac0c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7dabfff640 1 -- 172.21.15.19:0/1331079099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac0c62f0 con 0x7f7d940047d0 2023-11-20T06:41:41.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f3766e17640 1 -- 172.21.15.19:0/1524235754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37600b0340 msgr2=0x7f376015e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f3766e17640 1 --2- 172.21.15.19:0/1524235754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37600b0340 0x7f376015e4d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f37500097c0 tx=0x7f375001c3f0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f0d89cc9640 1 Processor -- start 2023-11-20T06:41:41.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f9a2c96f640 1 -- 172.21.15.19:0/2534948066 >> v2:172.21.15.190:3300/0 conn(0x7f9a2815abd0 msgr2=0x7f9a280b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:41.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f9a2c96f640 1 --2- 172.21.15.19:0/2534948066 >> v2:172.21.15.190:3300/0 conn(0x7f9a2815abd0 0x7f9a280b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f9a2c96f640 1 -- 172.21.15.19:0/2534948066 >> v1:172.21.15.190:6789/0 conn(0x7f9a280705d0 legacy=0x7f9a28070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7dabfff640 1 --2- 172.21.15.19:0/1331079099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d940047d0 0x7f7dac0c3b40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7da00072e0 tx=0x7f7da00077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7554165640 1 -- 172.21.15.19:0/3025230879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f754c15cf00 msgr2=0x7f754c0cd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7554165640 1 --2- 172.21.15.19:0/3025230879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f754c15cf00 0x7f754c0cd9a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7544009e50 tx=0x7f754401c9a0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f6a0530f640 1 -- 172.21.15.19:0/4262367168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a0015eaf0 msgr2=0x7f6a001655f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f6a0530f640 1 --2- 172.21.15.19:0/4262367168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a0015eaf0 0x7f6a001655f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f69f00097f0 tx=0x7f69f001c430 comp rx=0 tx=0).stop 2023-11-20T06:41:41.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7554165640 1 -- 172.21.15.19:0/3025230879 shutdown_connections 2023-11-20T06:41:41.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7554165640 1 --2- 172.21.15.19:0/3025230879 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f754c0cdee0 0x7f754c0d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7554165640 1 --2- 172.21.15.19:0/3025230879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f754c15cf00 0x7f754c0cd9a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7554165640 1 -- 172.21.15.19:0/3025230879 >> 172.21.15.19:0/3025230879 conn(0x7f754c0b4470 msgr2=0x7f754c0b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f9a2c96f640 1 -- 172.21.15.19:0/2534948066 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a280c9840 con 0x7f9a2815a7f0 2023-11-20T06:41:41.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f9a1ffff640 1 --2- 172.21.15.19:0/2534948066 >> v2:172.21.15.190:3300/0 conn(0x7f9a2815abd0 0x7f9a280b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:41.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f3766e17640 1 -- 172.21.15.19:0/1524235754 shutdown_connections 2023-11-20T06:41:41.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f3766e17640 1 --2- 172.21.15.19:0/1524235754 >> v2:172.21.15.19:3300/0 conn(0x7f37600b0720 0x7f37600b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f3766e17640 1 --2- 172.21.15.19:0/1524235754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37600b0340 0x7f376015e4d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f3766e17640 1 -- 172.21.15.19:0/1524235754 >> 172.21.15.19:0/1524235754 conn(0x7f376006c190 msgr2=0x7f376006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f0d89cc9640 1 -- start start 2023-11-20T06:41:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7554165640 1 -- 172.21.15.19:0/3025230879 shutdown_connections 2023-11-20T06:41:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7da8ff9640 1 -- 172.21.15.19:0/1331079099 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da000f960 con 0x7f7d940047d0 2023-11-20T06:41:41.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7da8ff9640 1 -- 172.21.15.19:0/1331079099 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da000fac0 con 0x7f7d940047d0 2023-11-20T06:41:41.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7da8ff9640 1 -- 172.21.15.19:0/1331079099 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da000fe30 con 0x7f7d940047d0 2023-11-20T06:41:41.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f3766e17640 1 -- 172.21.15.19:0/1524235754 shutdown_connections 2023-11-20T06:41:41.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7554165640 1 -- 172.21.15.19:0/3025230879 wait complete. 2023-11-20T06:41:41.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f3766e17640 1 -- 172.21.15.19:0/1524235754 wait complete. 2023-11-20T06:41:41.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d89cc9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d7c033d10 0x7f0d7c0d7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d89cc9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d7c047bd0 0x7f0d7c0e6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d89cc9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d7c048200 0x7f0d7c0e72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d89cc9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c0dc1f0 con 0x7f0d7c047bd0 2023-11-20T06:41:41.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d89cc9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c0dc4d0 con 0x7f0d7c048200 2023-11-20T06:41:41.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d89cc9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c0dc7b0 con 0x7f0d7c033d10 2023-11-20T06:41:41.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d837fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d7c033d10 0x7f0d7c0d7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d837fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d7c033d10 0x7f0d7c0d7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:42026/0 (socket says 172.21.15.19:42026) 2023-11-20T06:41:41.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d837fe640 1 -- 172.21.15.19:0/957660782 learned_addr learned my addr 172.21.15.19:0/957660782 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d83fff640 1 --2- 172.21.15.19:0/957660782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d7c048200 0x7f0d7c0e72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7db259d640 1 -- 172.21.15.19:0/1331079099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dac0c65d0 con 0x7f7d940047d0 2023-11-20T06:41:41.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.691+0000 7f7db259d640 1 -- 172.21.15.19:0/1331079099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dac0c6b90 con 0x7f7d940047d0 2023-11-20T06:41:41.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f7db259d640 1 -- 172.21.15.19:0/1331079099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dac073fa0 con 0x7f7d940047d0 2023-11-20T06:41:41.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d837fe640 1 -- 172.21.15.19:0/957660782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d7c048200 msgr2=0x7f0d7c0e72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d837fe640 1 --2- 172.21.15.19:0/957660782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d7c048200 0x7f0d7c0e72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d82ffd640 1 --2- 172.21.15.19:0/957660782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d7c047bd0 0x7f0d7c0e6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d837fe640 1 -- 172.21.15.19:0/957660782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d7c047bd0 msgr2=0x7f0d7c0e6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d837fe640 1 --2- 172.21.15.19:0/957660782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d7c047bd0 0x7f0d7c0e6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d837fe640 1 -- 172.21.15.19:0/957660782 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d780094d0 con 0x7f0d7c033d10 2023-11-20T06:41:41.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d82ffd640 1 --2- 172.21.15.19:0/957660782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d7c047bd0 0x7f0d7c0e6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:41.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f6a0530f640 1 -- 172.21.15.19:0/4262367168 shutdown_connections 2023-11-20T06:41:41.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f6a0530f640 1 --2- 172.21.15.19:0/4262367168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a0015eaf0 0x7f6a001655f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f6a0530f640 1 -- 172.21.15.19:0/4262367168 >> 172.21.15.19:0/4262367168 conn(0x7f6a000b4470 msgr2=0x7f6a000b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d837fe640 1 --2- 172.21.15.19:0/957660782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d7c033d10 0x7f0d7c0d7fd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0d7801cd30 tx=0x7f0d78019230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f7554165640 1 Processor -- start 2023-11-20T06:41:41.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f7554165640 1 -- start start 2023-11-20T06:41:41.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f7da8ff9640 1 -- 172.21.15.19:0/1331079099 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7da001d460 con 0x7f7d940047d0 2023-11-20T06:41:41.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f7da8ff9640 1 --2- 172.21.15.19:0/1331079099 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7d980664f0 0x7f7d980689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f7da8ff9640 1 -- 172.21.15.19:0/1331079099 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7da0084d90 con 0x7f7d940047d0 2023-11-20T06:41:41.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f85f37fe640 1 -- 172.21.15.19:0/858586502 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f860c167110 con 0x7f86040528b0 2023-11-20T06:41:41.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d6ffff640 1 -- 172.21.15.19:0/957660782 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d780b5400 con 0x7f0d7c033d10 2023-11-20T06:41:41.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d6ffff640 1 -- 172.21.15.19:0/957660782 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d780b5560 con 0x7f0d7c033d10 2023-11-20T06:41:41.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d6ffff640 1 -- 172.21.15.19:0/957660782 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d780b5910 con 0x7f0d7c033d10 2023-11-20T06:41:41.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d89cc9640 1 -- 172.21.15.19:0/957660782 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7c0dca90 con 0x7f0d7c033d10 2023-11-20T06:41:41.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f0d89cc9640 1 -- 172.21.15.19:0/957660782 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7c035fa0 con 0x7f0d7c033d10 2023-11-20T06:41:41.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f0d6dffb640 1 -- 172.21.15.19:0/957660782 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d7c0dc610 con 0x7f0d7c033d10 2023-11-20T06:41:41.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f0d6ffff640 1 -- 172.21.15.19:0/957660782 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0d780b5a70 con 0x7f0d7c033d10 2023-11-20T06:41:41.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f3766e17640 1 Processor -- start 2023-11-20T06:41:41.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f3766e17640 1 -- start start 2023-11-20T06:41:41.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f3766e17640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37600b0340 0x7f3760150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f3766e17640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37600b0720 0x7f376014fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f3766e17640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37600c8cb0 0x7f37600c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f3766e17640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3760150bd0 con 0x7f37600c8cb0 2023-11-20T06:41:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f3766e17640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37600c2d10 con 0x7f37600b0340 2023-11-20T06:41:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f3766e17640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37600c2f80 con 0x7f37600b0720 2023-11-20T06:41:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f3764bb3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37600b0340 0x7f3760150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f375ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37600b0720 0x7f376014fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f375ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37600b0720 0x7f376014fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:42034/0 (socket says 172.21.15.19:42034) 2023-11-20T06:41:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f375ffff640 1 -- 172.21.15.19:0/3678901819 learned_addr learned my addr 172.21.15.19:0/3678901819 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f37653b4640 1 --2- 172.21.15.19:0/3678901819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37600c8cb0 0x7f37600c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f3764bb3640 1 -- 172.21.15.19:0/3678901819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37600b0720 msgr2=0x7f376014fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f3764bb3640 1 --2- 172.21.15.19:0/3678901819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37600b0720 0x7f376014fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f3764bb3640 1 -- 172.21.15.19:0/3678901819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37600c8cb0 msgr2=0x7f37600c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f3764bb3640 1 --2- 172.21.15.19:0/3678901819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37600c8cb0 0x7f37600c7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f3764bb3640 1 -- 172.21.15.19:0/3678901819 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3750009420 con 0x7f37600b0340 2023-11-20T06:41:41.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f375ffff640 1 --2- 172.21.15.19:0/3678901819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37600b0720 0x7f376014fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:41:41.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f3764bb3640 1 --2- 172.21.15.19:0/3678901819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37600b0340 0x7f3760150310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f37500ab000 tx=0x7f375001ac30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f37653b4640 1 --2- 172.21.15.19:0/3678901819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37600c8cb0 0x7f37600c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:41.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f375d7fa640 1 -- 172.21.15.19:0/3678901819 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37500b7650 con 0x7f37600b0340 2023-11-20T06:41:41.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f375d7fa640 1 -- 172.21.15.19:0/3678901819 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37500b77b0 con 0x7f37600b0340 2023-11-20T06:41:41.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f6a0530f640 1 -- 172.21.15.19:0/4262367168 shutdown_connections 2023-11-20T06:41:41.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.695+0000 7f6a0530f640 1 -- 172.21.15.19:0/4262367168 wait complete. 2023-11-20T06:41:41.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f6a0530f640 1 Processor -- start 2023-11-20T06:41:41.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f6a0530f640 1 -- start start 2023-11-20T06:41:41.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f6a0530f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a000ccfb0 0x7f6a0015aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f6a0530f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a000cf270 0x7f6a000cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f6a0530f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a0015eaf0 0x7f6a000c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f6a0530f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a000cc910 con 0x7f6a0015eaf0 2023-11-20T06:41:41.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f69feffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a000ccfb0 0x7f6a0015aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f69feffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a000ccfb0 0x7f6a0015aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:38922/0 (socket says 172.21.15.19:38922) 2023-11-20T06:41:41.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f69feffd640 1 -- 172.21.15.19:0/434480413 learned_addr learned my addr 172.21.15.19:0/434480413 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f69fe7fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a000cf270 0x7f6a000cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f69ff7fe640 1 --2- 172.21.15.19:0/434480413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a0015eaf0 0x7f6a000c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f6a0530f640 1 -- 172.21.15.19:0/434480413 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a000c9fe0 con 0x7f6a000ccfb0 2023-11-20T06:41:41.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f6a0530f640 1 -- 172.21.15.19:0/434480413 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a000c7a20 con 0x7f6a000cf270 2023-11-20T06:41:41.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f69fe7fc640 1 -- 172.21.15.19:0/434480413 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a000ccfb0 msgr2=0x7f6a0015aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f69fe7fc640 1 --2- 172.21.15.19:0/434480413 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a000ccfb0 0x7f6a0015aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f69fe7fc640 1 -- 172.21.15.19:0/434480413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a0015eaf0 msgr2=0x7f6a000c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f69fe7fc640 1 --2- 172.21.15.19:0/434480413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a0015eaf0 0x7f6a000c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f69fe7fc640 1 -- 172.21.15.19:0/434480413 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f0009420 con 0x7f6a000cf270 2023-11-20T06:41:41.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f69ff7fe640 1 --2- 172.21.15.19:0/434480413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a0015eaf0 0x7f6a000c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:41.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f69fe7fc640 1 --2- 172.21.15.19:0/434480413 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a000cf270 0x7f6a000cc3d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6a000cf6b0 tx=0x7f69f400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f69e77fe640 1 -- 172.21.15.19:0/434480413 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f40074e0 con 0x7f6a000cf270 2023-11-20T06:41:41.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f69e77fe640 1 -- 172.21.15.19:0/434480413 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f4007640 con 0x7f6a000cf270 2023-11-20T06:41:41.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f69e77fe640 1 -- 172.21.15.19:0/434480413 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4004a30 con 0x7f6a000cf270 2023-11-20T06:41:41.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f6a0530f640 1 -- 172.21.15.19:0/434480413 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a000ccb40 con 0x7f6a000cf270 2023-11-20T06:41:41.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f6a0530f640 1 -- 172.21.15.19:0/434480413 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a000ca510 con 0x7f6a000cf270 2023-11-20T06:41:41.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f7554165640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f754c0cdee0 0x7f754c156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f7554165640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f754c0d1240 0x7f754c15bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f7554165640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f754c15cf00 0x7f754c15ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f7554165640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c15a700 con 0x7f754c0cdee0 2023-11-20T06:41:41.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f7554165640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c0ca060 con 0x7f754c0d1240 2023-11-20T06:41:41.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f7554165640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c0ca340 con 0x7f754c15cf00 2023-11-20T06:41:41.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f375d7fa640 1 -- 172.21.15.19:0/3678901819 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37500b7b40 con 0x7f37600b0340 2023-11-20T06:41:41.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f3766e17640 1 -- 172.21.15.19:0/3678901819 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37600c94d0 con 0x7f37600b0340 2023-11-20T06:41:41.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f7dab7fe640 1 --2- 172.21.15.19:0/1331079099 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7d980664f0 0x7f7d980689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f3766e17640 1 -- 172.21.15.19:0/3678901819 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37600c3540 con 0x7f37600b0340 2023-11-20T06:41:41.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f9a2c96f640 1 --2- 172.21.15.19:0/2534948066 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a2815a7f0 0x7f9a280b00e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9a180097c0 tx=0x7f9a1801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90531d2abff5cf04 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f9a1f7fe640 1 -- 172.21.15.19:0/2534948066 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a180ab600 con 0x7f9a2815a7f0 2023-11-20T06:41:41.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f9a1f7fe640 1 -- 172.21.15.19:0/2534948066 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a180a7050 con 0x7f9a2815a7f0 2023-11-20T06:41:41.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f9a1f7fe640 1 -- 172.21.15.19:0/2534948066 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a180ab980 con 0x7f9a2815a7f0 2023-11-20T06:41:41.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f9a2ebd3640 1 -- 172.21.15.19:0/2534948066 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a2815a7f0 msgr2=0x7f9a280b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.699+0000 7f9a2ebd3640 1 --2- 172.21.15.19:0/2534948066 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a2815a7f0 0x7f9a280b00e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9a180097c0 tx=0x7f9a1801c3f0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f9a2ebd3640 1 -- 172.21.15.19:0/2534948066 shutdown_connections 2023-11-20T06:41:41.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f9a2ebd3640 1 --2- 172.21.15.19:0/2534948066 >> v2:172.21.15.190:3300/0 conn(0x7f9a2815abd0 0x7f9a280b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f9a2ebd3640 1 --2- 172.21.15.19:0/2534948066 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a2815a7f0 0x7f9a280b00e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f9a2ebd3640 1 -- 172.21.15.19:0/2534948066 >> 172.21.15.19:0/2534948066 conn(0x7f9a2806c190 msgr2=0x7f9a2806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:41.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f9a2ebd3640 1 -- 172.21.15.19:0/2534948066 shutdown_connections 2023-11-20T06:41:41.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f9a2ebd3640 1 -- 172.21.15.19:0/2534948066 wait complete. 2023-11-20T06:41:41.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f0d6ffff640 1 --2- 172.21.15.19:0/957660782 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0d680664f0 0x7f0d680689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f0d6ffff640 1 -- 172.21.15.19:0/957660782 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0d7811e5f0 con 0x7f0d7c033d10 2023-11-20T06:41:41.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f6a0530f640 1 -- 172.21.15.19:0/434480413 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e0005260 con 0x7f6a000cf270 2023-11-20T06:41:41.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f7551f01640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f754c0cdee0 0x7f754c156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f7552702640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f754c15cf00 0x7f754c15ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f7551f01640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f754c0cdee0 0x7f754c156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48682/0 (socket says 172.21.15.19:48682) 2023-11-20T06:41:41.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f7552702640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f754c15cf00 0x7f754c15ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:42050/0 (socket says 172.21.15.19:42050) 2023-11-20T06:41:41.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f7551f01640 1 -- 172.21.15.19:0/1138054538 learned_addr learned my addr 172.21.15.19:0/1138054538 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.707+0000 7f0d82ffd640 1 --2- 172.21.15.19:0/957660782 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0d680664f0 0x7f0d680689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f3766e17640 1 -- 172.21.15.19:0/3678901819 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3760074010 con 0x7f37600b0340 2023-11-20T06:41:41.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f7552702640 1 -- 172.21.15.19:0/1138054538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f754c0d1240 msgr2=0x7f754c15bcc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-20T06:41:41.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f7552702640 1 --2- 172.21.15.19:0/1138054538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f754c0d1240 0x7f754c15bcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f7552702640 1 -- 172.21.15.19:0/1138054538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f754c0cdee0 msgr2=0x7f754c156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f7552702640 1 --2- 172.21.15.19:0/1138054538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f754c0cdee0 0x7f754c156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.703+0000 7f7552702640 1 -- 172.21.15.19:0/1138054538 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7544009b30 con 0x7f754c15cf00 2023-11-20T06:41:41.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.707+0000 7f7552702640 1 --2- 172.21.15.19:0/1138054538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f754c15cf00 0x7f754c15ab90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f753c00c3c0 tx=0x7f753c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.707+0000 7f9a2ebd3640 1 Processor -- start 2023-11-20T06:41:41.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.707+0000 7f7dab7fe640 1 --2- 172.21.15.19:0/1331079099 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7d980664f0 0x7f7d980689b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7da40b3000 tx=0x7f7da4004a50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.707+0000 7f0d82ffd640 1 --2- 172.21.15.19:0/957660782 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0d680664f0 0x7f0d680689b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c183600 tx=0x7f0d70008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.707+0000 7f9a2ebd3640 1 -- start start 2023-11-20T06:41:41.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.707+0000 7f0d6ffff640 1 -- 172.21.15.19:0/957660782 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0d7c0dc610 con 0x7f0d7c033d10 2023-11-20T06:41:41.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.707+0000 7f375d7fa640 1 -- 172.21.15.19:0/3678901819 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f37500b7ca0 con 0x7f37600b0340 2023-11-20T06:41:41.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.707+0000 7f75427fc640 1 -- 172.21.15.19:0/1138054538 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c0052d0 con 0x7f754c15cf00 2023-11-20T06:41:41.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.707+0000 7f7da8ff9640 1 -- 172.21.15.19:0/1331079099 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7da0052000 con 0x7f7d940047d0 2023-11-20T06:41:41.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.707+0000 7f75427fc640 1 -- 172.21.15.19:0/1138054538 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753c005450 con 0x7f754c15cf00 2023-11-20T06:41:41.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.707+0000 7f75427fc640 1 -- 172.21.15.19:0/1138054538 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c007260 con 0x7f754c15cf00 2023-11-20T06:41:41.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.707+0000 7f7554165640 1 -- 172.21.15.19:0/1138054538 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754c0ca620 con 0x7f754c15cf00 2023-11-20T06:41:41.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.707+0000 7f7554165640 1 -- 172.21.15.19:0/1138054538 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754c158a40 con 0x7f754c15cf00 2023-11-20T06:41:41.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.707+0000 7f9a2ebd3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a280705d0 0x7f9a282044f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.707+0000 7f9a2ebd3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a2815a7f0 0x7f9a280cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f375d7fa640 1 --2- 172.21.15.19:0/3678901819 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f374c0664d0 0x7f374c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f9a2ebd3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a2815abd0 0x7f9a280ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f9a2ebd3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a28204a30 con 0x7f9a280705d0 2023-11-20T06:41:41.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f9a2ebd3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a282057f0 con 0x7f9a2815a7f0 2023-11-20T06:41:41.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f9a2ebd3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a28204be0 con 0x7f9a2815abd0 2023-11-20T06:41:41.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f69e77fe640 1 -- 172.21.15.19:0/434480413 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f69f4004b90 con 0x7f6a000cf270 2023-11-20T06:41:41.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f375d7fa640 1 -- 172.21.15.19:0/3678901819 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f375011f0e0 con 0x7f37600b0340 2023-11-20T06:41:41.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f375ffff640 1 --2- 172.21.15.19:0/3678901819 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f374c0664d0 0x7f374c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f9a2c96f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a280705d0 0x7f9a282044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f9a2c96f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a280705d0 0x7f9a282044f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48694/0 (socket says 172.21.15.19:48694) 2023-11-20T06:41:41.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f9a2c96f640 1 -- 172.21.15.19:0/1671749111 learned_addr learned my addr 172.21.15.19:0/1671749111 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:41.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f9a1ffff640 1 --2- 172.21.15.19:0/1671749111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a2815a7f0 0x7f9a280cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f7554165640 1 -- 172.21.15.19:0/1138054538 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f754c15a8b0 con 0x7f754c15cf00 2023-11-20T06:41:41.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f9a1ffff640 1 -- 172.21.15.19:0/1671749111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a2815abd0 msgr2=0x7f9a280ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f9a1ffff640 1 --2- 172.21.15.19:0/1671749111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a2815abd0 0x7f9a280ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f9a1ffff640 1 -- 172.21.15.19:0/1671749111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a280705d0 msgr2=0x7f9a282044f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:41.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f9a1ffff640 1 --2- 172.21.15.19:0/1671749111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a280705d0 0x7f9a282044f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:41.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f9a1ffff640 1 -- 172.21.15.19:0/1671749111 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a18009420 con 0x7f9a2815a7f0 2023-11-20T06:41:41.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f375ffff640 1 --2- 172.21.15.19:0/3678901819 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f374c0664d0 0x7f374c068990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f37601fce50 tx=0x7f3754009210 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f9a1ffff640 1 --2- 172.21.15.19:0/1671749111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a2815a7f0 0x7f9a280cc9d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400e600 tx=0x7f9a2400eac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f375d7fa640 1 -- 172.21.15.19:0/3678901819 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f37500ec420 con 0x7f37600b0340 2023-11-20T06:41:41.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f69e77fe640 1 --2- 172.21.15.19:0/434480413 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f69ec066570 0x7f69ec068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f69e77fe640 1 -- 172.21.15.19:0/434480413 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f69f40844c0 con 0x7f6a000cf270 2023-11-20T06:41:41.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f9a1d7fa640 1 -- 172.21.15.19:0/1671749111 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24004230 con 0x7f9a2815a7f0 2023-11-20T06:41:41.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f9a1d7fa640 1 -- 172.21.15.19:0/1671749111 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a24004390 con 0x7f9a2815a7f0 2023-11-20T06:41:41.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f9a1d7fa640 1 -- 172.21.15.19:0/1671749111 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24003840 con 0x7f9a2815a7f0 2023-11-20T06:41:41.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f9a2ebd3640 1 -- 172.21.15.19:0/1671749111 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a28204ec0 con 0x7f9a2815a7f0 2023-11-20T06:41:41.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f9a2ebd3640 1 -- 172.21.15.19:0/1671749111 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a28205480 con 0x7f9a2815a7f0 2023-11-20T06:41:41.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f69feffd640 1 --2- 172.21.15.19:0/434480413 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f69ec066570 0x7f69ec068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.711+0000 7f69feffd640 1 --2- 172.21.15.19:0/434480413 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f69ec066570 0x7f69ec068a30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f69f001a060 tx=0x7f69f00a4f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.715+0000 7f9a2ebd3640 1 -- 172.21.15.19:0/1671749111 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a28205960 con 0x7f9a2815a7f0 2023-11-20T06:41:41.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.715+0000 7f69e77fe640 1 -- 172.21.15.19:0/434480413 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f69f40516c0 con 0x7f6a000cf270 2023-11-20T06:41:41.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.715+0000 7f75427fc640 1 -- 172.21.15.19:0/1138054538 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f753c0073c0 con 0x7f754c15cf00 2023-11-20T06:41:41.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.715+0000 7f9a1d7fa640 1 -- 172.21.15.19:0/1671749111 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9a240039a0 con 0x7f9a2815a7f0 2023-11-20T06:41:41.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.715+0000 7f75427fc640 1 --2- 172.21.15.19:0/1138054538 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f75300665a0 0x7f7530068a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.715+0000 7f75427fc640 1 -- 172.21.15.19:0/1138054538 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f753c0839b0 con 0x7f754c15cf00 2023-11-20T06:41:41.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.719+0000 7f7551f01640 1 --2- 172.21.15.19:0/1138054538 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f75300665a0 0x7f7530068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.719+0000 7f9a1d7fa640 1 --2- 172.21.15.19:0/1671749111 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9a140665a0 0x7f9a14068a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:41.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.719+0000 7f7551f01640 1 --2- 172.21.15.19:0/1138054538 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f75300665a0 0x7f7530068a60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7544009e50 tx=0x7f75440a7070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.719+0000 7f9a2c96f640 1 --2- 172.21.15.19:0/1671749111 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9a140665a0 0x7f9a14068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:41.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.719+0000 7f9a1d7fa640 1 -- 172.21.15.19:0/1671749111 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9a24083b30 con 0x7f9a2815a7f0 2023-11-20T06:41:41.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.719+0000 7f75427fc640 1 -- 172.21.15.19:0/1138054538 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f753c050c60 con 0x7f754c15cf00 2023-11-20T06:41:41.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.719+0000 7f9a2c96f640 1 --2- 172.21.15.19:0/1671749111 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9a140665a0 0x7f9a14068a60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9a1801aaa0 tx=0x7f9a180a4f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:41.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:41.719+0000 7f9a1d7fa640 1 -- 172.21.15.19:0/1671749111 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9a24050d50 con 0x7f9a2815a7f0 2023-11-20T06:41:42.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.031+0000 7fe8d759e640 1 -- 172.21.15.19:0/2200646990 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe8bc005510 con 0x7fe8d80c9a80 2023-11-20T06:41:42.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.035+0000 7f8611446640 1 -- 172.21.15.19:0/858586502 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f85ec005510 con 0x7f86040528b0 2023-11-20T06:41:42.040 INFO:teuthology.orchestra.run.smithi019.stdout:55834574857 2023-11-20T06:41:42.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.035+0000 7fe8ceffd640 1 -- 172.21.15.19:0/2200646990 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe8c00652a0 con 0x7fe8d80c9a80 2023-11-20T06:41:42.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.035+0000 7f85f37fe640 1 -- 172.21.15.19:0/858586502 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f860c16a730 con 0x7f86040528b0 2023-11-20T06:41:42.040 INFO:teuthology.orchestra.run.smithi019.stdout:55834574859 2023-11-20T06:41:42.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.035+0000 7fe8d759e640 1 -- 172.21.15.19:0/2200646990 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe8b80664d0 msgr2=0x7fe8b8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:42.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.035+0000 7fe8d759e640 1 --2- 172.21.15.19:0/2200646990 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe8b80664d0 0x7fe8b8068990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00af000 tx=0x7fe8d00a7070 comp rx=0 tx=0).stop 2023-11-20T06:41:42.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.035+0000 7fe8d759e640 1 -- 172.21.15.19:0/2200646990 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8d80c9a80 msgr2=0x7fe8d814f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:42.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.035+0000 7fe8d759e640 1 --2- 172.21.15.19:0/2200646990 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8d80c9a80 0x7fe8d814f120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000b3f0 tx=0x7fe8c000b8b0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7fe8d759e640 1 -- 172.21.15.19:0/2200646990 shutdown_connections 2023-11-20T06:41:42.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7fe8d759e640 1 --2- 172.21.15.19:0/2200646990 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe8b80664d0 0x7fe8b8068990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7fe8d759e640 1 --2- 172.21.15.19:0/2200646990 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8d80c9a80 0x7fe8d814f120 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7fe8d759e640 1 --2- 172.21.15.19:0/2200646990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8d8071e30 0x7fe8d81f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7fe8d759e640 1 --2- 172.21.15.19:0/2200646990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8d806c9f0 0x7fe8d80abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7fe8d759e640 1 -- 172.21.15.19:0/2200646990 >> 172.21.15.19:0/2200646990 conn(0x7fe8d80afe60 msgr2=0x7fe8d815c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:42.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7f8611446640 1 -- 172.21.15.19:0/858586502 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f85f80664f0 msgr2=0x7f85f80689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:42.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7f8611446640 1 --2- 172.21.15.19:0/858586502 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f85f80664f0 0x7f85f80689b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00a890 tx=0x7f85fc008040 comp rx=0 tx=0).stop 2023-11-20T06:41:42.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7f8611446640 1 -- 172.21.15.19:0/858586502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86040528b0 msgr2=0x7f860403a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:42.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7f8611446640 1 --2- 172.21.15.19:0/858586502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86040528b0 0x7f860403a1e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f860c063a60 tx=0x7f860c095750 comp rx=0 tx=0).stop 2023-11-20T06:41:42.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7fe8d759e640 1 -- 172.21.15.19:0/2200646990 shutdown_connections 2023-11-20T06:41:42.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7f8611446640 1 -- 172.21.15.19:0/858586502 shutdown_connections 2023-11-20T06:41:42.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7f8611446640 1 --2- 172.21.15.19:0/858586502 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f85f80664f0 0x7f85f80689b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7f8611446640 1 --2- 172.21.15.19:0/858586502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86040528b0 0x7f860403a1e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7f8611446640 1 --2- 172.21.15.19:0/858586502 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f860404fc20 0x7f8604039ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7f8611446640 1 --2- 172.21.15.19:0/858586502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8604034110 0x7f860404a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7f8611446640 1 -- 172.21.15.19:0/858586502 >> 172.21.15.19:0/858586502 conn(0x7f8604054ce0 msgr2=0x7f8604007580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:42.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7f0d6dffb640 1 -- 172.21.15.19:0/957660782 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0d7c054830 con 0x7f0d7c033d10 2023-11-20T06:41:42.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7fe8d759e640 1 -- 172.21.15.19:0/2200646990 wait complete. 2023-11-20T06:41:42.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7f8611446640 1 -- 172.21.15.19:0/858586502 shutdown_connections 2023-11-20T06:41:42.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7f8611446640 1 -- 172.21.15.19:0/858586502 wait complete. 2023-11-20T06:41:42.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7f0d6ffff640 1 -- 172.21.15.19:0/957660782 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d7c054830 con 0x7f0d7c033d10 2023-11-20T06:41:42.049 INFO:teuthology.orchestra.run.smithi019.stdout:55834574856 2023-11-20T06:41:42.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.039+0000 7f7db259d640 1 -- 172.21.15.19:0/1331079099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7dac06b060 con 0x7f7d940047d0 2023-11-20T06:41:42.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.043+0000 7f7da8ff9640 1 -- 172.21.15.19:0/1331079099 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7da0052000 con 0x7f7d940047d0 2023-11-20T06:41:42.050 INFO:teuthology.orchestra.run.smithi019.stdout:55834574856 2023-11-20T06:41:42.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.043+0000 7f0d6dffb640 1 -- 172.21.15.19:0/957660782 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0d680664f0 msgr2=0x7f0d680689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:42.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.043+0000 7f7db259d640 1 -- 172.21.15.19:0/1331079099 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7d980664f0 msgr2=0x7f7d980689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:42.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.043+0000 7f7db259d640 1 --2- 172.21.15.19:0/1331079099 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7d980664f0 0x7f7d980689b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7da40b3000 tx=0x7f7da4004a50 comp rx=0 tx=0).stop 2023-11-20T06:41:42.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.043+0000 7f7db259d640 1 -- 172.21.15.19:0/1331079099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d940047d0 msgr2=0x7f7dac0c3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:42.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.043+0000 7f7db259d640 1 --2- 172.21.15.19:0/1331079099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d940047d0 0x7f7dac0c3b40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7da00072e0 tx=0x7f7da00077a0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.043+0000 7f7db259d640 1 -- 172.21.15.19:0/1331079099 shutdown_connections 2023-11-20T06:41:42.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.043+0000 7f7db259d640 1 --2- 172.21.15.19:0/1331079099 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7d980664f0 0x7f7d980689b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.043+0000 7f7db259d640 1 --2- 172.21.15.19:0/1331079099 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7dac1f6140 0x7f7dac1f65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.047+0000 7f7db259d640 1 --2- 172.21.15.19:0/1331079099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7dac0c5e60 0x7f7dac0c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.047+0000 7f7db259d640 1 --2- 172.21.15.19:0/1331079099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d940047d0 0x7f7dac0c3b40 secure :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7da00072e0 tx=0x7f7da00077a0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.047+0000 7f7db259d640 1 -- 172.21.15.19:0/1331079099 >> 172.21.15.19:0/1331079099 conn(0x7f7dac06a290 msgr2=0x7f7dac0cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:42.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.047+0000 7f0d6dffb640 1 --2- 172.21.15.19:0/957660782 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0d680664f0 0x7f0d680689b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c183600 tx=0x7f0d70008040 comp rx=0 tx=0).stop 2023-11-20T06:41:42.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.047+0000 7f0d6dffb640 1 -- 172.21.15.19:0/957660782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d7c033d10 msgr2=0x7f0d7c0d7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:42.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.047+0000 7f0d6dffb640 1 --2- 172.21.15.19:0/957660782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d7c033d10 0x7f0d7c0d7fd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0d7801cd30 tx=0x7f0d78019230 comp rx=0 tx=0).stop 2023-11-20T06:41:42.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.047+0000 7f0d6dffb640 1 -- 172.21.15.19:0/957660782 shutdown_connections 2023-11-20T06:41:42.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.047+0000 7f0d6dffb640 1 --2- 172.21.15.19:0/957660782 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0d680664f0 0x7f0d680689b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.047+0000 7f0d6dffb640 1 --2- 172.21.15.19:0/957660782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d7c048200 0x7f0d7c0e72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.047+0000 7f0d6dffb640 1 --2- 172.21.15.19:0/957660782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d7c047bd0 0x7f0d7c0e6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.047+0000 7f0d6dffb640 1 --2- 172.21.15.19:0/957660782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d7c033d10 0x7f0d7c0d7fd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.047+0000 7f0d6dffb640 1 -- 172.21.15.19:0/957660782 >> 172.21.15.19:0/957660782 conn(0x7f0d7c054b10 msgr2=0x7f0d7c053370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:42.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.047+0000 7f0d6dffb640 1 -- 172.21.15.19:0/957660782 shutdown_connections 2023-11-20T06:41:42.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.047+0000 7f0d6dffb640 1 -- 172.21.15.19:0/957660782 wait complete. 2023-11-20T06:41:42.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.051+0000 7f7db259d640 1 -- 172.21.15.19:0/1331079099 shutdown_connections 2023-11-20T06:41:42.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.051+0000 7f7db259d640 1 -- 172.21.15.19:0/1331079099 wait complete. 2023-11-20T06:41:42.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.051+0000 7f6a0530f640 1 -- 172.21.15.19:0/434480413 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f69e00057e0 con 0x7f6a000cf270 2023-11-20T06:41:42.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.051+0000 7f9a2ebd3640 1 -- 172.21.15.19:0/1671749111 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9a28074010 con 0x7f9a2815a7f0 2023-11-20T06:41:42.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.051+0000 7f9a1d7fa640 1 -- 172.21.15.19:0/1671749111 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a24081e60 con 0x7f9a2815a7f0 2023-11-20T06:41:42.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.051+0000 7f69e77fe640 1 -- 172.21.15.19:0/434480413 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f69f4054ce0 con 0x7f6a000cf270 2023-11-20T06:41:42.060 INFO:teuthology.orchestra.run.smithi019.stdout:55834574858 2023-11-20T06:41:42.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.051+0000 7f3766e17640 1 -- 172.21.15.19:0/3678901819 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3760070350 con 0x7f37600b0340 2023-11-20T06:41:42.061 INFO:teuthology.orchestra.run.smithi019.stdout:55834574857 2023-11-20T06:41:42.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.055+0000 7f375d7fa640 1 -- 172.21.15.19:0/3678901819 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37500efa40 con 0x7f37600b0340 2023-11-20T06:41:42.062 INFO:teuthology.orchestra.run.smithi019.stdout:55834574856 2023-11-20T06:41:42.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.055+0000 7f6a0530f640 1 -- 172.21.15.19:0/434480413 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f69ec066570 msgr2=0x7f69ec068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:42.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.055+0000 7f6a0530f640 1 --2- 172.21.15.19:0/434480413 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f69ec066570 0x7f69ec068a30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f69f001a060 tx=0x7f69f00a4f90 comp rx=0 tx=0).stop 2023-11-20T06:41:42.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.055+0000 7f6a0530f640 1 -- 172.21.15.19:0/434480413 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a000cf270 msgr2=0x7f6a000cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:42.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.055+0000 7f6a0530f640 1 --2- 172.21.15.19:0/434480413 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a000cf270 0x7f6a000cc3d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6a000cf6b0 tx=0x7f69f400c8c0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f6a0530f640 1 -- 172.21.15.19:0/434480413 shutdown_connections 2023-11-20T06:41:42.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f6a0530f640 1 --2- 172.21.15.19:0/434480413 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f69ec066570 0x7f69ec068a30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f6a0530f640 1 --2- 172.21.15.19:0/434480413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a0015eaf0 0x7f6a000c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f6a0530f640 1 --2- 172.21.15.19:0/434480413 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a000cf270 0x7f6a000cc3d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f6a0530f640 1 --2- 172.21.15.19:0/434480413 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a000ccfb0 0x7f6a0015aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f6a0530f640 1 -- 172.21.15.19:0/434480413 >> 172.21.15.19:0/434480413 conn(0x7f6a000b4470 msgr2=0x7f6a000d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:42.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f9a2ebd3640 1 -- 172.21.15.19:0/1671749111 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9a140665a0 msgr2=0x7f9a14068a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:42.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f9a2ebd3640 1 --2- 172.21.15.19:0/1671749111 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9a140665a0 0x7f9a14068a60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9a1801aaa0 tx=0x7f9a180a4f90 comp rx=0 tx=0).stop 2023-11-20T06:41:42.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f9a2ebd3640 1 -- 172.21.15.19:0/1671749111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a2815a7f0 msgr2=0x7f9a280cc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:42.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f9a2ebd3640 1 --2- 172.21.15.19:0/1671749111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a2815a7f0 0x7f9a280cc9d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400e600 tx=0x7f9a2400eac0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f7554165640 1 -- 172.21.15.19:0/1138054538 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f754c0ca480 con 0x7f754c15cf00 2023-11-20T06:41:42.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f9a2ebd3640 1 -- 172.21.15.19:0/1671749111 shutdown_connections 2023-11-20T06:41:42.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f9a2ebd3640 1 --2- 172.21.15.19:0/1671749111 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9a140665a0 0x7f9a14068a60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f9a2ebd3640 1 --2- 172.21.15.19:0/1671749111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a2815abd0 0x7f9a280ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f9a2ebd3640 1 --2- 172.21.15.19:0/1671749111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a2815a7f0 0x7f9a280cc9d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f9a2ebd3640 1 --2- 172.21.15.19:0/1671749111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a280705d0 0x7f9a282044f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f9a2ebd3640 1 -- 172.21.15.19:0/1671749111 >> 172.21.15.19:0/1671749111 conn(0x7f9a2806c190 msgr2=0x7f9a2806c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:42.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f6a0530f640 1 -- 172.21.15.19:0/434480413 shutdown_connections 2023-11-20T06:41:42.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f75427fc640 1 -- 172.21.15.19:0/1138054538 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f754c0ca480 con 0x7f754c15cf00 2023-11-20T06:41:42.067 INFO:teuthology.orchestra.run.smithi019.stdout:55834574858 2023-11-20T06:41:42.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f6a0530f640 1 -- 172.21.15.19:0/434480413 wait complete. 2023-11-20T06:41:42.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f9a2ebd3640 1 -- 172.21.15.19:0/1671749111 shutdown_connections 2023-11-20T06:41:42.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f9a2ebd3640 1 -- 172.21.15.19:0/1671749111 wait complete. 2023-11-20T06:41:42.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f3766e17640 1 -- 172.21.15.19:0/3678901819 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f374c0664d0 msgr2=0x7f374c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:42.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f3766e17640 1 --2- 172.21.15.19:0/3678901819 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f374c0664d0 0x7f374c068990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f37601fce50 tx=0x7f3754009210 comp rx=0 tx=0).stop 2023-11-20T06:41:42.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f3766e17640 1 -- 172.21.15.19:0/3678901819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37600b0340 msgr2=0x7f3760150310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:42.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f3766e17640 1 --2- 172.21.15.19:0/3678901819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37600b0340 0x7f3760150310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f37500ab000 tx=0x7f375001ac30 comp rx=0 tx=0).stop 2023-11-20T06:41:42.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f3766e17640 1 -- 172.21.15.19:0/3678901819 shutdown_connections 2023-11-20T06:41:42.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f3766e17640 1 --2- 172.21.15.19:0/3678901819 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f374c0664d0 0x7f374c068990 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f3766e17640 1 --2- 172.21.15.19:0/3678901819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37600c8cb0 0x7f37600c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f3766e17640 1 --2- 172.21.15.19:0/3678901819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37600b0720 0x7f376014fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f3766e17640 1 --2- 172.21.15.19:0/3678901819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37600b0340 0x7f3760150310 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f3766e17640 1 -- 172.21.15.19:0/3678901819 >> 172.21.15.19:0/3678901819 conn(0x7f376006c190 msgr2=0x7f37600add30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f3766e17640 1 -- 172.21.15.19:0/3678901819 shutdown_connections 2023-11-20T06:41:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.059+0000 7f3766e17640 1 -- 172.21.15.19:0/3678901819 wait complete. 2023-11-20T06:41:42.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.063+0000 7f7554165640 1 -- 172.21.15.19:0/1138054538 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f75300665a0 msgr2=0x7f7530068a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:42.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.063+0000 7f7554165640 1 --2- 172.21.15.19:0/1138054538 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f75300665a0 0x7f7530068a60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7544009e50 tx=0x7f75440a7070 comp rx=0 tx=0).stop 2023-11-20T06:41:42.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.063+0000 7f7554165640 1 -- 172.21.15.19:0/1138054538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f754c15cf00 msgr2=0x7f754c15ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:42.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.063+0000 7f7554165640 1 --2- 172.21.15.19:0/1138054538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f754c15cf00 0x7f754c15ab90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f753c00c3c0 tx=0x7f753c00c880 comp rx=0 tx=0).stop 2023-11-20T06:41:42.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.063+0000 7f7554165640 1 -- 172.21.15.19:0/1138054538 shutdown_connections 2023-11-20T06:41:42.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.063+0000 7f7554165640 1 --2- 172.21.15.19:0/1138054538 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f75300665a0 0x7f7530068a60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.063+0000 7f7554165640 1 --2- 172.21.15.19:0/1138054538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f754c15cf00 0x7f754c15ab90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.063+0000 7f7554165640 1 --2- 172.21.15.19:0/1138054538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f754c0d1240 0x7f754c15bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.063+0000 7f7554165640 1 --2- 172.21.15.19:0/1138054538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f754c0cdee0 0x7f754c156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:42.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.063+0000 7f7554165640 1 -- 172.21.15.19:0/1138054538 >> 172.21.15.19:0/1138054538 conn(0x7f754c0b4470 msgr2=0x7f754c0d2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:42.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.063+0000 7f7554165640 1 -- 172.21.15.19:0/1138054538 shutdown_connections 2023-11-20T06:41:42.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:42.063+0000 7f7554165640 1 -- 172.21.15.19:0/1138054538 wait complete. 2023-11-20T06:41:42.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.1 2023-11-20T06:41:42.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2023-11-20T06:41:42.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2023-11-20T06:41:42.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2023-11-20T06:41:42.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2023-11-20T06:41:42.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.6 2023-11-20T06:41:42.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.7 2023-11-20T06:41:42.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2023-11-20T06:41:43.090 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-20T06:41:43.090 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-20T06:41:43.098 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-20T06:41:43.105 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-20T06:41:43.107 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-20T06:41:43.110 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-20T06:41:43.112 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-20T06:41:43.112 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-20T06:41:43.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.331+0000 7efd34ec9640 1 Processor -- start 2023-11-20T06:41:43.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.331+0000 7efd34ec9640 1 -- start start 2023-11-20T06:41:43.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.331+0000 7efd2e59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7efd300b00e0 0x7efd300b04c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40702/0 (socket says 172.21.15.19:40702) 2023-11-20T06:41:43.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.331+0000 7efd2e59c640 1 -- 172.21.15.19:0/3122251144 learned_addr learned my addr 172.21.15.19:0/3122251144 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:43.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.335+0000 7efd34ec9640 1 --2- 172.21.15.19:0/3122251144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd300cb720 0x7efd300cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.335+0000 7efd34ec9640 1 -- 172.21.15.19:0/3122251144 --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd300c8cb0 con 0x7efd300b00e0 2023-11-20T06:41:43.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.335+0000 7efd2ed9d640 1 --2- 172.21.15.19:0/3122251144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd300cb720 0x7efd300cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.335+0000 7efd34ec9640 1 -- 172.21.15.19:0/3122251144 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd300c9550 con 0x7efd300c99e0 2023-11-20T06:41:43.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.335+0000 7efd34ec9640 1 -- 172.21.15.19:0/3122251144 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd300cbbb0 con 0x7efd300cb720 2023-11-20T06:41:43.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.335+0000 7efd2d59a640 1 -- 172.21.15.19:0/3122251144 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330695496 0 0) 0x7efd300c8cb0 con 0x7efd300b00e0 2023-11-20T06:41:43.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.335+0000 7efd2d59a640 1 -- 172.21.15.19:0/3122251144 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd18003530 con 0x7efd300b00e0 2023-11-20T06:41:43.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.335+0000 7efd2d59a640 1 -- 172.21.15.19:0/3122251144 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206854010 0 0) 0x7efd300c9550 con 0x7efd300c99e0 2023-11-20T06:41:43.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.335+0000 7efd2d59a640 1 -- 172.21.15.19:0/3122251144 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd300c8cb0 con 0x7efd300c99e0 2023-11-20T06:41:43.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.335+0000 7efd2ed9d640 1 -- 172.21.15.19:0/3122251144 >> v1:172.21.15.190:6789/0 conn(0x7efd300c99e0 legacy=0x7efd300cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.335+0000 7efd2ed9d640 1 -- 172.21.15.19:0/3122251144 >> v1:172.21.15.19:6789/0 conn(0x7efd300b00e0 legacy=0x7efd300b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.335+0000 7efd2ed9d640 1 -- 172.21.15.19:0/3122251144 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd300ce330 con 0x7efd300cb720 2023-11-20T06:41:43.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.339+0000 7f0e7b3b5640 1 Processor -- start 2023-11-20T06:41:43.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.339+0000 7f0e7b3b5640 1 -- start start 2023-11-20T06:41:43.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.339+0000 7f0e7b3b5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e7406e090 0x7f0e7415d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.339+0000 7f0e7b3b5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0e740cac60 0x7f0e740cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.339+0000 7f0e7b3b5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0e740cc740 0x7f0e740ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.339+0000 7efd2ed9d640 1 --2- 172.21.15.19:0/3122251144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd300cb720 0x7efd300cca00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efd28009dc0 tx=0x7efd2801c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b19e681e671477b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.339+0000 7f0e7a3b3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e7406e090 0x7f0e7415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.339+0000 7f0e7a3b3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e7406e090 0x7f0e7415d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:43346/0 (socket says 172.21.15.19:43346) 2023-11-20T06:41:43.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.343+0000 7f0e79bb2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0e740cac60 0x7f0e740cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.343+0000 7efd2d59a640 1 -- 172.21.15.19:0/3122251144 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd280a5770 con 0x7efd300cb720 2023-11-20T06:41:43.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.343+0000 7f0e7b3b5640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e74159de0 con 0x7f0e740cac60 2023-11-20T06:41:43.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.343+0000 7f0e7a3b3640 1 -- 172.21.15.19:0/1900206923 learned_addr learned my addr 172.21.15.19:0/1900206923 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:43.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.343+0000 7f0e7b3b5640 1 -- 172.21.15.19:0/1900206923 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e74159b00 con 0x7f0e740cc740 2023-11-20T06:41:43.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.343+0000 7efd2d59a640 1 -- 172.21.15.19:0/3122251144 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd280a58d0 con 0x7efd300cb720 2023-11-20T06:41:43.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.343+0000 7f0e7abb4640 1 --2- 172.21.15.19:0/1900206923 >> v2:172.21.15.190:3300/0 conn(0x7f0e740cc740 0x7f0e740ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.343+0000 7f0e7b3b5640 1 -- 172.21.15.19:0/1900206923 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7415c560 con 0x7f0e7406e090 2023-11-20T06:41:43.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.343+0000 7f0e7a3b3640 1 -- 172.21.15.19:0/1900206923 >> v2:172.21.15.190:3300/0 conn(0x7f0e740cc740 msgr2=0x7f0e740ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:43.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.343+0000 7f0e7a3b3640 1 --2- 172.21.15.19:0/1900206923 >> v2:172.21.15.190:3300/0 conn(0x7f0e740cc740 0x7f0e740ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.343+0000 7f0e7a3b3640 1 -- 172.21.15.19:0/1900206923 >> v2:172.21.15.19:3300/0 conn(0x7f0e740cac60 msgr2=0x7f0e740cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:43.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.343+0000 7f0e7a3b3640 1 --2- 172.21.15.19:0/1900206923 >> v2:172.21.15.19:3300/0 conn(0x7f0e740cac60 0x7f0e740cb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.343+0000 7f0e7a3b3640 1 -- 172.21.15.19:0/1900206923 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7415c840 con 0x7f0e7406e090 2023-11-20T06:41:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.343+0000 7efd2d59a640 1 -- 172.21.15.19:0/3122251144 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd280a5c60 con 0x7efd300cb720 2023-11-20T06:41:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.343+0000 7efd34ec9640 1 -- 172.21.15.19:0/3122251144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd300cb720 msgr2=0x7efd300cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.343+0000 7efd34ec9640 1 --2- 172.21.15.19:0/3122251144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd300cb720 0x7efd300cca00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efd28009dc0 tx=0x7efd2801c8b0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.343+0000 7efd34ec9640 1 -- 172.21.15.19:0/3122251144 shutdown_connections 2023-11-20T06:41:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.343+0000 7efd34ec9640 1 --2- 172.21.15.19:0/3122251144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd300cb720 0x7efd300cca00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.343+0000 7efd34ec9640 1 -- 172.21.15.19:0/3122251144 >> 172.21.15.19:0/3122251144 conn(0x7efd3006c190 msgr2=0x7efd3006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.347+0000 7efd34ec9640 1 -- 172.21.15.19:0/3122251144 shutdown_connections 2023-11-20T06:41:43.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.347+0000 7efd34ec9640 1 -- 172.21.15.19:0/3122251144 wait complete. 2023-11-20T06:41:43.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.347+0000 7efd34ec9640 1 Processor -- start 2023-11-20T06:41:43.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.351+0000 7efd34ec9640 1 -- start start 2023-11-20T06:41:43.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.351+0000 7efd34ec9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd300b00e0 0x7efd300c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.351+0000 7efd34ec9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd300c99e0 0x7efd300c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.351+0000 7efd34ec9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd300cb720 0x7efd300b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.351+0000 7efd2e59c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd300b00e0 0x7efd300c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.351+0000 7efd34ec9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd300b1020 con 0x7efd300c99e0 2023-11-20T06:41:43.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.351+0000 7efd34ec9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd300b12c0 con 0x7efd300cb720 2023-11-20T06:41:43.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.351+0000 7efd34ec9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd300b15a0 con 0x7efd300b00e0 2023-11-20T06:41:43.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.351+0000 7efd2e59c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd300b00e0 0x7efd300c7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:43348/0 (socket says 172.21.15.19:43348) 2023-11-20T06:41:43.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.351+0000 7efd2e59c640 1 -- 172.21.15.19:0/792668682 learned_addr learned my addr 172.21.15.19:0/792668682 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:43.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.355+0000 7efd2e59c640 1 -- 172.21.15.19:0/792668682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd300cb720 msgr2=0x7efd300b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.355+0000 7efd2ed9d640 1 --2- 172.21.15.19:0/792668682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd300cb720 0x7efd300b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.355+0000 7efd2e59c640 1 --2- 172.21.15.19:0/792668682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd300cb720 0x7efd300b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.355+0000 7efd2e59c640 1 -- 172.21.15.19:0/792668682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd300c99e0 msgr2=0x7efd300c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.355+0000 7efd2e59c640 1 --2- 172.21.15.19:0/792668682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd300c99e0 0x7efd300c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.355+0000 7efd2e59c640 1 -- 172.21.15.19:0/792668682 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd28009a70 con 0x7efd300b00e0 2023-11-20T06:41:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.355+0000 7efd2ed9d640 1 --2- 172.21.15.19:0/792668682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd300cb720 0x7efd300b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.355+0000 7efd2e59c640 1 --2- 172.21.15.19:0/792668682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd300b00e0 0x7efd300c7d10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efd2000c4d0 tx=0x7efd2000c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.355+0000 7efd1effd640 1 -- 172.21.15.19:0/792668682 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd20005cf0 con 0x7efd300b00e0 2023-11-20T06:41:43.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.355+0000 7efd1effd640 1 -- 172.21.15.19:0/792668682 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd20005e50 con 0x7efd300b00e0 2023-11-20T06:41:43.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.355+0000 7efd1effd640 1 -- 172.21.15.19:0/792668682 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd20007270 con 0x7efd300b00e0 2023-11-20T06:41:43.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.355+0000 7efd34ec9640 1 -- 172.21.15.19:0/792668682 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd300b1880 con 0x7efd300b00e0 2023-11-20T06:41:43.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.355+0000 7efd34ec9640 1 -- 172.21.15.19:0/792668682 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd300b32e0 con 0x7efd300b00e0 2023-11-20T06:41:43.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.351+0000 7f0e7a3b3640 1 --2- 172.21.15.19:0/1900206923 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e7406e090 0x7f0e7415d020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0e740ca6d0 tx=0x7f0e6401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5d0b447da97bc80 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.359+0000 7f0e793b1640 1 -- 172.21.15.19:0/1900206923 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e640ad660 con 0x7f0e7406e090 2023-11-20T06:41:43.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.359+0000 7f0e793b1640 1 -- 172.21.15.19:0/1900206923 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e640ad7c0 con 0x7f0e7406e090 2023-11-20T06:41:43.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.359+0000 7f0e793b1640 1 -- 172.21.15.19:0/1900206923 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e640adb90 con 0x7f0e7406e090 2023-11-20T06:41:43.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.359+0000 7f0e7b3b5640 1 -- 172.21.15.19:0/1900206923 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e7406e090 msgr2=0x7f0e7415d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.359+0000 7f0e7b3b5640 1 --2- 172.21.15.19:0/1900206923 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e7406e090 0x7f0e7415d020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0e740ca6d0 tx=0x7f0e6401c490 comp rx=0 tx=0).stop 2023-11-20T06:41:43.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.359+0000 7f0e7b3b5640 1 -- 172.21.15.19:0/1900206923 shutdown_connections 2023-11-20T06:41:43.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.359+0000 7f0e7b3b5640 1 --2- 172.21.15.19:0/1900206923 >> v2:172.21.15.190:3300/0 conn(0x7f0e740cc740 0x7f0e740ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.359+0000 7f0e7b3b5640 1 --2- 172.21.15.19:0/1900206923 >> v2:172.21.15.19:3300/0 conn(0x7f0e740cac60 0x7f0e740cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.359+0000 7f0e7b3b5640 1 --2- 172.21.15.19:0/1900206923 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e7406e090 0x7f0e7415d020 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.359+0000 7f0e7b3b5640 1 -- 172.21.15.19:0/1900206923 >> 172.21.15.19:0/1900206923 conn(0x7f0e7406a6e0 msgr2=0x7f0e740afe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:43.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.359+0000 7efd1cff9640 1 -- 172.21.15.19:0/792668682 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd30074010 con 0x7efd300b00e0 2023-11-20T06:41:43.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.359+0000 7efd1effd640 1 -- 172.21.15.19:0/792668682 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efd200073d0 con 0x7efd300b00e0 2023-11-20T06:41:43.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.359+0000 7efd1effd640 1 --2- 172.21.15.19:0/792668682 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7efd100664f0 0x7efd100689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.359+0000 7efd1effd640 1 -- 172.21.15.19:0/792668682 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efd200834d0 con 0x7efd300b00e0 2023-11-20T06:41:43.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.359+0000 7efd2dd9b640 1 --2- 172.21.15.19:0/792668682 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7efd100664f0 0x7efd100689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.363+0000 7efd2dd9b640 1 --2- 172.21.15.19:0/792668682 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7efd100664f0 0x7efd100689b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efd24007fd0 tx=0x7efd24007960 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.359+0000 7f0e7b3b5640 1 -- 172.21.15.19:0/1900206923 shutdown_connections 2023-11-20T06:41:43.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.359+0000 7f0e7b3b5640 1 -- 172.21.15.19:0/1900206923 wait complete. 2023-11-20T06:41:43.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.363+0000 7f0e7b3b5640 1 Processor -- start 2023-11-20T06:41:43.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.363+0000 7f0e7b3b5640 1 -- start start 2023-11-20T06:41:43.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.367+0000 7f0e7b3b5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e7406e090 0x7f0e74157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.367+0000 7f0e7b3b5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e740cac60 0x7f0e740c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.367+0000 7f0e7b3b5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e740cc740 0x7f0e741f78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.367+0000 7f0e7a3b3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e7406e090 0x7f0e74157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.367+0000 7f0e7a3b3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e7406e090 0x7f0e74157730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:43352/0 (socket says 172.21.15.19:43352) 2023-11-20T06:41:43.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.367+0000 7f0e79bb2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e740cac60 0x7f0e740c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.367+0000 7f0e79bb2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e740cac60 0x7f0e740c2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48412/0 (socket says 172.21.15.19:48412) 2023-11-20T06:41:43.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.367+0000 7f0e7abb4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e740cc740 0x7f0e741f78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.367+0000 7f0e7abb4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e740cc740 0x7f0e741f78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:38346/0 (socket says 172.21.15.19:38346) 2023-11-20T06:41:43.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.367+0000 7f0e7a3b3640 1 -- 172.21.15.19:0/4249846842 learned_addr learned my addr 172.21.15.19:0/4249846842 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:43.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.367+0000 7f0e7b3b5640 1 -- 172.21.15.19:0/4249846842 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e740c1e40 con 0x7f0e740cac60 2023-11-20T06:41:43.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.367+0000 7f0e7b3b5640 1 -- 172.21.15.19:0/4249846842 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e740c2610 con 0x7f0e740cc740 2023-11-20T06:41:43.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.367+0000 7f0e7b3b5640 1 -- 172.21.15.19:0/4249846842 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e740b2500 con 0x7f0e7406e090 2023-11-20T06:41:43.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.367+0000 7f0e7a3b3640 1 -- 172.21.15.19:0/4249846842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e740cc740 msgr2=0x7f0e741f78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.367+0000 7efd1effd640 1 -- 172.21.15.19:0/792668682 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efd20050880 con 0x7efd300b00e0 2023-11-20T06:41:43.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.367+0000 7f0e7a3b3640 1 --2- 172.21.15.19:0/4249846842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e740cc740 0x7f0e741f78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.367+0000 7f0e7a3b3640 1 -- 172.21.15.19:0/4249846842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e740cac60 msgr2=0x7f0e740c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.367+0000 7f0e7a3b3640 1 --2- 172.21.15.19:0/4249846842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e740cac60 0x7f0e740c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.367+0000 7f0e7a3b3640 1 -- 172.21.15.19:0/4249846842 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e640094d0 con 0x7f0e7406e090 2023-11-20T06:41:43.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.367+0000 7f0e7a3b3640 1 --2- 172.21.15.19:0/4249846842 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e7406e090 0x7f0e74157730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0e640b0040 tx=0x7f0e64019230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.371+0000 7f0e6affd640 1 -- 172.21.15.19:0/4249846842 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e640b6640 con 0x7f0e7406e090 2023-11-20T06:41:43.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.371+0000 7f0e6affd640 1 -- 172.21.15.19:0/4249846842 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e640b67a0 con 0x7f0e7406e090 2023-11-20T06:41:43.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.371+0000 7f0e6affd640 1 -- 172.21.15.19:0/4249846842 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e640b6640 con 0x7f0e7406e090 2023-11-20T06:41:43.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.371+0000 7f0e79bb2640 1 --2- 172.21.15.19:0/4249846842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e740cac60 0x7f0e740c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:43.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.371+0000 7f0e7abb4640 1 --2- 172.21.15.19:0/4249846842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e740cc740 0x7f0e741f78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:43.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.371+0000 7f0e7b3b5640 1 -- 172.21.15.19:0/4249846842 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e740c2050 con 0x7f0e7406e090 2023-11-20T06:41:43.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.371+0000 7f0e7b3b5640 1 -- 172.21.15.19:0/4249846842 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e740b27a0 con 0x7f0e7406e090 2023-11-20T06:41:43.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.371+0000 7f0e6affd640 1 -- 172.21.15.19:0/4249846842 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0e640b4070 con 0x7f0e7406e090 2023-11-20T06:41:43.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.375+0000 7f0e7b3b5640 1 -- 172.21.15.19:0/4249846842 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e740b2360 con 0x7f0e7406e090 2023-11-20T06:41:43.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.375+0000 7f0e6affd640 1 --2- 172.21.15.19:0/4249846842 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0e58066560 0x7f0e58068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.375+0000 7f0e6affd640 1 -- 172.21.15.19:0/4249846842 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0e6411dee0 con 0x7f0e7406e090 2023-11-20T06:41:43.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.375+0000 7f0e79bb2640 1 --2- 172.21.15.19:0/4249846842 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0e58066560 0x7f0e58068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.379+0000 7f0e79bb2640 1 --2- 172.21.15.19:0/4249846842 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0e58066560 0x7f0e58068a20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0e74163560 tx=0x7f0e70008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.383+0000 7f0e6affd640 1 -- 172.21.15.19:0/4249846842 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0e740b2360 con 0x7f0e7406e090 2023-11-20T06:41:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.391+0000 7fc69f3b8640 1 Processor -- start 2023-11-20T06:41:43.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.395+0000 7fc69f3b8640 1 -- start start 2023-11-20T06:41:43.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.395+0000 7fc69f3b8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc6980cd070 0x7fc69806bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.395+0000 7fc69f3b8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6980c90e0 con 0x7fc6980ccbe0 2023-11-20T06:41:43.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.395+0000 7fc69f3b8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6980cd4c0 con 0x7fc69815c960 2023-11-20T06:41:43.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.395+0000 7fc69f3b8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6980cc420 con 0x7fc6980cd070 2023-11-20T06:41:43.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.395+0000 7fc69d154640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fc69815c960 0x7fc6980c89d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:53304/0 (socket says 172.21.15.19:53304) 2023-11-20T06:41:43.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.395+0000 7fc69d154640 1 -- 172.21.15.19:0/3081861404 learned_addr learned my addr 172.21.15.19:0/3081861404 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:43.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc68ffff640 1 -- 172.21.15.19:0/3081861404 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436935193 0 0) 0x7fc6980cd4c0 con 0x7fc69815c960 2023-11-20T06:41:43.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc68ffff640 1 -- 172.21.15.19:0/3081861404 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc684003530 con 0x7fc69815c960 2023-11-20T06:41:43.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc69d955640 1 --2- 172.21.15.19:0/3081861404 >> v2:172.21.15.19:3300/0 conn(0x7fc6980cd070 0x7fc69806bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc68ffff640 1 -- 172.21.15.19:0/3081861404 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3524290309 0 0) 0x7fc684003530 con 0x7fc69815c960 2023-11-20T06:41:43.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc68ffff640 1 -- 172.21.15.19:0/3081861404 >> v2:172.21.15.19:3300/0 conn(0x7fc6980cd070 msgr2=0x7fc69806bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:43.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc68ffff640 1 --2- 172.21.15.19:0/3081861404 >> v2:172.21.15.19:3300/0 conn(0x7fc6980cd070 0x7fc69806bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc68ffff640 1 -- 172.21.15.19:0/3081861404 >> v1:172.21.15.19:6789/0 conn(0x7fc6980ccbe0 legacy=0x7fc6980ab9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:43.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc68ffff640 1 -- 172.21.15.19:0/3081861404 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6980c9340 con 0x7fc69815c960 2023-11-20T06:41:43.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc68ffff640 1 -- 172.21.15.19:0/3081861404 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7fc690001a00 con 0x7fc69815c960 2023-11-20T06:41:43.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc68ffff640 1 -- 172.21.15.19:0/3081861404 >> v1:172.21.15.190:6789/0 conn(0x7fc69815c960 legacy=0x7fc6980c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc68ffff640 1 --2- 172.21.15.19:0/3081861404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6840039f0 0x7fc684003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc68ffff640 1 --2- 172.21.15.19:0/3081861404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6840047d0 0x7fc684004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc68ffff640 1 --2- 172.21.15.19:0/3081861404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6840052b0 0x7fc6840141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc68ffff640 1 -- 172.21.15.19:0/3081861404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6980cc420 con 0x7fc6840039f0 2023-11-20T06:41:43.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc68ffff640 1 -- 172.21.15.19:0/3081861404 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc684014a10 con 0x7fc6840052b0 2023-11-20T06:41:43.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc68ffff640 1 -- 172.21.15.19:0/3081861404 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc684014bd0 con 0x7fc6840047d0 2023-11-20T06:41:43.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc69c953640 1 --2- 172.21.15.19:0/3081861404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6840047d0 0x7fc684004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc69c953640 1 -- 172.21.15.19:0/3081861404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6840052b0 msgr2=0x7fc6840141a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-20T06:41:43.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc69c953640 1 --2- 172.21.15.19:0/3081861404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6840052b0 0x7fc6840141a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc69c953640 1 -- 172.21.15.19:0/3081861404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6840039f0 msgr2=0x7fc684003e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-20T06:41:43.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc69c953640 1 --2- 172.21.15.19:0/3081861404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6840039f0 0x7fc684003e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.399+0000 7fc69c953640 1 -- 172.21.15.19:0/3081861404 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6980c9340 con 0x7fc6840047d0 2023-11-20T06:41:43.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.403+0000 7fc69d955640 1 --2- 172.21.15.19:0/3081861404 >> v2:172.21.15.19:3300/0 conn(0x7fc6980cd070 0x7fc69806bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:43.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.403+0000 7fc69d955640 1 -- 172.21.15.19:0/3081861404 reap_dead start 2023-11-20T06:41:43.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.403+0000 7fc69c953640 1 --2- 172.21.15.19:0/3081861404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6840047d0 0x7fc684004c50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc694001750 tx=0x7fc69401c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa2e2d9df2b72b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.407+0000 7fc68ffff640 1 -- 172.21.15.19:0/3081861404 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6940052d0 con 0x7fc6840047d0 2023-11-20T06:41:43.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.407+0000 7fc68ffff640 1 -- 172.21.15.19:0/3081861404 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6940a7050 con 0x7fc6840047d0 2023-11-20T06:41:43.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.407+0000 7fc68ffff640 1 -- 172.21.15.19:0/3081861404 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694003600 con 0x7fc6840047d0 2023-11-20T06:41:43.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.407+0000 7f7ed59f8640 1 Processor -- start 2023-11-20T06:41:43.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.407+0000 7f7ed59f8640 1 -- start start 2023-11-20T06:41:43.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.407+0000 7fc69f3b8640 1 -- 172.21.15.19:0/3081861404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6840047d0 msgr2=0x7fc684004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.407+0000 7fc69f3b8640 1 --2- 172.21.15.19:0/3081861404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6840047d0 0x7fc684004c50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc694001750 tx=0x7fc69401c3b0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.407+0000 7fc69f3b8640 1 -- 172.21.15.19:0/3081861404 shutdown_connections 2023-11-20T06:41:43.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.407+0000 7fc69f3b8640 1 --2- 172.21.15.19:0/3081861404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6840047d0 0x7fc684004c50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.407+0000 7fc69f3b8640 1 -- 172.21.15.19:0/3081861404 >> 172.21.15.19:0/3081861404 conn(0x7fc69806a290 msgr2=0x7fc69806a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:43.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.407+0000 7fc69f3b8640 1 -- 172.21.15.19:0/3081861404 shutdown_connections 2023-11-20T06:41:43.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.407+0000 7fc69f3b8640 1 -- 172.21.15.19:0/3081861404 wait complete. 2023-11-20T06:41:43.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7f6389cd6640 1 Processor -- start 2023-11-20T06:41:43.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7f6389cd6640 1 -- start start 2023-11-20T06:41:43.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7fc69f3b8640 1 Processor -- start 2023-11-20T06:41:43.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7fc69f3b8640 1 -- start start 2023-11-20T06:41:43.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7f7ed59f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ed006bfe0 0x7f7ed006c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7f7ed59f8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed00cc5b0 con 0x7f7ed0161150 2023-11-20T06:41:43.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7f7eceffd640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f7ed015ff70 0x7f7ed00c93c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:53312/0 (socket says 172.21.15.19:53312) 2023-11-20T06:41:43.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7f7eceffd640 1 -- 172.21.15.19:0/1606015519 learned_addr learned my addr 172.21.15.19:0/1606015519 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:43.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7f7ed59f8640 1 -- 172.21.15.19:0/1606015519 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed00cd410 con 0x7f7ed015ff70 2023-11-20T06:41:43.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7f7ed59f8640 1 -- 172.21.15.19:0/1606015519 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed0160350 con 0x7f7ed006bfe0 2023-11-20T06:41:43.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7f7ecf7fe640 1 --2- 172.21.15.19:0/1606015519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ed006bfe0 0x7f7ed006c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7f7ecdffb640 1 -- 172.21.15.19:0/1606015519 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831889605 0 0) 0x7f7ed00cd410 con 0x7f7ed015ff70 2023-11-20T06:41:43.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7f7ecdffb640 1 -- 172.21.15.19:0/1606015519 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eb8003530 con 0x7f7ed015ff70 2023-11-20T06:41:43.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7fc69f3b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6840047d0 0x7fc6980a9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7fc69f3b8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69815d700 0x7fc69815f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7f6389cd6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f637c053750 0x7f637c007430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7f6389cd6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f637c007970 0x7f637c0ecd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7f6389cd6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637c0540d0 con 0x7f637c056cd0 2023-11-20T06:41:43.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7f6389cd6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f637c0580c0 con 0x7f637c007970 2023-11-20T06:41:43.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7f6389cd6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637c038950 con 0x7f637c053750 2023-11-20T06:41:43.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7fc69f3b8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc69815f950 0x7fc698156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7fc69f3b8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69815e440 con 0x7fc69815d700 2023-11-20T06:41:43.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7fc69f3b8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6980c6dd0 con 0x7fc69815f950 2023-11-20T06:41:43.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7fc69f3b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69815dba0 con 0x7fc6840047d0 2023-11-20T06:41:43.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7fc69d154640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6840047d0 0x7fc6980a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7fc69d154640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6840047d0 0x7fc6980a9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:43378/0 (socket says 172.21.15.19:43378) 2023-11-20T06:41:43.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7fc69d154640 1 -- 172.21.15.19:0/4000851164 learned_addr learned my addr 172.21.15.19:0/4000851164 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:43.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7fc69d955640 1 --2- 172.21.15.19:0/4000851164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc69815f950 0x7fc698156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7fc69d154640 1 -- 172.21.15.19:0/4000851164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc69815f950 msgr2=0x7fc698156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7fc69d154640 1 --2- 172.21.15.19:0/4000851164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc69815f950 0x7fc698156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7fc69d154640 1 -- 172.21.15.19:0/4000851164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69815d700 msgr2=0x7fc69815f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7fc69d154640 1 --2- 172.21.15.19:0/4000851164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69815d700 0x7fc69815f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.411+0000 7fc69d154640 1 -- 172.21.15.19:0/4000851164 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69815de80 con 0x7fc6840047d0 2023-11-20T06:41:43.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.415+0000 7fc69d154640 1 --2- 172.21.15.19:0/4000851164 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6840047d0 0x7fc6980a9760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc690001b80 tx=0x7fc69000cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.415+0000 7f63837fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f637c056cd0 0x7f637c006d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40736/0 (socket says 172.21.15.19:40736) 2023-11-20T06:41:43.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.415+0000 7f63837fe640 1 -- 172.21.15.19:0/3206402410 learned_addr learned my addr 172.21.15.19:0/3206402410 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:43.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.415+0000 7f6383fff640 1 --2- 172.21.15.19:0/3206402410 >> v2:172.21.15.19:3300/0 conn(0x7f637c007970 0x7f637c0ecd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.415+0000 7f6382ffd640 1 --2- 172.21.15.19:0/3206402410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f637c053750 0x7f637c007430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.415+0000 7f6383fff640 1 -- 172.21.15.19:0/3206402410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f637c053750 msgr2=0x7f637c007430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:43.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.415+0000 7f6383fff640 1 --2- 172.21.15.19:0/3206402410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f637c053750 0x7f637c007430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.415+0000 7f6383fff640 1 -- 172.21.15.19:0/3206402410 >> v1:172.21.15.19:6789/0 conn(0x7f637c056cd0 legacy=0x7f637c006d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:43.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.415+0000 7f6383fff640 1 -- 172.21.15.19:0/3206402410 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c038160 con 0x7f637c007970 2023-11-20T06:41:43.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.415+0000 7fc68dffb640 1 -- 172.21.15.19:0/4000851164 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc690004d80 con 0x7fc6840047d0 2023-11-20T06:41:43.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.415+0000 7fc68dffb640 1 -- 172.21.15.19:0/4000851164 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69000a7f0 con 0x7fc6840047d0 2023-11-20T06:41:43.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.415+0000 7fc68dffb640 1 -- 172.21.15.19:0/4000851164 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69000ab80 con 0x7fc6840047d0 2023-11-20T06:41:43.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.415+0000 7fc69f3b8640 1 -- 172.21.15.19:0/4000851164 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69815e160 con 0x7fc6840047d0 2023-11-20T06:41:43.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.415+0000 7fc69f3b8640 1 -- 172.21.15.19:0/4000851164 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6980a9e70 con 0x7fc6840047d0 2023-11-20T06:41:43.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.415+0000 7f7ecf7fe640 1 -- 172.21.15.19:0/1606015519 >> v1:172.21.15.190:6789/0 conn(0x7f7ed015ff70 legacy=0x7f7ed00c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.415+0000 7f7ecf7fe640 1 -- 172.21.15.19:0/1606015519 >> v1:172.21.15.19:6789/0 conn(0x7f7ed0161150 legacy=0x7f7ed00cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.415+0000 7f7ecf7fe640 1 -- 172.21.15.19:0/1606015519 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed00cc800 con 0x7f7ed006bfe0 2023-11-20T06:41:43.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.415+0000 7fc69f3b8640 1 -- 172.21.15.19:0/4000851164 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6980c6b80 con 0x7fc6840047d0 2023-11-20T06:41:43.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.419+0000 7ffa8ecac640 1 Processor -- start 2023-11-20T06:41:43.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.419+0000 7fc68dffb640 1 -- 172.21.15.19:0/4000851164 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc69000ace0 con 0x7fc6840047d0 2023-11-20T06:41:43.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.419+0000 7f6383fff640 1 --2- 172.21.15.19:0/3206402410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f637c007970 0x7f637c0ecd00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f63700097c0 tx=0x7f637001c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341c53050eac4732 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.419+0000 7f7ecf7fe640 1 --2- 172.21.15.19:0/1606015519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ed006bfe0 0x7f7ed006c450 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00097f0 tx=0x7f7ec001ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ef765868c77cf71 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.419+0000 7ffa8ecac640 1 -- start start 2023-11-20T06:41:43.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.419+0000 7fc68dffb640 1 --2- 172.21.15.19:0/4000851164 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc67c0664a0 0x7fc67c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7fc68dffb640 1 -- 172.21.15.19:0/4000851164 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc690094690 con 0x7fc6840047d0 2023-11-20T06:41:43.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7fc69c953640 1 --2- 172.21.15.19:0/4000851164 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc67c0664a0 0x7fc67c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7ffa8ecac640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa800e7790 0x7ffa80007960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7ffa8ecac640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffa8004fd40 0x7ffa80037ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7ffa8ecac640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa80054440 con 0x7ffa800483d0 2023-11-20T06:41:43.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7f63827fc640 1 -- 172.21.15.19:0/3206402410 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63700ab600 con 0x7f637c007970 2023-11-20T06:41:43.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7ffa8ecac640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa800074d0 con 0x7ffa8004fd40 2023-11-20T06:41:43.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7ffa8ecac640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa80006ef0 con 0x7ffa800e7790 2023-11-20T06:41:43.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7ffa8dcaa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa800e7790 0x7ffa80007960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7ffa8d4a9640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7ffa800483d0 0x7ffa8004f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:53318/0 (socket says 172.21.15.19:53318) 2023-11-20T06:41:43.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7ffa8d4a9640 1 -- 172.21.15.19:0/3709661264 learned_addr learned my addr 172.21.15.19:0/3709661264 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:43.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7ffa8e4ab640 1 --2- 172.21.15.19:0/3709661264 >> v2:172.21.15.19:3300/0 conn(0x7ffa8004fd40 0x7ffa80037ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7ffa8cca8640 1 -- 172.21.15.19:0/3709661264 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878037206 0 0) 0x7ffa80054440 con 0x7ffa800483d0 2023-11-20T06:41:43.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7ffa8cca8640 1 -- 172.21.15.19:0/3709661264 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa74003530 con 0x7ffa800483d0 2023-11-20T06:41:43.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7f63827fc640 1 -- 172.21.15.19:0/3206402410 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63700a7050 con 0x7f637c007970 2023-11-20T06:41:43.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7ffa8e4ab640 1 -- 172.21.15.19:0/3709661264 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa800e7790 msgr2=0x7ffa80007960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:43.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7ffa8e4ab640 1 --2- 172.21.15.19:0/3709661264 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa800e7790 0x7ffa80007960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7ffa8e4ab640 1 -- 172.21.15.19:0/3709661264 >> v1:172.21.15.190:6789/0 conn(0x7ffa800483d0 legacy=0x7ffa8004f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7f63827fc640 1 -- 172.21.15.19:0/3206402410 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63700ab600 con 0x7f637c007970 2023-11-20T06:41:43.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7ffa8e4ab640 1 -- 172.21.15.19:0/3709661264 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa80054a50 con 0x7ffa8004fd40 2023-11-20T06:41:43.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7f6389cd6640 1 -- 172.21.15.19:0/3206402410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f637c007970 msgr2=0x7f637c0ecd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7f6389cd6640 1 --2- 172.21.15.19:0/3206402410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f637c007970 0x7f637c0ecd00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f63700097c0 tx=0x7f637001c2f0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7f6389cd6640 1 -- 172.21.15.19:0/3206402410 shutdown_connections 2023-11-20T06:41:43.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7f6389cd6640 1 --2- 172.21.15.19:0/3206402410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f637c007970 0x7f637c0ecd00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7f6389cd6640 1 --2- 172.21.15.19:0/3206402410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f637c053750 0x7f637c007430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7f6389cd6640 1 -- 172.21.15.19:0/3206402410 >> 172.21.15.19:0/3206402410 conn(0x7f637c059100 msgr2=0x7f637c059510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:43.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7fc69c953640 1 --2- 172.21.15.19:0/4000851164 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc67c0664a0 0x7fc67c068960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc6840057b0 tx=0x7fc694001130 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7f6389cd6640 1 -- 172.21.15.19:0/3206402410 shutdown_connections 2023-11-20T06:41:43.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.423+0000 7f6389cd6640 1 -- 172.21.15.19:0/3206402410 wait complete. 2023-11-20T06:41:43.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.427+0000 7fc68dffb640 1 -- 172.21.15.19:0/4000851164 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc6900618b0 con 0x7fc6840047d0 2023-11-20T06:41:43.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.427+0000 7f7ecdffb640 1 -- 172.21.15.19:0/1606015519 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec00a89b0 con 0x7f7ed006bfe0 2023-11-20T06:41:43.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.427+0000 7f7ecdffb640 1 -- 172.21.15.19:0/1606015519 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec00a8b10 con 0x7f7ed006bfe0 2023-11-20T06:41:43.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.427+0000 7f7ecdffb640 1 -- 172.21.15.19:0/1606015519 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec00a89b0 con 0x7f7ed006bfe0 2023-11-20T06:41:43.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.427+0000 7f9f77fff640 1 Processor -- start 2023-11-20T06:41:43.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.427+0000 7f7ed59f8640 1 -- 172.21.15.19:0/1606015519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ed006bfe0 msgr2=0x7f7ed006c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.427+0000 7f7ed59f8640 1 --2- 172.21.15.19:0/1606015519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ed006bfe0 0x7f7ed006c450 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00097f0 tx=0x7f7ec001ecd0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.427+0000 7f6389cd6640 1 Processor -- start 2023-11-20T06:41:43.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.427+0000 7f9f77fff640 1 -- start start 2023-11-20T06:41:43.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.427+0000 7f6389cd6640 1 -- start start 2023-11-20T06:41:43.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.427+0000 7ffa8e4ab640 1 --2- 172.21.15.19:0/3709661264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa8004fd40 0x7ffa80037ec0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffa840097c0 tx=0x7ffa8401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7632f23a3ce8a3e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7ffa8cca8640 1 -- 172.21.15.19:0/3709661264 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80038c10 con 0x7ffa8004fd40 2023-11-20T06:41:43.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7ffa8cca8640 1 -- 172.21.15.19:0/3709661264 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa840a7050 con 0x7ffa8004fd40 2023-11-20T06:41:43.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7ffa8cca8640 1 -- 172.21.15.19:0/3709661264 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80038c10 con 0x7ffa8004fd40 2023-11-20T06:41:43.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f7ed59f8640 1 -- 172.21.15.19:0/1606015519 shutdown_connections 2023-11-20T06:41:43.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f7ed59f8640 1 --2- 172.21.15.19:0/1606015519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ed006bfe0 0x7f7ed006c450 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f7ed59f8640 1 -- 172.21.15.19:0/1606015519 >> 172.21.15.19:0/1606015519 conn(0x7f7ed006a290 msgr2=0x7f7ed006a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:43.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f9f77fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9f7806ffa0 0x7f9f780cac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f9f77fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f780cb1b0 0x7f9f780cc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f9f77fff640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f780cb640 con 0x7f9f780c19a0 2023-11-20T06:41:43.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f9f77fff640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f780c9870 con 0x7f9f7806ffa0 2023-11-20T06:41:43.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f9f77fff640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f781613d0 con 0x7f9f780cb1b0 2023-11-20T06:41:43.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f6389cd6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f637c007970 0x7f637c0d7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f6389cd6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f637c053750 0x7f637c03b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f6389cd6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f637c056cd0 0x7f637c0d4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f6389cd6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c03a880 con 0x7f637c007970 2023-11-20T06:41:43.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f6389cd6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c03ba20 con 0x7f637c053750 2023-11-20T06:41:43.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f6389cd6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637c039f50 con 0x7f637c056cd0 2023-11-20T06:41:43.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f9f767fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9f7806ffa0 0x7f9f780cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f9f777fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f780cb1b0 0x7f9f780cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f9f767fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9f7806ffa0 0x7f9f780cac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48454/0 (socket says 172.21.15.19:48454) 2023-11-20T06:41:43.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f9f767fc640 1 -- 172.21.15.19:0/4090055202 learned_addr learned my addr 172.21.15.19:0/4090055202 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:43.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f63837fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f637c007970 0x7f637c0d7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f63837fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f637c007970 0x7f637c0d7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48470/0 (socket says 172.21.15.19:48470) 2023-11-20T06:41:43.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f63837fe640 1 -- 172.21.15.19:0/2207005808 learned_addr learned my addr 172.21.15.19:0/2207005808 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:43.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f6383fff640 1 --2- 172.21.15.19:0/2207005808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f637c056cd0 0x7f637c0d4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f6382ffd640 1 --2- 172.21.15.19:0/2207005808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f637c053750 0x7f637c03b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f6383fff640 1 -- 172.21.15.19:0/2207005808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f637c053750 msgr2=0x7f637c03b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f6383fff640 1 --2- 172.21.15.19:0/2207005808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f637c053750 0x7f637c03b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f6383fff640 1 -- 172.21.15.19:0/2207005808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f637c007970 msgr2=0x7f637c0d7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f6383fff640 1 --2- 172.21.15.19:0/2207005808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f637c007970 0x7f637c0d7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f6383fff640 1 -- 172.21.15.19:0/2207005808 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6370009420 con 0x7f637c056cd0 2023-11-20T06:41:43.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f6382ffd640 1 --2- 172.21.15.19:0/2207005808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f637c053750 0x7f637c03b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:41:43.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f6383fff640 1 --2- 172.21.15.19:0/2207005808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f637c056cd0 0x7f637c0d4280 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f63700ab000 tx=0x7f6370019090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f636ffff640 1 -- 172.21.15.19:0/2207005808 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6370003b70 con 0x7f637c056cd0 2023-11-20T06:41:43.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f636ffff640 1 -- 172.21.15.19:0/2207005808 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6370003cd0 con 0x7f637c056cd0 2023-11-20T06:41:43.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f636ffff640 1 -- 172.21.15.19:0/2207005808 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63700b4600 con 0x7f637c056cd0 2023-11-20T06:41:43.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f6389cd6640 1 -- 172.21.15.19:0/2207005808 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637c03a230 con 0x7f637c056cd0 2023-11-20T06:41:43.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.435+0000 7f6389cd6640 1 -- 172.21.15.19:0/2207005808 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637c0d47c0 con 0x7f637c056cd0 2023-11-20T06:41:43.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.435+0000 7f7ed59f8640 1 -- 172.21.15.19:0/1606015519 shutdown_connections 2023-11-20T06:41:43.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f9f777fe640 1 -- 172.21.15.19:0/4090055202 >> v2:172.21.15.19:3300/0 conn(0x7f9f7806ffa0 msgr2=0x7f9f780cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:43.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f9f777fe640 1 --2- 172.21.15.19:0/4090055202 >> v2:172.21.15.19:3300/0 conn(0x7f9f7806ffa0 0x7f9f780cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f9f777fe640 1 -- 172.21.15.19:0/4090055202 >> v1:172.21.15.19:6789/0 conn(0x7f9f780c19a0 legacy=0x7f9f78071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f9f777fe640 1 -- 172.21.15.19:0/4090055202 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f78164ac0 con 0x7f9f780cb1b0 2023-11-20T06:41:43.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.431+0000 7f9f767fc640 1 --2- 172.21.15.19:0/4090055202 >> v2:172.21.15.19:3300/0 conn(0x7f9f7806ffa0 0x7f9f780cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:43.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.435+0000 7f6389cd6640 1 -- 172.21.15.19:0/2207005808 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f637c03a9f0 con 0x7f637c056cd0 2023-11-20T06:41:43.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.435+0000 7ffa8ecac640 1 -- 172.21.15.19:0/3709661264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa8004fd40 msgr2=0x7ffa80037ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.435+0000 7ffa8ecac640 1 --2- 172.21.15.19:0/3709661264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa8004fd40 0x7ffa80037ec0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffa840097c0 tx=0x7ffa8401c480 comp rx=0 tx=0).stop 2023-11-20T06:41:43.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.435+0000 7ffa8ecac640 1 -- 172.21.15.19:0/3709661264 shutdown_connections 2023-11-20T06:41:43.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.435+0000 7ffa8ecac640 1 --2- 172.21.15.19:0/3709661264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa8004fd40 0x7ffa80037ec0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.435+0000 7ffa8ecac640 1 --2- 172.21.15.19:0/3709661264 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa800e7790 0x7ffa80007960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.435+0000 7ffa8ecac640 1 -- 172.21.15.19:0/3709661264 >> 172.21.15.19:0/3709661264 conn(0x7ffa8000a560 msgr2=0x7ffa8000a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:43.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.435+0000 7ffa8ecac640 1 -- 172.21.15.19:0/3709661264 shutdown_connections 2023-11-20T06:41:43.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.435+0000 7f636ffff640 1 -- 172.21.15.19:0/2207005808 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f63700b2040 con 0x7f637c056cd0 2023-11-20T06:41:43.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.435+0000 7f7ed59f8640 1 -- 172.21.15.19:0/1606015519 wait complete. 2023-11-20T06:41:43.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.435+0000 7ffa8ecac640 1 -- 172.21.15.19:0/3709661264 wait complete. 2023-11-20T06:41:43.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.439+0000 7ffa8ecac640 1 Processor -- start 2023-11-20T06:41:43.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.439+0000 7ffa8ecac640 1 -- start start 2023-11-20T06:41:43.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.439+0000 7f7ed59f8640 1 Processor -- start 2023-11-20T06:41:43.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.439+0000 7f636ffff640 1 --2- 172.21.15.19:0/2207005808 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f63680664a0 0x7f6368068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.439+0000 7f7ed59f8640 1 -- start start 2023-11-20T06:41:43.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.439+0000 7f636ffff640 1 -- 172.21.15.19:0/2207005808 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f637011df30 con 0x7f637c056cd0 2023-11-20T06:41:43.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.439+0000 7f63837fe640 1 --2- 172.21.15.19:0/2207005808 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f63680664a0 0x7f6368068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.439+0000 7f9f777fe640 1 --2- 172.21.15.19:0/4090055202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f780cb1b0 0x7f9f780cc570 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9f70009d90 tx=0x7f9f7001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9e0c8aa41ad133c server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.439+0000 7ffa8ecac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa800483d0 0x7ffa800db360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.439+0000 7f63837fe640 1 --2- 172.21.15.19:0/2207005808 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f63680664a0 0x7f6368068960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f638404fab0 tx=0x7f638408af90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.439+0000 7ffa8dcaa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa800483d0 0x7ffa800db360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.439+0000 7ffa8dcaa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa800483d0 0x7ffa800db360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48478/0 (socket says 172.21.15.19:48478) 2023-11-20T06:41:43.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.439+0000 7ffa8ecac640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa8004fd40 0x7ffa800e5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.439+0000 7ffa8ecac640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa800e7790 0x7ffa800d5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.439+0000 7ffa8ecac640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800dc270 con 0x7ffa800483d0 2023-11-20T06:41:43.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.439+0000 7f7ed59f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ed006bfe0 0x7f7ed015a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.439+0000 7ffa8ecac640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800dbcb0 con 0x7ffa8004fd40 2023-11-20T06:41:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.439+0000 7ffa8ecac640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800dbf90 con 0x7ffa800e7790 2023-11-20T06:41:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.439+0000 7ffa8dcaa640 1 -- 172.21.15.19:0/2904124288 learned_addr learned my addr 172.21.15.19:0/2904124288 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f7ed59f8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ed015ff70 0x7f7ed00ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f7ed59f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ed0161150 0x7f7ed00ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f7ece7fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ed015ff70 0x7f7ed00ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f7eceffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ed006bfe0 0x7f7ed015a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f7eceffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ed006bfe0 0x7f7ed015a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48494/0 (socket says 172.21.15.19:48494) 2023-11-20T06:41:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f7ece7fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ed015ff70 0x7f7ed00ade00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:38386/0 (socket says 172.21.15.19:38386) 2023-11-20T06:41:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f9f75ffb640 1 -- 172.21.15.19:0/4090055202 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f700a59e0 con 0x7f9f780cb1b0 2023-11-20T06:41:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f9f75ffb640 1 -- 172.21.15.19:0/4090055202 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f700a5b40 con 0x7f9f780cb1b0 2023-11-20T06:41:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f9f75ffb640 1 -- 172.21.15.19:0/4090055202 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f700ad440 con 0x7f9f780cb1b0 2023-11-20T06:41:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7ffa8e4ab640 1 --2- 172.21.15.19:0/2904124288 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa800e7790 0x7ffa800d5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7ffa8d4a9640 1 --2- 172.21.15.19:0/2904124288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa8004fd40 0x7ffa800e5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7ffa8dcaa640 1 -- 172.21.15.19:0/2904124288 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa800e7790 msgr2=0x7ffa800d5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7ffa8dcaa640 1 --2- 172.21.15.19:0/2904124288 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa800e7790 0x7ffa800d5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7ffa8dcaa640 1 -- 172.21.15.19:0/2904124288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa8004fd40 msgr2=0x7ffa800e5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7ffa8dcaa640 1 --2- 172.21.15.19:0/2904124288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa8004fd40 0x7ffa800e5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7ffa8dcaa640 1 -- 172.21.15.19:0/2904124288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa84009420 con 0x7ffa800483d0 2023-11-20T06:41:43.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f7eceffd640 1 -- 172.21.15.19:0/2519015207 learned_addr learned my addr 172.21.15.19:0/2519015207 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:43.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7ffa8dcaa640 1 --2- 172.21.15.19:0/2904124288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa800483d0 0x7ffa800db360 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffa88068cd0 tx=0x7ffa88072520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f7ecf7fe640 1 --2- 172.21.15.19:0/2519015207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ed0161150 0x7f7ed00ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f9f77fff640 1 -- 172.21.15.19:0/4090055202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f780cb1b0 msgr2=0x7f9f780cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f9f77fff640 1 --2- 172.21.15.19:0/4090055202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f780cb1b0 0x7f9f780cc570 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9f70009d90 tx=0x7f9f7001c940 comp rx=0 tx=0).stop 2023-11-20T06:41:43.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f636ffff640 1 -- 172.21.15.19:0/2207005808 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f63700eb160 con 0x7f637c056cd0 2023-11-20T06:41:43.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f7ed59f8640 1 -- 172.21.15.19:0/2519015207 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed00c5450 con 0x7f7ed006bfe0 2023-11-20T06:41:43.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f7ed59f8640 1 -- 172.21.15.19:0/2519015207 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed00c5730 con 0x7f7ed015ff70 2023-11-20T06:41:43.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f7ed59f8640 1 -- 172.21.15.19:0/2519015207 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed00c5a10 con 0x7f7ed0161150 2023-11-20T06:41:43.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f9f77fff640 1 -- 172.21.15.19:0/4090055202 shutdown_connections 2023-11-20T06:41:43.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f9f77fff640 1 --2- 172.21.15.19:0/4090055202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f780cb1b0 0x7f9f780cc570 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f9f77fff640 1 --2- 172.21.15.19:0/4090055202 >> v2:172.21.15.19:3300/0 conn(0x7f9f7806ffa0 0x7f9f780cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f9f77fff640 1 -- 172.21.15.19:0/4090055202 >> 172.21.15.19:0/4090055202 conn(0x7f9f7806a6e0 msgr2=0x7f9f780afe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:43.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f7ece7fc640 1 -- 172.21.15.19:0/2519015207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ed0161150 msgr2=0x7f7ed00ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f7ece7fc640 1 --2- 172.21.15.19:0/2519015207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ed0161150 0x7f7ed00ae340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f7ece7fc640 1 -- 172.21.15.19:0/2519015207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ed006bfe0 msgr2=0x7f7ed015a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f7ece7fc640 1 --2- 172.21.15.19:0/2519015207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ed006bfe0 0x7f7ed015a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f7ece7fc640 1 -- 172.21.15.19:0/2519015207 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec0009420 con 0x7f7ed015ff70 2023-11-20T06:41:43.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f9f77fff640 1 -- 172.21.15.19:0/4090055202 shutdown_connections 2023-11-20T06:41:43.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7f9f77fff640 1 -- 172.21.15.19:0/4090055202 wait complete. 2023-11-20T06:41:43.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7ffa7e7fc640 1 -- 172.21.15.19:0/2904124288 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8808e070 con 0x7ffa800483d0 2023-11-20T06:41:43.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7ffa8ecac640 1 -- 172.21.15.19:0/2904124288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8004d690 con 0x7ffa800483d0 2023-11-20T06:41:43.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7ffa8ecac640 1 -- 172.21.15.19:0/2904124288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa800db8a0 con 0x7ffa800483d0 2023-11-20T06:41:43.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.447+0000 7f7ece7fc640 1 --2- 172.21.15.19:0/2519015207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ed015ff70 0x7f7ed00ade00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7ec400c3c0 tx=0x7f7ec400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.447+0000 7f7eb7fff640 1 -- 172.21.15.19:0/2519015207 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec40052d0 con 0x7f7ed015ff70 2023-11-20T06:41:43.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.447+0000 7f7eb7fff640 1 -- 172.21.15.19:0/2519015207 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec4005430 con 0x7f7ed015ff70 2023-11-20T06:41:43.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.447+0000 7f7eb7fff640 1 -- 172.21.15.19:0/2519015207 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec4007260 con 0x7f7ed015ff70 2023-11-20T06:41:43.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.443+0000 7ffa7e7fc640 1 -- 172.21.15.19:0/2904124288 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8804e2b0 con 0x7ffa800483d0 2023-11-20T06:41:43.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.447+0000 7ffa7e7fc640 1 -- 172.21.15.19:0/2904124288 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa88072c50 con 0x7ffa800483d0 2023-11-20T06:41:43.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.447+0000 7f7ed59f8640 1 -- 172.21.15.19:0/2519015207 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed00c5cf0 con 0x7f7ed015ff70 2023-11-20T06:41:43.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.447+0000 7f7ed59f8640 1 -- 172.21.15.19:0/2519015207 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed00c62b0 con 0x7f7ed015ff70 2023-11-20T06:41:43.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.447+0000 7f9f77fff640 1 Processor -- start 2023-11-20T06:41:43.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.447+0000 7f9f77fff640 1 -- start start 2023-11-20T06:41:43.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.447+0000 7f7ed59f8640 1 -- 172.21.15.19:0/2519015207 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed0073fa0 con 0x7f7ed015ff70 2023-11-20T06:41:43.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7f9f77fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f7806ffa0 0x7f9f7815f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7f9f77fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f780c19a0 0x7f9f7815a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7f9f77fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f780cb1b0 0x7f9f780b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7f9f76ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f7806ffa0 0x7f9f7815f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7f9f76ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f7806ffa0 0x7f9f7815f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:38392/0 (socket says 172.21.15.19:38392) 2023-11-20T06:41:43.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7f9f76ffd640 1 -- 172.21.15.19:0/1364549428 learned_addr learned my addr 172.21.15.19:0/1364549428 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:43.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7f9f77fff640 1 -- 172.21.15.19:0/1364549428 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f780b3f10 con 0x7f9f780c19a0 2023-11-20T06:41:43.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7f9f77fff640 1 -- 172.21.15.19:0/1364549428 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f780b17b0 con 0x7f9f7806ffa0 2023-11-20T06:41:43.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7f9f77fff640 1 -- 172.21.15.19:0/1364549428 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f780c51f0 con 0x7f9f780cb1b0 2023-11-20T06:41:43.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.447+0000 7ffa7e7fc640 1 -- 172.21.15.19:0/2904124288 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffa88072db0 con 0x7ffa800483d0 2023-11-20T06:41:43.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7ffa8ecac640 1 -- 172.21.15.19:0/2904124288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa70005260 con 0x7ffa800483d0 2023-11-20T06:41:43.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7ffa7e7fc640 1 --2- 172.21.15.19:0/2904124288 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ffa6c0664a0 0x7ffa6c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7ffa7e7fc640 1 -- 172.21.15.19:0/2904124288 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffa880fd7b0 con 0x7ffa800483d0 2023-11-20T06:41:43.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7f9f777fe640 1 --2- 172.21.15.19:0/1364549428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f780cb1b0 0x7f9f780b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7ffa8d4a9640 1 --2- 172.21.15.19:0/2904124288 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ffa6c0664a0 0x7ffa6c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7f7eb7fff640 1 -- 172.21.15.19:0/2519015207 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7ec40073c0 con 0x7f7ed015ff70 2023-11-20T06:41:43.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7f9f76ffd640 1 -- 172.21.15.19:0/1364549428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f780cb1b0 msgr2=0x7f9f780b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7f9f76ffd640 1 --2- 172.21.15.19:0/1364549428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f780cb1b0 0x7f9f780b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7f9f76ffd640 1 -- 172.21.15.19:0/1364549428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f780c19a0 msgr2=0x7f9f7815a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7f9f767fc640 1 --2- 172.21.15.19:0/1364549428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f780c19a0 0x7f9f7815a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7ffa8d4a9640 1 --2- 172.21.15.19:0/2904124288 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ffa6c0664a0 0x7ffa6c068960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ffa800363f0 tx=0x7ffa78009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7f9f76ffd640 1 --2- 172.21.15.19:0/1364549428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f780c19a0 0x7f9f7815a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7f9f76ffd640 1 -- 172.21.15.19:0/1364549428 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f70009a70 con 0x7f9f7806ffa0 2023-11-20T06:41:43.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.451+0000 7f9f767fc640 1 --2- 172.21.15.19:0/1364549428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f780c19a0 0x7f9f7815a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:43.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.455+0000 7f9f76ffd640 1 --2- 172.21.15.19:0/1364549428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f7806ffa0 0x7f9f7815f870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800c500 tx=0x7f9f6800c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.455+0000 7f7eb7fff640 1 --2- 172.21.15.19:0/2519015207 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7ebc066520 0x7f7ebc0689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.455+0000 7f7eb7fff640 1 -- 172.21.15.19:0/2519015207 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7ec4083350 con 0x7f7ed015ff70 2023-11-20T06:41:43.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.455+0000 7f7eceffd640 1 --2- 172.21.15.19:0/2519015207 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7ebc066520 0x7f7ebc0689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.455+0000 7f7eceffd640 1 --2- 172.21.15.19:0/2519015207 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7ebc066520 0x7f7ebc0689e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8001570 tx=0x7f7ec8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.455+0000 7f325ef03640 1 Processor -- start 2023-11-20T06:41:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.455+0000 7f325ef03640 1 -- start start 2023-11-20T06:41:43.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.459+0000 7f9f5f7fe640 1 -- 172.21.15.19:0/1364549428 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f68005220 con 0x7f9f7806ffa0 2023-11-20T06:41:43.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.459+0000 7f9f5f7fe640 1 -- 172.21.15.19:0/1364549428 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f68005380 con 0x7f9f7806ffa0 2023-11-20T06:41:43.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.459+0000 7f9f5f7fe640 1 -- 172.21.15.19:0/1364549428 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f68007270 con 0x7f9f7806ffa0 2023-11-20T06:41:43.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.459+0000 7f9f77fff640 1 -- 172.21.15.19:0/1364549428 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f780b1bd0 con 0x7f9f7806ffa0 2023-11-20T06:41:43.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.459+0000 7f325ef03640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3250033d10 0x7f32500eb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.459+0000 7f325ef03640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3250048200 0x7f32500eb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.459+0000 7f325ef03640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32500ec020 con 0x7f3250047bd0 2023-11-20T06:41:43.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.459+0000 7f7eb7fff640 1 -- 172.21.15.19:0/2519015207 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7ec40504c0 con 0x7f7ed015ff70 2023-11-20T06:41:43.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.459+0000 7f9f77fff640 1 -- 172.21.15.19:0/1364549428 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f780b10f0 con 0x7f9f7806ffa0 2023-11-20T06:41:43.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.463+0000 7f9f5d7fa640 1 -- 172.21.15.19:0/1364549428 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f780b1a20 con 0x7f9f7806ffa0 2023-11-20T06:41:43.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.463+0000 7f9f5f7fe640 1 -- 172.21.15.19:0/1364549428 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9f680073d0 con 0x7f9f7806ffa0 2023-11-20T06:41:43.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.463+0000 7ffa7e7fc640 1 -- 172.21.15.19:0/2904124288 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffa880ce3c0 con 0x7ffa800483d0 2023-11-20T06:41:43.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.459+0000 7f325ef03640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3250053ef0 con 0x7f3250048200 2023-11-20T06:41:43.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.459+0000 7f325ef03640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325004f200 con 0x7f3250033d10 2023-11-20T06:41:43.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.459+0000 7f325df01640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3250033d10 0x7f32500eb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.459+0000 7f325df01640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3250033d10 0x7f32500eb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:43440/0 (socket says 172.21.15.19:43440) 2023-11-20T06:41:43.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.459+0000 7f325df01640 1 -- 172.21.15.19:0/4122258360 learned_addr learned my addr 172.21.15.19:0/4122258360 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:43.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.459+0000 7f325d700640 1 --2- 172.21.15.19:0/4122258360 >> v2:172.21.15.19:3300/0 conn(0x7f3250048200 0x7f32500eb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.463+0000 7f325ceff640 1 -- 172.21.15.19:0/4122258360 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159753339 0 0) 0x7f32500ec020 con 0x7f3250047bd0 2023-11-20T06:41:43.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.463+0000 7f325ceff640 1 -- 172.21.15.19:0/4122258360 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3244003530 con 0x7f3250047bd0 2023-11-20T06:41:43.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.463+0000 7f325df01640 1 -- 172.21.15.19:0/4122258360 >> v2:172.21.15.19:3300/0 conn(0x7f3250048200 msgr2=0x7f32500eb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:43.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.463+0000 7f325df01640 1 --2- 172.21.15.19:0/4122258360 >> v2:172.21.15.19:3300/0 conn(0x7f3250048200 0x7f32500eb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.463+0000 7f325df01640 1 -- 172.21.15.19:0/4122258360 >> v1:172.21.15.190:6789/0 conn(0x7f3250047bd0 legacy=0x7f3250005ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.463+0000 7f325df01640 1 -- 172.21.15.19:0/4122258360 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325004f4e0 con 0x7f3250033d10 2023-11-20T06:41:43.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.467+0000 7f325d700640 1 --2- 172.21.15.19:0/4122258360 >> v2:172.21.15.19:3300/0 conn(0x7f3250048200 0x7f32500eb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:41:43.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.467+0000 7f9f5f7fe640 1 --2- 172.21.15.19:0/1364549428 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9f640664a0 0x7f9f64068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.467+0000 7f9f5f7fe640 1 -- 172.21.15.19:0/1364549428 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9f68083760 con 0x7f9f7806ffa0 2023-11-20T06:41:43.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.467+0000 7f9f767fc640 1 --2- 172.21.15.19:0/1364549428 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9f640664a0 0x7f9f64068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.467+0000 7f325df01640 1 --2- 172.21.15.19:0/4122258360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3250033d10 0x7f32500eb150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f32540098a0 tx=0x7f325401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83f66b2d3e1554e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.467+0000 7f325ceff640 1 -- 172.21.15.19:0/4122258360 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32540ab480 con 0x7f3250033d10 2023-11-20T06:41:43.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.467+0000 7f325ceff640 1 -- 172.21.15.19:0/4122258360 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32540ab5e0 con 0x7f3250033d10 2023-11-20T06:41:43.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.467+0000 7f325ceff640 1 -- 172.21.15.19:0/4122258360 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32540ab970 con 0x7f3250033d10 2023-11-20T06:41:43.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.467+0000 7f325ef03640 1 -- 172.21.15.19:0/4122258360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3250033d10 msgr2=0x7f32500eb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.467+0000 7f325ef03640 1 --2- 172.21.15.19:0/4122258360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3250033d10 0x7f32500eb150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f32540098a0 tx=0x7f325401c530 comp rx=0 tx=0).stop 2023-11-20T06:41:43.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.467+0000 7f9f767fc640 1 --2- 172.21.15.19:0/1364549428 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9f640664a0 0x7f9f64068960 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9f78161d40 tx=0x7f9f6c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.467+0000 7f325ef03640 1 -- 172.21.15.19:0/4122258360 shutdown_connections 2023-11-20T06:41:43.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.467+0000 7f325ef03640 1 --2- 172.21.15.19:0/4122258360 >> v2:172.21.15.19:3300/0 conn(0x7f3250048200 0x7f32500eb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.467+0000 7f325ef03640 1 --2- 172.21.15.19:0/4122258360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3250033d10 0x7f32500eb150 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.467+0000 7f325ef03640 1 -- 172.21.15.19:0/4122258360 >> 172.21.15.19:0/4122258360 conn(0x7f3250054b10 msgr2=0x7f3250054f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:43.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.471+0000 7f325ef03640 1 -- 172.21.15.19:0/4122258360 shutdown_connections 2023-11-20T06:41:43.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.471+0000 7f325ef03640 1 -- 172.21.15.19:0/4122258360 wait complete. 2023-11-20T06:41:43.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.471+0000 7f9f5f7fe640 1 -- 172.21.15.19:0/1364549428 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9f68050860 con 0x7f9f7806ffa0 2023-11-20T06:41:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.471+0000 7f325ef03640 1 Processor -- start 2023-11-20T06:41:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.471+0000 7f325ef03640 1 -- start start 2023-11-20T06:41:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.475+0000 7f325ef03640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3250033d10 0x7f3250039ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.475+0000 7f325ef03640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3250047bd0 0x7f32500dae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.475+0000 7f325ef03640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3250048200 0x7f32500db6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.475+0000 7f325df01640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3250033d10 0x7f3250039ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.475+0000 7f325df01640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3250033d10 0x7f3250039ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:43450/0 (socket says 172.21.15.19:43450) 2023-11-20T06:41:43.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.475+0000 7f325df01640 1 -- 172.21.15.19:0/4176618276 learned_addr learned my addr 172.21.15.19:0/4176618276 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:43.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.475+0000 7f325ef03640 1 -- 172.21.15.19:0/4176618276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325004bbe0 con 0x7f3250047bd0 2023-11-20T06:41:43.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.475+0000 7f325ef03640 1 -- 172.21.15.19:0/4176618276 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325004e4c0 con 0x7f3250048200 2023-11-20T06:41:43.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.475+0000 7f325ef03640 1 -- 172.21.15.19:0/4176618276 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325004e7a0 con 0x7f3250033d10 2023-11-20T06:41:43.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.475+0000 7f325e702640 1 --2- 172.21.15.19:0/4176618276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3250048200 0x7f32500db6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.479+0000 7f325e702640 1 -- 172.21.15.19:0/4176618276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3250033d10 msgr2=0x7f3250039ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.479+0000 7f325e702640 1 --2- 172.21.15.19:0/4176618276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3250033d10 0x7f3250039ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.479+0000 7f325e702640 1 -- 172.21.15.19:0/4176618276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3250047bd0 msgr2=0x7f32500dae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.479+0000 7f325e702640 1 --2- 172.21.15.19:0/4176618276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3250047bd0 0x7f32500dae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.479+0000 7f325e702640 1 -- 172.21.15.19:0/4176618276 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3248009420 con 0x7f3250048200 2023-11-20T06:41:43.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.479+0000 7f325e702640 1 --2- 172.21.15.19:0/4176618276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3250048200 0x7f32500db6a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3258063ef0 tx=0x7f3258072570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.479+0000 7f324e7fc640 1 -- 172.21.15.19:0/4176618276 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258072040 con 0x7f3250048200 2023-11-20T06:41:43.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.479+0000 7f324e7fc640 1 -- 172.21.15.19:0/4176618276 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3258072c30 con 0x7f3250048200 2023-11-20T06:41:43.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.479+0000 7f324e7fc640 1 -- 172.21.15.19:0/4176618276 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258072fc0 con 0x7f3250048200 2023-11-20T06:41:43.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.479+0000 7f325ef03640 1 -- 172.21.15.19:0/4176618276 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32540094d0 con 0x7f3250048200 2023-11-20T06:41:43.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.479+0000 7f325ef03640 1 -- 172.21.15.19:0/4176618276 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325004c110 con 0x7f3250048200 2023-11-20T06:41:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.483+0000 7f324e7fc640 1 -- 172.21.15.19:0/4176618276 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f325808f020 con 0x7f3250048200 2023-11-20T06:41:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.483+0000 7f325ef03640 1 -- 172.21.15.19:0/4176618276 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325004e9c0 con 0x7f3250048200 2023-11-20T06:41:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.483+0000 7f324e7fc640 1 --2- 172.21.15.19:0/4176618276 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f323c066520 0x7f323c0689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.483+0000 7f325df01640 1 --2- 172.21.15.19:0/4176618276 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f323c066520 0x7f323c0689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:43.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.483+0000 7f324e7fc640 1 -- 172.21.15.19:0/4176618276 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f32580ce0e0 con 0x7f3250048200 2023-11-20T06:41:43.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.487+0000 7f325df01640 1 --2- 172.21.15.19:0/4176618276 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f323c066520 0x7f323c0689e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f325401c570 tx=0x7f32540b6040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:43.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.487+0000 7f324e7fc640 1 -- 172.21.15.19:0/4176618276 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f32580cabb0 con 0x7f3250048200 2023-11-20T06:41:43.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.707+0000 7efd1cff9640 1 -- 172.21.15.19:0/792668682 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efd300b16e0 con 0x7efd300b00e0 2023-11-20T06:41:43.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.715+0000 7efd1effd640 1 -- 172.21.15.19:0/792668682 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd300b16e0 con 0x7efd300b00e0 2023-11-20T06:41:43.719 INFO:teuthology.orchestra.run.smithi019.stdout:55834574860 2023-11-20T06:41:43.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.715+0000 7efd34ec9640 1 -- 172.21.15.19:0/792668682 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7efd100664f0 msgr2=0x7efd100689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.715+0000 7efd34ec9640 1 --2- 172.21.15.19:0/792668682 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7efd100664f0 0x7efd100689b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efd24007fd0 tx=0x7efd24007960 comp rx=0 tx=0).stop 2023-11-20T06:41:43.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.715+0000 7efd34ec9640 1 -- 172.21.15.19:0/792668682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd300b00e0 msgr2=0x7efd300c7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.715+0000 7efd34ec9640 1 --2- 172.21.15.19:0/792668682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd300b00e0 0x7efd300c7d10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efd2000c4d0 tx=0x7efd2000c990 comp rx=0 tx=0).stop 2023-11-20T06:41:43.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.715+0000 7f0e7b3b5640 1 -- 172.21.15.19:0/4249846842 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0e740b2990 con 0x7f0e7406e090 2023-11-20T06:41:43.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.715+0000 7efd34ec9640 1 -- 172.21.15.19:0/792668682 shutdown_connections 2023-11-20T06:41:43.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.715+0000 7efd34ec9640 1 --2- 172.21.15.19:0/792668682 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7efd100664f0 0x7efd100689b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.715+0000 7efd34ec9640 1 --2- 172.21.15.19:0/792668682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd300cb720 0x7efd300b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.715+0000 7efd34ec9640 1 --2- 172.21.15.19:0/792668682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd300c99e0 0x7efd300c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.715+0000 7efd34ec9640 1 --2- 172.21.15.19:0/792668682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd300b00e0 0x7efd300c7d10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.715+0000 7efd34ec9640 1 -- 172.21.15.19:0/792668682 >> 172.21.15.19:0/792668682 conn(0x7efd3006c190 msgr2=0x7efd300cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:43.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.719+0000 7efd34ec9640 1 -- 172.21.15.19:0/792668682 shutdown_connections 2023-11-20T06:41:43.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.719+0000 7efd34ec9640 1 -- 172.21.15.19:0/792668682 wait complete. 2023-11-20T06:41:43.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.719+0000 7f0e6affd640 1 -- 172.21.15.19:0/4249846842 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0e640ba070 con 0x7f0e7406e090 2023-11-20T06:41:43.724 INFO:teuthology.orchestra.run.smithi019.stdout:55834574858 2023-11-20T06:41:43.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.723+0000 7f0e7b3b5640 1 -- 172.21.15.19:0/4249846842 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0e58066560 msgr2=0x7f0e58068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.723+0000 7f0e7b3b5640 1 --2- 172.21.15.19:0/4249846842 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0e58066560 0x7f0e58068a20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0e74163560 tx=0x7f0e70008040 comp rx=0 tx=0).stop 2023-11-20T06:41:43.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.723+0000 7f0e7b3b5640 1 -- 172.21.15.19:0/4249846842 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e7406e090 msgr2=0x7f0e74157730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.723+0000 7f0e7b3b5640 1 --2- 172.21.15.19:0/4249846842 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e7406e090 0x7f0e74157730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0e640b0040 tx=0x7f0e64019230 comp rx=0 tx=0).stop 2023-11-20T06:41:43.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.723+0000 7f0e7b3b5640 1 -- 172.21.15.19:0/4249846842 shutdown_connections 2023-11-20T06:41:43.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.723+0000 7f0e7b3b5640 1 --2- 172.21.15.19:0/4249846842 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0e58066560 0x7f0e58068a20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.723+0000 7f0e7b3b5640 1 --2- 172.21.15.19:0/4249846842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e740cc740 0x7f0e741f78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.723+0000 7f0e7b3b5640 1 --2- 172.21.15.19:0/4249846842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e740cac60 0x7f0e740c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.723+0000 7f0e7b3b5640 1 --2- 172.21.15.19:0/4249846842 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e7406e090 0x7f0e74157730 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.723+0000 7f0e7b3b5640 1 -- 172.21.15.19:0/4249846842 >> 172.21.15.19:0/4249846842 conn(0x7f0e7406a6e0 msgr2=0x7f0e7415b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:43.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.727+0000 7f0e7b3b5640 1 -- 172.21.15.19:0/4249846842 shutdown_connections 2023-11-20T06:41:43.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.727+0000 7f0e7b3b5640 1 -- 172.21.15.19:0/4249846842 wait complete. 2023-11-20T06:41:43.757 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.1 2023-11-20T06:41:43.757 DEBUG:teuthology.parallel:result is None 2023-11-20T06:41:43.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2023-11-20T06:41:43.765 DEBUG:teuthology.parallel:result is None 2023-11-20T06:41:43.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.759+0000 7fc69f3b8640 1 -- 172.21.15.19:0/4000851164 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc698073fa0 con 0x7fc6840047d0 2023-11-20T06:41:43.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.763+0000 7fc68dffb640 1 -- 172.21.15.19:0/4000851164 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc690064ed0 con 0x7fc6840047d0 2023-11-20T06:41:43.767 INFO:teuthology.orchestra.run.smithi019.stdout:55834574859 2023-11-20T06:41:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.763+0000 7fc69f3b8640 1 -- 172.21.15.19:0/4000851164 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc67c0664a0 msgr2=0x7fc67c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.763+0000 7fc69f3b8640 1 --2- 172.21.15.19:0/4000851164 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc67c0664a0 0x7fc67c068960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc6840057b0 tx=0x7fc694001130 comp rx=0 tx=0).stop 2023-11-20T06:41:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.763+0000 7fc69f3b8640 1 -- 172.21.15.19:0/4000851164 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6840047d0 msgr2=0x7fc6980a9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.763+0000 7fc69f3b8640 1 --2- 172.21.15.19:0/4000851164 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6840047d0 0x7fc6980a9760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc690001b80 tx=0x7fc69000cf60 comp rx=0 tx=0).stop 2023-11-20T06:41:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.763+0000 7fc69f3b8640 1 -- 172.21.15.19:0/4000851164 shutdown_connections 2023-11-20T06:41:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.763+0000 7fc69f3b8640 1 --2- 172.21.15.19:0/4000851164 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc67c0664a0 0x7fc67c068960 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.763+0000 7fc69f3b8640 1 --2- 172.21.15.19:0/4000851164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc69815f950 0x7fc698156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.763+0000 7fc69f3b8640 1 --2- 172.21.15.19:0/4000851164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69815d700 0x7fc69815f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.763+0000 7fc69f3b8640 1 --2- 172.21.15.19:0/4000851164 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6840047d0 0x7fc6980a9760 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.763+0000 7fc69f3b8640 1 -- 172.21.15.19:0/4000851164 >> 172.21.15.19:0/4000851164 conn(0x7fc69806a290 msgr2=0x7fc69815b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.767+0000 7fc69f3b8640 1 -- 172.21.15.19:0/4000851164 shutdown_connections 2023-11-20T06:41:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.767+0000 7fc69f3b8640 1 -- 172.21.15.19:0/4000851164 wait complete. 2023-11-20T06:41:43.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.771+0000 7f6389cd6640 1 -- 172.21.15.19:0/2207005808 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f637c0054d0 con 0x7f637c056cd0 2023-11-20T06:41:43.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.771+0000 7f636ffff640 1 -- 172.21.15.19:0/2207005808 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f63700ee780 con 0x7f637c056cd0 2023-11-20T06:41:43.776 INFO:teuthology.orchestra.run.smithi019.stdout:55834574857 2023-11-20T06:41:43.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.771+0000 7f6389cd6640 1 -- 172.21.15.19:0/2207005808 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f63680664a0 msgr2=0x7f6368068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.771+0000 7f6389cd6640 1 --2- 172.21.15.19:0/2207005808 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f63680664a0 0x7f6368068960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f638404fab0 tx=0x7f638408af90 comp rx=0 tx=0).stop 2023-11-20T06:41:43.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.771+0000 7f6389cd6640 1 -- 172.21.15.19:0/2207005808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f637c056cd0 msgr2=0x7f637c0d4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.771+0000 7f6389cd6640 1 --2- 172.21.15.19:0/2207005808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f637c056cd0 0x7f637c0d4280 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f63700ab000 tx=0x7f6370019090 comp rx=0 tx=0).stop 2023-11-20T06:41:43.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.775+0000 7f6389cd6640 1 -- 172.21.15.19:0/2207005808 shutdown_connections 2023-11-20T06:41:43.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.775+0000 7f6389cd6640 1 --2- 172.21.15.19:0/2207005808 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f63680664a0 0x7f6368068960 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.775+0000 7f6389cd6640 1 --2- 172.21.15.19:0/2207005808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f637c056cd0 0x7f637c0d4280 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.775+0000 7f6389cd6640 1 --2- 172.21.15.19:0/2207005808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f637c053750 0x7f637c03b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.775+0000 7f6389cd6640 1 --2- 172.21.15.19:0/2207005808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f637c007970 0x7f637c0d7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.775+0000 7f6389cd6640 1 -- 172.21.15.19:0/2207005808 >> 172.21.15.19:0/2207005808 conn(0x7f637c059100 msgr2=0x7f637c0521e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:43.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.775+0000 7f6389cd6640 1 -- 172.21.15.19:0/2207005808 shutdown_connections 2023-11-20T06:41:43.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.775+0000 7f6389cd6640 1 -- 172.21.15.19:0/2207005808 wait complete. 2023-11-20T06:41:43.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.775+0000 7ffa8ecac640 1 -- 172.21.15.19:0/2904124288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ffa70005510 con 0x7ffa800483d0 2023-11-20T06:41:43.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.775+0000 7ffa7e7fc640 1 -- 172.21.15.19:0/2904124288 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffa880cdf50 con 0x7ffa800483d0 2023-11-20T06:41:43.783 INFO:teuthology.orchestra.run.smithi019.stdout:55834574859 2023-11-20T06:41:43.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.779+0000 7ffa8ecac640 1 -- 172.21.15.19:0/2904124288 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ffa6c0664a0 msgr2=0x7ffa6c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.779+0000 7ffa8ecac640 1 --2- 172.21.15.19:0/2904124288 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ffa6c0664a0 0x7ffa6c068960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ffa800363f0 tx=0x7ffa78009040 comp rx=0 tx=0).stop 2023-11-20T06:41:43.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.779+0000 7ffa8ecac640 1 -- 172.21.15.19:0/2904124288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa800483d0 msgr2=0x7ffa800db360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.779+0000 7ffa8ecac640 1 --2- 172.21.15.19:0/2904124288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa800483d0 0x7ffa800db360 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffa88068cd0 tx=0x7ffa88072520 comp rx=0 tx=0).stop 2023-11-20T06:41:43.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.783+0000 7ffa8ecac640 1 -- 172.21.15.19:0/2904124288 shutdown_connections 2023-11-20T06:41:43.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.783+0000 7ffa8ecac640 1 --2- 172.21.15.19:0/2904124288 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ffa6c0664a0 0x7ffa6c068960 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.783+0000 7ffa8ecac640 1 --2- 172.21.15.19:0/2904124288 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa800e7790 0x7ffa800d5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.783+0000 7ffa8ecac640 1 --2- 172.21.15.19:0/2904124288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa8004fd40 0x7ffa800e5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.783+0000 7ffa8ecac640 1 --2- 172.21.15.19:0/2904124288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa800483d0 0x7ffa800db360 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.783+0000 7ffa8ecac640 1 -- 172.21.15.19:0/2904124288 >> 172.21.15.19:0/2904124288 conn(0x7ffa8000a560 msgr2=0x7ffa8000a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:43.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.783+0000 7ffa8ecac640 1 -- 172.21.15.19:0/2904124288 shutdown_connections 2023-11-20T06:41:43.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.783+0000 7ffa8ecac640 1 -- 172.21.15.19:0/2904124288 wait complete. 2023-11-20T06:41:43.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.795+0000 7f9f5d7fa640 1 -- 172.21.15.19:0/1364549428 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9f78073fa0 con 0x7f9f7806ffa0 2023-11-20T06:41:43.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.795+0000 7f9f5f7fe640 1 -- 172.21.15.19:0/1364549428 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f68053e80 con 0x7f9f7806ffa0 2023-11-20T06:41:43.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2023-11-20T06:41:43.800 INFO:teuthology.orchestra.run.smithi019.stdout:55834574858 2023-11-20T06:41:43.801 DEBUG:teuthology.parallel:result is None 2023-11-20T06:41:43.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.795+0000 7f9f5d7fa640 1 -- 172.21.15.19:0/1364549428 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9f640664a0 msgr2=0x7f9f64068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.795+0000 7f9f5d7fa640 1 --2- 172.21.15.19:0/1364549428 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9f640664a0 0x7f9f64068960 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9f78161d40 tx=0x7f9f6c008040 comp rx=0 tx=0).stop 2023-11-20T06:41:43.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.795+0000 7f9f5d7fa640 1 -- 172.21.15.19:0/1364549428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f7806ffa0 msgr2=0x7f9f7815f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.795+0000 7f9f5d7fa640 1 --2- 172.21.15.19:0/1364549428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f7806ffa0 0x7f9f7815f870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800c500 tx=0x7f9f6800c9c0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.795+0000 7f9f5d7fa640 1 -- 172.21.15.19:0/1364549428 shutdown_connections 2023-11-20T06:41:43.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.795+0000 7f9f5d7fa640 1 --2- 172.21.15.19:0/1364549428 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9f640664a0 0x7f9f64068960 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.795+0000 7f9f5d7fa640 1 --2- 172.21.15.19:0/1364549428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f780cb1b0 0x7f9f780b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.795+0000 7f9f5d7fa640 1 --2- 172.21.15.19:0/1364549428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f780c19a0 0x7f9f7815a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.795+0000 7f9f5d7fa640 1 --2- 172.21.15.19:0/1364549428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f7806ffa0 0x7f9f7815f870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.795+0000 7f9f5d7fa640 1 -- 172.21.15.19:0/1364549428 >> 172.21.15.19:0/1364549428 conn(0x7f9f7806a6e0 msgr2=0x7f9f780afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:43.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.799+0000 7f9f5d7fa640 1 -- 172.21.15.19:0/1364549428 shutdown_connections 2023-11-20T06:41:43.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.799+0000 7f9f5d7fa640 1 -- 172.21.15.19:0/1364549428 wait complete. 2023-11-20T06:41:43.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.799+0000 7f7ed59f8640 1 -- 172.21.15.19:0/2519015207 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7ed00cbfb0 con 0x7f7ed015ff70 2023-11-20T06:41:43.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.799+0000 7f7eb7fff640 1 -- 172.21.15.19:0/2519015207 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7ec4053ae0 con 0x7f7ed015ff70 2023-11-20T06:41:43.804 INFO:teuthology.orchestra.run.smithi019.stdout:55834574857 2023-11-20T06:41:43.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.803+0000 7f7ed59f8640 1 -- 172.21.15.19:0/2519015207 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7ebc066520 msgr2=0x7f7ebc0689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.803+0000 7f7ed59f8640 1 --2- 172.21.15.19:0/2519015207 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7ebc066520 0x7f7ebc0689e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8001570 tx=0x7f7ec8009040 comp rx=0 tx=0).stop 2023-11-20T06:41:43.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.803+0000 7f7ed59f8640 1 -- 172.21.15.19:0/2519015207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ed015ff70 msgr2=0x7f7ed00ade00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.803+0000 7f7ed59f8640 1 --2- 172.21.15.19:0/2519015207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ed015ff70 0x7f7ed00ade00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7ec400c3c0 tx=0x7f7ec400c880 comp rx=0 tx=0).stop 2023-11-20T06:41:43.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.803+0000 7f7ed59f8640 1 -- 172.21.15.19:0/2519015207 shutdown_connections 2023-11-20T06:41:43.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.803+0000 7f7ed59f8640 1 --2- 172.21.15.19:0/2519015207 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7ebc066520 0x7f7ebc0689e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.803+0000 7f7ed59f8640 1 --2- 172.21.15.19:0/2519015207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ed0161150 0x7f7ed00ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.803+0000 7f7ed59f8640 1 --2- 172.21.15.19:0/2519015207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ed015ff70 0x7f7ed00ade00 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7ec400c3c0 tx=0x7f7ec400c880 comp rx=0 tx=0).stop 2023-11-20T06:41:43.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.803+0000 7f7ed59f8640 1 --2- 172.21.15.19:0/2519015207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ed006bfe0 0x7f7ed015a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.803+0000 7f7ed59f8640 1 -- 172.21.15.19:0/2519015207 >> 172.21.15.19:0/2519015207 conn(0x7f7ed006a290 msgr2=0x7f7ed006a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:43.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.803+0000 7f7ed59f8640 1 -- 172.21.15.19:0/2519015207 shutdown_connections 2023-11-20T06:41:43.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.803+0000 7f7ed59f8640 1 -- 172.21.15.19:0/2519015207 wait complete. 2023-11-20T06:41:43.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-11-20T06:41:43.813 DEBUG:teuthology.parallel:result is None 2023-11-20T06:41:43.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2023-11-20T06:41:43.820 DEBUG:teuthology.parallel:result is None 2023-11-20T06:41:43.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2023-11-20T06:41:43.828 DEBUG:teuthology.parallel:result is None 2023-11-20T06:41:43.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.823+0000 7f325ef03640 1 -- 172.21.15.19:0/4176618276 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f325004c300 con 0x7f3250048200 2023-11-20T06:41:43.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.823+0000 7f324e7fc640 1 -- 172.21.15.19:0/4176618276 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3258097020 con 0x7f3250048200 2023-11-20T06:41:43.831 INFO:teuthology.orchestra.run.smithi019.stdout:55834574857 2023-11-20T06:41:43.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.827+0000 7f325ef03640 1 -- 172.21.15.19:0/4176618276 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f323c066520 msgr2=0x7f323c0689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.827+0000 7f325ef03640 1 --2- 172.21.15.19:0/4176618276 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f323c066520 0x7f323c0689e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f325401c570 tx=0x7f32540b6040 comp rx=0 tx=0).stop 2023-11-20T06:41:43.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.827+0000 7f325ef03640 1 -- 172.21.15.19:0/4176618276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3250048200 msgr2=0x7f32500db6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:43.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.827+0000 7f325ef03640 1 --2- 172.21.15.19:0/4176618276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3250048200 0x7f32500db6a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3258063ef0 tx=0x7f3258072570 comp rx=0 tx=0).stop 2023-11-20T06:41:43.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.827+0000 7f325ef03640 1 -- 172.21.15.19:0/4176618276 shutdown_connections 2023-11-20T06:41:43.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.827+0000 7f325ef03640 1 --2- 172.21.15.19:0/4176618276 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f323c066520 0x7f323c0689e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.827+0000 7f325ef03640 1 --2- 172.21.15.19:0/4176618276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3250048200 0x7f32500db6a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.827+0000 7f325ef03640 1 --2- 172.21.15.19:0/4176618276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3250047bd0 0x7f32500dae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.827+0000 7f325ef03640 1 --2- 172.21.15.19:0/4176618276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3250033d10 0x7f3250039ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:43.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.827+0000 7f325ef03640 1 -- 172.21.15.19:0/4176618276 >> 172.21.15.19:0/4176618276 conn(0x7f3250054b10 msgr2=0x7f3250006e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:43.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.827+0000 7f325ef03640 1 -- 172.21.15.19:0/4176618276 shutdown_connections 2023-11-20T06:41:43.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:43.827+0000 7f325ef03640 1 -- 172.21.15.19:0/4176618276 wait complete. 2023-11-20T06:41:43.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2023-11-20T06:41:43.837 DEBUG:teuthology.parallel:result is None 2023-11-20T06:41:43.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2023-11-20T06:41:43.853 DEBUG:teuthology.parallel:result is None 2023-11-20T06:41:43.854 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-20T06:41:43.854 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T06:41:44.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.031+0000 7f82e566b640 1 Processor -- start 2023-11-20T06:41:44.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.031+0000 7f82e566b640 1 -- start start 2023-11-20T06:41:44.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.035+0000 7f82e566b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f82e015ca70 0x7f82e00d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:44.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.035+0000 7f82e566b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e00c65f0 con 0x7f82e00cf7a0 2023-11-20T06:41:44.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.035+0000 7f82e566b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e00cdf80 con 0x7f82e00d3550 2023-11-20T06:41:44.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.035+0000 7f82e566b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e00ce820 con 0x7f82e015ca70 2023-11-20T06:41:44.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.035+0000 7f82df7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f82e00cf7a0 0x7f82e00c6ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40756/0 (socket says 172.21.15.19:40756) 2023-11-20T06:41:44.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.035+0000 7f82deffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f82e015ca70 0x7f82e00d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:44.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.035+0000 7f82df7fe640 1 -- 172.21.15.19:0/3444231566 learned_addr learned my addr 172.21.15.19:0/3444231566 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:44.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.035+0000 7f82de7fc640 1 -- 172.21.15.19:0/3444231566 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756492709 0 0) 0x7f82e00c65f0 con 0x7f82e00cf7a0 2023-11-20T06:41:44.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.035+0000 7f82de7fc640 1 -- 172.21.15.19:0/3444231566 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82cc003530 con 0x7f82e00cf7a0 2023-11-20T06:41:44.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.035+0000 7f82deffd640 1 -- 172.21.15.19:0/3444231566 >> v1:172.21.15.190:6789/0 conn(0x7f82e00d3550 legacy=0x7f82e00cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:44.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.035+0000 7f82de7fc640 1 -- 172.21.15.19:0/3444231566 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2979653598 0 0) 0x7f82e00cdf80 con 0x7f82e00d3550 2023-11-20T06:41:44.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.035+0000 7f82deffd640 1 -- 172.21.15.19:0/3444231566 >> v1:172.21.15.19:6789/0 conn(0x7f82e00cf7a0 legacy=0x7f82e00c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:44.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.035+0000 7f82deffd640 1 -- 172.21.15.19:0/3444231566 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e00ce260 con 0x7f82e015ca70 2023-11-20T06:41:44.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.039+0000 7f82deffd640 1 --2- 172.21.15.19:0/3444231566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82e015ca70 0x7f82e00d3010 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f82d00097a0 tx=0x7f82d001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afbcba795ffcd513 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:44.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.039+0000 7f82de7fc640 1 -- 172.21.15.19:0/3444231566 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d00a8050 con 0x7f82e015ca70 2023-11-20T06:41:44.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.039+0000 7f82de7fc640 1 -- 172.21.15.19:0/3444231566 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d00ac5f0 con 0x7f82e015ca70 2023-11-20T06:41:44.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.039+0000 7f82de7fc640 1 -- 172.21.15.19:0/3444231566 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d00ac960 con 0x7f82e015ca70 2023-11-20T06:41:44.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.039+0000 7f82e566b640 1 -- 172.21.15.19:0/3444231566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82e015ca70 msgr2=0x7f82e00d3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:44.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.039+0000 7f82e566b640 1 --2- 172.21.15.19:0/3444231566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82e015ca70 0x7f82e00d3010 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f82d00097a0 tx=0x7f82d001c430 comp rx=0 tx=0).stop 2023-11-20T06:41:44.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.039+0000 7f82e566b640 1 -- 172.21.15.19:0/3444231566 shutdown_connections 2023-11-20T06:41:44.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.039+0000 7f82e566b640 1 --2- 172.21.15.19:0/3444231566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82e015ca70 0x7f82e00d3010 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.039+0000 7f82e566b640 1 -- 172.21.15.19:0/3444231566 >> 172.21.15.19:0/3444231566 conn(0x7f82e009bc50 msgr2=0x7f82e00d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:44.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.039+0000 7f82e566b640 1 -- 172.21.15.19:0/3444231566 shutdown_connections 2023-11-20T06:41:44.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.039+0000 7f82e566b640 1 -- 172.21.15.19:0/3444231566 wait complete. 2023-11-20T06:41:44.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.039+0000 7f82e566b640 1 Processor -- start 2023-11-20T06:41:44.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.039+0000 7f82e566b640 1 -- start start 2023-11-20T06:41:44.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.039+0000 7f82e566b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82e00cf7a0 0x7f82e0154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:44.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.039+0000 7f82e566b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82e00d3550 0x7f82e0155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:44.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.039+0000 7f82e566b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82e015ca70 0x7f82e00b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:44.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.039+0000 7f82e566b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00c99d0 con 0x7f82e00cf7a0 2023-11-20T06:41:44.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.039+0000 7f82e566b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00b6f20 con 0x7f82e00d3550 2023-11-20T06:41:44.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.039+0000 7f82e566b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e015d2a0 con 0x7f82e015ca70 2023-11-20T06:41:44.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.039+0000 7f82deffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82e00cf7a0 0x7f82e0154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:44.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.043+0000 7f82deffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82e00cf7a0 0x7f82e0154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48540/0 (socket says 172.21.15.19:48540) 2023-11-20T06:41:44.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.043+0000 7f82deffd640 1 -- 172.21.15.19:0/1734423807 learned_addr learned my addr 172.21.15.19:0/1734423807 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:44.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.043+0000 7f82d7fff640 1 --2- 172.21.15.19:0/1734423807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82e00d3550 0x7f82e0155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:44.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.043+0000 7f82df7fe640 1 --2- 172.21.15.19:0/1734423807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82e015ca70 0x7f82e00b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:44.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.043+0000 7f82deffd640 1 -- 172.21.15.19:0/1734423807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82e015ca70 msgr2=0x7f82e00b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:44.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.043+0000 7f82deffd640 1 --2- 172.21.15.19:0/1734423807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82e015ca70 0x7f82e00b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.043+0000 7f82deffd640 1 -- 172.21.15.19:0/1734423807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82e00d3550 msgr2=0x7f82e0155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:44.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.043+0000 7f82deffd640 1 --2- 172.21.15.19:0/1734423807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82e00d3550 0x7f82e0155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.043+0000 7f82deffd640 1 -- 172.21.15.19:0/1734423807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d00093b0 con 0x7f82e00cf7a0 2023-11-20T06:41:44.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.043+0000 7f82deffd640 1 --2- 172.21.15.19:0/1734423807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82e00cf7a0 0x7f82e0154940 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f82d001aae0 tx=0x7f82d00191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:44.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.043+0000 7f82d77fe640 1 -- 172.21.15.19:0/1734423807 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0006dc0 con 0x7f82e00cf7a0 2023-11-20T06:41:44.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.043+0000 7f82d77fe640 1 -- 172.21.15.19:0/1734423807 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d00b5610 con 0x7f82e00cf7a0 2023-11-20T06:41:44.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.043+0000 7f82e566b640 1 -- 172.21.15.19:0/1734423807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e00c9be0 con 0x7f82e00cf7a0 2023-11-20T06:41:44.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.043+0000 7f82d77fe640 1 -- 172.21.15.19:0/1734423807 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d00b59a0 con 0x7f82e00cf7a0 2023-11-20T06:41:44.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.043+0000 7f82e566b640 1 -- 172.21.15.19:0/1734423807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e015d540 con 0x7f82e00cf7a0 2023-11-20T06:41:44.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.043+0000 7f82e566b640 1 -- 172.21.15.19:0/1734423807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e015d730 con 0x7f82e00cf7a0 2023-11-20T06:41:44.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.043+0000 7f82d77fe640 1 -- 172.21.15.19:0/1734423807 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f82d00b3040 con 0x7f82e00cf7a0 2023-11-20T06:41:44.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.047+0000 7f82d77fe640 1 --2- 172.21.15.19:0/1734423807 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f82c00664a0 0x7f82c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:44.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.047+0000 7f82d77fe640 1 -- 172.21.15.19:0/1734423807 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f82d011e120 con 0x7f82e00cf7a0 2023-11-20T06:41:44.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.047+0000 7f82d7fff640 1 --2- 172.21.15.19:0/1734423807 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f82c00664a0 0x7f82c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:44.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.047+0000 7f82d7fff640 1 --2- 172.21.15.19:0/1734423807 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f82c00664a0 0x7f82c0068960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f82e00cd770 tx=0x7f82c8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:44.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.051+0000 7f82d77fe640 1 -- 172.21.15.19:0/1734423807 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f82d00eb2a0 con 0x7f82e00cf7a0 2023-11-20T06:41:44.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.203+0000 7f82e566b640 1 -- 172.21.15.19:0/1734423807 --> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82e00c79f0 con 0x7f82c00664a0 2023-11-20T06:41:44.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.211+0000 7f82d77fe640 1 -- 172.21.15.19:0/1734423807 <== mgr.4109 v2:172.21.15.190:6832/142426253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345275 (secure 0 0 0) 0x7f82c800f820 con 0x7f82c00664a0 2023-11-20T06:41:44.222 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:44.230 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-20T06:41:44.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.215+0000 7f82e566b640 1 -- 172.21.15.19:0/1734423807 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f82c00664a0 msgr2=0x7f82c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:44.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.215+0000 7f82e566b640 1 --2- 172.21.15.19:0/1734423807 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f82c00664a0 0x7f82c0068960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f82e00cd770 tx=0x7f82c8009040 comp rx=0 tx=0).stop 2023-11-20T06:41:44.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.215+0000 7f82e566b640 1 -- 172.21.15.19:0/1734423807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82e00cf7a0 msgr2=0x7f82e0154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:44.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.215+0000 7f82e566b640 1 --2- 172.21.15.19:0/1734423807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82e00cf7a0 0x7f82e0154940 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f82d001aae0 tx=0x7f82d00191d0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.215+0000 7f82e566b640 1 -- 172.21.15.19:0/1734423807 shutdown_connections 2023-11-20T06:41:44.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.215+0000 7f82e566b640 1 --2- 172.21.15.19:0/1734423807 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f82c00664a0 0x7f82c0068960 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.215+0000 7f82e566b640 1 --2- 172.21.15.19:0/1734423807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82e015ca70 0x7f82e00b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.215+0000 7f82e566b640 1 --2- 172.21.15.19:0/1734423807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82e00d3550 0x7f82e0155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.215+0000 7f82e566b640 1 --2- 172.21.15.19:0/1734423807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82e00cf7a0 0x7f82e0154940 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.215+0000 7f82e566b640 1 -- 172.21.15.19:0/1734423807 >> 172.21.15.19:0/1734423807 conn(0x7f82e009bc50 msgr2=0x7f82e006c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:44.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.215+0000 7f82e566b640 1 -- 172.21.15.19:0/1734423807 shutdown_connections 2023-11-20T06:41:44.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.215+0000 7f82e566b640 1 -- 172.21.15.19:0/1734423807 wait complete. 2023-11-20T06:41:44.244 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-11-20T06:41:43.489980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219472,"kb_used_data":3300,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755248,"statfs":{"total":773094113280,"available":772869373952,"internally_reserved":0,"allocated":3379200,"data_stored":2043755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003308"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578685+0000","last_change":"2023-11-20T06:41:13.239285+0000","last_active":"2023-11-20T06:41:19.578685+0000","last_peered":"2023-11-20T06:41:19.578685+0000","last_clean":"2023-11-20T06:41:19.578685+0000","last_became_active":"2023-11-20T06:41:13.238954+0000","last_became_peered":"2023-11-20T06:41:13.238954+0000","last_unstale":"2023-11-20T06:41:19.578685+0000","last_undegraded":"2023-11-20T06:41:19.578685+0000","last_fullsized":"2023-11-20T06:41:19.578685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:47:01.655222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.584187+0000","last_change":"2023-11-20T06:41:14.261632+0000","last_active":"2023-11-20T06:41:19.584187+0000","last_peered":"2023-11-20T06:41:19.584187+0000","last_clean":"2023-11-20T06:41:19.584187+0000","last_became_active":"2023-11-20T06:41:14.261282+0000","last_became_peered":"2023-11-20T06:41:14.261282+0000","last_unstale":"2023-11-20T06:41:19.584187+0000","last_undegraded":"2023-11-20T06:41:19.584187+0000","last_fullsized":"2023-11-20T06:41:19.584187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:45:19.227613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.313252+0000","last_change":"2023-11-20T06:41:18.900797+0000","last_active":"2023-11-20T06:41:20.313252+0000","last_peered":"2023-11-20T06:41:20.313252+0000","last_clean":"2023-11-20T06:41:20.313252+0000","last_became_active":"2023-11-20T06:41:18.900345+0000","last_became_peered":"2023-11-20T06:41:18.900345+0000","last_unstale":"2023-11-20T06:41:20.313252+0000","last_undegraded":"2023-11-20T06:41:20.313252+0000","last_fullsized":"2023-11-20T06:41:20.313252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:58:31.638685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.584272+0000","last_change":"2023-11-20T06:41:13.239899+0000","last_active":"2023-11-20T06:41:19.584272+0000","last_peered":"2023-11-20T06:41:19.584272+0000","last_clean":"2023-11-20T06:41:19.584272+0000","last_became_active":"2023-11-20T06:41:13.239579+0000","last_became_peered":"2023-11-20T06:41:13.239579+0000","last_unstale":"2023-11-20T06:41:19.584272+0000","last_undegraded":"2023-11-20T06:41:19.584272+0000","last_fullsized":"2023-11-20T06:41:19.584272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:15:33.516237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578577+0000","last_change":"2023-11-20T06:41:14.262518+0000","last_active":"2023-11-20T06:41:19.578577+0000","last_peered":"2023-11-20T06:41:19.578577+0000","last_clean":"2023-11-20T06:41:19.578577+0000","last_became_active":"2023-11-20T06:41:14.260033+0000","last_became_peered":"2023-11-20T06:41:14.260033+0000","last_unstale":"2023-11-20T06:41:19.578577+0000","last_undegraded":"2023-11-20T06:41:19.578577+0000","last_fullsized":"2023-11-20T06:41:19.578577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:25.537288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.315596+0000","last_change":"2023-11-20T06:41:18.295727+0000","last_active":"2023-11-20T06:41:20.315596+0000","last_peered":"2023-11-20T06:41:20.315596+0000","last_clean":"2023-11-20T06:41:20.315596+0000","last_became_active":"2023-11-20T06:41:18.295305+0000","last_became_peered":"2023-11-20T06:41:18.295305+0000","last_unstale":"2023-11-20T06:41:20.315596+0000","last_undegraded":"2023-11-20T06:41:20.315596+0000","last_fullsized":"2023-11-20T06:41:20.315596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:45:54.333725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931461+0000","last_change":"2023-11-20T06:41:13.252932+0000","last_active":"2023-11-20T06:41:19.931461+0000","last_peered":"2023-11-20T06:41:19.931461+0000","last_clean":"2023-11-20T06:41:19.931461+0000","last_became_active":"2023-11-20T06:41:13.252621+0000","last_became_peered":"2023-11-20T06:41:13.252621+0000","last_unstale":"2023-11-20T06:41:19.931461+0000","last_undegraded":"2023-11-20T06:41:19.931461+0000","last_fullsized":"2023-11-20T06:41:19.931461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:20.467472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787860+0000","last_change":"2023-11-20T06:41:14.256127+0000","last_active":"2023-11-20T06:41:19.787860+0000","last_peered":"2023-11-20T06:41:19.787860+0000","last_clean":"2023-11-20T06:41:19.787860+0000","last_became_active":"2023-11-20T06:41:14.255819+0000","last_became_peered":"2023-11-20T06:41:14.255819+0000","last_unstale":"2023-11-20T06:41:19.787860+0000","last_undegraded":"2023-11-20T06:41:19.787860+0000","last_fullsized":"2023-11-20T06:41:19.787860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:45:19.227613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.315754+0000","last_change":"2023-11-20T06:41:18.301642+0000","last_active":"2023-11-20T06:41:20.315754+0000","last_peered":"2023-11-20T06:41:20.315754+0000","last_clean":"2023-11-20T06:41:20.315754+0000","last_became_active":"2023-11-20T06:41:18.301181+0000","last_became_peered":"2023-11-20T06:41:18.301181+0000","last_unstale":"2023-11-20T06:41:20.315754+0000","last_undegraded":"2023-11-20T06:41:20.315754+0000","last_fullsized":"2023-11-20T06:41:20.315754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:49.111361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931279+0000","last_change":"2023-11-20T06:41:13.254958+0000","last_active":"2023-11-20T06:41:19.931279+0000","last_peered":"2023-11-20T06:41:19.931279+0000","last_clean":"2023-11-20T06:41:19.931279+0000","last_became_active":"2023-11-20T06:41:13.254686+0000","last_became_peered":"2023-11-20T06:41:13.254686+0000","last_unstale":"2023-11-20T06:41:19.931279+0000","last_undegraded":"2023-11-20T06:41:19.931279+0000","last_fullsized":"2023-11-20T06:41:19.931279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:48:12.763247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.788059+0000","last_change":"2023-11-20T06:41:14.260659+0000","last_active":"2023-11-20T06:41:19.788059+0000","last_peered":"2023-11-20T06:41:19.788059+0000","last_clean":"2023-11-20T06:41:19.788059+0000","last_became_active":"2023-11-20T06:41:14.260375+0000","last_became_peered":"2023-11-20T06:41:14.260375+0000","last_unstale":"2023-11-20T06:41:19.788059+0000","last_undegraded":"2023-11-20T06:41:19.788059+0000","last_fullsized":"2023-11-20T06:41:19.788059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:20:01.827771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.315993+0000","last_change":"2023-11-20T06:41:18.289391+0000","last_active":"2023-11-20T06:41:20.315993+0000","last_peered":"2023-11-20T06:41:20.315993+0000","last_clean":"2023-11-20T06:41:20.315993+0000","last_became_active":"2023-11-20T06:41:18.288932+0000","last_became_peered":"2023-11-20T06:41:18.288932+0000","last_unstale":"2023-11-20T06:41:20.315993+0000","last_undegraded":"2023-11-20T06:41:20.315993+0000","last_fullsized":"2023-11-20T06:41:20.315993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:57:19.944479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314649+0000","last_change":"2023-11-20T06:41:14.270272+0000","last_active":"2023-11-20T06:41:19.314649+0000","last_peered":"2023-11-20T06:41:19.314649+0000","last_clean":"2023-11-20T06:41:19.314649+0000","last_became_active":"2023-11-20T06:41:14.269983+0000","last_became_peered":"2023-11-20T06:41:14.269983+0000","last_unstale":"2023-11-20T06:41:19.314649+0000","last_undegraded":"2023-11-20T06:41:19.314649+0000","last_fullsized":"2023-11-20T06:41:19.314649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:03:05.538623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931428+0000","last_change":"2023-11-20T06:41:13.252298+0000","last_active":"2023-11-20T06:41:19.931428+0000","last_peered":"2023-11-20T06:41:19.931428+0000","last_clean":"2023-11-20T06:41:19.931428+0000","last_became_active":"2023-11-20T06:41:13.252009+0000","last_became_peered":"2023-11-20T06:41:13.252009+0000","last_unstale":"2023-11-20T06:41:19.931428+0000","last_undegraded":"2023-11-20T06:41:19.931428+0000","last_fullsized":"2023-11-20T06:41:19.931428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:24.531185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.316395+0000","last_change":"2023-11-20T06:41:18.299248+0000","last_active":"2023-11-20T06:41:20.316395+0000","last_peered":"2023-11-20T06:41:20.316395+0000","last_clean":"2023-11-20T06:41:20.316395+0000","last_became_active":"2023-11-20T06:41:18.298935+0000","last_became_peered":"2023-11-20T06:41:18.298935+0000","last_unstale":"2023-11-20T06:41:20.316395+0000","last_undegraded":"2023-11-20T06:41:20.316395+0000","last_fullsized":"2023-11-20T06:41:20.316395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:00:16.728243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583729+0000","last_change":"2023-11-20T06:41:14.267951+0000","last_active":"2023-11-20T06:41:19.583729+0000","last_peered":"2023-11-20T06:41:19.583729+0000","last_clean":"2023-11-20T06:41:19.583729+0000","last_became_active":"2023-11-20T06:41:14.266970+0000","last_became_peered":"2023-11-20T06:41:14.266970+0000","last_unstale":"2023-11-20T06:41:19.583729+0000","last_undegraded":"2023-11-20T06:41:19.583729+0000","last_fullsized":"2023-11-20T06:41:19.583729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:35:30.568821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662297+0000","last_change":"2023-11-20T06:41:13.242711+0000","last_active":"2023-11-20T06:41:19.662297+0000","last_peered":"2023-11-20T06:41:19.662297+0000","last_clean":"2023-11-20T06:41:19.662297+0000","last_became_active":"2023-11-20T06:41:13.242342+0000","last_became_peered":"2023-11-20T06:41:13.242342+0000","last_unstale":"2023-11-20T06:41:19.662297+0000","last_undegraded":"2023-11-20T06:41:19.662297+0000","last_fullsized":"2023-11-20T06:41:19.662297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:47:01.655222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.317121+0000","last_change":"2023-11-20T06:41:18.301608+0000","last_active":"2023-11-20T06:41:20.317121+0000","last_peered":"2023-11-20T06:41:20.317121+0000","last_clean":"2023-11-20T06:41:20.317121+0000","last_became_active":"2023-11-20T06:41:18.301170+0000","last_became_peered":"2023-11-20T06:41:18.301170+0000","last_unstale":"2023-11-20T06:41:20.317121+0000","last_undegraded":"2023-11-20T06:41:20.317121+0000","last_fullsized":"2023-11-20T06:41:20.317121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:49:09.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583521+0000","last_change":"2023-11-20T06:41:14.269440+0000","last_active":"2023-11-20T06:41:19.583521+0000","last_peered":"2023-11-20T06:41:19.583521+0000","last_clean":"2023-11-20T06:41:19.583521+0000","last_became_active":"2023-11-20T06:41:14.269118+0000","last_became_peered":"2023-11-20T06:41:14.269118+0000","last_unstale":"2023-11-20T06:41:19.583521+0000","last_undegraded":"2023-11-20T06:41:19.583521+0000","last_fullsized":"2023-11-20T06:41:19.583521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:42:53.602834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.661987+0000","last_change":"2023-11-20T06:41:13.247696+0000","last_active":"2023-11-20T06:41:19.661987+0000","last_peered":"2023-11-20T06:41:19.661987+0000","last_clean":"2023-11-20T06:41:19.661987+0000","last_became_active":"2023-11-20T06:41:13.247416+0000","last_became_peered":"2023-11-20T06:41:13.247416+0000","last_unstale":"2023-11-20T06:41:19.661987+0000","last_undegraded":"2023-11-20T06:41:19.661987+0000","last_fullsized":"2023-11-20T06:41:19.661987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:36:43.073673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.743727+0000","last_change":"2023-11-20T06:41:18.897168+0000","last_active":"2023-11-20T06:41:20.743727+0000","last_peered":"2023-11-20T06:41:20.743727+0000","last_clean":"2023-11-20T06:41:20.743727+0000","last_became_active":"2023-11-20T06:41:18.896705+0000","last_became_peered":"2023-11-20T06:41:18.896705+0000","last_unstale":"2023-11-20T06:41:20.743727+0000","last_undegraded":"2023-11-20T06:41:20.743727+0000","last_fullsized":"2023-11-20T06:41:20.743727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:49:09.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.313398+0000","last_change":"2023-11-20T06:41:14.267054+0000","last_active":"2023-11-20T06:41:19.313398+0000","last_peered":"2023-11-20T06:41:19.313398+0000","last_clean":"2023-11-20T06:41:19.313398+0000","last_became_active":"2023-11-20T06:41:14.262005+0000","last_became_peered":"2023-11-20T06:41:14.262005+0000","last_unstale":"2023-11-20T06:41:19.313398+0000","last_undegraded":"2023-11-20T06:41:19.313398+0000","last_fullsized":"2023-11-20T06:41:19.313398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:52:49.697194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931076+0000","last_change":"2023-11-20T06:41:13.257483+0000","last_active":"2023-11-20T06:41:19.931076+0000","last_peered":"2023-11-20T06:41:19.931076+0000","last_clean":"2023-11-20T06:41:19.931076+0000","last_became_active":"2023-11-20T06:41:13.257122+0000","last_became_peered":"2023-11-20T06:41:13.257122+0000","last_unstale":"2023-11-20T06:41:19.931076+0000","last_undegraded":"2023-11-20T06:41:19.931076+0000","last_fullsized":"2023-11-20T06:41:19.931076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:15:33.516237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.317008+0000","last_change":"2023-11-20T06:41:18.302677+0000","last_active":"2023-11-20T06:41:20.317008+0000","last_peered":"2023-11-20T06:41:20.317008+0000","last_clean":"2023-11-20T06:41:20.317008+0000","last_became_active":"2023-11-20T06:41:18.301938+0000","last_became_peered":"2023-11-20T06:41:18.301938+0000","last_unstale":"2023-11-20T06:41:20.317008+0000","last_undegraded":"2023-11-20T06:41:20.317008+0000","last_fullsized":"2023-11-20T06:41:20.317008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:25:06.683699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578465+0000","last_change":"2023-11-20T06:41:14.264039+0000","last_active":"2023-11-20T06:41:19.578465+0000","last_peered":"2023-11-20T06:41:19.578465+0000","last_clean":"2023-11-20T06:41:19.578465+0000","last_became_active":"2023-11-20T06:41:14.262551+0000","last_became_peered":"2023-11-20T06:41:14.262551+0000","last_unstale":"2023-11-20T06:41:19.578465+0000","last_undegraded":"2023-11-20T06:41:19.578465+0000","last_fullsized":"2023-11-20T06:41:19.578465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:08:41.021374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315807+0000","last_change":"2023-11-20T06:41:13.251311+0000","last_active":"2023-11-20T06:41:19.315807+0000","last_peered":"2023-11-20T06:41:19.315807+0000","last_clean":"2023-11-20T06:41:19.315807+0000","last_became_active":"2023-11-20T06:41:13.251022+0000","last_became_peered":"2023-11-20T06:41:13.251022+0000","last_unstale":"2023-11-20T06:41:19.315807+0000","last_undegraded":"2023-11-20T06:41:19.315807+0000","last_fullsized":"2023-11-20T06:41:19.315807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:20.467472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.316272+0000","last_change":"2023-11-20T06:41:18.899620+0000","last_active":"2023-11-20T06:41:20.316272+0000","last_peered":"2023-11-20T06:41:20.316272+0000","last_clean":"2023-11-20T06:41:20.316272+0000","last_became_active":"2023-11-20T06:41:18.899201+0000","last_became_peered":"2023-11-20T06:41:18.899201+0000","last_unstale":"2023-11-20T06:41:20.316272+0000","last_undegraded":"2023-11-20T06:41:20.316272+0000","last_fullsized":"2023-11-20T06:41:20.316272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:16:52.140361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.584296+0000","last_change":"2023-11-20T06:41:14.270250+0000","last_active":"2023-11-20T06:41:19.584296+0000","last_peered":"2023-11-20T06:41:19.584296+0000","last_clean":"2023-11-20T06:41:19.584296+0000","last_became_active":"2023-11-20T06:41:14.269658+0000","last_became_peered":"2023-11-20T06:41:14.269658+0000","last_unstale":"2023-11-20T06:41:19.584296+0000","last_undegraded":"2023-11-20T06:41:19.584296+0000","last_fullsized":"2023-11-20T06:41:19.584296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:27:59.872035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.663105+0000","last_change":"2023-11-20T06:41:13.241077+0000","last_active":"2023-11-20T06:41:19.663105+0000","last_peered":"2023-11-20T06:41:19.663105+0000","last_clean":"2023-11-20T06:41:19.663105+0000","last_became_active":"2023-11-20T06:41:13.240478+0000","last_became_peered":"2023-11-20T06:41:13.240478+0000","last_unstale":"2023-11-20T06:41:19.663105+0000","last_undegraded":"2023-11-20T06:41:19.663105+0000","last_fullsized":"2023-11-20T06:41:19.663105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:16:12.804737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.313191+0000","last_change":"2023-11-20T06:41:18.899891+0000","last_active":"2023-11-20T06:41:20.313191+0000","last_peered":"2023-11-20T06:41:20.313191+0000","last_clean":"2023-11-20T06:41:20.313191+0000","last_became_active":"2023-11-20T06:41:18.899023+0000","last_became_peered":"2023-11-20T06:41:18.899023+0000","last_unstale":"2023-11-20T06:41:20.313191+0000","last_undegraded":"2023-11-20T06:41:20.313191+0000","last_fullsized":"2023-11-20T06:41:20.313191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:37:56.697790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662455+0000","last_change":"2023-11-20T06:41:14.257593+0000","last_active":"2023-11-20T06:41:19.662455+0000","last_peered":"2023-11-20T06:41:19.662455+0000","last_clean":"2023-11-20T06:41:19.662455+0000","last_became_active":"2023-11-20T06:41:14.257296+0000","last_became_peered":"2023-11-20T06:41:14.257296+0000","last_unstale":"2023-11-20T06:41:19.662455+0000","last_undegraded":"2023-11-20T06:41:19.662455+0000","last_fullsized":"2023-11-20T06:41:19.662455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:25.537288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931571+0000","last_change":"2023-11-20T06:41:13.253474+0000","last_active":"2023-11-20T06:41:19.931571+0000","last_peered":"2023-11-20T06:41:19.931571+0000","last_clean":"2023-11-20T06:41:19.931571+0000","last_became_active":"2023-11-20T06:41:13.253199+0000","last_became_peered":"2023-11-20T06:41:13.253199+0000","last_unstale":"2023-11-20T06:41:19.931571+0000","last_undegraded":"2023-11-20T06:41:19.931571+0000","last_fullsized":"2023-11-20T06:41:19.931571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:36:43.073673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.679008+0000","last_change":"2023-11-20T06:41:18.897668+0000","last_active":"2023-11-20T06:41:20.679008+0000","last_peered":"2023-11-20T06:41:20.679008+0000","last_clean":"2023-11-20T06:41:20.679008+0000","last_became_active":"2023-11-20T06:41:18.897265+0000","last_became_peered":"2023-11-20T06:41:18.897265+0000","last_unstale":"2023-11-20T06:41:20.679008+0000","last_undegraded":"2023-11-20T06:41:20.679008+0000","last_fullsized":"2023-11-20T06:41:20.679008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:00:16.728243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.788104+0000","last_change":"2023-11-20T06:41:14.277073+0000","last_active":"2023-11-20T06:41:19.788104+0000","last_peered":"2023-11-20T06:41:19.788104+0000","last_clean":"2023-11-20T06:41:19.788104+0000","last_became_active":"2023-11-20T06:41:14.276783+0000","last_became_peered":"2023-11-20T06:41:14.276783+0000","last_unstale":"2023-11-20T06:41:19.788104+0000","last_undegraded":"2023-11-20T06:41:19.788104+0000","last_fullsized":"2023-11-20T06:41:19.788104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:07:38.977327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662498+0000","last_change":"2023-11-20T06:41:13.244589+0000","last_active":"2023-11-20T06:41:19.662498+0000","last_peered":"2023-11-20T06:41:19.662498+0000","last_clean":"2023-11-20T06:41:19.662498+0000","last_became_active":"2023-11-20T06:41:13.244242+0000","last_became_peered":"2023-11-20T06:41:13.244242+0000","last_unstale":"2023-11-20T06:41:19.662498+0000","last_undegraded":"2023-11-20T06:41:19.662498+0000","last_fullsized":"2023-11-20T06:41:19.662498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:01:37.302430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.743291+0000","last_change":"2023-11-20T06:41:18.302053+0000","last_active":"2023-11-20T06:41:20.743291+0000","last_peered":"2023-11-20T06:41:20.743291+0000","last_clean":"2023-11-20T06:41:20.743291+0000","last_became_active":"2023-11-20T06:41:18.301615+0000","last_became_peered":"2023-11-20T06:41:18.301615+0000","last_unstale":"2023-11-20T06:41:20.743291+0000","last_undegraded":"2023-11-20T06:41:20.743291+0000","last_fullsized":"2023-11-20T06:41:20.743291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:16:52.140361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314736+0000","last_change":"2023-11-20T06:41:14.268552+0000","last_active":"2023-11-20T06:41:19.314736+0000","last_peered":"2023-11-20T06:41:19.314736+0000","last_clean":"2023-11-20T06:41:19.314736+0000","last_became_active":"2023-11-20T06:41:14.268201+0000","last_became_peered":"2023-11-20T06:41:14.268201+0000","last_unstale":"2023-11-20T06:41:19.314736+0000","last_undegraded":"2023-11-20T06:41:19.314736+0000","last_fullsized":"2023-11-20T06:41:19.314736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:13:30.790091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787765+0000","last_change":"2023-11-20T06:41:13.249876+0000","last_active":"2023-11-20T06:41:19.787765+0000","last_peered":"2023-11-20T06:41:19.787765+0000","last_clean":"2023-11-20T06:41:19.787765+0000","last_became_active":"2023-11-20T06:41:13.249316+0000","last_became_peered":"2023-11-20T06:41:13.249316+0000","last_unstale":"2023-11-20T06:41:19.787765+0000","last_undegraded":"2023-11-20T06:41:19.787765+0000","last_fullsized":"2023-11-20T06:41:19.787765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:20.467472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.743432+0000","last_change":"2023-11-20T06:41:18.298035+0000","last_active":"2023-11-20T06:41:20.743432+0000","last_peered":"2023-11-20T06:41:20.743432+0000","last_clean":"2023-11-20T06:41:20.743432+0000","last_became_active":"2023-11-20T06:41:18.297674+0000","last_became_peered":"2023-11-20T06:41:18.297674+0000","last_unstale":"2023-11-20T06:41:20.743432+0000","last_undegraded":"2023-11-20T06:41:20.743432+0000","last_fullsized":"2023-11-20T06:41:20.743432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:00:16.728243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662052+0000","last_change":"2023-11-20T06:41:14.258777+0000","last_active":"2023-11-20T06:41:19.662052+0000","last_peered":"2023-11-20T06:41:19.662052+0000","last_clean":"2023-11-20T06:41:19.662052+0000","last_became_active":"2023-11-20T06:41:14.258430+0000","last_became_peered":"2023-11-20T06:41:14.258430+0000","last_unstale":"2023-11-20T06:41:19.662052+0000","last_undegraded":"2023-11-20T06:41:19.662052+0000","last_fullsized":"2023-11-20T06:41:19.662052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:42:53.602834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.309513+0000","last_change":"2023-11-20T06:41:13.226120+0000","last_active":"2023-11-20T06:41:19.309513+0000","last_peered":"2023-11-20T06:41:19.309513+0000","last_clean":"2023-11-20T06:41:19.309513+0000","last_became_active":"2023-11-20T06:41:13.225814+0000","last_became_peered":"2023-11-20T06:41:13.225814+0000","last_unstale":"2023-11-20T06:41:19.309513+0000","last_undegraded":"2023-11-20T06:41:19.309513+0000","last_fullsized":"2023-11-20T06:41:19.309513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:54:25.014221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.743763+0000","last_change":"2023-11-20T06:41:18.294432+0000","last_active":"2023-11-20T06:41:20.743763+0000","last_peered":"2023-11-20T06:41:20.743763+0000","last_clean":"2023-11-20T06:41:20.743763+0000","last_became_active":"2023-11-20T06:41:18.293345+0000","last_became_peered":"2023-11-20T06:41:18.293345+0000","last_unstale":"2023-11-20T06:41:20.743763+0000","last_undegraded":"2023-11-20T06:41:20.743763+0000","last_fullsized":"2023-11-20T06:41:20.743763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:13:29.540284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578235+0000","last_change":"2023-11-20T06:41:14.250513+0000","last_active":"2023-11-20T06:41:19.578235+0000","last_peered":"2023-11-20T06:41:19.578235+0000","last_clean":"2023-11-20T06:41:19.578235+0000","last_became_active":"2023-11-20T06:41:14.250195+0000","last_became_peered":"2023-11-20T06:41:14.250195+0000","last_unstale":"2023-11-20T06:41:19.578235+0000","last_undegraded":"2023-11-20T06:41:19.578235+0000","last_fullsized":"2023-11-20T06:41:19.578235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:01:38.308533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931054+0000","last_change":"2023-11-20T06:41:13.255728+0000","last_active":"2023-11-20T06:41:19.931054+0000","last_peered":"2023-11-20T06:41:19.931054+0000","last_clean":"2023-11-20T06:41:19.931054+0000","last_became_active":"2023-11-20T06:41:13.255440+0000","last_became_peered":"2023-11-20T06:41:13.255440+0000","last_unstale":"2023-11-20T06:41:19.931054+0000","last_undegraded":"2023-11-20T06:41:19.931054+0000","last_fullsized":"2023-11-20T06:41:19.931054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:27:01.563513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.679449+0000","last_change":"2023-11-20T06:41:18.900803+0000","last_active":"2023-11-20T06:41:20.679449+0000","last_peered":"2023-11-20T06:41:20.679449+0000","last_clean":"2023-11-20T06:41:20.679449+0000","last_became_active":"2023-11-20T06:41:18.900347+0000","last_became_peered":"2023-11-20T06:41:18.900347+0000","last_unstale":"2023-11-20T06:41:20.679449+0000","last_undegraded":"2023-11-20T06:41:20.679449+0000","last_fullsized":"2023-11-20T06:41:20.679449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:32:07.244747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583650+0000","last_change":"2023-11-20T06:41:14.265573+0000","last_active":"2023-11-20T06:41:19.583650+0000","last_peered":"2023-11-20T06:41:19.583650+0000","last_clean":"2023-11-20T06:41:19.583650+0000","last_became_active":"2023-11-20T06:41:14.260035+0000","last_became_peered":"2023-11-20T06:41:14.260035+0000","last_unstale":"2023-11-20T06:41:19.583650+0000","last_undegraded":"2023-11-20T06:41:19.583650+0000","last_fullsized":"2023-11-20T06:41:19.583650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:25.537288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787737+0000","last_change":"2023-11-20T06:41:13.237196+0000","last_active":"2023-11-20T06:41:19.787737+0000","last_peered":"2023-11-20T06:41:19.787737+0000","last_clean":"2023-11-20T06:41:19.787737+0000","last_became_active":"2023-11-20T06:41:13.236793+0000","last_became_peered":"2023-11-20T06:41:13.236793+0000","last_unstale":"2023-11-20T06:41:19.787737+0000","last_undegraded":"2023-11-20T06:41:19.787737+0000","last_fullsized":"2023-11-20T06:41:19.787737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:44:08.985984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.930761+0000","last_change":"2023-11-20T06:41:03.783345+0000","last_active":"2023-11-20T06:41:19.930761+0000","last_peered":"2023-11-20T06:41:19.930761+0000","last_clean":"2023-11-20T06:41:19.930761+0000","last_became_active":"2023-11-20T06:41:03.782257+0000","last_became_peered":"2023-11-20T06:41:03.782257+0000","last_unstale":"2023-11-20T06:41:19.930761+0000","last_undegraded":"2023-11-20T06:41:19.930761+0000","last_fullsized":"2023-11-20T06:41:19.930761+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:01.979090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:01.979090+0000","last_clean_scrub_stamp":"2023-11-20T06:41:01.979090+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:20:41.084382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.746476+0000","last_change":"2023-11-20T06:41:18.903133+0000","last_active":"2023-11-20T06:41:20.746476+0000","last_peered":"2023-11-20T06:41:20.746476+0000","last_clean":"2023-11-20T06:41:20.746476+0000","last_became_active":"2023-11-20T06:41:18.902697+0000","last_became_peered":"2023-11-20T06:41:18.902697+0000","last_unstale":"2023-11-20T06:41:20.746476+0000","last_undegraded":"2023-11-20T06:41:20.746476+0000","last_fullsized":"2023-11-20T06:41:20.746476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:57:19.944479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931329+0000","last_change":"2023-11-20T06:41:14.263973+0000","last_active":"2023-11-20T06:41:19.931329+0000","last_peered":"2023-11-20T06:41:19.931329+0000","last_clean":"2023-11-20T06:41:19.931329+0000","last_became_active":"2023-11-20T06:41:14.263492+0000","last_became_peered":"2023-11-20T06:41:14.263492+0000","last_unstale":"2023-11-20T06:41:19.931329+0000","last_undegraded":"2023-11-20T06:41:19.931329+0000","last_fullsized":"2023-11-20T06:41:19.931329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:07:38.977327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.310124+0000","last_change":"2023-11-20T06:41:13.233779+0000","last_active":"2023-11-20T06:41:19.310124+0000","last_peered":"2023-11-20T06:41:19.310124+0000","last_clean":"2023-11-20T06:41:19.310124+0000","last_became_active":"2023-11-20T06:41:13.233388+0000","last_became_peered":"2023-11-20T06:41:13.233388+0000","last_unstale":"2023-11-20T06:41:19.310124+0000","last_undegraded":"2023-11-20T06:41:19.310124+0000","last_fullsized":"2023-11-20T06:41:19.310124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:52:48.691091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.746246+0000","last_change":"2023-11-20T06:41:18.899818+0000","last_active":"2023-11-20T06:41:20.746246+0000","last_peered":"2023-11-20T06:41:20.746246+0000","last_clean":"2023-11-20T06:41:20.746246+0000","last_became_active":"2023-11-20T06:41:18.899254+0000","last_became_peered":"2023-11-20T06:41:18.899254+0000","last_unstale":"2023-11-20T06:41:20.746246+0000","last_undegraded":"2023-11-20T06:41:20.746246+0000","last_fullsized":"2023-11-20T06:41:20.746246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:49:36.631359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787891+0000","last_change":"2023-11-20T06:41:14.277327+0000","last_active":"2023-11-20T06:41:19.787891+0000","last_peered":"2023-11-20T06:41:19.787891+0000","last_clean":"2023-11-20T06:41:19.787891+0000","last_became_active":"2023-11-20T06:41:14.276750+0000","last_became_peered":"2023-11-20T06:41:14.276750+0000","last_unstale":"2023-11-20T06:41:19.787891+0000","last_undegraded":"2023-11-20T06:41:19.787891+0000","last_fullsized":"2023-11-20T06:41:19.787891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:07:43.904895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662857+0000","last_change":"2023-11-20T06:41:13.237042+0000","last_active":"2023-11-20T06:41:19.662857+0000","last_peered":"2023-11-20T06:41:19.662857+0000","last_clean":"2023-11-20T06:41:19.662857+0000","last_became_active":"2023-11-20T06:41:13.236730+0000","last_became_peered":"2023-11-20T06:41:13.236730+0000","last_unstale":"2023-11-20T06:41:19.662857+0000","last_undegraded":"2023-11-20T06:41:19.662857+0000","last_fullsized":"2023-11-20T06:41:19.662857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:20.467472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.679071+0000","last_change":"2023-11-20T06:41:18.300034+0000","last_active":"2023-11-20T06:41:20.679071+0000","last_peered":"2023-11-20T06:41:20.679071+0000","last_clean":"2023-11-20T06:41:20.679071+0000","last_became_active":"2023-11-20T06:41:18.299636+0000","last_became_peered":"2023-11-20T06:41:18.299636+0000","last_unstale":"2023-11-20T06:41:20.679071+0000","last_undegraded":"2023-11-20T06:41:20.679071+0000","last_fullsized":"2023-11-20T06:41:20.679071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:25:06.683699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931760+0000","last_change":"2023-11-20T06:41:14.273791+0000","last_active":"2023-11-20T06:41:19.931760+0000","last_peered":"2023-11-20T06:41:19.931760+0000","last_clean":"2023-11-20T06:41:19.931760+0000","last_became_active":"2023-11-20T06:41:14.273507+0000","last_became_peered":"2023-11-20T06:41:14.273507+0000","last_unstale":"2023-11-20T06:41:19.931760+0000","last_undegraded":"2023-11-20T06:41:19.931760+0000","last_fullsized":"2023-11-20T06:41:19.931760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:00:12.676212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.310448+0000","last_change":"2023-11-20T06:41:13.243381+0000","last_active":"2023-11-20T06:41:19.310448+0000","last_peered":"2023-11-20T06:41:19.310448+0000","last_clean":"2023-11-20T06:41:19.310448+0000","last_became_active":"2023-11-20T06:41:13.242286+0000","last_became_peered":"2023-11-20T06:41:13.242286+0000","last_unstale":"2023-11-20T06:41:19.310448+0000","last_undegraded":"2023-11-20T06:41:19.310448+0000","last_fullsized":"2023-11-20T06:41:19.310448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:13:29.783988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.315374+0000","last_change":"2023-11-20T06:41:18.900675+0000","last_active":"2023-11-20T06:41:20.315374+0000","last_peered":"2023-11-20T06:41:20.315374+0000","last_clean":"2023-11-20T06:41:20.315374+0000","last_became_active":"2023-11-20T06:41:18.899705+0000","last_became_peered":"2023-11-20T06:41:18.899705+0000","last_unstale":"2023-11-20T06:41:20.315374+0000","last_undegraded":"2023-11-20T06:41:20.315374+0000","last_fullsized":"2023-11-20T06:41:20.315374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:49:09.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931619+0000","last_change":"2023-11-20T06:41:14.261198+0000","last_active":"2023-11-20T06:41:19.931619+0000","last_peered":"2023-11-20T06:41:19.931619+0000","last_clean":"2023-11-20T06:41:19.931619+0000","last_became_active":"2023-11-20T06:41:14.260837+0000","last_became_peered":"2023-11-20T06:41:14.260837+0000","last_unstale":"2023-11-20T06:41:19.931619+0000","last_undegraded":"2023-11-20T06:41:19.931619+0000","last_fullsized":"2023-11-20T06:41:19.931619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:57:15.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314546+0000","last_change":"2023-11-20T06:41:13.234116+0000","last_active":"2023-11-20T06:41:19.314546+0000","last_peered":"2023-11-20T06:41:19.314546+0000","last_clean":"2023-11-20T06:41:19.314546+0000","last_became_active":"2023-11-20T06:41:13.233691+0000","last_became_peered":"2023-11-20T06:41:13.233691+0000","last_unstale":"2023-11-20T06:41:19.314546+0000","last_undegraded":"2023-11-20T06:41:19.314546+0000","last_fullsized":"2023-11-20T06:41:19.314546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:44:08.985984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.315962+0000","last_change":"2023-11-20T06:41:18.295800+0000","last_active":"2023-11-20T06:41:20.315962+0000","last_peered":"2023-11-20T06:41:20.315962+0000","last_clean":"2023-11-20T06:41:20.315962+0000","last_became_active":"2023-11-20T06:41:18.295366+0000","last_became_peered":"2023-11-20T06:41:18.295366+0000","last_unstale":"2023-11-20T06:41:20.315962+0000","last_undegraded":"2023-11-20T06:41:20.315962+0000","last_fullsized":"2023-11-20T06:41:20.315962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:49:36.631359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931202+0000","last_change":"2023-11-20T06:41:14.274139+0000","last_active":"2023-11-20T06:41:19.931202+0000","last_peered":"2023-11-20T06:41:19.931202+0000","last_clean":"2023-11-20T06:41:19.931202+0000","last_became_active":"2023-11-20T06:41:14.273838+0000","last_became_peered":"2023-11-20T06:41:14.273838+0000","last_unstale":"2023-11-20T06:41:19.931202+0000","last_undegraded":"2023-11-20T06:41:19.931202+0000","last_fullsized":"2023-11-20T06:41:19.931202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:27:59.872035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.309437+0000","last_change":"2023-11-20T06:41:13.238251+0000","last_active":"2023-11-20T06:41:19.309437+0000","last_peered":"2023-11-20T06:41:19.309437+0000","last_clean":"2023-11-20T06:41:19.309437+0000","last_became_active":"2023-11-20T06:41:13.237920+0000","last_became_peered":"2023-11-20T06:41:13.237920+0000","last_unstale":"2023-11-20T06:41:19.309437+0000","last_undegraded":"2023-11-20T06:41:19.309437+0000","last_fullsized":"2023-11-20T06:41:19.309437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:44:08.985984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.679312+0000","last_change":"2023-11-20T06:41:18.292764+0000","last_active":"2023-11-20T06:41:20.679312+0000","last_peered":"2023-11-20T06:41:20.679312+0000","last_clean":"2023-11-20T06:41:20.679312+0000","last_became_active":"2023-11-20T06:41:18.292352+0000","last_became_peered":"2023-11-20T06:41:18.292352+0000","last_unstale":"2023-11-20T06:41:20.679312+0000","last_undegraded":"2023-11-20T06:41:20.679312+0000","last_fullsized":"2023-11-20T06:41:20.679312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:13:29.540284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314386+0000","last_change":"2023-11-20T06:41:14.273982+0000","last_active":"2023-11-20T06:41:19.314386+0000","last_peered":"2023-11-20T06:41:19.314386+0000","last_clean":"2023-11-20T06:41:19.314386+0000","last_became_active":"2023-11-20T06:41:14.273301+0000","last_became_peered":"2023-11-20T06:41:14.273301+0000","last_unstale":"2023-11-20T06:41:19.314386+0000","last_undegraded":"2023-11-20T06:41:19.314386+0000","last_fullsized":"2023-11-20T06:41:19.314386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:06:44.444162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314956+0000","last_change":"2023-11-20T06:41:13.246748+0000","last_active":"2023-11-20T06:41:19.314956+0000","last_peered":"2023-11-20T06:41:19.314956+0000","last_clean":"2023-11-20T06:41:19.314956+0000","last_became_active":"2023-11-20T06:41:13.246302+0000","last_became_peered":"2023-11-20T06:41:13.246302+0000","last_unstale":"2023-11-20T06:41:19.314956+0000","last_undegraded":"2023-11-20T06:41:19.314956+0000","last_fullsized":"2023-11-20T06:41:19.314956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:27:01.563513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.314405+0000","last_change":"2023-11-20T06:41:18.897842+0000","last_active":"2023-11-20T06:41:20.314405+0000","last_peered":"2023-11-20T06:41:20.314405+0000","last_clean":"2023-11-20T06:41:20.314405+0000","last_became_active":"2023-11-20T06:41:18.896898+0000","last_became_peered":"2023-11-20T06:41:18.896898+0000","last_unstale":"2023-11-20T06:41:20.314405+0000","last_undegraded":"2023-11-20T06:41:20.314405+0000","last_fullsized":"2023-11-20T06:41:20.314405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:18:24.107898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931464+0000","last_change":"2023-11-20T06:41:14.274131+0000","last_active":"2023-11-20T06:41:19.931464+0000","last_peered":"2023-11-20T06:41:19.931464+0000","last_clean":"2023-11-20T06:41:19.931464+0000","last_became_active":"2023-11-20T06:41:14.273690+0000","last_became_peered":"2023-11-20T06:41:14.273690+0000","last_unstale":"2023-11-20T06:41:19.931464+0000","last_undegraded":"2023-11-20T06:41:19.931464+0000","last_fullsized":"2023-11-20T06:41:19.931464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:49:32.579328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787724+0000","last_change":"2023-11-20T06:41:13.257423+0000","last_active":"2023-11-20T06:41:19.787724+0000","last_peered":"2023-11-20T06:41:19.787724+0000","last_clean":"2023-11-20T06:41:19.787724+0000","last_became_active":"2023-11-20T06:41:13.256548+0000","last_became_peered":"2023-11-20T06:41:13.256548+0000","last_unstale":"2023-11-20T06:41:19.787724+0000","last_undegraded":"2023-11-20T06:41:19.787724+0000","last_fullsized":"2023-11-20T06:41:19.787724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:56:08.376468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.313587+0000","last_change":"2023-11-20T06:41:18.898144+0000","last_active":"2023-11-20T06:41:20.313587+0000","last_peered":"2023-11-20T06:41:20.313587+0000","last_clean":"2023-11-20T06:41:20.313587+0000","last_became_active":"2023-11-20T06:41:18.897259+0000","last_became_peered":"2023-11-20T06:41:18.897259+0000","last_unstale":"2023-11-20T06:41:20.313587+0000","last_undegraded":"2023-11-20T06:41:20.313587+0000","last_fullsized":"2023-11-20T06:41:20.313587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:21:39.903978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578463+0000","last_change":"2023-11-20T06:41:14.265376+0000","last_active":"2023-11-20T06:41:19.578463+0000","last_peered":"2023-11-20T06:41:19.578463+0000","last_clean":"2023-11-20T06:41:19.578463+0000","last_became_active":"2023-11-20T06:41:14.264937+0000","last_became_peered":"2023-11-20T06:41:14.264937+0000","last_unstale":"2023-11-20T06:41:19.578463+0000","last_undegraded":"2023-11-20T06:41:19.578463+0000","last_fullsized":"2023-11-20T06:41:19.578463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:21.473575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578629+0000","last_change":"2023-11-20T06:41:13.239163+0000","last_active":"2023-11-20T06:41:19.578629+0000","last_peered":"2023-11-20T06:41:19.578629+0000","last_clean":"2023-11-20T06:41:19.578629+0000","last_became_active":"2023-11-20T06:41:13.238828+0000","last_became_peered":"2023-11-20T06:41:13.238828+0000","last_unstale":"2023-11-20T06:41:19.578629+0000","last_undegraded":"2023-11-20T06:41:19.578629+0000","last_fullsized":"2023-11-20T06:41:19.578629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:13:29.783988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.317093+0000","last_change":"2023-11-20T06:41:18.899795+0000","last_active":"2023-11-20T06:41:20.317093+0000","last_peered":"2023-11-20T06:41:20.317093+0000","last_clean":"2023-11-20T06:41:20.317093+0000","last_became_active":"2023-11-20T06:41:18.899270+0000","last_became_peered":"2023-11-20T06:41:18.899270+0000","last_unstale":"2023-11-20T06:41:20.317093+0000","last_undegraded":"2023-11-20T06:41:20.317093+0000","last_fullsized":"2023-11-20T06:41:20.317093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:13:29.540284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931226+0000","last_change":"2023-11-20T06:41:14.275627+0000","last_active":"2023-11-20T06:41:19.931226+0000","last_peered":"2023-11-20T06:41:19.931226+0000","last_clean":"2023-11-20T06:41:19.931226+0000","last_became_active":"2023-11-20T06:41:14.272890+0000","last_became_peered":"2023-11-20T06:41:14.272890+0000","last_unstale":"2023-11-20T06:41:19.931226+0000","last_undegraded":"2023-11-20T06:41:19.931226+0000","last_fullsized":"2023-11-20T06:41:19.931226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:20:01.827771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:29.363554+0000","last_change":"2023-11-20T06:41:13.245874+0000","last_active":"2023-11-20T06:41:29.363554+0000","last_peered":"2023-11-20T06:41:29.363554+0000","last_clean":"2023-11-20T06:41:29.363554+0000","last_became_active":"2023-11-20T06:41:13.245454+0000","last_became_peered":"2023-11-20T06:41:13.245454+0000","last_unstale":"2023-11-20T06:41:29.363554+0000","last_undegraded":"2023-11-20T06:41:29.363554+0000","last_fullsized":"2023-11-20T06:41:29.363554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:56:08.376468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.743578+0000","last_change":"2023-11-20T06:41:18.299146+0000","last_active":"2023-11-20T06:41:20.743578+0000","last_peered":"2023-11-20T06:41:20.743578+0000","last_clean":"2023-11-20T06:41:20.743578+0000","last_became_active":"2023-11-20T06:41:18.298722+0000","last_became_peered":"2023-11-20T06:41:18.298722+0000","last_unstale":"2023-11-20T06:41:20.743578+0000","last_undegraded":"2023-11-20T06:41:20.743578+0000","last_fullsized":"2023-11-20T06:41:20.743578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:25:06.683699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315269+0000","last_change":"2023-11-20T06:41:14.263229+0000","last_active":"2023-11-20T06:41:19.315269+0000","last_peered":"2023-11-20T06:41:19.315269+0000","last_clean":"2023-11-20T06:41:19.315269+0000","last_became_active":"2023-11-20T06:41:14.262970+0000","last_became_peered":"2023-11-20T06:41:14.262970+0000","last_unstale":"2023-11-20T06:41:19.315269+0000","last_undegraded":"2023-11-20T06:41:19.315269+0000","last_fullsized":"2023-11-20T06:41:19.315269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:15:34.522340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662861+0000","last_change":"2023-11-20T06:41:13.238315+0000","last_active":"2023-11-20T06:41:19.662861+0000","last_peered":"2023-11-20T06:41:19.662861+0000","last_clean":"2023-11-20T06:41:19.662861+0000","last_became_active":"2023-11-20T06:41:13.237159+0000","last_became_peered":"2023-11-20T06:41:13.237159+0000","last_unstale":"2023-11-20T06:41:19.662861+0000","last_undegraded":"2023-11-20T06:41:19.662861+0000","last_fullsized":"2023-11-20T06:41:19.662861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:56:08.376468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.316149+0000","last_change":"2023-11-20T06:41:18.301654+0000","last_active":"2023-11-20T06:41:20.316149+0000","last_peered":"2023-11-20T06:41:20.316149+0000","last_clean":"2023-11-20T06:41:20.316149+0000","last_became_active":"2023-11-20T06:41:18.301243+0000","last_became_peered":"2023-11-20T06:41:18.301243+0000","last_unstale":"2023-11-20T06:41:20.316149+0000","last_undegraded":"2023-11-20T06:41:20.316149+0000","last_fullsized":"2023-11-20T06:41:20.316149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:13:30.194807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578630+0000","last_change":"2023-11-20T06:41:14.251212+0000","last_active":"2023-11-20T06:41:19.578630+0000","last_peered":"2023-11-20T06:41:19.578630+0000","last_clean":"2023-11-20T06:41:19.578630+0000","last_became_active":"2023-11-20T06:41:14.250584+0000","last_became_peered":"2023-11-20T06:41:14.250584+0000","last_unstale":"2023-11-20T06:41:19.578630+0000","last_undegraded":"2023-11-20T06:41:19.578630+0000","last_fullsized":"2023-11-20T06:41:19.578630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:35:30.568821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.788069+0000","last_change":"2023-11-20T06:41:13.255026+0000","last_active":"2023-11-20T06:41:19.788069+0000","last_peered":"2023-11-20T06:41:19.788069+0000","last_clean":"2023-11-20T06:41:19.788069+0000","last_became_active":"2023-11-20T06:41:13.254057+0000","last_became_peered":"2023-11-20T06:41:13.254057+0000","last_unstale":"2023-11-20T06:41:19.788069+0000","last_undegraded":"2023-11-20T06:41:19.788069+0000","last_fullsized":"2023-11-20T06:41:19.788069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:01:37.302430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.313428+0000","last_change":"2023-11-20T06:41:18.295335+0000","last_active":"2023-11-20T06:41:20.313428+0000","last_peered":"2023-11-20T06:41:20.313428+0000","last_clean":"2023-11-20T06:41:20.313428+0000","last_became_active":"2023-11-20T06:41:18.294740+0000","last_became_peered":"2023-11-20T06:41:18.294740+0000","last_unstale":"2023-11-20T06:41:20.313428+0000","last_undegraded":"2023-11-20T06:41:20.313428+0000","last_fullsized":"2023-11-20T06:41:20.313428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:52:52.872039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.788050+0000","last_change":"2023-11-20T06:41:14.276548+0000","last_active":"2023-11-20T06:41:19.788050+0000","last_peered":"2023-11-20T06:41:19.788050+0000","last_clean":"2023-11-20T06:41:19.788050+0000","last_became_active":"2023-11-20T06:41:14.261629+0000","last_became_peered":"2023-11-20T06:41:14.261629+0000","last_unstale":"2023-11-20T06:41:19.788050+0000","last_undegraded":"2023-11-20T06:41:19.788050+0000","last_fullsized":"2023-11-20T06:41:19.788050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:49:32.579328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315706+0000","last_change":"2023-11-20T06:41:13.258736+0000","last_active":"2023-11-20T06:41:19.315706+0000","last_peered":"2023-11-20T06:41:19.315706+0000","last_clean":"2023-11-20T06:41:19.315706+0000","last_became_active":"2023-11-20T06:41:13.258459+0000","last_became_peered":"2023-11-20T06:41:13.258459+0000","last_unstale":"2023-11-20T06:41:19.315706+0000","last_undegraded":"2023-11-20T06:41:19.315706+0000","last_fullsized":"2023-11-20T06:41:19.315706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:16:12.804737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.313326+0000","last_change":"2023-11-20T06:41:18.897111+0000","last_active":"2023-11-20T06:41:20.313326+0000","last_peered":"2023-11-20T06:41:20.313326+0000","last_clean":"2023-11-20T06:41:20.313326+0000","last_became_active":"2023-11-20T06:41:18.896661+0000","last_became_peered":"2023-11-20T06:41:18.896661+0000","last_unstale":"2023-11-20T06:41:20.313326+0000","last_undegraded":"2023-11-20T06:41:20.313326+0000","last_fullsized":"2023-11-20T06:41:20.313326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:19:44.001789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.679176+0000","last_change":"2023-11-20T06:41:18.900073+0000","last_active":"2023-11-20T06:41:20.679176+0000","last_peered":"2023-11-20T06:41:20.679176+0000","last_clean":"2023-11-20T06:41:20.679176+0000","last_became_active":"2023-11-20T06:41:18.898514+0000","last_became_peered":"2023-11-20T06:41:18.898514+0000","last_unstale":"2023-11-20T06:41:20.679176+0000","last_undegraded":"2023-11-20T06:41:20.679176+0000","last_fullsized":"2023-11-20T06:41:20.679176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:49:09.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.661897+0000","last_change":"2023-11-20T06:41:14.264028+0000","last_active":"2023-11-20T06:41:19.661897+0000","last_peered":"2023-11-20T06:41:19.661897+0000","last_clean":"2023-11-20T06:41:19.661897+0000","last_became_active":"2023-11-20T06:41:14.263528+0000","last_became_peered":"2023-11-20T06:41:14.263528+0000","last_unstale":"2023-11-20T06:41:19.661897+0000","last_undegraded":"2023-11-20T06:41:19.661897+0000","last_fullsized":"2023-11-20T06:41:19.661897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:06:44.444162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787639+0000","last_change":"2023-11-20T06:41:13.247680+0000","last_active":"2023-11-20T06:41:19.787639+0000","last_peered":"2023-11-20T06:41:19.787639+0000","last_clean":"2023-11-20T06:41:19.787639+0000","last_became_active":"2023-11-20T06:41:13.247333+0000","last_became_peered":"2023-11-20T06:41:13.247333+0000","last_unstale":"2023-11-20T06:41:19.787639+0000","last_undegraded":"2023-11-20T06:41:19.787639+0000","last_fullsized":"2023-11-20T06:41:19.787639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:42:52.596731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.746665+0000","last_change":"2023-11-20T06:41:18.306274+0000","last_active":"2023-11-20T06:41:20.746665+0000","last_peered":"2023-11-20T06:41:20.746665+0000","last_clean":"2023-11-20T06:41:20.746665+0000","last_became_active":"2023-11-20T06:41:18.305628+0000","last_became_peered":"2023-11-20T06:41:18.305628+0000","last_unstale":"2023-11-20T06:41:20.746665+0000","last_undegraded":"2023-11-20T06:41:20.746665+0000","last_fullsized":"2023-11-20T06:41:20.746665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:13:30.194807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583459+0000","last_change":"2023-11-20T06:41:14.268805+0000","last_active":"2023-11-20T06:41:19.583459+0000","last_peered":"2023-11-20T06:41:19.583459+0000","last_clean":"2023-11-20T06:41:19.583459+0000","last_became_active":"2023-11-20T06:41:14.268489+0000","last_became_peered":"2023-11-20T06:41:14.268489+0000","last_unstale":"2023-11-20T06:41:19.583459+0000","last_undegraded":"2023-11-20T06:41:19.583459+0000","last_fullsized":"2023-11-20T06:41:19.583459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:06:44.444162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583458+0000","last_change":"2023-11-20T06:41:13.242442+0000","last_active":"2023-11-20T06:41:19.583458+0000","last_peered":"2023-11-20T06:41:19.583458+0000","last_clean":"2023-11-20T06:41:19.583458+0000","last_became_active":"2023-11-20T06:41:13.242113+0000","last_became_peered":"2023-11-20T06:41:13.242113+0000","last_unstale":"2023-11-20T06:41:19.583458+0000","last_undegraded":"2023-11-20T06:41:19.583458+0000","last_fullsized":"2023-11-20T06:41:19.583458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:54:25.014221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314850+0000","last_change":"2023-11-20T06:41:13.246961+0000","last_active":"2023-11-20T06:41:19.314850+0000","last_peered":"2023-11-20T06:41:19.314850+0000","last_clean":"2023-11-20T06:41:19.314850+0000","last_became_active":"2023-11-20T06:41:13.245832+0000","last_became_peered":"2023-11-20T06:41:13.245832+0000","last_unstale":"2023-11-20T06:41:19.314850+0000","last_undegraded":"2023-11-20T06:41:19.314850+0000","last_fullsized":"2023-11-20T06:41:19.314850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:01:37.302430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578545+0000","last_change":"2023-11-20T06:41:14.263883+0000","last_active":"2023-11-20T06:41:19.578545+0000","last_peered":"2023-11-20T06:41:19.578545+0000","last_clean":"2023-11-20T06:41:19.578545+0000","last_became_active":"2023-11-20T06:41:14.263575+0000","last_became_peered":"2023-11-20T06:41:14.263575+0000","last_unstale":"2023-11-20T06:41:19.578545+0000","last_undegraded":"2023-11-20T06:41:19.578545+0000","last_fullsized":"2023-11-20T06:41:19.578545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:03:05.538623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.590487+0000","last_change":"2023-11-20T06:41:18.306473+0000","last_active":"2023-11-20T06:41:20.590487+0000","last_peered":"2023-11-20T06:41:20.590487+0000","last_clean":"2023-11-20T06:41:20.590487+0000","last_became_active":"2023-11-20T06:41:18.305307+0000","last_became_peered":"2023-11-20T06:41:18.305307+0000","last_unstale":"2023-11-20T06:41:20.590487+0000","last_undegraded":"2023-11-20T06:41:20.590487+0000","last_fullsized":"2023-11-20T06:41:20.590487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:25.525606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583794+0000","last_change":"2023-11-20T06:41:13.244143+0000","last_active":"2023-11-20T06:41:19.583794+0000","last_peered":"2023-11-20T06:41:19.583794+0000","last_clean":"2023-11-20T06:41:19.583794+0000","last_became_active":"2023-11-20T06:41:13.242220+0000","last_became_peered":"2023-11-20T06:41:13.242220+0000","last_unstale":"2023-11-20T06:41:19.583794+0000","last_undegraded":"2023-11-20T06:41:19.583794+0000","last_fullsized":"2023-11-20T06:41:19.583794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:16:12.804737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.313569+0000","last_change":"2023-11-20T06:41:14.266403+0000","last_active":"2023-11-20T06:41:19.313569+0000","last_peered":"2023-11-20T06:41:19.313569+0000","last_clean":"2023-11-20T06:41:19.313569+0000","last_became_active":"2023-11-20T06:41:14.266135+0000","last_became_peered":"2023-11-20T06:41:14.266135+0000","last_unstale":"2023-11-20T06:41:19.313569+0000","last_undegraded":"2023-11-20T06:41:19.313569+0000","last_fullsized":"2023-11-20T06:41:19.313569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:48:13.769350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.314045+0000","last_change":"2023-11-20T06:41:18.299944+0000","last_active":"2023-11-20T06:41:20.314045+0000","last_peered":"2023-11-20T06:41:20.314045+0000","last_clean":"2023-11-20T06:41:20.314045+0000","last_became_active":"2023-11-20T06:41:18.298166+0000","last_became_peered":"2023-11-20T06:41:18.298166+0000","last_unstale":"2023-11-20T06:41:20.314045+0000","last_undegraded":"2023-11-20T06:41:20.314045+0000","last_fullsized":"2023-11-20T06:41:20.314045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:15:14.873283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314208+0000","last_change":"2023-11-20T06:41:14.274186+0000","last_active":"2023-11-20T06:41:19.314208+0000","last_peered":"2023-11-20T06:41:19.314208+0000","last_clean":"2023-11-20T06:41:19.314208+0000","last_became_active":"2023-11-20T06:41:14.273726+0000","last_became_peered":"2023-11-20T06:41:14.273726+0000","last_unstale":"2023-11-20T06:41:19.314208+0000","last_undegraded":"2023-11-20T06:41:19.314208+0000","last_fullsized":"2023-11-20T06:41:19.314208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:36:44.079776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.309592+0000","last_change":"2023-11-20T06:41:14.256793+0000","last_active":"2023-11-20T06:41:19.309592+0000","last_peered":"2023-11-20T06:41:19.309592+0000","last_clean":"2023-11-20T06:41:19.309592+0000","last_became_active":"2023-11-20T06:41:14.256478+0000","last_became_peered":"2023-11-20T06:41:14.256478+0000","last_unstale":"2023-11-20T06:41:19.309592+0000","last_undegraded":"2023-11-20T06:41:19.309592+0000","last_fullsized":"2023-11-20T06:41:19.309592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:15:34.522340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787630+0000","last_change":"2023-11-20T06:41:14.277266+0000","last_active":"2023-11-20T06:41:19.787630+0000","last_peered":"2023-11-20T06:41:19.787630+0000","last_clean":"2023-11-20T06:41:19.787630+0000","last_became_active":"2023-11-20T06:41:14.276909+0000","last_became_peered":"2023-11-20T06:41:14.276909+0000","last_unstale":"2023-11-20T06:41:19.787630+0000","last_undegraded":"2023-11-20T06:41:19.787630+0000","last_fullsized":"2023-11-20T06:41:19.787630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:27:59.872035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578469+0000","last_change":"2023-11-20T06:41:14.264602+0000","last_active":"2023-11-20T06:41:19.578469+0000","last_peered":"2023-11-20T06:41:19.578469+0000","last_clean":"2023-11-20T06:41:19.578469+0000","last_became_active":"2023-11-20T06:41:14.264256+0000","last_became_peered":"2023-11-20T06:41:14.264256+0000","last_unstale":"2023-11-20T06:41:19.578469+0000","last_undegraded":"2023-11-20T06:41:19.578469+0000","last_fullsized":"2023-11-20T06:41:19.578469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:06:44.444162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583903+0000","last_change":"2023-11-20T06:41:14.257660+0000","last_active":"2023-11-20T06:41:19.583903+0000","last_peered":"2023-11-20T06:41:19.583903+0000","last_clean":"2023-11-20T06:41:19.583903+0000","last_became_active":"2023-11-20T06:41:14.257461+0000","last_became_peered":"2023-11-20T06:41:14.257461+0000","last_unstale":"2023-11-20T06:41:19.583903+0000","last_undegraded":"2023-11-20T06:41:19.583903+0000","last_fullsized":"2023-11-20T06:41:19.583903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:55:30.603010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662377+0000","last_change":"2023-11-20T06:41:14.266691+0000","last_active":"2023-11-20T06:41:19.662377+0000","last_peered":"2023-11-20T06:41:19.662377+0000","last_clean":"2023-11-20T06:41:19.662377+0000","last_became_active":"2023-11-20T06:41:14.266401+0000","last_became_peered":"2023-11-20T06:41:14.266401+0000","last_unstale":"2023-11-20T06:41:19.662377+0000","last_undegraded":"2023-11-20T06:41:19.662377+0000","last_fullsized":"2023-11-20T06:41:19.662377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:08:41.021374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315058+0000","last_change":"2023-11-20T06:41:14.266874+0000","last_active":"2023-11-20T06:41:19.315058+0000","last_peered":"2023-11-20T06:41:19.315058+0000","last_clean":"2023-11-20T06:41:19.315058+0000","last_became_active":"2023-11-20T06:41:14.266564+0000","last_became_peered":"2023-11-20T06:41:14.266564+0000","last_unstale":"2023-11-20T06:41:19.315058+0000","last_undegraded":"2023-11-20T06:41:19.315058+0000","last_fullsized":"2023-11-20T06:41:19.315058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:35:30.568821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.584279+0000","last_change":"2023-11-20T06:41:14.258127+0000","last_active":"2023-11-20T06:41:19.584279+0000","last_peered":"2023-11-20T06:41:19.584279+0000","last_clean":"2023-11-20T06:41:19.584279+0000","last_became_active":"2023-11-20T06:41:14.257873+0000","last_became_peered":"2023-11-20T06:41:14.257873+0000","last_unstale":"2023-11-20T06:41:19.584279+0000","last_undegraded":"2023-11-20T06:41:19.584279+0000","last_fullsized":"2023-11-20T06:41:19.584279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:07:43.904895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787515+0000","last_change":"2023-11-20T06:41:14.271045+0000","last_active":"2023-11-20T06:41:19.787515+0000","last_peered":"2023-11-20T06:41:19.787515+0000","last_clean":"2023-11-20T06:41:19.787515+0000","last_became_active":"2023-11-20T06:41:14.265731+0000","last_became_peered":"2023-11-20T06:41:14.265731+0000","last_unstale":"2023-11-20T06:41:19.787515+0000","last_undegraded":"2023-11-20T06:41:19.787515+0000","last_fullsized":"2023-11-20T06:41:19.787515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:45.059330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583398+0000","last_change":"2023-11-20T06:41:14.259066+0000","last_active":"2023-11-20T06:41:19.583398+0000","last_peered":"2023-11-20T06:41:19.583398+0000","last_clean":"2023-11-20T06:41:19.583398+0000","last_became_active":"2023-11-20T06:41:14.258818+0000","last_became_peered":"2023-11-20T06:41:14.258818+0000","last_unstale":"2023-11-20T06:41:19.583398+0000","last_undegraded":"2023-11-20T06:41:19.583398+0000","last_fullsized":"2023-11-20T06:41:19.583398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:03:05.538623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787570+0000","last_change":"2023-11-20T06:41:14.275181+0000","last_active":"2023-11-20T06:41:19.787570+0000","last_peered":"2023-11-20T06:41:19.787570+0000","last_clean":"2023-11-20T06:41:19.787570+0000","last_became_active":"2023-11-20T06:41:14.268467+0000","last_became_peered":"2023-11-20T06:41:14.268467+0000","last_unstale":"2023-11-20T06:41:19.787570+0000","last_undegraded":"2023-11-20T06:41:19.787570+0000","last_fullsized":"2023-11-20T06:41:19.787570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:55:30.603010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578862+0000","last_change":"2023-11-20T06:41:14.270268+0000","last_active":"2023-11-20T06:41:19.578862+0000","last_peered":"2023-11-20T06:41:19.578862+0000","last_clean":"2023-11-20T06:41:19.578862+0000","last_became_active":"2023-11-20T06:41:14.270056+0000","last_became_peered":"2023-11-20T06:41:14.270056+0000","last_unstale":"2023-11-20T06:41:19.578862+0000","last_undegraded":"2023-11-20T06:41:19.578862+0000","last_fullsized":"2023-11-20T06:41:19.578862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:36:44.079776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315115+0000","last_change":"2023-11-20T06:41:14.269251+0000","last_active":"2023-11-20T06:41:19.315115+0000","last_peered":"2023-11-20T06:41:19.315115+0000","last_clean":"2023-11-20T06:41:19.315115+0000","last_became_active":"2023-11-20T06:41:14.267320+0000","last_became_peered":"2023-11-20T06:41:14.267320+0000","last_unstale":"2023-11-20T06:41:19.315115+0000","last_undegraded":"2023-11-20T06:41:19.315115+0000","last_fullsized":"2023-11-20T06:41:19.315115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:42:53.602834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931525+0000","last_change":"2023-11-20T06:41:14.273161+0000","last_active":"2023-11-20T06:41:19.931525+0000","last_peered":"2023-11-20T06:41:19.931525+0000","last_clean":"2023-11-20T06:41:19.931525+0000","last_became_active":"2023-11-20T06:41:14.272837+0000","last_became_peered":"2023-11-20T06:41:14.272837+0000","last_unstale":"2023-11-20T06:41:19.931525+0000","last_undegraded":"2023-11-20T06:41:19.931525+0000","last_fullsized":"2023-11-20T06:41:19.931525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:16:48.088330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.310361+0000","last_change":"2023-11-20T06:41:14.272286+0000","last_active":"2023-11-20T06:41:19.310361+0000","last_peered":"2023-11-20T06:41:19.310361+0000","last_clean":"2023-11-20T06:41:19.310361+0000","last_became_active":"2023-11-20T06:41:14.258570+0000","last_became_peered":"2023-11-20T06:41:14.258570+0000","last_unstale":"2023-11-20T06:41:19.310361+0000","last_undegraded":"2023-11-20T06:41:19.310361+0000","last_fullsized":"2023-11-20T06:41:19.310361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:27:02.569616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.788326+0000","last_change":"2023-11-20T06:41:14.275187+0000","last_active":"2023-11-20T06:41:19.788326+0000","last_peered":"2023-11-20T06:41:19.788326+0000","last_clean":"2023-11-20T06:41:19.788326+0000","last_became_active":"2023-11-20T06:41:14.270334+0000","last_became_peered":"2023-11-20T06:41:14.270334+0000","last_unstale":"2023-11-20T06:41:19.788326+0000","last_undegraded":"2023-11-20T06:41:19.788326+0000","last_fullsized":"2023-11-20T06:41:19.788326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:45:50.281694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787513+0000","last_change":"2023-11-20T06:41:14.272042+0000","last_active":"2023-11-20T06:41:19.787513+0000","last_peered":"2023-11-20T06:41:19.787513+0000","last_clean":"2023-11-20T06:41:19.787513+0000","last_became_active":"2023-11-20T06:41:14.271776+0000","last_became_peered":"2023-11-20T06:41:14.271776+0000","last_unstale":"2023-11-20T06:41:19.787513+0000","last_undegraded":"2023-11-20T06:41:19.787513+0000","last_fullsized":"2023-11-20T06:41:19.787513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:25.537288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662034+0000","last_change":"2023-11-20T06:41:14.265036+0000","last_active":"2023-11-20T06:41:19.662034+0000","last_peered":"2023-11-20T06:41:19.662034+0000","last_clean":"2023-11-20T06:41:19.662034+0000","last_became_active":"2023-11-20T06:41:14.264757+0000","last_became_peered":"2023-11-20T06:41:14.264757+0000","last_unstale":"2023-11-20T06:41:19.662034+0000","last_undegraded":"2023-11-20T06:41:19.662034+0000","last_fullsized":"2023-11-20T06:41:19.662034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:03:05.538623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578415+0000","last_change":"2023-11-20T06:41:14.263606+0000","last_active":"2023-11-20T06:41:19.578415+0000","last_peered":"2023-11-20T06:41:19.578415+0000","last_clean":"2023-11-20T06:41:19.578415+0000","last_became_active":"2023-11-20T06:41:14.263046+0000","last_became_peered":"2023-11-20T06:41:14.263046+0000","last_unstale":"2023-11-20T06:41:19.578415+0000","last_undegraded":"2023-11-20T06:41:19.578415+0000","last_fullsized":"2023-11-20T06:41:19.578415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:56:09.382571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583697+0000","last_change":"2023-11-20T06:41:14.261028+0000","last_active":"2023-11-20T06:41:19.583697+0000","last_peered":"2023-11-20T06:41:19.583697+0000","last_clean":"2023-11-20T06:41:19.583697+0000","last_became_active":"2023-11-20T06:41:14.257826+0000","last_became_peered":"2023-11-20T06:41:14.257826+0000","last_unstale":"2023-11-20T06:41:19.583697+0000","last_undegraded":"2023-11-20T06:41:19.583697+0000","last_fullsized":"2023-11-20T06:41:19.583697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:08:41.021374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315274+0000","last_change":"2023-11-20T06:41:14.269257+0000","last_active":"2023-11-20T06:41:19.315274+0000","last_peered":"2023-11-20T06:41:19.315274+0000","last_clean":"2023-11-20T06:41:19.315274+0000","last_became_active":"2023-11-20T06:41:14.264896+0000","last_became_peered":"2023-11-20T06:41:14.264896+0000","last_unstale":"2023-11-20T06:41:19.315274+0000","last_undegraded":"2023-11-20T06:41:19.315274+0000","last_fullsized":"2023-11-20T06:41:19.315274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:54:26.020324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315416+0000","last_change":"2023-11-20T06:41:14.282030+0000","last_active":"2023-11-20T06:41:19.315416+0000","last_peered":"2023-11-20T06:41:19.315416+0000","last_clean":"2023-11-20T06:41:19.315416+0000","last_became_active":"2023-11-20T06:41:14.281723+0000","last_became_peered":"2023-11-20T06:41:14.281723+0000","last_unstale":"2023-11-20T06:41:19.315416+0000","last_undegraded":"2023-11-20T06:41:19.315416+0000","last_fullsized":"2023-11-20T06:41:19.315416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:08:41.021374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314963+0000","last_change":"2023-11-20T06:41:14.281916+0000","last_active":"2023-11-20T06:41:19.314963+0000","last_peered":"2023-11-20T06:41:19.314963+0000","last_clean":"2023-11-20T06:41:19.314963+0000","last_became_active":"2023-11-20T06:41:14.281641+0000","last_became_peered":"2023-11-20T06:41:14.281641+0000","last_unstale":"2023-11-20T06:41:19.314963+0000","last_undegraded":"2023-11-20T06:41:19.314963+0000","last_fullsized":"2023-11-20T06:41:19.314963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:25.537288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931727+0000","last_change":"2023-11-20T06:41:14.284924+0000","last_active":"2023-11-20T06:41:19.931727+0000","last_peered":"2023-11-20T06:41:19.931727+0000","last_clean":"2023-11-20T06:41:19.931727+0000","last_became_active":"2023-11-20T06:41:14.284654+0000","last_became_peered":"2023-11-20T06:41:14.284654+0000","last_unstale":"2023-11-20T06:41:19.931727+0000","last_undegraded":"2023-11-20T06:41:19.931727+0000","last_fullsized":"2023-11-20T06:41:19.931727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:13:26.142776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583308+0000","last_change":"2023-11-20T06:41:14.271513+0000","last_active":"2023-11-20T06:41:19.583308+0000","last_peered":"2023-11-20T06:41:19.583308+0000","last_clean":"2023-11-20T06:41:19.583308+0000","last_became_active":"2023-11-20T06:41:14.271045+0000","last_became_peered":"2023-11-20T06:41:14.271045+0000","last_unstale":"2023-11-20T06:41:19.583308+0000","last_undegraded":"2023-11-20T06:41:19.583308+0000","last_fullsized":"2023-11-20T06:41:19.583308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:36:44.079776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931144+0000","last_change":"2023-11-20T06:41:14.269364+0000","last_active":"2023-11-20T06:41:19.931144+0000","last_peered":"2023-11-20T06:41:19.931144+0000","last_clean":"2023-11-20T06:41:19.931144+0000","last_became_active":"2023-11-20T06:41:14.269091+0000","last_became_peered":"2023-11-20T06:41:14.269091+0000","last_unstale":"2023-11-20T06:41:19.931144+0000","last_undegraded":"2023-11-20T06:41:19.931144+0000","last_fullsized":"2023-11-20T06:41:19.931144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:07:43.904895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787491+0000","last_change":"2023-11-20T06:41:14.275911+0000","last_active":"2023-11-20T06:41:19.787491+0000","last_peered":"2023-11-20T06:41:19.787491+0000","last_clean":"2023-11-20T06:41:19.787491+0000","last_became_active":"2023-11-20T06:41:14.275285+0000","last_became_peered":"2023-11-20T06:41:14.275285+0000","last_unstale":"2023-11-20T06:41:19.787491+0000","last_undegraded":"2023-11-20T06:41:19.787491+0000","last_fullsized":"2023-11-20T06:41:19.787491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:08:41.021374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931288+0000","last_change":"2023-11-20T06:41:14.271029+0000","last_active":"2023-11-20T06:41:19.931288+0000","last_peered":"2023-11-20T06:41:19.931288+0000","last_clean":"2023-11-20T06:41:19.931288+0000","last_became_active":"2023-11-20T06:41:14.269917+0000","last_became_peered":"2023-11-20T06:41:14.269917+0000","last_unstale":"2023-11-20T06:41:19.931288+0000","last_undegraded":"2023-11-20T06:41:19.931288+0000","last_fullsized":"2023-11-20T06:41:19.931288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:45.059330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787805+0000","last_change":"2023-11-20T06:41:14.277449+0000","last_active":"2023-11-20T06:41:19.787805+0000","last_peered":"2023-11-20T06:41:19.787805+0000","last_clean":"2023-11-20T06:41:19.787805+0000","last_became_active":"2023-11-20T06:41:14.277166+0000","last_became_peered":"2023-11-20T06:41:14.277166+0000","last_unstale":"2023-11-20T06:41:19.787805+0000","last_undegraded":"2023-11-20T06:41:19.787805+0000","last_fullsized":"2023-11-20T06:41:19.787805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:35:30.568821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578392+0000","last_change":"2023-11-20T06:41:14.253214+0000","last_active":"2023-11-20T06:41:19.578392+0000","last_peered":"2023-11-20T06:41:19.578392+0000","last_clean":"2023-11-20T06:41:19.578392+0000","last_became_active":"2023-11-20T06:41:14.252882+0000","last_became_peered":"2023-11-20T06:41:14.252882+0000","last_unstale":"2023-11-20T06:41:19.578392+0000","last_undegraded":"2023-11-20T06:41:19.578392+0000","last_fullsized":"2023-11-20T06:41:19.578392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:42:53.602834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.663050+0000","last_change":"2023-11-20T06:41:14.268127+0000","last_active":"2023-11-20T06:41:19.663050+0000","last_peered":"2023-11-20T06:41:19.663050+0000","last_clean":"2023-11-20T06:41:19.663050+0000","last_became_active":"2023-11-20T06:41:14.267318+0000","last_became_peered":"2023-11-20T06:41:14.267318+0000","last_unstale":"2023-11-20T06:41:19.663050+0000","last_undegraded":"2023-11-20T06:41:19.663050+0000","last_fullsized":"2023-11-20T06:41:19.663050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:35:30.568821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931671+0000","last_change":"2023-11-20T06:41:14.265577+0000","last_active":"2023-11-20T06:41:19.931671+0000","last_peered":"2023-11-20T06:41:19.931671+0000","last_clean":"2023-11-20T06:41:19.931671+0000","last_became_active":"2023-11-20T06:41:14.263538+0000","last_became_peered":"2023-11-20T06:41:14.263538+0000","last_unstale":"2023-11-20T06:41:19.931671+0000","last_undegraded":"2023-11-20T06:41:19.931671+0000","last_fullsized":"2023-11-20T06:41:19.931671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:45:50.281694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":697795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":110686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6220000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4910000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.833}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":106935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":106971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":110686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":106845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":696832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T06:41:44.255 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T06:41:44.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.431+0000 7fcaa563c640 1 Processor -- start 2023-11-20T06:41:44.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.431+0000 7fcaa563c640 1 -- start start 2023-11-20T06:41:44.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.431+0000 7fcaa563c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaa015c910 0x7fcaa00d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.431+0000 7fcaa563c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcaa00d3170 0x7fcaa00cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.431+0000 7fcaa563c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa00ce730 con 0x7fcaa00cefe0 2023-11-20T06:41:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.431+0000 7fcaa563c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa00d17a0 con 0x7fcaa00d3170 2023-11-20T06:41:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.431+0000 7fcaa563c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00d0dd0 con 0x7fcaa015c910 2023-11-20T06:41:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.431+0000 7fca9ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaa015c910 0x7fcaa00d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.431+0000 7fca9ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaa015c910 0x7fcaa00d1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:43464/0 (socket says 172.21.15.19:43464) 2023-11-20T06:41:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.431+0000 7fca9f7fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcaa00d3170 0x7fcaa00cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.431+0000 7fca9ffff640 1 -- 172.21.15.19:0/1888020732 learned_addr learned my addr 172.21.15.19:0/1888020732 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.431+0000 7fcaa4e3b640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fcaa00cefe0 0x7fcaa006b050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:53342/0 (socket says 172.21.15.19:53342) 2023-11-20T06:41:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.431+0000 7fca9effd640 1 -- 172.21.15.19:0/1888020732 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570168564 0 0) 0x7fcaa00ce730 con 0x7fcaa00cefe0 2023-11-20T06:41:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.431+0000 7fca9effd640 1 -- 172.21.15.19:0/1888020732 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca88003530 con 0x7fcaa00cefe0 2023-11-20T06:41:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.431+0000 7fca9ffff640 1 -- 172.21.15.19:0/1888020732 >> v2:172.21.15.190:3300/0 conn(0x7fcaa00d3170 msgr2=0x7fcaa00cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:44.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.431+0000 7fca9ffff640 1 --2- 172.21.15.19:0/1888020732 >> v2:172.21.15.190:3300/0 conn(0x7fcaa00d3170 0x7fcaa00cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.431+0000 7fca9ffff640 1 -- 172.21.15.19:0/1888020732 >> v1:172.21.15.190:6789/0 conn(0x7fcaa00cefe0 legacy=0x7fcaa006b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:44.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.431+0000 7fca9ffff640 1 -- 172.21.15.19:0/1888020732 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa00d04a0 con 0x7fcaa015c910 2023-11-20T06:41:44.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.431+0000 7fca9f7fe640 1 --2- 172.21.15.19:0/1888020732 >> v2:172.21.15.190:3300/0 conn(0x7fcaa00d3170 0x7fcaa00cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:41:44.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.435+0000 7fca9ffff640 1 --2- 172.21.15.19:0/1888020732 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaa015c910 0x7fcaa00d1260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca90006fd0 tx=0x7fca9001c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a373ffa61b5c8cd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:44.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.435+0000 7fca9effd640 1 -- 172.21.15.19:0/1888020732 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca900ab660 con 0x7fcaa015c910 2023-11-20T06:41:44.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.435+0000 7fca9effd640 1 -- 172.21.15.19:0/1888020732 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca900ab7c0 con 0x7fcaa015c910 2023-11-20T06:41:44.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.435+0000 7fca9effd640 1 -- 172.21.15.19:0/1888020732 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca900abb50 con 0x7fcaa015c910 2023-11-20T06:41:44.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.435+0000 7fcaa563c640 1 -- 172.21.15.19:0/1888020732 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaa015c910 msgr2=0x7fcaa00d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:44.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.435+0000 7fcaa563c640 1 --2- 172.21.15.19:0/1888020732 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaa015c910 0x7fcaa00d1260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca90006fd0 tx=0x7fca9001c460 comp rx=0 tx=0).stop 2023-11-20T06:41:44.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.435+0000 7fcaa563c640 1 -- 172.21.15.19:0/1888020732 shutdown_connections 2023-11-20T06:41:44.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.435+0000 7fcaa563c640 1 --2- 172.21.15.19:0/1888020732 >> v2:172.21.15.190:3300/0 conn(0x7fcaa00d3170 0x7fcaa00cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.435+0000 7fcaa563c640 1 --2- 172.21.15.19:0/1888020732 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaa015c910 0x7fcaa00d1260 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.435+0000 7fcaa563c640 1 -- 172.21.15.19:0/1888020732 >> 172.21.15.19:0/1888020732 conn(0x7fcaa009bb50 msgr2=0x7fcaa00d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:44.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.435+0000 7fcaa563c640 1 -- 172.21.15.19:0/1888020732 shutdown_connections 2023-11-20T06:41:44.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.435+0000 7fcaa563c640 1 -- 172.21.15.19:0/1888020732 wait complete. 2023-11-20T06:41:44.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fcaa563c640 1 Processor -- start 2023-11-20T06:41:44.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fcaa563c640 1 -- start start 2023-11-20T06:41:44.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fcaa563c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcaa00cefe0 0x7fcaa00b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:44.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fcaa563c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcaa00d3170 0x7fcaa01517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:44.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fcaa563c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaa015c910 0x7fcaa015b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:44.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fcaa563c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa0157ff0 con 0x7fcaa00d3170 2023-11-20T06:41:44.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fcaa563c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00b3eb0 con 0x7fcaa00cefe0 2023-11-20T06:41:44.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fcaa563c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00cc040 con 0x7fcaa015c910 2023-11-20T06:41:44.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fca9f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcaa00d3170 0x7fcaa01517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:44.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fca9f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcaa00d3170 0x7fcaa01517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48550/0 (socket says 172.21.15.19:48550) 2023-11-20T06:41:44.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fca9f7fe640 1 -- 172.21.15.19:0/5480031 learned_addr learned my addr 172.21.15.19:0/5480031 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:44.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fca9ffff640 1 --2- 172.21.15.19:0/5480031 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcaa00cefe0 0x7fcaa00b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:44.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fcaa4e3b640 1 --2- 172.21.15.19:0/5480031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaa015c910 0x7fcaa015b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:44.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fca9f7fe640 1 -- 172.21.15.19:0/5480031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaa015c910 msgr2=0x7fcaa015b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:44.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fca9f7fe640 1 --2- 172.21.15.19:0/5480031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaa015c910 0x7fcaa015b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fca9f7fe640 1 -- 172.21.15.19:0/5480031 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcaa00cefe0 msgr2=0x7fcaa00b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:44.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fca9f7fe640 1 --2- 172.21.15.19:0/5480031 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcaa00cefe0 0x7fcaa00b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fca9f7fe640 1 -- 172.21.15.19:0/5480031 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca94009420 con 0x7fcaa00d3170 2023-11-20T06:41:44.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fca9f7fe640 1 --2- 172.21.15.19:0/5480031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcaa00d3170 0x7fcaa01517d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fca9400e930 tx=0x7fca9400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:44.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fca9cff9640 1 -- 172.21.15.19:0/5480031 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9400ca00 con 0x7fcaa00d3170 2023-11-20T06:41:44.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fca9cff9640 1 -- 172.21.15.19:0/5480031 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9400cb60 con 0x7fcaa00d3170 2023-11-20T06:41:44.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fcaa563c640 1 -- 172.21.15.19:0/5480031 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca90009480 con 0x7fcaa00d3170 2023-11-20T06:41:44.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fca9cff9640 1 -- 172.21.15.19:0/5480031 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca94013470 con 0x7fcaa00d3170 2023-11-20T06:41:44.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.439+0000 7fcaa563c640 1 -- 172.21.15.19:0/5480031 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa00cc600 con 0x7fcaa00d3170 2023-11-20T06:41:44.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.443+0000 7fcaa563c640 1 -- 172.21.15.19:0/5480031 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa004e9c0 con 0x7fcaa00d3170 2023-11-20T06:41:44.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.443+0000 7fca9cff9640 1 -- 172.21.15.19:0/5480031 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fca940135d0 con 0x7fcaa00d3170 2023-11-20T06:41:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.443+0000 7fca9cff9640 1 --2- 172.21.15.19:0/5480031 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fca8c0664a0 0x7fca8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.443+0000 7fca9cff9640 1 -- 172.21.15.19:0/5480031 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fca940842f0 con 0x7fcaa00d3170 2023-11-20T06:41:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.443+0000 7fca9ffff640 1 --2- 172.21.15.19:0/5480031 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fca8c0664a0 0x7fca8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.443+0000 7fca9ffff640 1 --2- 172.21.15.19:0/5480031 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fca8c0664a0 0x7fca8c068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fca900af000 tx=0x7fca900a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:44.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.447+0000 7fca9cff9640 1 -- 172.21.15.19:0/5480031 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fca94051530 con 0x7fcaa00d3170 2023-11-20T06:41:44.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.599+0000 7fcaa563c640 1 -- 172.21.15.19:0/5480031 --> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcaa006bb70 con 0x7fca8c0664a0 2023-11-20T06:41:44.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.611+0000 7fca9cff9640 1 -- 172.21.15.19:0/5480031 <== mgr.4109 v2:172.21.15.190:6832/142426253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345275 (secure 0 0 0) 0x7fca900ab5e0 con 0x7fca8c0664a0 2023-11-20T06:41:44.616 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:44.623 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-20T06:41:44.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.615+0000 7fcaa563c640 1 -- 172.21.15.19:0/5480031 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fca8c0664a0 msgr2=0x7fca8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:44.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.615+0000 7fcaa563c640 1 --2- 172.21.15.19:0/5480031 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fca8c0664a0 0x7fca8c068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fca900af000 tx=0x7fca900a7000 comp rx=0 tx=0).stop 2023-11-20T06:41:44.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.615+0000 7fcaa563c640 1 -- 172.21.15.19:0/5480031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcaa00d3170 msgr2=0x7fcaa01517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:44.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.615+0000 7fcaa563c640 1 --2- 172.21.15.19:0/5480031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcaa00d3170 0x7fcaa01517d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fca9400e930 tx=0x7fca9400edf0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.615+0000 7fcaa563c640 1 -- 172.21.15.19:0/5480031 shutdown_connections 2023-11-20T06:41:44.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.615+0000 7fcaa563c640 1 --2- 172.21.15.19:0/5480031 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fca8c0664a0 0x7fca8c068960 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.615+0000 7fcaa563c640 1 --2- 172.21.15.19:0/5480031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaa015c910 0x7fcaa015b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.615+0000 7fcaa563c640 1 --2- 172.21.15.19:0/5480031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcaa00d3170 0x7fcaa01517d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.615+0000 7fcaa563c640 1 --2- 172.21.15.19:0/5480031 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcaa00cefe0 0x7fcaa00b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.615+0000 7fcaa563c640 1 -- 172.21.15.19:0/5480031 >> 172.21.15.19:0/5480031 conn(0x7fcaa009bb50 msgr2=0x7fcaa00b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:44.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.615+0000 7fcaa563c640 1 -- 172.21.15.19:0/5480031 shutdown_connections 2023-11-20T06:41:44.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.615+0000 7fcaa563c640 1 -- 172.21.15.19:0/5480031 wait complete. 2023-11-20T06:41:44.639 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-11-20T06:41:43.489980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219472,"kb_used_data":3300,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755248,"statfs":{"total":773094113280,"available":772869373952,"internally_reserved":0,"allocated":3379200,"data_stored":2043755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003308"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578685+0000","last_change":"2023-11-20T06:41:13.239285+0000","last_active":"2023-11-20T06:41:19.578685+0000","last_peered":"2023-11-20T06:41:19.578685+0000","last_clean":"2023-11-20T06:41:19.578685+0000","last_became_active":"2023-11-20T06:41:13.238954+0000","last_became_peered":"2023-11-20T06:41:13.238954+0000","last_unstale":"2023-11-20T06:41:19.578685+0000","last_undegraded":"2023-11-20T06:41:19.578685+0000","last_fullsized":"2023-11-20T06:41:19.578685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:47:01.655222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.584187+0000","last_change":"2023-11-20T06:41:14.261632+0000","last_active":"2023-11-20T06:41:19.584187+0000","last_peered":"2023-11-20T06:41:19.584187+0000","last_clean":"2023-11-20T06:41:19.584187+0000","last_became_active":"2023-11-20T06:41:14.261282+0000","last_became_peered":"2023-11-20T06:41:14.261282+0000","last_unstale":"2023-11-20T06:41:19.584187+0000","last_undegraded":"2023-11-20T06:41:19.584187+0000","last_fullsized":"2023-11-20T06:41:19.584187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:45:19.227613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.313252+0000","last_change":"2023-11-20T06:41:18.900797+0000","last_active":"2023-11-20T06:41:20.313252+0000","last_peered":"2023-11-20T06:41:20.313252+0000","last_clean":"2023-11-20T06:41:20.313252+0000","last_became_active":"2023-11-20T06:41:18.900345+0000","last_became_peered":"2023-11-20T06:41:18.900345+0000","last_unstale":"2023-11-20T06:41:20.313252+0000","last_undegraded":"2023-11-20T06:41:20.313252+0000","last_fullsized":"2023-11-20T06:41:20.313252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:58:31.638685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.584272+0000","last_change":"2023-11-20T06:41:13.239899+0000","last_active":"2023-11-20T06:41:19.584272+0000","last_peered":"2023-11-20T06:41:19.584272+0000","last_clean":"2023-11-20T06:41:19.584272+0000","last_became_active":"2023-11-20T06:41:13.239579+0000","last_became_peered":"2023-11-20T06:41:13.239579+0000","last_unstale":"2023-11-20T06:41:19.584272+0000","last_undegraded":"2023-11-20T06:41:19.584272+0000","last_fullsized":"2023-11-20T06:41:19.584272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:15:33.516237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578577+0000","last_change":"2023-11-20T06:41:14.262518+0000","last_active":"2023-11-20T06:41:19.578577+0000","last_peered":"2023-11-20T06:41:19.578577+0000","last_clean":"2023-11-20T06:41:19.578577+0000","last_became_active":"2023-11-20T06:41:14.260033+0000","last_became_peered":"2023-11-20T06:41:14.260033+0000","last_unstale":"2023-11-20T06:41:19.578577+0000","last_undegraded":"2023-11-20T06:41:19.578577+0000","last_fullsized":"2023-11-20T06:41:19.578577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:25.537288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.315596+0000","last_change":"2023-11-20T06:41:18.295727+0000","last_active":"2023-11-20T06:41:20.315596+0000","last_peered":"2023-11-20T06:41:20.315596+0000","last_clean":"2023-11-20T06:41:20.315596+0000","last_became_active":"2023-11-20T06:41:18.295305+0000","last_became_peered":"2023-11-20T06:41:18.295305+0000","last_unstale":"2023-11-20T06:41:20.315596+0000","last_undegraded":"2023-11-20T06:41:20.315596+0000","last_fullsized":"2023-11-20T06:41:20.315596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:45:54.333725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931461+0000","last_change":"2023-11-20T06:41:13.252932+0000","last_active":"2023-11-20T06:41:19.931461+0000","last_peered":"2023-11-20T06:41:19.931461+0000","last_clean":"2023-11-20T06:41:19.931461+0000","last_became_active":"2023-11-20T06:41:13.252621+0000","last_became_peered":"2023-11-20T06:41:13.252621+0000","last_unstale":"2023-11-20T06:41:19.931461+0000","last_undegraded":"2023-11-20T06:41:19.931461+0000","last_fullsized":"2023-11-20T06:41:19.931461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:20.467472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787860+0000","last_change":"2023-11-20T06:41:14.256127+0000","last_active":"2023-11-20T06:41:19.787860+0000","last_peered":"2023-11-20T06:41:19.787860+0000","last_clean":"2023-11-20T06:41:19.787860+0000","last_became_active":"2023-11-20T06:41:14.255819+0000","last_became_peered":"2023-11-20T06:41:14.255819+0000","last_unstale":"2023-11-20T06:41:19.787860+0000","last_undegraded":"2023-11-20T06:41:19.787860+0000","last_fullsized":"2023-11-20T06:41:19.787860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:45:19.227613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.315754+0000","last_change":"2023-11-20T06:41:18.301642+0000","last_active":"2023-11-20T06:41:20.315754+0000","last_peered":"2023-11-20T06:41:20.315754+0000","last_clean":"2023-11-20T06:41:20.315754+0000","last_became_active":"2023-11-20T06:41:18.301181+0000","last_became_peered":"2023-11-20T06:41:18.301181+0000","last_unstale":"2023-11-20T06:41:20.315754+0000","last_undegraded":"2023-11-20T06:41:20.315754+0000","last_fullsized":"2023-11-20T06:41:20.315754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:49.111361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931279+0000","last_change":"2023-11-20T06:41:13.254958+0000","last_active":"2023-11-20T06:41:19.931279+0000","last_peered":"2023-11-20T06:41:19.931279+0000","last_clean":"2023-11-20T06:41:19.931279+0000","last_became_active":"2023-11-20T06:41:13.254686+0000","last_became_peered":"2023-11-20T06:41:13.254686+0000","last_unstale":"2023-11-20T06:41:19.931279+0000","last_undegraded":"2023-11-20T06:41:19.931279+0000","last_fullsized":"2023-11-20T06:41:19.931279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:48:12.763247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.788059+0000","last_change":"2023-11-20T06:41:14.260659+0000","last_active":"2023-11-20T06:41:19.788059+0000","last_peered":"2023-11-20T06:41:19.788059+0000","last_clean":"2023-11-20T06:41:19.788059+0000","last_became_active":"2023-11-20T06:41:14.260375+0000","last_became_peered":"2023-11-20T06:41:14.260375+0000","last_unstale":"2023-11-20T06:41:19.788059+0000","last_undegraded":"2023-11-20T06:41:19.788059+0000","last_fullsized":"2023-11-20T06:41:19.788059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:20:01.827771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.315993+0000","last_change":"2023-11-20T06:41:18.289391+0000","last_active":"2023-11-20T06:41:20.315993+0000","last_peered":"2023-11-20T06:41:20.315993+0000","last_clean":"2023-11-20T06:41:20.315993+0000","last_became_active":"2023-11-20T06:41:18.288932+0000","last_became_peered":"2023-11-20T06:41:18.288932+0000","last_unstale":"2023-11-20T06:41:20.315993+0000","last_undegraded":"2023-11-20T06:41:20.315993+0000","last_fullsized":"2023-11-20T06:41:20.315993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:57:19.944479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314649+0000","last_change":"2023-11-20T06:41:14.270272+0000","last_active":"2023-11-20T06:41:19.314649+0000","last_peered":"2023-11-20T06:41:19.314649+0000","last_clean":"2023-11-20T06:41:19.314649+0000","last_became_active":"2023-11-20T06:41:14.269983+0000","last_became_peered":"2023-11-20T06:41:14.269983+0000","last_unstale":"2023-11-20T06:41:19.314649+0000","last_undegraded":"2023-11-20T06:41:19.314649+0000","last_fullsized":"2023-11-20T06:41:19.314649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:03:05.538623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931428+0000","last_change":"2023-11-20T06:41:13.252298+0000","last_active":"2023-11-20T06:41:19.931428+0000","last_peered":"2023-11-20T06:41:19.931428+0000","last_clean":"2023-11-20T06:41:19.931428+0000","last_became_active":"2023-11-20T06:41:13.252009+0000","last_became_peered":"2023-11-20T06:41:13.252009+0000","last_unstale":"2023-11-20T06:41:19.931428+0000","last_undegraded":"2023-11-20T06:41:19.931428+0000","last_fullsized":"2023-11-20T06:41:19.931428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:24.531185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.316395+0000","last_change":"2023-11-20T06:41:18.299248+0000","last_active":"2023-11-20T06:41:20.316395+0000","last_peered":"2023-11-20T06:41:20.316395+0000","last_clean":"2023-11-20T06:41:20.316395+0000","last_became_active":"2023-11-20T06:41:18.298935+0000","last_became_peered":"2023-11-20T06:41:18.298935+0000","last_unstale":"2023-11-20T06:41:20.316395+0000","last_undegraded":"2023-11-20T06:41:20.316395+0000","last_fullsized":"2023-11-20T06:41:20.316395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:00:16.728243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583729+0000","last_change":"2023-11-20T06:41:14.267951+0000","last_active":"2023-11-20T06:41:19.583729+0000","last_peered":"2023-11-20T06:41:19.583729+0000","last_clean":"2023-11-20T06:41:19.583729+0000","last_became_active":"2023-11-20T06:41:14.266970+0000","last_became_peered":"2023-11-20T06:41:14.266970+0000","last_unstale":"2023-11-20T06:41:19.583729+0000","last_undegraded":"2023-11-20T06:41:19.583729+0000","last_fullsized":"2023-11-20T06:41:19.583729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:35:30.568821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662297+0000","last_change":"2023-11-20T06:41:13.242711+0000","last_active":"2023-11-20T06:41:19.662297+0000","last_peered":"2023-11-20T06:41:19.662297+0000","last_clean":"2023-11-20T06:41:19.662297+0000","last_became_active":"2023-11-20T06:41:13.242342+0000","last_became_peered":"2023-11-20T06:41:13.242342+0000","last_unstale":"2023-11-20T06:41:19.662297+0000","last_undegraded":"2023-11-20T06:41:19.662297+0000","last_fullsized":"2023-11-20T06:41:19.662297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:47:01.655222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.317121+0000","last_change":"2023-11-20T06:41:18.301608+0000","last_active":"2023-11-20T06:41:20.317121+0000","last_peered":"2023-11-20T06:41:20.317121+0000","last_clean":"2023-11-20T06:41:20.317121+0000","last_became_active":"2023-11-20T06:41:18.301170+0000","last_became_peered":"2023-11-20T06:41:18.301170+0000","last_unstale":"2023-11-20T06:41:20.317121+0000","last_undegraded":"2023-11-20T06:41:20.317121+0000","last_fullsized":"2023-11-20T06:41:20.317121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:49:09.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583521+0000","last_change":"2023-11-20T06:41:14.269440+0000","last_active":"2023-11-20T06:41:19.583521+0000","last_peered":"2023-11-20T06:41:19.583521+0000","last_clean":"2023-11-20T06:41:19.583521+0000","last_became_active":"2023-11-20T06:41:14.269118+0000","last_became_peered":"2023-11-20T06:41:14.269118+0000","last_unstale":"2023-11-20T06:41:19.583521+0000","last_undegraded":"2023-11-20T06:41:19.583521+0000","last_fullsized":"2023-11-20T06:41:19.583521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:42:53.602834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.661987+0000","last_change":"2023-11-20T06:41:13.247696+0000","last_active":"2023-11-20T06:41:19.661987+0000","last_peered":"2023-11-20T06:41:19.661987+0000","last_clean":"2023-11-20T06:41:19.661987+0000","last_became_active":"2023-11-20T06:41:13.247416+0000","last_became_peered":"2023-11-20T06:41:13.247416+0000","last_unstale":"2023-11-20T06:41:19.661987+0000","last_undegraded":"2023-11-20T06:41:19.661987+0000","last_fullsized":"2023-11-20T06:41:19.661987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:36:43.073673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.743727+0000","last_change":"2023-11-20T06:41:18.897168+0000","last_active":"2023-11-20T06:41:20.743727+0000","last_peered":"2023-11-20T06:41:20.743727+0000","last_clean":"2023-11-20T06:41:20.743727+0000","last_became_active":"2023-11-20T06:41:18.896705+0000","last_became_peered":"2023-11-20T06:41:18.896705+0000","last_unstale":"2023-11-20T06:41:20.743727+0000","last_undegraded":"2023-11-20T06:41:20.743727+0000","last_fullsized":"2023-11-20T06:41:20.743727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:49:09.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.313398+0000","last_change":"2023-11-20T06:41:14.267054+0000","last_active":"2023-11-20T06:41:19.313398+0000","last_peered":"2023-11-20T06:41:19.313398+0000","last_clean":"2023-11-20T06:41:19.313398+0000","last_became_active":"2023-11-20T06:41:14.262005+0000","last_became_peered":"2023-11-20T06:41:14.262005+0000","last_unstale":"2023-11-20T06:41:19.313398+0000","last_undegraded":"2023-11-20T06:41:19.313398+0000","last_fullsized":"2023-11-20T06:41:19.313398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:52:49.697194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931076+0000","last_change":"2023-11-20T06:41:13.257483+0000","last_active":"2023-11-20T06:41:19.931076+0000","last_peered":"2023-11-20T06:41:19.931076+0000","last_clean":"2023-11-20T06:41:19.931076+0000","last_became_active":"2023-11-20T06:41:13.257122+0000","last_became_peered":"2023-11-20T06:41:13.257122+0000","last_unstale":"2023-11-20T06:41:19.931076+0000","last_undegraded":"2023-11-20T06:41:19.931076+0000","last_fullsized":"2023-11-20T06:41:19.931076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:15:33.516237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.317008+0000","last_change":"2023-11-20T06:41:18.302677+0000","last_active":"2023-11-20T06:41:20.317008+0000","last_peered":"2023-11-20T06:41:20.317008+0000","last_clean":"2023-11-20T06:41:20.317008+0000","last_became_active":"2023-11-20T06:41:18.301938+0000","last_became_peered":"2023-11-20T06:41:18.301938+0000","last_unstale":"2023-11-20T06:41:20.317008+0000","last_undegraded":"2023-11-20T06:41:20.317008+0000","last_fullsized":"2023-11-20T06:41:20.317008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:25:06.683699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578465+0000","last_change":"2023-11-20T06:41:14.264039+0000","last_active":"2023-11-20T06:41:19.578465+0000","last_peered":"2023-11-20T06:41:19.578465+0000","last_clean":"2023-11-20T06:41:19.578465+0000","last_became_active":"2023-11-20T06:41:14.262551+0000","last_became_peered":"2023-11-20T06:41:14.262551+0000","last_unstale":"2023-11-20T06:41:19.578465+0000","last_undegraded":"2023-11-20T06:41:19.578465+0000","last_fullsized":"2023-11-20T06:41:19.578465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:08:41.021374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315807+0000","last_change":"2023-11-20T06:41:13.251311+0000","last_active":"2023-11-20T06:41:19.315807+0000","last_peered":"2023-11-20T06:41:19.315807+0000","last_clean":"2023-11-20T06:41:19.315807+0000","last_became_active":"2023-11-20T06:41:13.251022+0000","last_became_peered":"2023-11-20T06:41:13.251022+0000","last_unstale":"2023-11-20T06:41:19.315807+0000","last_undegraded":"2023-11-20T06:41:19.315807+0000","last_fullsized":"2023-11-20T06:41:19.315807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:20.467472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.316272+0000","last_change":"2023-11-20T06:41:18.899620+0000","last_active":"2023-11-20T06:41:20.316272+0000","last_peered":"2023-11-20T06:41:20.316272+0000","last_clean":"2023-11-20T06:41:20.316272+0000","last_became_active":"2023-11-20T06:41:18.899201+0000","last_became_peered":"2023-11-20T06:41:18.899201+0000","last_unstale":"2023-11-20T06:41:20.316272+0000","last_undegraded":"2023-11-20T06:41:20.316272+0000","last_fullsized":"2023-11-20T06:41:20.316272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:16:52.140361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.584296+0000","last_change":"2023-11-20T06:41:14.270250+0000","last_active":"2023-11-20T06:41:19.584296+0000","last_peered":"2023-11-20T06:41:19.584296+0000","last_clean":"2023-11-20T06:41:19.584296+0000","last_became_active":"2023-11-20T06:41:14.269658+0000","last_became_peered":"2023-11-20T06:41:14.269658+0000","last_unstale":"2023-11-20T06:41:19.584296+0000","last_undegraded":"2023-11-20T06:41:19.584296+0000","last_fullsized":"2023-11-20T06:41:19.584296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:27:59.872035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.663105+0000","last_change":"2023-11-20T06:41:13.241077+0000","last_active":"2023-11-20T06:41:19.663105+0000","last_peered":"2023-11-20T06:41:19.663105+0000","last_clean":"2023-11-20T06:41:19.663105+0000","last_became_active":"2023-11-20T06:41:13.240478+0000","last_became_peered":"2023-11-20T06:41:13.240478+0000","last_unstale":"2023-11-20T06:41:19.663105+0000","last_undegraded":"2023-11-20T06:41:19.663105+0000","last_fullsized":"2023-11-20T06:41:19.663105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:16:12.804737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.313191+0000","last_change":"2023-11-20T06:41:18.899891+0000","last_active":"2023-11-20T06:41:20.313191+0000","last_peered":"2023-11-20T06:41:20.313191+0000","last_clean":"2023-11-20T06:41:20.313191+0000","last_became_active":"2023-11-20T06:41:18.899023+0000","last_became_peered":"2023-11-20T06:41:18.899023+0000","last_unstale":"2023-11-20T06:41:20.313191+0000","last_undegraded":"2023-11-20T06:41:20.313191+0000","last_fullsized":"2023-11-20T06:41:20.313191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:37:56.697790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662455+0000","last_change":"2023-11-20T06:41:14.257593+0000","last_active":"2023-11-20T06:41:19.662455+0000","last_peered":"2023-11-20T06:41:19.662455+0000","last_clean":"2023-11-20T06:41:19.662455+0000","last_became_active":"2023-11-20T06:41:14.257296+0000","last_became_peered":"2023-11-20T06:41:14.257296+0000","last_unstale":"2023-11-20T06:41:19.662455+0000","last_undegraded":"2023-11-20T06:41:19.662455+0000","last_fullsized":"2023-11-20T06:41:19.662455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:25.537288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931571+0000","last_change":"2023-11-20T06:41:13.253474+0000","last_active":"2023-11-20T06:41:19.931571+0000","last_peered":"2023-11-20T06:41:19.931571+0000","last_clean":"2023-11-20T06:41:19.931571+0000","last_became_active":"2023-11-20T06:41:13.253199+0000","last_became_peered":"2023-11-20T06:41:13.253199+0000","last_unstale":"2023-11-20T06:41:19.931571+0000","last_undegraded":"2023-11-20T06:41:19.931571+0000","last_fullsized":"2023-11-20T06:41:19.931571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:36:43.073673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.679008+0000","last_change":"2023-11-20T06:41:18.897668+0000","last_active":"2023-11-20T06:41:20.679008+0000","last_peered":"2023-11-20T06:41:20.679008+0000","last_clean":"2023-11-20T06:41:20.679008+0000","last_became_active":"2023-11-20T06:41:18.897265+0000","last_became_peered":"2023-11-20T06:41:18.897265+0000","last_unstale":"2023-11-20T06:41:20.679008+0000","last_undegraded":"2023-11-20T06:41:20.679008+0000","last_fullsized":"2023-11-20T06:41:20.679008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:00:16.728243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.788104+0000","last_change":"2023-11-20T06:41:14.277073+0000","last_active":"2023-11-20T06:41:19.788104+0000","last_peered":"2023-11-20T06:41:19.788104+0000","last_clean":"2023-11-20T06:41:19.788104+0000","last_became_active":"2023-11-20T06:41:14.276783+0000","last_became_peered":"2023-11-20T06:41:14.276783+0000","last_unstale":"2023-11-20T06:41:19.788104+0000","last_undegraded":"2023-11-20T06:41:19.788104+0000","last_fullsized":"2023-11-20T06:41:19.788104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:07:38.977327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662498+0000","last_change":"2023-11-20T06:41:13.244589+0000","last_active":"2023-11-20T06:41:19.662498+0000","last_peered":"2023-11-20T06:41:19.662498+0000","last_clean":"2023-11-20T06:41:19.662498+0000","last_became_active":"2023-11-20T06:41:13.244242+0000","last_became_peered":"2023-11-20T06:41:13.244242+0000","last_unstale":"2023-11-20T06:41:19.662498+0000","last_undegraded":"2023-11-20T06:41:19.662498+0000","last_fullsized":"2023-11-20T06:41:19.662498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:01:37.302430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.743291+0000","last_change":"2023-11-20T06:41:18.302053+0000","last_active":"2023-11-20T06:41:20.743291+0000","last_peered":"2023-11-20T06:41:20.743291+0000","last_clean":"2023-11-20T06:41:20.743291+0000","last_became_active":"2023-11-20T06:41:18.301615+0000","last_became_peered":"2023-11-20T06:41:18.301615+0000","last_unstale":"2023-11-20T06:41:20.743291+0000","last_undegraded":"2023-11-20T06:41:20.743291+0000","last_fullsized":"2023-11-20T06:41:20.743291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:16:52.140361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314736+0000","last_change":"2023-11-20T06:41:14.268552+0000","last_active":"2023-11-20T06:41:19.314736+0000","last_peered":"2023-11-20T06:41:19.314736+0000","last_clean":"2023-11-20T06:41:19.314736+0000","last_became_active":"2023-11-20T06:41:14.268201+0000","last_became_peered":"2023-11-20T06:41:14.268201+0000","last_unstale":"2023-11-20T06:41:19.314736+0000","last_undegraded":"2023-11-20T06:41:19.314736+0000","last_fullsized":"2023-11-20T06:41:19.314736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:13:30.790091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787765+0000","last_change":"2023-11-20T06:41:13.249876+0000","last_active":"2023-11-20T06:41:19.787765+0000","last_peered":"2023-11-20T06:41:19.787765+0000","last_clean":"2023-11-20T06:41:19.787765+0000","last_became_active":"2023-11-20T06:41:13.249316+0000","last_became_peered":"2023-11-20T06:41:13.249316+0000","last_unstale":"2023-11-20T06:41:19.787765+0000","last_undegraded":"2023-11-20T06:41:19.787765+0000","last_fullsized":"2023-11-20T06:41:19.787765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:20.467472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.743432+0000","last_change":"2023-11-20T06:41:18.298035+0000","last_active":"2023-11-20T06:41:20.743432+0000","last_peered":"2023-11-20T06:41:20.743432+0000","last_clean":"2023-11-20T06:41:20.743432+0000","last_became_active":"2023-11-20T06:41:18.297674+0000","last_became_peered":"2023-11-20T06:41:18.297674+0000","last_unstale":"2023-11-20T06:41:20.743432+0000","last_undegraded":"2023-11-20T06:41:20.743432+0000","last_fullsized":"2023-11-20T06:41:20.743432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:00:16.728243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662052+0000","last_change":"2023-11-20T06:41:14.258777+0000","last_active":"2023-11-20T06:41:19.662052+0000","last_peered":"2023-11-20T06:41:19.662052+0000","last_clean":"2023-11-20T06:41:19.662052+0000","last_became_active":"2023-11-20T06:41:14.258430+0000","last_became_peered":"2023-11-20T06:41:14.258430+0000","last_unstale":"2023-11-20T06:41:19.662052+0000","last_undegraded":"2023-11-20T06:41:19.662052+0000","last_fullsized":"2023-11-20T06:41:19.662052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:42:53.602834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.309513+0000","last_change":"2023-11-20T06:41:13.226120+0000","last_active":"2023-11-20T06:41:19.309513+0000","last_peered":"2023-11-20T06:41:19.309513+0000","last_clean":"2023-11-20T06:41:19.309513+0000","last_became_active":"2023-11-20T06:41:13.225814+0000","last_became_peered":"2023-11-20T06:41:13.225814+0000","last_unstale":"2023-11-20T06:41:19.309513+0000","last_undegraded":"2023-11-20T06:41:19.309513+0000","last_fullsized":"2023-11-20T06:41:19.309513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:54:25.014221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.743763+0000","last_change":"2023-11-20T06:41:18.294432+0000","last_active":"2023-11-20T06:41:20.743763+0000","last_peered":"2023-11-20T06:41:20.743763+0000","last_clean":"2023-11-20T06:41:20.743763+0000","last_became_active":"2023-11-20T06:41:18.293345+0000","last_became_peered":"2023-11-20T06:41:18.293345+0000","last_unstale":"2023-11-20T06:41:20.743763+0000","last_undegraded":"2023-11-20T06:41:20.743763+0000","last_fullsized":"2023-11-20T06:41:20.743763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:13:29.540284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578235+0000","last_change":"2023-11-20T06:41:14.250513+0000","last_active":"2023-11-20T06:41:19.578235+0000","last_peered":"2023-11-20T06:41:19.578235+0000","last_clean":"2023-11-20T06:41:19.578235+0000","last_became_active":"2023-11-20T06:41:14.250195+0000","last_became_peered":"2023-11-20T06:41:14.250195+0000","last_unstale":"2023-11-20T06:41:19.578235+0000","last_undegraded":"2023-11-20T06:41:19.578235+0000","last_fullsized":"2023-11-20T06:41:19.578235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:01:38.308533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931054+0000","last_change":"2023-11-20T06:41:13.255728+0000","last_active":"2023-11-20T06:41:19.931054+0000","last_peered":"2023-11-20T06:41:19.931054+0000","last_clean":"2023-11-20T06:41:19.931054+0000","last_became_active":"2023-11-20T06:41:13.255440+0000","last_became_peered":"2023-11-20T06:41:13.255440+0000","last_unstale":"2023-11-20T06:41:19.931054+0000","last_undegraded":"2023-11-20T06:41:19.931054+0000","last_fullsized":"2023-11-20T06:41:19.931054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:27:01.563513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.679449+0000","last_change":"2023-11-20T06:41:18.900803+0000","last_active":"2023-11-20T06:41:20.679449+0000","last_peered":"2023-11-20T06:41:20.679449+0000","last_clean":"2023-11-20T06:41:20.679449+0000","last_became_active":"2023-11-20T06:41:18.900347+0000","last_became_peered":"2023-11-20T06:41:18.900347+0000","last_unstale":"2023-11-20T06:41:20.679449+0000","last_undegraded":"2023-11-20T06:41:20.679449+0000","last_fullsized":"2023-11-20T06:41:20.679449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:32:07.244747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583650+0000","last_change":"2023-11-20T06:41:14.265573+0000","last_active":"2023-11-20T06:41:19.583650+0000","last_peered":"2023-11-20T06:41:19.583650+0000","last_clean":"2023-11-20T06:41:19.583650+0000","last_became_active":"2023-11-20T06:41:14.260035+0000","last_became_peered":"2023-11-20T06:41:14.260035+0000","last_unstale":"2023-11-20T06:41:19.583650+0000","last_undegraded":"2023-11-20T06:41:19.583650+0000","last_fullsized":"2023-11-20T06:41:19.583650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:25.537288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787737+0000","last_change":"2023-11-20T06:41:13.237196+0000","last_active":"2023-11-20T06:41:19.787737+0000","last_peered":"2023-11-20T06:41:19.787737+0000","last_clean":"2023-11-20T06:41:19.787737+0000","last_became_active":"2023-11-20T06:41:13.236793+0000","last_became_peered":"2023-11-20T06:41:13.236793+0000","last_unstale":"2023-11-20T06:41:19.787737+0000","last_undegraded":"2023-11-20T06:41:19.787737+0000","last_fullsized":"2023-11-20T06:41:19.787737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:44:08.985984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.930761+0000","last_change":"2023-11-20T06:41:03.783345+0000","last_active":"2023-11-20T06:41:19.930761+0000","last_peered":"2023-11-20T06:41:19.930761+0000","last_clean":"2023-11-20T06:41:19.930761+0000","last_became_active":"2023-11-20T06:41:03.782257+0000","last_became_peered":"2023-11-20T06:41:03.782257+0000","last_unstale":"2023-11-20T06:41:19.930761+0000","last_undegraded":"2023-11-20T06:41:19.930761+0000","last_fullsized":"2023-11-20T06:41:19.930761+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:01.979090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:01.979090+0000","last_clean_scrub_stamp":"2023-11-20T06:41:01.979090+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:20:41.084382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.746476+0000","last_change":"2023-11-20T06:41:18.903133+0000","last_active":"2023-11-20T06:41:20.746476+0000","last_peered":"2023-11-20T06:41:20.746476+0000","last_clean":"2023-11-20T06:41:20.746476+0000","last_became_active":"2023-11-20T06:41:18.902697+0000","last_became_peered":"2023-11-20T06:41:18.902697+0000","last_unstale":"2023-11-20T06:41:20.746476+0000","last_undegraded":"2023-11-20T06:41:20.746476+0000","last_fullsized":"2023-11-20T06:41:20.746476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:57:19.944479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931329+0000","last_change":"2023-11-20T06:41:14.263973+0000","last_active":"2023-11-20T06:41:19.931329+0000","last_peered":"2023-11-20T06:41:19.931329+0000","last_clean":"2023-11-20T06:41:19.931329+0000","last_became_active":"2023-11-20T06:41:14.263492+0000","last_became_peered":"2023-11-20T06:41:14.263492+0000","last_unstale":"2023-11-20T06:41:19.931329+0000","last_undegraded":"2023-11-20T06:41:19.931329+0000","last_fullsized":"2023-11-20T06:41:19.931329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:07:38.977327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.310124+0000","last_change":"2023-11-20T06:41:13.233779+0000","last_active":"2023-11-20T06:41:19.310124+0000","last_peered":"2023-11-20T06:41:19.310124+0000","last_clean":"2023-11-20T06:41:19.310124+0000","last_became_active":"2023-11-20T06:41:13.233388+0000","last_became_peered":"2023-11-20T06:41:13.233388+0000","last_unstale":"2023-11-20T06:41:19.310124+0000","last_undegraded":"2023-11-20T06:41:19.310124+0000","last_fullsized":"2023-11-20T06:41:19.310124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:52:48.691091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.746246+0000","last_change":"2023-11-20T06:41:18.899818+0000","last_active":"2023-11-20T06:41:20.746246+0000","last_peered":"2023-11-20T06:41:20.746246+0000","last_clean":"2023-11-20T06:41:20.746246+0000","last_became_active":"2023-11-20T06:41:18.899254+0000","last_became_peered":"2023-11-20T06:41:18.899254+0000","last_unstale":"2023-11-20T06:41:20.746246+0000","last_undegraded":"2023-11-20T06:41:20.746246+0000","last_fullsized":"2023-11-20T06:41:20.746246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:49:36.631359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787891+0000","last_change":"2023-11-20T06:41:14.277327+0000","last_active":"2023-11-20T06:41:19.787891+0000","last_peered":"2023-11-20T06:41:19.787891+0000","last_clean":"2023-11-20T06:41:19.787891+0000","last_became_active":"2023-11-20T06:41:14.276750+0000","last_became_peered":"2023-11-20T06:41:14.276750+0000","last_unstale":"2023-11-20T06:41:19.787891+0000","last_undegraded":"2023-11-20T06:41:19.787891+0000","last_fullsized":"2023-11-20T06:41:19.787891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:07:43.904895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662857+0000","last_change":"2023-11-20T06:41:13.237042+0000","last_active":"2023-11-20T06:41:19.662857+0000","last_peered":"2023-11-20T06:41:19.662857+0000","last_clean":"2023-11-20T06:41:19.662857+0000","last_became_active":"2023-11-20T06:41:13.236730+0000","last_became_peered":"2023-11-20T06:41:13.236730+0000","last_unstale":"2023-11-20T06:41:19.662857+0000","last_undegraded":"2023-11-20T06:41:19.662857+0000","last_fullsized":"2023-11-20T06:41:19.662857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:20.467472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.679071+0000","last_change":"2023-11-20T06:41:18.300034+0000","last_active":"2023-11-20T06:41:20.679071+0000","last_peered":"2023-11-20T06:41:20.679071+0000","last_clean":"2023-11-20T06:41:20.679071+0000","last_became_active":"2023-11-20T06:41:18.299636+0000","last_became_peered":"2023-11-20T06:41:18.299636+0000","last_unstale":"2023-11-20T06:41:20.679071+0000","last_undegraded":"2023-11-20T06:41:20.679071+0000","last_fullsized":"2023-11-20T06:41:20.679071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:25:06.683699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931760+0000","last_change":"2023-11-20T06:41:14.273791+0000","last_active":"2023-11-20T06:41:19.931760+0000","last_peered":"2023-11-20T06:41:19.931760+0000","last_clean":"2023-11-20T06:41:19.931760+0000","last_became_active":"2023-11-20T06:41:14.273507+0000","last_became_peered":"2023-11-20T06:41:14.273507+0000","last_unstale":"2023-11-20T06:41:19.931760+0000","last_undegraded":"2023-11-20T06:41:19.931760+0000","last_fullsized":"2023-11-20T06:41:19.931760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:00:12.676212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.310448+0000","last_change":"2023-11-20T06:41:13.243381+0000","last_active":"2023-11-20T06:41:19.310448+0000","last_peered":"2023-11-20T06:41:19.310448+0000","last_clean":"2023-11-20T06:41:19.310448+0000","last_became_active":"2023-11-20T06:41:13.242286+0000","last_became_peered":"2023-11-20T06:41:13.242286+0000","last_unstale":"2023-11-20T06:41:19.310448+0000","last_undegraded":"2023-11-20T06:41:19.310448+0000","last_fullsized":"2023-11-20T06:41:19.310448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:13:29.783988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.315374+0000","last_change":"2023-11-20T06:41:18.900675+0000","last_active":"2023-11-20T06:41:20.315374+0000","last_peered":"2023-11-20T06:41:20.315374+0000","last_clean":"2023-11-20T06:41:20.315374+0000","last_became_active":"2023-11-20T06:41:18.899705+0000","last_became_peered":"2023-11-20T06:41:18.899705+0000","last_unstale":"2023-11-20T06:41:20.315374+0000","last_undegraded":"2023-11-20T06:41:20.315374+0000","last_fullsized":"2023-11-20T06:41:20.315374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:49:09.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931619+0000","last_change":"2023-11-20T06:41:14.261198+0000","last_active":"2023-11-20T06:41:19.931619+0000","last_peered":"2023-11-20T06:41:19.931619+0000","last_clean":"2023-11-20T06:41:19.931619+0000","last_became_active":"2023-11-20T06:41:14.260837+0000","last_became_peered":"2023-11-20T06:41:14.260837+0000","last_unstale":"2023-11-20T06:41:19.931619+0000","last_undegraded":"2023-11-20T06:41:19.931619+0000","last_fullsized":"2023-11-20T06:41:19.931619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:57:15.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314546+0000","last_change":"2023-11-20T06:41:13.234116+0000","last_active":"2023-11-20T06:41:19.314546+0000","last_peered":"2023-11-20T06:41:19.314546+0000","last_clean":"2023-11-20T06:41:19.314546+0000","last_became_active":"2023-11-20T06:41:13.233691+0000","last_became_peered":"2023-11-20T06:41:13.233691+0000","last_unstale":"2023-11-20T06:41:19.314546+0000","last_undegraded":"2023-11-20T06:41:19.314546+0000","last_fullsized":"2023-11-20T06:41:19.314546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:44:08.985984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.315962+0000","last_change":"2023-11-20T06:41:18.295800+0000","last_active":"2023-11-20T06:41:20.315962+0000","last_peered":"2023-11-20T06:41:20.315962+0000","last_clean":"2023-11-20T06:41:20.315962+0000","last_became_active":"2023-11-20T06:41:18.295366+0000","last_became_peered":"2023-11-20T06:41:18.295366+0000","last_unstale":"2023-11-20T06:41:20.315962+0000","last_undegraded":"2023-11-20T06:41:20.315962+0000","last_fullsized":"2023-11-20T06:41:20.315962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:49:36.631359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931202+0000","last_change":"2023-11-20T06:41:14.274139+0000","last_active":"2023-11-20T06:41:19.931202+0000","last_peered":"2023-11-20T06:41:19.931202+0000","last_clean":"2023-11-20T06:41:19.931202+0000","last_became_active":"2023-11-20T06:41:14.273838+0000","last_became_peered":"2023-11-20T06:41:14.273838+0000","last_unstale":"2023-11-20T06:41:19.931202+0000","last_undegraded":"2023-11-20T06:41:19.931202+0000","last_fullsized":"2023-11-20T06:41:19.931202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:27:59.872035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.309437+0000","last_change":"2023-11-20T06:41:13.238251+0000","last_active":"2023-11-20T06:41:19.309437+0000","last_peered":"2023-11-20T06:41:19.309437+0000","last_clean":"2023-11-20T06:41:19.309437+0000","last_became_active":"2023-11-20T06:41:13.237920+0000","last_became_peered":"2023-11-20T06:41:13.237920+0000","last_unstale":"2023-11-20T06:41:19.309437+0000","last_undegraded":"2023-11-20T06:41:19.309437+0000","last_fullsized":"2023-11-20T06:41:19.309437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:44:08.985984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.679312+0000","last_change":"2023-11-20T06:41:18.292764+0000","last_active":"2023-11-20T06:41:20.679312+0000","last_peered":"2023-11-20T06:41:20.679312+0000","last_clean":"2023-11-20T06:41:20.679312+0000","last_became_active":"2023-11-20T06:41:18.292352+0000","last_became_peered":"2023-11-20T06:41:18.292352+0000","last_unstale":"2023-11-20T06:41:20.679312+0000","last_undegraded":"2023-11-20T06:41:20.679312+0000","last_fullsized":"2023-11-20T06:41:20.679312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:13:29.540284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314386+0000","last_change":"2023-11-20T06:41:14.273982+0000","last_active":"2023-11-20T06:41:19.314386+0000","last_peered":"2023-11-20T06:41:19.314386+0000","last_clean":"2023-11-20T06:41:19.314386+0000","last_became_active":"2023-11-20T06:41:14.273301+0000","last_became_peered":"2023-11-20T06:41:14.273301+0000","last_unstale":"2023-11-20T06:41:19.314386+0000","last_undegraded":"2023-11-20T06:41:19.314386+0000","last_fullsized":"2023-11-20T06:41:19.314386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:06:44.444162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314956+0000","last_change":"2023-11-20T06:41:13.246748+0000","last_active":"2023-11-20T06:41:19.314956+0000","last_peered":"2023-11-20T06:41:19.314956+0000","last_clean":"2023-11-20T06:41:19.314956+0000","last_became_active":"2023-11-20T06:41:13.246302+0000","last_became_peered":"2023-11-20T06:41:13.246302+0000","last_unstale":"2023-11-20T06:41:19.314956+0000","last_undegraded":"2023-11-20T06:41:19.314956+0000","last_fullsized":"2023-11-20T06:41:19.314956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:27:01.563513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.314405+0000","last_change":"2023-11-20T06:41:18.897842+0000","last_active":"2023-11-20T06:41:20.314405+0000","last_peered":"2023-11-20T06:41:20.314405+0000","last_clean":"2023-11-20T06:41:20.314405+0000","last_became_active":"2023-11-20T06:41:18.896898+0000","last_became_peered":"2023-11-20T06:41:18.896898+0000","last_unstale":"2023-11-20T06:41:20.314405+0000","last_undegraded":"2023-11-20T06:41:20.314405+0000","last_fullsized":"2023-11-20T06:41:20.314405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:18:24.107898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931464+0000","last_change":"2023-11-20T06:41:14.274131+0000","last_active":"2023-11-20T06:41:19.931464+0000","last_peered":"2023-11-20T06:41:19.931464+0000","last_clean":"2023-11-20T06:41:19.931464+0000","last_became_active":"2023-11-20T06:41:14.273690+0000","last_became_peered":"2023-11-20T06:41:14.273690+0000","last_unstale":"2023-11-20T06:41:19.931464+0000","last_undegraded":"2023-11-20T06:41:19.931464+0000","last_fullsized":"2023-11-20T06:41:19.931464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:49:32.579328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787724+0000","last_change":"2023-11-20T06:41:13.257423+0000","last_active":"2023-11-20T06:41:19.787724+0000","last_peered":"2023-11-20T06:41:19.787724+0000","last_clean":"2023-11-20T06:41:19.787724+0000","last_became_active":"2023-11-20T06:41:13.256548+0000","last_became_peered":"2023-11-20T06:41:13.256548+0000","last_unstale":"2023-11-20T06:41:19.787724+0000","last_undegraded":"2023-11-20T06:41:19.787724+0000","last_fullsized":"2023-11-20T06:41:19.787724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:56:08.376468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.313587+0000","last_change":"2023-11-20T06:41:18.898144+0000","last_active":"2023-11-20T06:41:20.313587+0000","last_peered":"2023-11-20T06:41:20.313587+0000","last_clean":"2023-11-20T06:41:20.313587+0000","last_became_active":"2023-11-20T06:41:18.897259+0000","last_became_peered":"2023-11-20T06:41:18.897259+0000","last_unstale":"2023-11-20T06:41:20.313587+0000","last_undegraded":"2023-11-20T06:41:20.313587+0000","last_fullsized":"2023-11-20T06:41:20.313587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:21:39.903978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578463+0000","last_change":"2023-11-20T06:41:14.265376+0000","last_active":"2023-11-20T06:41:19.578463+0000","last_peered":"2023-11-20T06:41:19.578463+0000","last_clean":"2023-11-20T06:41:19.578463+0000","last_became_active":"2023-11-20T06:41:14.264937+0000","last_became_peered":"2023-11-20T06:41:14.264937+0000","last_unstale":"2023-11-20T06:41:19.578463+0000","last_undegraded":"2023-11-20T06:41:19.578463+0000","last_fullsized":"2023-11-20T06:41:19.578463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:21.473575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578629+0000","last_change":"2023-11-20T06:41:13.239163+0000","last_active":"2023-11-20T06:41:19.578629+0000","last_peered":"2023-11-20T06:41:19.578629+0000","last_clean":"2023-11-20T06:41:19.578629+0000","last_became_active":"2023-11-20T06:41:13.238828+0000","last_became_peered":"2023-11-20T06:41:13.238828+0000","last_unstale":"2023-11-20T06:41:19.578629+0000","last_undegraded":"2023-11-20T06:41:19.578629+0000","last_fullsized":"2023-11-20T06:41:19.578629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:13:29.783988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.317093+0000","last_change":"2023-11-20T06:41:18.899795+0000","last_active":"2023-11-20T06:41:20.317093+0000","last_peered":"2023-11-20T06:41:20.317093+0000","last_clean":"2023-11-20T06:41:20.317093+0000","last_became_active":"2023-11-20T06:41:18.899270+0000","last_became_peered":"2023-11-20T06:41:18.899270+0000","last_unstale":"2023-11-20T06:41:20.317093+0000","last_undegraded":"2023-11-20T06:41:20.317093+0000","last_fullsized":"2023-11-20T06:41:20.317093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:13:29.540284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931226+0000","last_change":"2023-11-20T06:41:14.275627+0000","last_active":"2023-11-20T06:41:19.931226+0000","last_peered":"2023-11-20T06:41:19.931226+0000","last_clean":"2023-11-20T06:41:19.931226+0000","last_became_active":"2023-11-20T06:41:14.272890+0000","last_became_peered":"2023-11-20T06:41:14.272890+0000","last_unstale":"2023-11-20T06:41:19.931226+0000","last_undegraded":"2023-11-20T06:41:19.931226+0000","last_fullsized":"2023-11-20T06:41:19.931226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:20:01.827771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:29.363554+0000","last_change":"2023-11-20T06:41:13.245874+0000","last_active":"2023-11-20T06:41:29.363554+0000","last_peered":"2023-11-20T06:41:29.363554+0000","last_clean":"2023-11-20T06:41:29.363554+0000","last_became_active":"2023-11-20T06:41:13.245454+0000","last_became_peered":"2023-11-20T06:41:13.245454+0000","last_unstale":"2023-11-20T06:41:29.363554+0000","last_undegraded":"2023-11-20T06:41:29.363554+0000","last_fullsized":"2023-11-20T06:41:29.363554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:56:08.376468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.743578+0000","last_change":"2023-11-20T06:41:18.299146+0000","last_active":"2023-11-20T06:41:20.743578+0000","last_peered":"2023-11-20T06:41:20.743578+0000","last_clean":"2023-11-20T06:41:20.743578+0000","last_became_active":"2023-11-20T06:41:18.298722+0000","last_became_peered":"2023-11-20T06:41:18.298722+0000","last_unstale":"2023-11-20T06:41:20.743578+0000","last_undegraded":"2023-11-20T06:41:20.743578+0000","last_fullsized":"2023-11-20T06:41:20.743578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:25:06.683699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315269+0000","last_change":"2023-11-20T06:41:14.263229+0000","last_active":"2023-11-20T06:41:19.315269+0000","last_peered":"2023-11-20T06:41:19.315269+0000","last_clean":"2023-11-20T06:41:19.315269+0000","last_became_active":"2023-11-20T06:41:14.262970+0000","last_became_peered":"2023-11-20T06:41:14.262970+0000","last_unstale":"2023-11-20T06:41:19.315269+0000","last_undegraded":"2023-11-20T06:41:19.315269+0000","last_fullsized":"2023-11-20T06:41:19.315269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:15:34.522340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662861+0000","last_change":"2023-11-20T06:41:13.238315+0000","last_active":"2023-11-20T06:41:19.662861+0000","last_peered":"2023-11-20T06:41:19.662861+0000","last_clean":"2023-11-20T06:41:19.662861+0000","last_became_active":"2023-11-20T06:41:13.237159+0000","last_became_peered":"2023-11-20T06:41:13.237159+0000","last_unstale":"2023-11-20T06:41:19.662861+0000","last_undegraded":"2023-11-20T06:41:19.662861+0000","last_fullsized":"2023-11-20T06:41:19.662861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:56:08.376468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.316149+0000","last_change":"2023-11-20T06:41:18.301654+0000","last_active":"2023-11-20T06:41:20.316149+0000","last_peered":"2023-11-20T06:41:20.316149+0000","last_clean":"2023-11-20T06:41:20.316149+0000","last_became_active":"2023-11-20T06:41:18.301243+0000","last_became_peered":"2023-11-20T06:41:18.301243+0000","last_unstale":"2023-11-20T06:41:20.316149+0000","last_undegraded":"2023-11-20T06:41:20.316149+0000","last_fullsized":"2023-11-20T06:41:20.316149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:13:30.194807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578630+0000","last_change":"2023-11-20T06:41:14.251212+0000","last_active":"2023-11-20T06:41:19.578630+0000","last_peered":"2023-11-20T06:41:19.578630+0000","last_clean":"2023-11-20T06:41:19.578630+0000","last_became_active":"2023-11-20T06:41:14.250584+0000","last_became_peered":"2023-11-20T06:41:14.250584+0000","last_unstale":"2023-11-20T06:41:19.578630+0000","last_undegraded":"2023-11-20T06:41:19.578630+0000","last_fullsized":"2023-11-20T06:41:19.578630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:35:30.568821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.788069+0000","last_change":"2023-11-20T06:41:13.255026+0000","last_active":"2023-11-20T06:41:19.788069+0000","last_peered":"2023-11-20T06:41:19.788069+0000","last_clean":"2023-11-20T06:41:19.788069+0000","last_became_active":"2023-11-20T06:41:13.254057+0000","last_became_peered":"2023-11-20T06:41:13.254057+0000","last_unstale":"2023-11-20T06:41:19.788069+0000","last_undegraded":"2023-11-20T06:41:19.788069+0000","last_fullsized":"2023-11-20T06:41:19.788069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:01:37.302430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.313428+0000","last_change":"2023-11-20T06:41:18.295335+0000","last_active":"2023-11-20T06:41:20.313428+0000","last_peered":"2023-11-20T06:41:20.313428+0000","last_clean":"2023-11-20T06:41:20.313428+0000","last_became_active":"2023-11-20T06:41:18.294740+0000","last_became_peered":"2023-11-20T06:41:18.294740+0000","last_unstale":"2023-11-20T06:41:20.313428+0000","last_undegraded":"2023-11-20T06:41:20.313428+0000","last_fullsized":"2023-11-20T06:41:20.313428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:52:52.872039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.788050+0000","last_change":"2023-11-20T06:41:14.276548+0000","last_active":"2023-11-20T06:41:19.788050+0000","last_peered":"2023-11-20T06:41:19.788050+0000","last_clean":"2023-11-20T06:41:19.788050+0000","last_became_active":"2023-11-20T06:41:14.261629+0000","last_became_peered":"2023-11-20T06:41:14.261629+0000","last_unstale":"2023-11-20T06:41:19.788050+0000","last_undegraded":"2023-11-20T06:41:19.788050+0000","last_fullsized":"2023-11-20T06:41:19.788050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:49:32.579328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315706+0000","last_change":"2023-11-20T06:41:13.258736+0000","last_active":"2023-11-20T06:41:19.315706+0000","last_peered":"2023-11-20T06:41:19.315706+0000","last_clean":"2023-11-20T06:41:19.315706+0000","last_became_active":"2023-11-20T06:41:13.258459+0000","last_became_peered":"2023-11-20T06:41:13.258459+0000","last_unstale":"2023-11-20T06:41:19.315706+0000","last_undegraded":"2023-11-20T06:41:19.315706+0000","last_fullsized":"2023-11-20T06:41:19.315706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:16:12.804737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.313326+0000","last_change":"2023-11-20T06:41:18.897111+0000","last_active":"2023-11-20T06:41:20.313326+0000","last_peered":"2023-11-20T06:41:20.313326+0000","last_clean":"2023-11-20T06:41:20.313326+0000","last_became_active":"2023-11-20T06:41:18.896661+0000","last_became_peered":"2023-11-20T06:41:18.896661+0000","last_unstale":"2023-11-20T06:41:20.313326+0000","last_undegraded":"2023-11-20T06:41:20.313326+0000","last_fullsized":"2023-11-20T06:41:20.313326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:19:44.001789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.679176+0000","last_change":"2023-11-20T06:41:18.900073+0000","last_active":"2023-11-20T06:41:20.679176+0000","last_peered":"2023-11-20T06:41:20.679176+0000","last_clean":"2023-11-20T06:41:20.679176+0000","last_became_active":"2023-11-20T06:41:18.898514+0000","last_became_peered":"2023-11-20T06:41:18.898514+0000","last_unstale":"2023-11-20T06:41:20.679176+0000","last_undegraded":"2023-11-20T06:41:20.679176+0000","last_fullsized":"2023-11-20T06:41:20.679176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:49:09.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.661897+0000","last_change":"2023-11-20T06:41:14.264028+0000","last_active":"2023-11-20T06:41:19.661897+0000","last_peered":"2023-11-20T06:41:19.661897+0000","last_clean":"2023-11-20T06:41:19.661897+0000","last_became_active":"2023-11-20T06:41:14.263528+0000","last_became_peered":"2023-11-20T06:41:14.263528+0000","last_unstale":"2023-11-20T06:41:19.661897+0000","last_undegraded":"2023-11-20T06:41:19.661897+0000","last_fullsized":"2023-11-20T06:41:19.661897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:06:44.444162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787639+0000","last_change":"2023-11-20T06:41:13.247680+0000","last_active":"2023-11-20T06:41:19.787639+0000","last_peered":"2023-11-20T06:41:19.787639+0000","last_clean":"2023-11-20T06:41:19.787639+0000","last_became_active":"2023-11-20T06:41:13.247333+0000","last_became_peered":"2023-11-20T06:41:13.247333+0000","last_unstale":"2023-11-20T06:41:19.787639+0000","last_undegraded":"2023-11-20T06:41:19.787639+0000","last_fullsized":"2023-11-20T06:41:19.787639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:42:52.596731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.746665+0000","last_change":"2023-11-20T06:41:18.306274+0000","last_active":"2023-11-20T06:41:20.746665+0000","last_peered":"2023-11-20T06:41:20.746665+0000","last_clean":"2023-11-20T06:41:20.746665+0000","last_became_active":"2023-11-20T06:41:18.305628+0000","last_became_peered":"2023-11-20T06:41:18.305628+0000","last_unstale":"2023-11-20T06:41:20.746665+0000","last_undegraded":"2023-11-20T06:41:20.746665+0000","last_fullsized":"2023-11-20T06:41:20.746665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:13:30.194807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583459+0000","last_change":"2023-11-20T06:41:14.268805+0000","last_active":"2023-11-20T06:41:19.583459+0000","last_peered":"2023-11-20T06:41:19.583459+0000","last_clean":"2023-11-20T06:41:19.583459+0000","last_became_active":"2023-11-20T06:41:14.268489+0000","last_became_peered":"2023-11-20T06:41:14.268489+0000","last_unstale":"2023-11-20T06:41:19.583459+0000","last_undegraded":"2023-11-20T06:41:19.583459+0000","last_fullsized":"2023-11-20T06:41:19.583459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:06:44.444162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583458+0000","last_change":"2023-11-20T06:41:13.242442+0000","last_active":"2023-11-20T06:41:19.583458+0000","last_peered":"2023-11-20T06:41:19.583458+0000","last_clean":"2023-11-20T06:41:19.583458+0000","last_became_active":"2023-11-20T06:41:13.242113+0000","last_became_peered":"2023-11-20T06:41:13.242113+0000","last_unstale":"2023-11-20T06:41:19.583458+0000","last_undegraded":"2023-11-20T06:41:19.583458+0000","last_fullsized":"2023-11-20T06:41:19.583458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:54:25.014221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314850+0000","last_change":"2023-11-20T06:41:13.246961+0000","last_active":"2023-11-20T06:41:19.314850+0000","last_peered":"2023-11-20T06:41:19.314850+0000","last_clean":"2023-11-20T06:41:19.314850+0000","last_became_active":"2023-11-20T06:41:13.245832+0000","last_became_peered":"2023-11-20T06:41:13.245832+0000","last_unstale":"2023-11-20T06:41:19.314850+0000","last_undegraded":"2023-11-20T06:41:19.314850+0000","last_fullsized":"2023-11-20T06:41:19.314850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:01:37.302430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578545+0000","last_change":"2023-11-20T06:41:14.263883+0000","last_active":"2023-11-20T06:41:19.578545+0000","last_peered":"2023-11-20T06:41:19.578545+0000","last_clean":"2023-11-20T06:41:19.578545+0000","last_became_active":"2023-11-20T06:41:14.263575+0000","last_became_peered":"2023-11-20T06:41:14.263575+0000","last_unstale":"2023-11-20T06:41:19.578545+0000","last_undegraded":"2023-11-20T06:41:19.578545+0000","last_fullsized":"2023-11-20T06:41:19.578545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:03:05.538623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.590487+0000","last_change":"2023-11-20T06:41:18.306473+0000","last_active":"2023-11-20T06:41:20.590487+0000","last_peered":"2023-11-20T06:41:20.590487+0000","last_clean":"2023-11-20T06:41:20.590487+0000","last_became_active":"2023-11-20T06:41:18.305307+0000","last_became_peered":"2023-11-20T06:41:18.305307+0000","last_unstale":"2023-11-20T06:41:20.590487+0000","last_undegraded":"2023-11-20T06:41:20.590487+0000","last_fullsized":"2023-11-20T06:41:20.590487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:04:25.525606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583794+0000","last_change":"2023-11-20T06:41:13.244143+0000","last_active":"2023-11-20T06:41:19.583794+0000","last_peered":"2023-11-20T06:41:19.583794+0000","last_clean":"2023-11-20T06:41:19.583794+0000","last_became_active":"2023-11-20T06:41:13.242220+0000","last_became_peered":"2023-11-20T06:41:13.242220+0000","last_unstale":"2023-11-20T06:41:19.583794+0000","last_undegraded":"2023-11-20T06:41:19.583794+0000","last_fullsized":"2023-11-20T06:41:19.583794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:12.202199+0000","last_clean_scrub_stamp":"2023-11-20T06:41:12.202199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:16:12.804737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.313569+0000","last_change":"2023-11-20T06:41:14.266403+0000","last_active":"2023-11-20T06:41:19.313569+0000","last_peered":"2023-11-20T06:41:19.313569+0000","last_clean":"2023-11-20T06:41:19.313569+0000","last_became_active":"2023-11-20T06:41:14.266135+0000","last_became_peered":"2023-11-20T06:41:14.266135+0000","last_unstale":"2023-11-20T06:41:19.313569+0000","last_undegraded":"2023-11-20T06:41:19.313569+0000","last_fullsized":"2023-11-20T06:41:19.313569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:48:13.769350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-20T06:41:20.314045+0000","last_change":"2023-11-20T06:41:18.299944+0000","last_active":"2023-11-20T06:41:20.314045+0000","last_peered":"2023-11-20T06:41:20.314045+0000","last_clean":"2023-11-20T06:41:20.314045+0000","last_became_active":"2023-11-20T06:41:18.298166+0000","last_became_peered":"2023-11-20T06:41:18.298166+0000","last_unstale":"2023-11-20T06:41:20.314045+0000","last_undegraded":"2023-11-20T06:41:20.314045+0000","last_fullsized":"2023-11-20T06:41:20.314045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:17.260333+0000","last_clean_scrub_stamp":"2023-11-20T06:41:17.260333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:15:14.873283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314208+0000","last_change":"2023-11-20T06:41:14.274186+0000","last_active":"2023-11-20T06:41:19.314208+0000","last_peered":"2023-11-20T06:41:19.314208+0000","last_clean":"2023-11-20T06:41:19.314208+0000","last_became_active":"2023-11-20T06:41:14.273726+0000","last_became_peered":"2023-11-20T06:41:14.273726+0000","last_unstale":"2023-11-20T06:41:19.314208+0000","last_undegraded":"2023-11-20T06:41:19.314208+0000","last_fullsized":"2023-11-20T06:41:19.314208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:36:44.079776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.309592+0000","last_change":"2023-11-20T06:41:14.256793+0000","last_active":"2023-11-20T06:41:19.309592+0000","last_peered":"2023-11-20T06:41:19.309592+0000","last_clean":"2023-11-20T06:41:19.309592+0000","last_became_active":"2023-11-20T06:41:14.256478+0000","last_became_peered":"2023-11-20T06:41:14.256478+0000","last_unstale":"2023-11-20T06:41:19.309592+0000","last_undegraded":"2023-11-20T06:41:19.309592+0000","last_fullsized":"2023-11-20T06:41:19.309592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:15:34.522340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787630+0000","last_change":"2023-11-20T06:41:14.277266+0000","last_active":"2023-11-20T06:41:19.787630+0000","last_peered":"2023-11-20T06:41:19.787630+0000","last_clean":"2023-11-20T06:41:19.787630+0000","last_became_active":"2023-11-20T06:41:14.276909+0000","last_became_peered":"2023-11-20T06:41:14.276909+0000","last_unstale":"2023-11-20T06:41:19.787630+0000","last_undegraded":"2023-11-20T06:41:19.787630+0000","last_fullsized":"2023-11-20T06:41:19.787630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:27:59.872035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578469+0000","last_change":"2023-11-20T06:41:14.264602+0000","last_active":"2023-11-20T06:41:19.578469+0000","last_peered":"2023-11-20T06:41:19.578469+0000","last_clean":"2023-11-20T06:41:19.578469+0000","last_became_active":"2023-11-20T06:41:14.264256+0000","last_became_peered":"2023-11-20T06:41:14.264256+0000","last_unstale":"2023-11-20T06:41:19.578469+0000","last_undegraded":"2023-11-20T06:41:19.578469+0000","last_fullsized":"2023-11-20T06:41:19.578469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:06:44.444162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583903+0000","last_change":"2023-11-20T06:41:14.257660+0000","last_active":"2023-11-20T06:41:19.583903+0000","last_peered":"2023-11-20T06:41:19.583903+0000","last_clean":"2023-11-20T06:41:19.583903+0000","last_became_active":"2023-11-20T06:41:14.257461+0000","last_became_peered":"2023-11-20T06:41:14.257461+0000","last_unstale":"2023-11-20T06:41:19.583903+0000","last_undegraded":"2023-11-20T06:41:19.583903+0000","last_fullsized":"2023-11-20T06:41:19.583903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:55:30.603010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662377+0000","last_change":"2023-11-20T06:41:14.266691+0000","last_active":"2023-11-20T06:41:19.662377+0000","last_peered":"2023-11-20T06:41:19.662377+0000","last_clean":"2023-11-20T06:41:19.662377+0000","last_became_active":"2023-11-20T06:41:14.266401+0000","last_became_peered":"2023-11-20T06:41:14.266401+0000","last_unstale":"2023-11-20T06:41:19.662377+0000","last_undegraded":"2023-11-20T06:41:19.662377+0000","last_fullsized":"2023-11-20T06:41:19.662377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:08:41.021374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315058+0000","last_change":"2023-11-20T06:41:14.266874+0000","last_active":"2023-11-20T06:41:19.315058+0000","last_peered":"2023-11-20T06:41:19.315058+0000","last_clean":"2023-11-20T06:41:19.315058+0000","last_became_active":"2023-11-20T06:41:14.266564+0000","last_became_peered":"2023-11-20T06:41:14.266564+0000","last_unstale":"2023-11-20T06:41:19.315058+0000","last_undegraded":"2023-11-20T06:41:19.315058+0000","last_fullsized":"2023-11-20T06:41:19.315058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:35:30.568821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.584279+0000","last_change":"2023-11-20T06:41:14.258127+0000","last_active":"2023-11-20T06:41:19.584279+0000","last_peered":"2023-11-20T06:41:19.584279+0000","last_clean":"2023-11-20T06:41:19.584279+0000","last_became_active":"2023-11-20T06:41:14.257873+0000","last_became_peered":"2023-11-20T06:41:14.257873+0000","last_unstale":"2023-11-20T06:41:19.584279+0000","last_undegraded":"2023-11-20T06:41:19.584279+0000","last_fullsized":"2023-11-20T06:41:19.584279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:07:43.904895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787515+0000","last_change":"2023-11-20T06:41:14.271045+0000","last_active":"2023-11-20T06:41:19.787515+0000","last_peered":"2023-11-20T06:41:19.787515+0000","last_clean":"2023-11-20T06:41:19.787515+0000","last_became_active":"2023-11-20T06:41:14.265731+0000","last_became_peered":"2023-11-20T06:41:14.265731+0000","last_unstale":"2023-11-20T06:41:19.787515+0000","last_undegraded":"2023-11-20T06:41:19.787515+0000","last_fullsized":"2023-11-20T06:41:19.787515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:45.059330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583398+0000","last_change":"2023-11-20T06:41:14.259066+0000","last_active":"2023-11-20T06:41:19.583398+0000","last_peered":"2023-11-20T06:41:19.583398+0000","last_clean":"2023-11-20T06:41:19.583398+0000","last_became_active":"2023-11-20T06:41:14.258818+0000","last_became_peered":"2023-11-20T06:41:14.258818+0000","last_unstale":"2023-11-20T06:41:19.583398+0000","last_undegraded":"2023-11-20T06:41:19.583398+0000","last_fullsized":"2023-11-20T06:41:19.583398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:03:05.538623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787570+0000","last_change":"2023-11-20T06:41:14.275181+0000","last_active":"2023-11-20T06:41:19.787570+0000","last_peered":"2023-11-20T06:41:19.787570+0000","last_clean":"2023-11-20T06:41:19.787570+0000","last_became_active":"2023-11-20T06:41:14.268467+0000","last_became_peered":"2023-11-20T06:41:14.268467+0000","last_unstale":"2023-11-20T06:41:19.787570+0000","last_undegraded":"2023-11-20T06:41:19.787570+0000","last_fullsized":"2023-11-20T06:41:19.787570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:55:30.603010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578862+0000","last_change":"2023-11-20T06:41:14.270268+0000","last_active":"2023-11-20T06:41:19.578862+0000","last_peered":"2023-11-20T06:41:19.578862+0000","last_clean":"2023-11-20T06:41:19.578862+0000","last_became_active":"2023-11-20T06:41:14.270056+0000","last_became_peered":"2023-11-20T06:41:14.270056+0000","last_unstale":"2023-11-20T06:41:19.578862+0000","last_undegraded":"2023-11-20T06:41:19.578862+0000","last_fullsized":"2023-11-20T06:41:19.578862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:36:44.079776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315115+0000","last_change":"2023-11-20T06:41:14.269251+0000","last_active":"2023-11-20T06:41:19.315115+0000","last_peered":"2023-11-20T06:41:19.315115+0000","last_clean":"2023-11-20T06:41:19.315115+0000","last_became_active":"2023-11-20T06:41:14.267320+0000","last_became_peered":"2023-11-20T06:41:14.267320+0000","last_unstale":"2023-11-20T06:41:19.315115+0000","last_undegraded":"2023-11-20T06:41:19.315115+0000","last_fullsized":"2023-11-20T06:41:19.315115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:42:53.602834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931525+0000","last_change":"2023-11-20T06:41:14.273161+0000","last_active":"2023-11-20T06:41:19.931525+0000","last_peered":"2023-11-20T06:41:19.931525+0000","last_clean":"2023-11-20T06:41:19.931525+0000","last_became_active":"2023-11-20T06:41:14.272837+0000","last_became_peered":"2023-11-20T06:41:14.272837+0000","last_unstale":"2023-11-20T06:41:19.931525+0000","last_undegraded":"2023-11-20T06:41:19.931525+0000","last_fullsized":"2023-11-20T06:41:19.931525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:16:48.088330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.310361+0000","last_change":"2023-11-20T06:41:14.272286+0000","last_active":"2023-11-20T06:41:19.310361+0000","last_peered":"2023-11-20T06:41:19.310361+0000","last_clean":"2023-11-20T06:41:19.310361+0000","last_became_active":"2023-11-20T06:41:14.258570+0000","last_became_peered":"2023-11-20T06:41:14.258570+0000","last_unstale":"2023-11-20T06:41:19.310361+0000","last_undegraded":"2023-11-20T06:41:19.310361+0000","last_fullsized":"2023-11-20T06:41:19.310361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:27:02.569616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.788326+0000","last_change":"2023-11-20T06:41:14.275187+0000","last_active":"2023-11-20T06:41:19.788326+0000","last_peered":"2023-11-20T06:41:19.788326+0000","last_clean":"2023-11-20T06:41:19.788326+0000","last_became_active":"2023-11-20T06:41:14.270334+0000","last_became_peered":"2023-11-20T06:41:14.270334+0000","last_unstale":"2023-11-20T06:41:19.788326+0000","last_undegraded":"2023-11-20T06:41:19.788326+0000","last_fullsized":"2023-11-20T06:41:19.788326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:45:50.281694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787513+0000","last_change":"2023-11-20T06:41:14.272042+0000","last_active":"2023-11-20T06:41:19.787513+0000","last_peered":"2023-11-20T06:41:19.787513+0000","last_clean":"2023-11-20T06:41:19.787513+0000","last_became_active":"2023-11-20T06:41:14.271776+0000","last_became_peered":"2023-11-20T06:41:14.271776+0000","last_unstale":"2023-11-20T06:41:19.787513+0000","last_undegraded":"2023-11-20T06:41:19.787513+0000","last_fullsized":"2023-11-20T06:41:19.787513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:25.537288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.662034+0000","last_change":"2023-11-20T06:41:14.265036+0000","last_active":"2023-11-20T06:41:19.662034+0000","last_peered":"2023-11-20T06:41:19.662034+0000","last_clean":"2023-11-20T06:41:19.662034+0000","last_became_active":"2023-11-20T06:41:14.264757+0000","last_became_peered":"2023-11-20T06:41:14.264757+0000","last_unstale":"2023-11-20T06:41:19.662034+0000","last_undegraded":"2023-11-20T06:41:19.662034+0000","last_fullsized":"2023-11-20T06:41:19.662034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:03:05.538623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578415+0000","last_change":"2023-11-20T06:41:14.263606+0000","last_active":"2023-11-20T06:41:19.578415+0000","last_peered":"2023-11-20T06:41:19.578415+0000","last_clean":"2023-11-20T06:41:19.578415+0000","last_became_active":"2023-11-20T06:41:14.263046+0000","last_became_peered":"2023-11-20T06:41:14.263046+0000","last_unstale":"2023-11-20T06:41:19.578415+0000","last_undegraded":"2023-11-20T06:41:19.578415+0000","last_fullsized":"2023-11-20T06:41:19.578415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:56:09.382571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583697+0000","last_change":"2023-11-20T06:41:14.261028+0000","last_active":"2023-11-20T06:41:19.583697+0000","last_peered":"2023-11-20T06:41:19.583697+0000","last_clean":"2023-11-20T06:41:19.583697+0000","last_became_active":"2023-11-20T06:41:14.257826+0000","last_became_peered":"2023-11-20T06:41:14.257826+0000","last_unstale":"2023-11-20T06:41:19.583697+0000","last_undegraded":"2023-11-20T06:41:19.583697+0000","last_fullsized":"2023-11-20T06:41:19.583697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:08:41.021374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315274+0000","last_change":"2023-11-20T06:41:14.269257+0000","last_active":"2023-11-20T06:41:19.315274+0000","last_peered":"2023-11-20T06:41:19.315274+0000","last_clean":"2023-11-20T06:41:19.315274+0000","last_became_active":"2023-11-20T06:41:14.264896+0000","last_became_peered":"2023-11-20T06:41:14.264896+0000","last_unstale":"2023-11-20T06:41:19.315274+0000","last_undegraded":"2023-11-20T06:41:19.315274+0000","last_fullsized":"2023-11-20T06:41:19.315274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:54:26.020324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.315416+0000","last_change":"2023-11-20T06:41:14.282030+0000","last_active":"2023-11-20T06:41:19.315416+0000","last_peered":"2023-11-20T06:41:19.315416+0000","last_clean":"2023-11-20T06:41:19.315416+0000","last_became_active":"2023-11-20T06:41:14.281723+0000","last_became_peered":"2023-11-20T06:41:14.281723+0000","last_unstale":"2023-11-20T06:41:19.315416+0000","last_undegraded":"2023-11-20T06:41:19.315416+0000","last_fullsized":"2023-11-20T06:41:19.315416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:08:41.021374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.314963+0000","last_change":"2023-11-20T06:41:14.281916+0000","last_active":"2023-11-20T06:41:19.314963+0000","last_peered":"2023-11-20T06:41:19.314963+0000","last_clean":"2023-11-20T06:41:19.314963+0000","last_became_active":"2023-11-20T06:41:14.281641+0000","last_became_peered":"2023-11-20T06:41:14.281641+0000","last_unstale":"2023-11-20T06:41:19.314963+0000","last_undegraded":"2023-11-20T06:41:19.314963+0000","last_fullsized":"2023-11-20T06:41:19.314963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:25.537288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931727+0000","last_change":"2023-11-20T06:41:14.284924+0000","last_active":"2023-11-20T06:41:19.931727+0000","last_peered":"2023-11-20T06:41:19.931727+0000","last_clean":"2023-11-20T06:41:19.931727+0000","last_became_active":"2023-11-20T06:41:14.284654+0000","last_became_peered":"2023-11-20T06:41:14.284654+0000","last_unstale":"2023-11-20T06:41:19.931727+0000","last_undegraded":"2023-11-20T06:41:19.931727+0000","last_fullsized":"2023-11-20T06:41:19.931727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:13:26.142776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.583308+0000","last_change":"2023-11-20T06:41:14.271513+0000","last_active":"2023-11-20T06:41:19.583308+0000","last_peered":"2023-11-20T06:41:19.583308+0000","last_clean":"2023-11-20T06:41:19.583308+0000","last_became_active":"2023-11-20T06:41:14.271045+0000","last_became_peered":"2023-11-20T06:41:14.271045+0000","last_unstale":"2023-11-20T06:41:19.583308+0000","last_undegraded":"2023-11-20T06:41:19.583308+0000","last_fullsized":"2023-11-20T06:41:19.583308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:36:44.079776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931144+0000","last_change":"2023-11-20T06:41:14.269364+0000","last_active":"2023-11-20T06:41:19.931144+0000","last_peered":"2023-11-20T06:41:19.931144+0000","last_clean":"2023-11-20T06:41:19.931144+0000","last_became_active":"2023-11-20T06:41:14.269091+0000","last_became_peered":"2023-11-20T06:41:14.269091+0000","last_unstale":"2023-11-20T06:41:19.931144+0000","last_undegraded":"2023-11-20T06:41:19.931144+0000","last_fullsized":"2023-11-20T06:41:19.931144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:07:43.904895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787491+0000","last_change":"2023-11-20T06:41:14.275911+0000","last_active":"2023-11-20T06:41:19.787491+0000","last_peered":"2023-11-20T06:41:19.787491+0000","last_clean":"2023-11-20T06:41:19.787491+0000","last_became_active":"2023-11-20T06:41:14.275285+0000","last_became_peered":"2023-11-20T06:41:14.275285+0000","last_unstale":"2023-11-20T06:41:19.787491+0000","last_undegraded":"2023-11-20T06:41:19.787491+0000","last_fullsized":"2023-11-20T06:41:19.787491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:08:41.021374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931288+0000","last_change":"2023-11-20T06:41:14.271029+0000","last_active":"2023-11-20T06:41:19.931288+0000","last_peered":"2023-11-20T06:41:19.931288+0000","last_clean":"2023-11-20T06:41:19.931288+0000","last_became_active":"2023-11-20T06:41:14.269917+0000","last_became_peered":"2023-11-20T06:41:14.269917+0000","last_unstale":"2023-11-20T06:41:19.931288+0000","last_undegraded":"2023-11-20T06:41:19.931288+0000","last_fullsized":"2023-11-20T06:41:19.931288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:45.059330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.787805+0000","last_change":"2023-11-20T06:41:14.277449+0000","last_active":"2023-11-20T06:41:19.787805+0000","last_peered":"2023-11-20T06:41:19.787805+0000","last_clean":"2023-11-20T06:41:19.787805+0000","last_became_active":"2023-11-20T06:41:14.277166+0000","last_became_peered":"2023-11-20T06:41:14.277166+0000","last_unstale":"2023-11-20T06:41:19.787805+0000","last_undegraded":"2023-11-20T06:41:19.787805+0000","last_fullsized":"2023-11-20T06:41:19.787805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:35:30.568821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.578392+0000","last_change":"2023-11-20T06:41:14.253214+0000","last_active":"2023-11-20T06:41:19.578392+0000","last_peered":"2023-11-20T06:41:19.578392+0000","last_clean":"2023-11-20T06:41:19.578392+0000","last_became_active":"2023-11-20T06:41:14.252882+0000","last_became_peered":"2023-11-20T06:41:14.252882+0000","last_unstale":"2023-11-20T06:41:19.578392+0000","last_undegraded":"2023-11-20T06:41:19.578392+0000","last_fullsized":"2023-11-20T06:41:19.578392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:42:53.602834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.663050+0000","last_change":"2023-11-20T06:41:14.268127+0000","last_active":"2023-11-20T06:41:19.663050+0000","last_peered":"2023-11-20T06:41:19.663050+0000","last_clean":"2023-11-20T06:41:19.663050+0000","last_became_active":"2023-11-20T06:41:14.267318+0000","last_became_peered":"2023-11-20T06:41:14.267318+0000","last_unstale":"2023-11-20T06:41:19.663050+0000","last_undegraded":"2023-11-20T06:41:19.663050+0000","last_fullsized":"2023-11-20T06:41:19.663050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:35:30.568821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T06:41:19.931671+0000","last_change":"2023-11-20T06:41:14.265577+0000","last_active":"2023-11-20T06:41:19.931671+0000","last_peered":"2023-11-20T06:41:19.931671+0000","last_clean":"2023-11-20T06:41:19.931671+0000","last_became_active":"2023-11-20T06:41:14.263538+0000","last_became_peered":"2023-11-20T06:41:14.263538+0000","last_unstale":"2023-11-20T06:41:19.931671+0000","last_undegraded":"2023-11-20T06:41:19.931671+0000","last_fullsized":"2023-11-20T06:41:19.931671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:13.208302+0000","last_clean_scrub_stamp":"2023-11-20T06:41:13.208302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:45:50.281694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":697795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":110686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6220000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4910000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.833}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":106935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":106971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":110686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":106845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":696832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T06:41:44.644 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-20T06:41:44.644 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-20T06:41:44.644 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-20T06:41:44.644 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-20T06:41:44.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.823+0000 7f99cb59e640 1 Processor -- start 2023-11-20T06:41:44.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.823+0000 7f99cb59e640 1 -- start start 2023-11-20T06:41:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99cb59e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99cc0d1490 0x7f99cc06af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99cb59e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99cc0d3510 con 0x7f99cc15c980 2023-11-20T06:41:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99cb59e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99cc0d2f50 con 0x7f99cc15cd60 2023-11-20T06:41:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99cb59e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0cd2b0 con 0x7f99cc0d1490 2023-11-20T06:41:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99ca59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f99cc15c980 0x7f99cc0d0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40762/0 (socket says 172.21.15.19:40762) 2023-11-20T06:41:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99ca59c640 1 -- 172.21.15.19:0/2960983715 learned_addr learned my addr 172.21.15.19:0/2960983715 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99c3fff640 1 --2- 172.21.15.19:0/2960983715 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99cc0d1490 0x7f99cc06af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99c9d9b640 1 -- 172.21.15.19:0/2960983715 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954552173 0 0) 0x7f99bc0012a0 con 0x7f99cc15c980 2023-11-20T06:41:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99c9d9b640 1 -- 172.21.15.19:0/2960983715 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99b8003530 con 0x7f99cc15c980 2023-11-20T06:41:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99c9d9b640 1 -- 172.21.15.19:0/2960983715 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4113121820 0 0) 0x7f99b8003530 con 0x7f99cc15c980 2023-11-20T06:41:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99c9d9b640 1 -- 172.21.15.19:0/2960983715 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99cc0d1490 msgr2=0x7f99cc06af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99c9d9b640 1 --2- 172.21.15.19:0/2960983715 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99cc0d1490 0x7f99cc06af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99c9d9b640 1 -- 172.21.15.19:0/2960983715 >> v1:172.21.15.190:6789/0 conn(0x7f99cc15cd60 legacy=0x7f99cc0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99c9d9b640 1 -- 172.21.15.19:0/2960983715 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc0d3230 con 0x7f99cc15c980 2023-11-20T06:41:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99c9d9b640 1 -- 172.21.15.19:0/2960983715 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7f99bc001990 con 0x7f99cc15c980 2023-11-20T06:41:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99c9d9b640 1 -- 172.21.15.19:0/2960983715 >> v1:172.21.15.19:6789/0 conn(0x7f99cc15c980 legacy=0x7f99cc0d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99c9d9b640 1 --2- 172.21.15.19:0/2960983715 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99cc0d1490 0x7f99b8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99c9d9b640 1 --2- 172.21.15.19:0/2960983715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99b8003fd0 0x7f99b80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99c9d9b640 1 --2- 172.21.15.19:0/2960983715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99b8004d10 0x7f99b8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99c9d9b640 1 -- 172.21.15.19:0/2960983715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0cd2b0 con 0x7f99b8004d10 2023-11-20T06:41:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99c9d9b640 1 -- 172.21.15.19:0/2960983715 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b800bad0 con 0x7f99b8003fd0 2023-11-20T06:41:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99c9d9b640 1 -- 172.21.15.19:0/2960983715 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b800bc90 con 0x7f99cc0d1490 2023-11-20T06:41:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99cad9d640 1 --2- 172.21.15.19:0/2960983715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99b8004d10 0x7f99b8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99ca59c640 1 --2- 172.21.15.19:0/2960983715 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99cc0d1490 0x7f99b8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99c3fff640 1 --2- 172.21.15.19:0/2960983715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99b8003fd0 0x7f99b80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99cad9d640 1 -- 172.21.15.19:0/2960983715 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99cc0d1490 msgr2=0x7f99b8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99cad9d640 1 --2- 172.21.15.19:0/2960983715 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99cc0d1490 0x7f99b8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99cad9d640 1 -- 172.21.15.19:0/2960983715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99b8003fd0 msgr2=0x7f99b80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:44.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99cad9d640 1 --2- 172.21.15.19:0/2960983715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99b8003fd0 0x7f99b80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.827+0000 7f99cad9d640 1 -- 172.21.15.19:0/2960983715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b8003530 con 0x7f99b8004d10 2023-11-20T06:41:44.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.831+0000 7f99cad9d640 1 --2- 172.21.15.19:0/2960983715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99b8004d10 0x7f99b8005190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f99c4001f60 tx=0x7f99c401c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8972ee258b17dca server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.831+0000 7f99c9d9b640 1 -- 172.21.15.19:0/2960983715 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c40a6650 con 0x7f99b8004d10 2023-11-20T06:41:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.831+0000 7f99c9d9b640 1 -- 172.21.15.19:0/2960983715 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c40a67b0 con 0x7f99b8004d10 2023-11-20T06:41:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.831+0000 7f99c9d9b640 1 -- 172.21.15.19:0/2960983715 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c40a6ba0 con 0x7f99b8004d10 2023-11-20T06:41:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.831+0000 7f99cb59e640 1 -- 172.21.15.19:0/2960983715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99b8004d10 msgr2=0x7f99b8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.831+0000 7f99cb59e640 1 --2- 172.21.15.19:0/2960983715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99b8004d10 0x7f99b8005190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f99c4001f60 tx=0x7f99c401c860 comp rx=0 tx=0).stop 2023-11-20T06:41:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.831+0000 7f99cad9d640 1 -- 172.21.15.19:0/2960983715 reap_dead start 2023-11-20T06:41:44.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.831+0000 7f99cb59e640 1 -- 172.21.15.19:0/2960983715 shutdown_connections 2023-11-20T06:41:44.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.831+0000 7f99cb59e640 1 -- 172.21.15.19:0/2960983715 >> 172.21.15.19:0/2960983715 conn(0x7f99cc09ba80 msgr2=0x7f99cc0d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:44.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.831+0000 7f99cb59e640 1 -- 172.21.15.19:0/2960983715 shutdown_connections 2023-11-20T06:41:44.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.831+0000 7f99cb59e640 1 -- 172.21.15.19:0/2960983715 wait complete. 2023-11-20T06:41:44.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99cb59e640 1 Processor -- start 2023-11-20T06:41:44.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99cb59e640 1 -- start start 2023-11-20T06:41:44.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99cb59e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99b8004d10 0x7f99cc0b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:44.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99cb59e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99cc0b5d40 0x7f99cc0af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:44.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99cb59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99cc0af8b0 0x7f99cc0afd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:44.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99cb59e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0b0b50 con 0x7f99cc0af8b0 2023-11-20T06:41:44.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99cb59e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0b0280 con 0x7f99cc0b5d40 2023-11-20T06:41:44.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99cb59e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0b6200 con 0x7f99b8004d10 2023-11-20T06:41:44.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99cad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99cc0af8b0 0x7f99cc0afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:44.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99cad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99cc0af8b0 0x7f99cc0afd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48572/0 (socket says 172.21.15.19:48572) 2023-11-20T06:41:44.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99cad9d640 1 -- 172.21.15.19:0/2071033560 learned_addr learned my addr 172.21.15.19:0/2071033560 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99c3fff640 1 --2- 172.21.15.19:0/2071033560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99cc0b5d40 0x7f99cc0af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99ca59c640 1 --2- 172.21.15.19:0/2071033560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99b8004d10 0x7f99cc0b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99cad9d640 1 -- 172.21.15.19:0/2071033560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99b8004d10 msgr2=0x7f99cc0b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99cad9d640 1 --2- 172.21.15.19:0/2071033560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99b8004d10 0x7f99cc0b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99cad9d640 1 -- 172.21.15.19:0/2071033560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99cc0b5d40 msgr2=0x7f99cc0af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99cad9d640 1 --2- 172.21.15.19:0/2071033560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99cc0b5d40 0x7f99cc0af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99cad9d640 1 -- 172.21.15.19:0/2071033560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc0b0490 con 0x7f99cc0af8b0 2023-11-20T06:41:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99cad9d640 1 --2- 172.21.15.19:0/2071033560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99cc0af8b0 0x7f99cc0afd40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f99c401cd40 tx=0x7f99b8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99c2ffd640 1 -- 172.21.15.19:0/2071033560 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c40a6b20 con 0x7f99cc0af8b0 2023-11-20T06:41:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99c2ffd640 1 -- 172.21.15.19:0/2071033560 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c40a6c80 con 0x7f99cc0af8b0 2023-11-20T06:41:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99c2ffd640 1 -- 172.21.15.19:0/2071033560 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c4005070 con 0x7f99cc0af8b0 2023-11-20T06:41:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99cb59e640 1 -- 172.21.15.19:0/2071033560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99cc0b0770 con 0x7f99cc0af8b0 2023-11-20T06:41:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99cb59e640 1 -- 172.21.15.19:0/2071033560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99cc15ffe0 con 0x7f99cc0af8b0 2023-11-20T06:41:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.835+0000 7f99cb59e640 1 -- 172.21.15.19:0/2071033560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99cc04e9c0 con 0x7f99cc0af8b0 2023-11-20T06:41:44.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.839+0000 7f99c2ffd640 1 -- 172.21.15.19:0/2071033560 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f99c40051d0 con 0x7f99cc0af8b0 2023-11-20T06:41:44.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.839+0000 7f99c2ffd640 1 --2- 172.21.15.19:0/2071033560 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f99ac0664a0 0x7f99ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:44.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.839+0000 7f99c2ffd640 1 -- 172.21.15.19:0/2071033560 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f99c411dff0 con 0x7f99cc0af8b0 2023-11-20T06:41:44.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.839+0000 7f99ca59c640 1 --2- 172.21.15.19:0/2071033560 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f99ac0664a0 0x7f99ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:44.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.839+0000 7f99ca59c640 1 --2- 172.21.15.19:0/2071033560 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f99ac0664a0 0x7f99ac068960 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f99bc001400 tx=0x7f99bc001060 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:44.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:44.843+0000 7f99c2ffd640 1 -- 172.21.15.19:0/2071033560 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f99c40eb220 con 0x7f99cc0af8b0 2023-11-20T06:41:45.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.031+0000 7f99cb59e640 1 -- 172.21.15.19:0/2071033560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f99cc0b8510 con 0x7f99cc0af8b0 2023-11-20T06:41:45.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.031+0000 7f99c2ffd640 1 -- 172.21.15.19:0/2071033560 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f99c40ac040 con 0x7f99cc0af8b0 2023-11-20T06:41:45.039 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:45.039 INFO:teuthology.orchestra.run.smithi019.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-20T06:41:45.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.035+0000 7f99cb59e640 1 -- 172.21.15.19:0/2071033560 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f99ac0664a0 msgr2=0x7f99ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:45.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.035+0000 7f99cb59e640 1 --2- 172.21.15.19:0/2071033560 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f99ac0664a0 0x7f99ac068960 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f99bc001400 tx=0x7f99bc001060 comp rx=0 tx=0).stop 2023-11-20T06:41:45.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.035+0000 7f99cb59e640 1 -- 172.21.15.19:0/2071033560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99cc0af8b0 msgr2=0x7f99cc0afd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:45.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.035+0000 7f99cb59e640 1 --2- 172.21.15.19:0/2071033560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99cc0af8b0 0x7f99cc0afd40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f99c401cd40 tx=0x7f99b8005800 comp rx=0 tx=0).stop 2023-11-20T06:41:45.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.035+0000 7f99cb59e640 1 -- 172.21.15.19:0/2071033560 shutdown_connections 2023-11-20T06:41:45.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.035+0000 7f99cb59e640 1 --2- 172.21.15.19:0/2071033560 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f99ac0664a0 0x7f99ac068960 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.035+0000 7f99cb59e640 1 --2- 172.21.15.19:0/2071033560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99cc0af8b0 0x7f99cc0afd40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.035+0000 7f99cb59e640 1 --2- 172.21.15.19:0/2071033560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99cc0b5d40 0x7f99cc0af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.035+0000 7f99cb59e640 1 --2- 172.21.15.19:0/2071033560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99b8004d10 0x7f99cc0b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.035+0000 7f99cb59e640 1 -- 172.21.15.19:0/2071033560 >> 172.21.15.19:0/2071033560 conn(0x7f99cc09ba80 msgr2=0x7f99cc0c8480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:45.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.035+0000 7f99cb59e640 1 -- 172.21.15.19:0/2071033560 shutdown_connections 2023-11-20T06:41:45.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.035+0000 7f99cb59e640 1 -- 172.21.15.19:0/2071033560 wait complete. 2023-11-20T06:41:45.060 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-20T06:41:45.060 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:41:45.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.199+0000 7efcbd209640 1 Processor -- start 2023-11-20T06:41:45.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.199+0000 7efcbd209640 1 -- start start 2023-11-20T06:41:45.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.203+0000 7efcbd209640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efcb815ca70 0x7efcb80d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:45.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.203+0000 7efcbd209640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb80c65f0 con 0x7efcb80d3550 2023-11-20T06:41:45.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.203+0000 7efcbd209640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb80cdf80 con 0x7efcb80cf7a0 2023-11-20T06:41:45.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.203+0000 7efcbd209640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb80ce820 con 0x7efcb815ca70 2023-11-20T06:41:45.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.203+0000 7efcb6d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efcb815ca70 0x7efcb80d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:45.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.203+0000 7efcaffff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7efcb80d3550 0x7efcb80cf090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40768/0 (socket says 172.21.15.19:40768) 2023-11-20T06:41:45.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.203+0000 7efcaffff640 1 -- 172.21.15.19:0/2076916923 learned_addr learned my addr 172.21.15.19:0/2076916923 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:45.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.203+0000 7efcb6d9d640 1 -- 172.21.15.19:0/2076916923 >> v1:172.21.15.190:6789/0 conn(0x7efcb80cf7a0 legacy=0x7efcb80c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:45.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.203+0000 7efcb6d9d640 1 -- 172.21.15.19:0/2076916923 >> v1:172.21.15.19:6789/0 conn(0x7efcb80d3550 legacy=0x7efcb80cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:45.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.203+0000 7efcb6d9d640 1 -- 172.21.15.19:0/2076916923 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb80ce260 con 0x7efcb815ca70 2023-11-20T06:41:45.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.203+0000 7efcb659c640 1 -- 172.21.15.19:0/2076916923 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702043597 0 0) 0x7efcb80c65f0 con 0x7efcb80d3550 2023-11-20T06:41:45.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.207+0000 7efcb6d9d640 1 --2- 172.21.15.19:0/2076916923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcb815ca70 0x7efcb80d3010 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efca80097a0 tx=0x7efca801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b322a65b8327ade3 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:45.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.207+0000 7efcb659c640 1 -- 172.21.15.19:0/2076916923 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca8004230 con 0x7efcb815ca70 2023-11-20T06:41:45.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.207+0000 7efcb659c640 1 -- 172.21.15.19:0/2076916923 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca80a7050 con 0x7efcb815ca70 2023-11-20T06:41:45.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.207+0000 7efcb659c640 1 -- 172.21.15.19:0/2076916923 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca8003620 con 0x7efcb815ca70 2023-11-20T06:41:45.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.207+0000 7efcbd209640 1 -- 172.21.15.19:0/2076916923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcb815ca70 msgr2=0x7efcb80d3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:45.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.207+0000 7efcbd209640 1 --2- 172.21.15.19:0/2076916923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcb815ca70 0x7efcb80d3010 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efca80097a0 tx=0x7efca801c3f0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.207+0000 7efcbd209640 1 -- 172.21.15.19:0/2076916923 shutdown_connections 2023-11-20T06:41:45.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.207+0000 7efcbd209640 1 --2- 172.21.15.19:0/2076916923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcb815ca70 0x7efcb80d3010 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.207+0000 7efcbd209640 1 -- 172.21.15.19:0/2076916923 >> 172.21.15.19:0/2076916923 conn(0x7efcb809bc50 msgr2=0x7efcb80d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:45.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.207+0000 7efcbd209640 1 -- 172.21.15.19:0/2076916923 shutdown_connections 2023-11-20T06:41:45.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.207+0000 7efcbd209640 1 -- 172.21.15.19:0/2076916923 wait complete. 2023-11-20T06:41:45.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.207+0000 7efcbd209640 1 Processor -- start 2023-11-20T06:41:45.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.207+0000 7efcbd209640 1 -- start start 2023-11-20T06:41:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcbd209640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcb80cf7a0 0x7efcb815f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcbd209640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb80d3550 0x7efcb814fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcbd209640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcb815ca70 0x7efcb81577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcbd209640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb8160460 con 0x7efcb815ca70 2023-11-20T06:41:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcbd209640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb8160180 con 0x7efcb80d3550 2023-11-20T06:41:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcbd209640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb8158a70 con 0x7efcb80cf7a0 2023-11-20T06:41:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcb759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcb815ca70 0x7efcb81577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcb759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcb815ca70 0x7efcb81577a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48600/0 (socket says 172.21.15.19:48600) 2023-11-20T06:41:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcb759e640 1 -- 172.21.15.19:0/423607277 learned_addr learned my addr 172.21.15.19:0/423607277 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcaffff640 1 --2- 172.21.15.19:0/423607277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb80d3550 0x7efcb814fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcb6d9d640 1 --2- 172.21.15.19:0/423607277 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcb80cf7a0 0x7efcb815f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:45.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcb759e640 1 -- 172.21.15.19:0/423607277 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcb80cf7a0 msgr2=0x7efcb815f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:45.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcb759e640 1 --2- 172.21.15.19:0/423607277 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcb80cf7a0 0x7efcb815f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcb759e640 1 -- 172.21.15.19:0/423607277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb80d3550 msgr2=0x7efcb814fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:45.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcb759e640 1 --2- 172.21.15.19:0/423607277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb80d3550 0x7efcb814fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcb759e640 1 -- 172.21.15.19:0/423607277 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca80093b0 con 0x7efcb815ca70 2023-11-20T06:41:45.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcb759e640 1 --2- 172.21.15.19:0/423607277 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcb815ca70 0x7efcb81577a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efcb000c780 tx=0x7efcb000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:45.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcaf7fe640 1 -- 172.21.15.19:0/423607277 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb000a9f0 con 0x7efcb815ca70 2023-11-20T06:41:45.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcaf7fe640 1 -- 172.21.15.19:0/423607277 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb000ce90 con 0x7efcb815ca70 2023-11-20T06:41:45.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcbd209640 1 -- 172.21.15.19:0/423607277 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb8158d50 con 0x7efcb815ca70 2023-11-20T06:41:45.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcaf7fe640 1 -- 172.21.15.19:0/423607277 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb000add0 con 0x7efcb815ca70 2023-11-20T06:41:45.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcbd209640 1 -- 172.21.15.19:0/423607277 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb815fd70 con 0x7efcb815ca70 2023-11-20T06:41:45.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcbd209640 1 -- 172.21.15.19:0/423607277 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb81588d0 con 0x7efcb815ca70 2023-11-20T06:41:45.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.211+0000 7efcaf7fe640 1 -- 172.21.15.19:0/423607277 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efcb0012420 con 0x7efcb815ca70 2023-11-20T06:41:45.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.215+0000 7efcaf7fe640 1 --2- 172.21.15.19:0/423607277 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7efc980664a0 0x7efc98068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:45.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.215+0000 7efcaf7fe640 1 -- 172.21.15.19:0/423607277 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efcb0083e20 con 0x7efcb815ca70 2023-11-20T06:41:45.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.215+0000 7efcb6d9d640 1 --2- 172.21.15.19:0/423607277 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7efc980664a0 0x7efc98068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:45.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.215+0000 7efcb6d9d640 1 --2- 172.21.15.19:0/423607277 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7efc980664a0 0x7efc98068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efca80ad000 tx=0x7efca80a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:45.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.219+0000 7efcaf7fe640 1 -- 172.21.15.19:0/423607277 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efcb81588d0 con 0x7efcb815ca70 2023-11-20T06:41:45.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.379+0000 7efcbd209640 1 -- 172.21.15.19:0/423607277 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcb81588d0 con 0x7efcb815ca70 2023-11-20T06:41:45.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.379+0000 7efcaf7fe640 1 -- 172.21.15.19:0/423607277 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18334 (secure 0 0 0) 0x7efcb81588d0 con 0x7efcb815ca70 2023-11-20T06:41:45.386 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:45.387 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":25,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:20.306335+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:41:45.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.383+0000 7efcbd209640 1 -- 172.21.15.19:0/423607277 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7efc980664a0 msgr2=0x7efc98068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:45.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.383+0000 7efcbd209640 1 --2- 172.21.15.19:0/423607277 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7efc980664a0 0x7efc98068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efca80ad000 tx=0x7efca80a6000 comp rx=0 tx=0).stop 2023-11-20T06:41:45.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.383+0000 7efcbd209640 1 -- 172.21.15.19:0/423607277 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcb815ca70 msgr2=0x7efcb81577a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:45.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.383+0000 7efcbd209640 1 --2- 172.21.15.19:0/423607277 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcb815ca70 0x7efcb81577a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efcb000c780 tx=0x7efcb000cc40 comp rx=0 tx=0).stop 2023-11-20T06:41:45.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.383+0000 7efcbd209640 1 -- 172.21.15.19:0/423607277 shutdown_connections 2023-11-20T06:41:45.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.383+0000 7efcbd209640 1 --2- 172.21.15.19:0/423607277 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7efc980664a0 0x7efc98068960 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.383+0000 7efcbd209640 1 --2- 172.21.15.19:0/423607277 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcb815ca70 0x7efcb81577a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.383+0000 7efcbd209640 1 --2- 172.21.15.19:0/423607277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb80d3550 0x7efcb814fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.383+0000 7efcbd209640 1 --2- 172.21.15.19:0/423607277 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcb80cf7a0 0x7efcb815f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.383+0000 7efcbd209640 1 -- 172.21.15.19:0/423607277 >> 172.21.15.19:0/423607277 conn(0x7efcb809bc50 msgr2=0x7efcb806bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:45.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.383+0000 7efcbd209640 1 -- 172.21.15.19:0/423607277 shutdown_connections 2023-11-20T06:41:45.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.383+0000 7efcbd209640 1 -- 172.21.15.19:0/423607277 wait complete. 2023-11-20T06:41:45.408 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T06:41:11.805111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T06:41:12.614034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T06:41:16.311206+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T06:41:45.408 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:41:45.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.551+0000 7f1c90646640 1 Processor -- start 2023-11-20T06:41:45.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.551+0000 7f1c90646640 1 -- start start 2023-11-20T06:41:45.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.551+0000 7f1c90646640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1c8815cba0 0x7f1c880d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:45.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.551+0000 7f1c90646640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1c880d0210 0x7f1c880b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:45.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.551+0000 7f1c90646640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c880d1670 con 0x7f1c880b84e0 2023-11-20T06:41:45.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.551+0000 7f1c90646640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c880d1460 con 0x7f1c880d0210 2023-11-20T06:41:45.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.551+0000 7f1c90646640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c880d1950 con 0x7f1c8815cba0 2023-11-20T06:41:45.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.551+0000 7f1c8dbe1640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1c880b84e0 0x7f1c880cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40772/0 (socket says 172.21.15.19:40772) 2023-11-20T06:41:45.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.551+0000 7f1c8dbe1640 1 -- 172.21.15.19:0/34998203 learned_addr learned my addr 172.21.15.19:0/34998203 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:45.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.551+0000 7f1c8ebe3640 1 --2- 172.21.15.19:0/34998203 >> v2:172.21.15.19:3300/0 conn(0x7f1c880d0210 0x7f1c880b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:45.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.551+0000 7f1c8e3e2640 1 --2- 172.21.15.19:0/34998203 >> v2:172.21.15.190:3300/0 conn(0x7f1c8815cba0 0x7f1c880d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.551+0000 7f1c8d3e0640 1 -- 172.21.15.19:0/34998203 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424142166 0 0) 0x7f1c880d1670 con 0x7f1c880b84e0 2023-11-20T06:41:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.551+0000 7f1c8d3e0640 1 -- 172.21.15.19:0/34998203 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c74003530 con 0x7f1c880b84e0 2023-11-20T06:41:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.551+0000 7f1c8ebe3640 1 -- 172.21.15.19:0/34998203 >> v2:172.21.15.190:3300/0 conn(0x7f1c8815cba0 msgr2=0x7f1c880d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.551+0000 7f1c8ebe3640 1 --2- 172.21.15.19:0/34998203 >> v2:172.21.15.190:3300/0 conn(0x7f1c8815cba0 0x7f1c880d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.551+0000 7f1c8ebe3640 1 -- 172.21.15.19:0/34998203 >> v1:172.21.15.19:6789/0 conn(0x7f1c880b84e0 legacy=0x7f1c880cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.551+0000 7f1c8ebe3640 1 -- 172.21.15.19:0/34998203 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c880d1c30 con 0x7f1c880d0210 2023-11-20T06:41:45.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.555+0000 7f1c8ebe3640 1 --2- 172.21.15.19:0/34998203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c880d0210 0x7f1c880b5cf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1c880b4890 tx=0x7f1c8001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520414dacbdb7308 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:45.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.555+0000 7f1c8d3e0640 1 -- 172.21.15.19:0/34998203 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c800a5940 con 0x7f1c880d0210 2023-11-20T06:41:45.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.555+0000 7f1c8d3e0640 1 -- 172.21.15.19:0/34998203 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c800a5aa0 con 0x7f1c880d0210 2023-11-20T06:41:45.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.555+0000 7f1c8d3e0640 1 -- 172.21.15.19:0/34998203 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c800a5e30 con 0x7f1c880d0210 2023-11-20T06:41:45.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.555+0000 7f1c90646640 1 -- 172.21.15.19:0/34998203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c880d0210 msgr2=0x7f1c880b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:45.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.555+0000 7f1c90646640 1 --2- 172.21.15.19:0/34998203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c880d0210 0x7f1c880b5cf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1c880b4890 tx=0x7f1c8001c880 comp rx=0 tx=0).stop 2023-11-20T06:41:45.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.555+0000 7f1c90646640 1 -- 172.21.15.19:0/34998203 shutdown_connections 2023-11-20T06:41:45.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.555+0000 7f1c90646640 1 --2- 172.21.15.19:0/34998203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c880d0210 0x7f1c880b5cf0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.555+0000 7f1c90646640 1 --2- 172.21.15.19:0/34998203 >> v2:172.21.15.190:3300/0 conn(0x7f1c8815cba0 0x7f1c880d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.555+0000 7f1c90646640 1 -- 172.21.15.19:0/34998203 >> 172.21.15.19:0/34998203 conn(0x7f1c880719c0 msgr2=0x7f1c88071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:45.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.555+0000 7f1c90646640 1 -- 172.21.15.19:0/34998203 shutdown_connections 2023-11-20T06:41:45.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.555+0000 7f1c90646640 1 -- 172.21.15.19:0/34998203 wait complete. 2023-11-20T06:41:45.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c90646640 1 Processor -- start 2023-11-20T06:41:45.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c90646640 1 -- start start 2023-11-20T06:41:45.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c90646640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c880b84e0 0x7f1c880c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:45.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c90646640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c880d0210 0x7f1c880c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:45.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c90646640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c8815cba0 0x7f1c880cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:45.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c90646640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c880c8ba0 con 0x7f1c880d0210 2023-11-20T06:41:45.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c90646640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c88158930 con 0x7f1c8815cba0 2023-11-20T06:41:45.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c90646640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c880ca2b0 con 0x7f1c880b84e0 2023-11-20T06:41:45.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c8dbe1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c880d0210 0x7f1c880c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:45.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c8dbe1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c880d0210 0x7f1c880c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48622/0 (socket says 172.21.15.19:48622) 2023-11-20T06:41:45.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c8dbe1640 1 -- 172.21.15.19:0/4172241901 learned_addr learned my addr 172.21.15.19:0/4172241901 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:45.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c8e3e2640 1 --2- 172.21.15.19:0/4172241901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c880b84e0 0x7f1c880c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:45.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c8ebe3640 1 --2- 172.21.15.19:0/4172241901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c8815cba0 0x7f1c880cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:45.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c8dbe1640 1 -- 172.21.15.19:0/4172241901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c880b84e0 msgr2=0x7f1c880c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:45.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c8dbe1640 1 --2- 172.21.15.19:0/4172241901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c880b84e0 0x7f1c880c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c8dbe1640 1 -- 172.21.15.19:0/4172241901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c8815cba0 msgr2=0x7f1c880cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:45.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c8dbe1640 1 --2- 172.21.15.19:0/4172241901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c8815cba0 0x7f1c880cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c8dbe1640 1 -- 172.21.15.19:0/4172241901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c80009a70 con 0x7f1c880d0210 2023-11-20T06:41:45.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c8dbe1640 1 --2- 172.21.15.19:0/4172241901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c880d0210 0x7f1c880c9c20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1c7800c4d0 tx=0x7f1c7800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:45.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c7effd640 1 -- 172.21.15.19:0/4172241901 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c78005cf0 con 0x7f1c880d0210 2023-11-20T06:41:45.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c7effd640 1 -- 172.21.15.19:0/4172241901 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c78005e50 con 0x7f1c880d0210 2023-11-20T06:41:45.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c7effd640 1 -- 172.21.15.19:0/4172241901 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c78007270 con 0x7f1c880d0210 2023-11-20T06:41:45.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c90646640 1 -- 172.21.15.19:0/4172241901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c880ca590 con 0x7f1c880d0210 2023-11-20T06:41:45.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.559+0000 7f1c90646640 1 -- 172.21.15.19:0/4172241901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c880cab50 con 0x7f1c880d0210 2023-11-20T06:41:45.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.563+0000 7f1c90646640 1 -- 172.21.15.19:0/4172241901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c88158af0 con 0x7f1c880d0210 2023-11-20T06:41:45.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.563+0000 7f1c7effd640 1 -- 172.21.15.19:0/4172241901 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1c780073d0 con 0x7f1c880d0210 2023-11-20T06:41:45.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.563+0000 7f1c7effd640 1 --2- 172.21.15.19:0/4172241901 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f1c6c0664a0 0x7f1c6c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:45.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.563+0000 7f1c7effd640 1 -- 172.21.15.19:0/4172241901 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1c780836d0 con 0x7f1c880d0210 2023-11-20T06:41:45.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.563+0000 7f1c8e3e2640 1 --2- 172.21.15.19:0/4172241901 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f1c6c0664a0 0x7f1c6c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:45.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.563+0000 7f1c8e3e2640 1 --2- 172.21.15.19:0/4172241901 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f1c6c0664a0 0x7f1c6c068960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1c84009ac0 tx=0x7f1c84009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:45.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.567+0000 7f1c7effd640 1 -- 172.21.15.19:0/4172241901 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1c78050900 con 0x7f1c880d0210 2023-11-20T06:41:45.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.723+0000 7f1c90646640 1 -- 172.21.15.19:0/4172241901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1c8804e170 con 0x7f1c880d0210 2023-11-20T06:41:45.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.723+0000 7f1c7effd640 1 -- 172.21.15.19:0/4172241901 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1c78053f20 con 0x7f1c880d0210 2023-11-20T06:41:45.730 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:41:45.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.727+0000 7f1c90646640 1 -- 172.21.15.19:0/4172241901 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f1c6c0664a0 msgr2=0x7f1c6c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:45.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.727+0000 7f1c90646640 1 --2- 172.21.15.19:0/4172241901 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f1c6c0664a0 0x7f1c6c068960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1c84009ac0 tx=0x7f1c84009190 comp rx=0 tx=0).stop 2023-11-20T06:41:45.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.727+0000 7f1c90646640 1 -- 172.21.15.19:0/4172241901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c880d0210 msgr2=0x7f1c880c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:45.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.727+0000 7f1c90646640 1 --2- 172.21.15.19:0/4172241901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c880d0210 0x7f1c880c9c20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1c7800c4d0 tx=0x7f1c7800c990 comp rx=0 tx=0).stop 2023-11-20T06:41:45.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.727+0000 7f1c90646640 1 -- 172.21.15.19:0/4172241901 shutdown_connections 2023-11-20T06:41:45.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.727+0000 7f1c90646640 1 --2- 172.21.15.19:0/4172241901 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f1c6c0664a0 0x7f1c6c068960 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.727+0000 7f1c90646640 1 --2- 172.21.15.19:0/4172241901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c8815cba0 0x7f1c880cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.727+0000 7f1c90646640 1 --2- 172.21.15.19:0/4172241901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c880d0210 0x7f1c880c9c20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.727+0000 7f1c90646640 1 --2- 172.21.15.19:0/4172241901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c880b84e0 0x7f1c880c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.727+0000 7f1c90646640 1 -- 172.21.15.19:0/4172241901 >> 172.21.15.19:0/4172241901 conn(0x7f1c880719c0 msgr2=0x7f1c8815b450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:45.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.727+0000 7f1c90646640 1 -- 172.21.15.19:0/4172241901 shutdown_connections 2023-11-20T06:41:45.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.727+0000 7f1c90646640 1 -- 172.21.15.19:0/4172241901 wait complete. 2023-11-20T06:41:45.751 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T06:41:45.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.891+0000 7f7cfc06b640 1 Processor -- start 2023-11-20T06:41:45.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.891+0000 7f7cfc06b640 1 -- start start 2023-11-20T06:41:45.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.891+0000 7f7cfc06b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cf415cba0 0x7f7cf40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:45.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.891+0000 7f7cfc06b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7cf40d0210 0x7f7cf40b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:45.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.891+0000 7f7cfc06b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf40d1670 con 0x7f7cf40b84e0 2023-11-20T06:41:45.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.891+0000 7f7cfc06b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf40d1460 con 0x7f7cf40d0210 2023-11-20T06:41:45.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.891+0000 7f7cfc06b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40d1950 con 0x7f7cf415cba0 2023-11-20T06:41:45.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.895+0000 7f7cf9e07640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cf415cba0 0x7f7cf40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:45.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.895+0000 7f7cfa608640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7cf40d0210 0x7f7cf40b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:45.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.895+0000 7f7cf9606640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f7cf40b84e0 0x7f7cf40cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:53380/0 (socket says 172.21.15.19:53380) 2023-11-20T06:41:45.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.895+0000 7f7cf9606640 1 -- 172.21.15.19:0/3393873991 learned_addr learned my addr 172.21.15.19:0/3393873991 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:45.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.895+0000 7f7cf9e07640 1 -- 172.21.15.19:0/3393873991 >> v2:172.21.15.190:3300/0 conn(0x7f7cf40d0210 msgr2=0x7f7cf40b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:45.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.895+0000 7f7cf9e07640 1 --2- 172.21.15.19:0/3393873991 >> v2:172.21.15.190:3300/0 conn(0x7f7cf40d0210 0x7f7cf40b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.895+0000 7f7cf9e07640 1 -- 172.21.15.19:0/3393873991 >> v1:172.21.15.190:6789/0 conn(0x7f7cf40b84e0 legacy=0x7f7cf40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:45.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.895+0000 7f7cf9e07640 1 -- 172.21.15.19:0/3393873991 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40d1c30 con 0x7f7cf415cba0 2023-11-20T06:41:45.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.895+0000 7f7cfa608640 1 --2- 172.21.15.19:0/3393873991 >> v2:172.21.15.190:3300/0 conn(0x7f7cf40d0210 0x7f7cf40b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:41:45.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.895+0000 7f7cf9e07640 1 --2- 172.21.15.19:0/3393873991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cf415cba0 0x7f7cf40d0f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00097c0 tx=0x7f7cf001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b722d8b5c4fa8fa7 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:45.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.895+0000 7f7cf8e05640 1 -- 172.21.15.19:0/3393873991 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00ab680 con 0x7f7cf415cba0 2023-11-20T06:41:45.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.895+0000 7f7cf8e05640 1 -- 172.21.15.19:0/3393873991 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf00ab7e0 con 0x7f7cf415cba0 2023-11-20T06:41:45.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.895+0000 7f7cf8e05640 1 -- 172.21.15.19:0/3393873991 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00abb70 con 0x7f7cf415cba0 2023-11-20T06:41:45.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cfc06b640 1 -- 172.21.15.19:0/3393873991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cf415cba0 msgr2=0x7f7cf40d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:45.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cfc06b640 1 --2- 172.21.15.19:0/3393873991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cf415cba0 0x7f7cf40d0f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00097c0 tx=0x7f7cf001c480 comp rx=0 tx=0).stop 2023-11-20T06:41:45.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cfc06b640 1 -- 172.21.15.19:0/3393873991 shutdown_connections 2023-11-20T06:41:45.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cfc06b640 1 --2- 172.21.15.19:0/3393873991 >> v2:172.21.15.190:3300/0 conn(0x7f7cf40d0210 0x7f7cf40b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cfc06b640 1 --2- 172.21.15.19:0/3393873991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cf415cba0 0x7f7cf40d0f20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cfc06b640 1 -- 172.21.15.19:0/3393873991 >> 172.21.15.19:0/3393873991 conn(0x7f7cf40719c0 msgr2=0x7f7cf4071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:45.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cfc06b640 1 -- 172.21.15.19:0/3393873991 shutdown_connections 2023-11-20T06:41:45.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cfc06b640 1 -- 172.21.15.19:0/3393873991 wait complete. 2023-11-20T06:41:45.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cfc06b640 1 Processor -- start 2023-11-20T06:41:45.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cfc06b640 1 -- start start 2023-11-20T06:41:45.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cfc06b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cf40b84e0 0x7f7cf414a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:45.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cfc06b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cf40d0210 0x7f7cf415a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:45.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cfc06b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cf415cba0 0x7f7cf415a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:45.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cfc06b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf414cdd0 con 0x7f7cf40b84e0 2023-11-20T06:41:45.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cfc06b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf414a840 con 0x7f7cf40d0210 2023-11-20T06:41:45.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cfc06b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf414c530 con 0x7f7cf415cba0 2023-11-20T06:41:45.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cf9e07640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cf40b84e0 0x7f7cf414a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:45.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cf9e07640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cf40b84e0 0x7f7cf414a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48630/0 (socket says 172.21.15.19:48630) 2023-11-20T06:41:45.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cf9e07640 1 -- 172.21.15.19:0/4134478045 learned_addr learned my addr 172.21.15.19:0/4134478045 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:45.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cf9606640 1 --2- 172.21.15.19:0/4134478045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cf40d0210 0x7f7cf415a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:45.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.899+0000 7f7cfa608640 1 --2- 172.21.15.19:0/4134478045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cf415cba0 0x7f7cf415a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:45.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.903+0000 7f7cf9e07640 1 -- 172.21.15.19:0/4134478045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cf415cba0 msgr2=0x7f7cf415a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:45.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.903+0000 7f7cf9e07640 1 --2- 172.21.15.19:0/4134478045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cf415cba0 0x7f7cf415a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.903+0000 7f7cf9e07640 1 -- 172.21.15.19:0/4134478045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cf40d0210 msgr2=0x7f7cf415a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:45.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.903+0000 7f7cf9e07640 1 --2- 172.21.15.19:0/4134478045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cf40d0210 0x7f7cf415a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:45.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.903+0000 7f7cf9e07640 1 -- 172.21.15.19:0/4134478045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cec009a70 con 0x7f7cf40b84e0 2023-11-20T06:41:45.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.903+0000 7f7cf9606640 1 --2- 172.21.15.19:0/4134478045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cf40d0210 0x7f7cf415a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:45.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.903+0000 7f7cf9e07640 1 --2- 172.21.15.19:0/4134478045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cf40b84e0 0x7f7cf414a300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00ad040 tx=0x7f7cf001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:45.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.903+0000 7f7cea7fc640 1 -- 172.21.15.19:0/4134478045 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00bf610 con 0x7f7cf40b84e0 2023-11-20T06:41:45.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.903+0000 7f7cea7fc640 1 -- 172.21.15.19:0/4134478045 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf00bf770 con 0x7f7cf40b84e0 2023-11-20T06:41:45.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.903+0000 7f7cea7fc640 1 -- 172.21.15.19:0/4134478045 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00bfb20 con 0x7f7cf40b84e0 2023-11-20T06:41:45.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.903+0000 7f7cfc06b640 1 -- 172.21.15.19:0/4134478045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf0009420 con 0x7f7cf40b84e0 2023-11-20T06:41:45.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.903+0000 7f7cfc06b640 1 -- 172.21.15.19:0/4134478045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf414caf0 con 0x7f7cf40b84e0 2023-11-20T06:41:45.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.903+0000 7f7cfc06b640 1 -- 172.21.15.19:0/4134478045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf404e170 con 0x7f7cf40b84e0 2023-11-20T06:41:45.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.903+0000 7f7cea7fc640 1 -- 172.21.15.19:0/4134478045 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7cf00bfc80 con 0x7f7cf40b84e0 2023-11-20T06:41:45.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.903+0000 7f7cea7fc640 1 --2- 172.21.15.19:0/4134478045 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7cd80664a0 0x7f7cd8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:45.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.903+0000 7f7cea7fc640 1 -- 172.21.15.19:0/4134478045 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7cf011efa0 con 0x7f7cf40b84e0 2023-11-20T06:41:45.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.903+0000 7f7cf9606640 1 --2- 172.21.15.19:0/4134478045 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7cd80664a0 0x7f7cd8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:45.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.907+0000 7f7cf9606640 1 --2- 172.21.15.19:0/4134478045 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7cd80664a0 0x7f7cd8068960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4150700 tx=0x7f7ce4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:45.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:45.907+0000 7f7cea7fc640 1 -- 172.21.15.19:0/4134478045 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7cf00ec1c0 con 0x7f7cf40b84e0 2023-11-20T06:41:46.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.063+0000 7f7cfc06b640 1 -- 172.21.15.19:0/4134478045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7cf415c3b0 con 0x7f7cf40b84e0 2023-11-20T06:41:46.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.063+0000 7f7cea7fc640 1 -- 172.21.15.19:0/4134478045 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7cf00ef7e0 con 0x7f7cf40b84e0 2023-11-20T06:41:46.070 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:41:46.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.067+0000 7f7cfc06b640 1 -- 172.21.15.19:0/4134478045 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7cd80664a0 msgr2=0x7f7cd8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:46.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.067+0000 7f7cfc06b640 1 --2- 172.21.15.19:0/4134478045 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7cd80664a0 0x7f7cd8068960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4150700 tx=0x7f7ce4009040 comp rx=0 tx=0).stop 2023-11-20T06:41:46.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.067+0000 7f7cfc06b640 1 -- 172.21.15.19:0/4134478045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cf40b84e0 msgr2=0x7f7cf414a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:46.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.067+0000 7f7cfc06b640 1 --2- 172.21.15.19:0/4134478045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cf40b84e0 0x7f7cf414a300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00ad040 tx=0x7f7cf001acc0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.067+0000 7f7cfc06b640 1 -- 172.21.15.19:0/4134478045 shutdown_connections 2023-11-20T06:41:46.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.067+0000 7f7cfc06b640 1 --2- 172.21.15.19:0/4134478045 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7cd80664a0 0x7f7cd8068960 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.067+0000 7f7cfc06b640 1 --2- 172.21.15.19:0/4134478045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cf415cba0 0x7f7cf415a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.067+0000 7f7cfc06b640 1 --2- 172.21.15.19:0/4134478045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cf40d0210 0x7f7cf415a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.067+0000 7f7cfc06b640 1 --2- 172.21.15.19:0/4134478045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cf40b84e0 0x7f7cf414a300 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.067+0000 7f7cfc06b640 1 -- 172.21.15.19:0/4134478045 >> 172.21.15.19:0/4134478045 conn(0x7f7cf40719c0 msgr2=0x7f7cf41563d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:46.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.067+0000 7f7cfc06b640 1 -- 172.21.15.19:0/4134478045 shutdown_connections 2023-11-20T06:41:46.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.067+0000 7f7cfc06b640 1 -- 172.21.15.19:0/4134478045 wait complete. 2023-11-20T06:41:46.091 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T06:41:46.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.231+0000 7f341c765640 1 Processor -- start 2023-11-20T06:41:46.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.231+0000 7f341c765640 1 -- start start 2023-11-20T06:41:46.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.231+0000 7f341c765640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f341406d010 0x7f34140c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:46.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.231+0000 7f341c765640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f34140c26b0 0x7f34140c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:46.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.231+0000 7f341c765640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f341415ae30 con 0x7f3414069e90 2023-11-20T06:41:46.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.231+0000 7f341c765640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34140cb090 con 0x7f341406d010 2023-11-20T06:41:46.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.231+0000 7f341c765640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f341406d470 con 0x7f34140c26b0 2023-11-20T06:41:46.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.231+0000 7f3419d00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f341406d010 0x7f34140c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:46.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.231+0000 7f3419d00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f341406d010 0x7f34140c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48634/0 (socket says 172.21.15.19:48634) 2023-11-20T06:41:46.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.231+0000 7f3419d00640 1 -- 172.21.15.19:0/2806904103 learned_addr learned my addr 172.21.15.19:0/2806904103 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:46.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.231+0000 7f341ad02640 1 --2- 172.21.15.19:0/2806904103 >> v2:172.21.15.190:3300/0 conn(0x7f34140c26b0 0x7f34140c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:46.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.235+0000 7f3419d00640 1 -- 172.21.15.19:0/2806904103 >> v2:172.21.15.190:3300/0 conn(0x7f34140c26b0 msgr2=0x7f34140c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:46.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.235+0000 7f3419d00640 1 --2- 172.21.15.19:0/2806904103 >> v2:172.21.15.190:3300/0 conn(0x7f34140c26b0 0x7f34140c2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.235+0000 7f3419d00640 1 -- 172.21.15.19:0/2806904103 >> v1:172.21.15.190:6789/0 conn(0x7f3414069e90 legacy=0x7f341406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:46.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.235+0000 7f3419d00640 1 -- 172.21.15.19:0/2806904103 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34140ca510 con 0x7f341406d010 2023-11-20T06:41:46.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.235+0000 7f3419d00640 1 --2- 172.21.15.19:0/2806904103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f341406d010 0x7f34140c9ce0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f34140b02e0 tx=0x7f340401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=914b545a8bf3123d server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:46.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.235+0000 7f34194ff640 1 -- 172.21.15.19:0/2806904103 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34040a89f0 con 0x7f341406d010 2023-11-20T06:41:46.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.235+0000 7f34194ff640 1 -- 172.21.15.19:0/2806904103 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34040a8b50 con 0x7f341406d010 2023-11-20T06:41:46.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.235+0000 7f34194ff640 1 -- 172.21.15.19:0/2806904103 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34040b0440 con 0x7f341406d010 2023-11-20T06:41:46.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.235+0000 7f341c765640 1 -- 172.21.15.19:0/2806904103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f341406d010 msgr2=0x7f34140c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:46.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.235+0000 7f341c765640 1 --2- 172.21.15.19:0/2806904103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f341406d010 0x7f34140c9ce0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f34140b02e0 tx=0x7f340401ecf0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f341c765640 1 -- 172.21.15.19:0/2806904103 shutdown_connections 2023-11-20T06:41:46.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f341c765640 1 --2- 172.21.15.19:0/2806904103 >> v2:172.21.15.190:3300/0 conn(0x7f34140c26b0 0x7f34140c2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f341c765640 1 --2- 172.21.15.19:0/2806904103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f341406d010 0x7f34140c9ce0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f341c765640 1 -- 172.21.15.19:0/2806904103 >> 172.21.15.19:0/2806904103 conn(0x7f34140b0da0 msgr2=0x7f34140ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:46.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f341c765640 1 -- 172.21.15.19:0/2806904103 shutdown_connections 2023-11-20T06:41:46.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f341c765640 1 -- 172.21.15.19:0/2806904103 wait complete. 2023-11-20T06:41:46.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f341c765640 1 Processor -- start 2023-11-20T06:41:46.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f341c765640 1 -- start start 2023-11-20T06:41:46.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f341c765640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3414069e90 0x7f34140c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:46.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f341c765640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f341406d010 0x7f34140c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:46.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f341c765640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34140c26b0 0x7f34140ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:46.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f341c765640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34140c4b50 con 0x7f341406d010 2023-11-20T06:41:46.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f341c765640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34140c7500 con 0x7f3414069e90 2023-11-20T06:41:46.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f341c765640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34140c77c0 con 0x7f34140c26b0 2023-11-20T06:41:46.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f3419d00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f341406d010 0x7f34140c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:46.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f3419d00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f341406d010 0x7f34140c6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48640/0 (socket says 172.21.15.19:48640) 2023-11-20T06:41:46.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f3419d00640 1 -- 172.21.15.19:0/3830672532 learned_addr learned my addr 172.21.15.19:0/3830672532 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:46.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f3419d00640 1 -- 172.21.15.19:0/3830672532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34140c26b0 msgr2=0x7f34140ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:46.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f3419d00640 1 --2- 172.21.15.19:0/3830672532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34140c26b0 0x7f34140ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f3419d00640 1 -- 172.21.15.19:0/3830672532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3414069e90 msgr2=0x7f34140c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:46.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f341a501640 1 --2- 172.21.15.19:0/3830672532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3414069e90 0x7f34140c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:46.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f3419d00640 1 --2- 172.21.15.19:0/3830672532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3414069e90 0x7f34140c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f3419d00640 1 -- 172.21.15.19:0/3830672532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34040094d0 con 0x7f341406d010 2023-11-20T06:41:46.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f341a501640 1 --2- 172.21.15.19:0/3830672532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3414069e90 0x7f34140c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:46.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.239+0000 7f3419d00640 1 --2- 172.21.15.19:0/3830672532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f341406d010 0x7f34140c6fc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f340401b900 tx=0x7f340401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:46.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.243+0000 7f340affd640 1 -- 172.21.15.19:0/3830672532 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34040ba600 con 0x7f341406d010 2023-11-20T06:41:46.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.243+0000 7f340affd640 1 -- 172.21.15.19:0/3830672532 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34040ba760 con 0x7f341406d010 2023-11-20T06:41:46.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.243+0000 7f340affd640 1 -- 172.21.15.19:0/3830672532 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34040bab10 con 0x7f341406d010 2023-11-20T06:41:46.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.243+0000 7f341c765640 1 -- 172.21.15.19:0/3830672532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34140c7aa0 con 0x7f341406d010 2023-11-20T06:41:46.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.243+0000 7f341c765640 1 -- 172.21.15.19:0/3830672532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34140c8060 con 0x7f341406d010 2023-11-20T06:41:46.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.243+0000 7f341c765640 1 -- 172.21.15.19:0/3830672532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34140caab0 con 0x7f341406d010 2023-11-20T06:41:46.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.243+0000 7f340affd640 1 -- 172.21.15.19:0/3830672532 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f34040bac70 con 0x7f341406d010 2023-11-20T06:41:46.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.243+0000 7f340affd640 1 --2- 172.21.15.19:0/3830672532 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f33f80664a0 0x7f33f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:46.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.243+0000 7f340affd640 1 -- 172.21.15.19:0/3830672532 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3404122800 con 0x7f341406d010 2023-11-20T06:41:46.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.243+0000 7f341a501640 1 --2- 172.21.15.19:0/3830672532 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f33f80664a0 0x7f33f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:46.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.247+0000 7f341a501640 1 --2- 172.21.15.19:0/3830672532 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f33f80664a0 0x7f33f8068960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3410000f70 tx=0x7f3410009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:46.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.247+0000 7f340affd640 1 -- 172.21.15.19:0/3830672532 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f34140caab0 con 0x7f341406d010 2023-11-20T06:41:46.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.411+0000 7f341c765640 1 -- 172.21.15.19:0/3830672532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f34140caab0 con 0x7f341406d010 2023-11-20T06:41:46.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.411+0000 7f340affd640 1 -- 172.21.15.19:0/3830672532 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f34140caab0 con 0x7f341406d010 2023-11-20T06:41:46.416 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-20T06:41:46.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.411+0000 7f341c765640 1 -- 172.21.15.19:0/3830672532 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f33f80664a0 msgr2=0x7f33f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:46.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.411+0000 7f341c765640 1 --2- 172.21.15.19:0/3830672532 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f33f80664a0 0x7f33f8068960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3410000f70 tx=0x7f3410009040 comp rx=0 tx=0).stop 2023-11-20T06:41:46.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.411+0000 7f341c765640 1 -- 172.21.15.19:0/3830672532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f341406d010 msgr2=0x7f34140c6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:46.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.411+0000 7f341c765640 1 --2- 172.21.15.19:0/3830672532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f341406d010 0x7f34140c6fc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f340401b900 tx=0x7f340401ba90 comp rx=0 tx=0).stop 2023-11-20T06:41:46.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.411+0000 7f341c765640 1 -- 172.21.15.19:0/3830672532 shutdown_connections 2023-11-20T06:41:46.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.411+0000 7f341c765640 1 --2- 172.21.15.19:0/3830672532 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f33f80664a0 0x7f33f8068960 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.411+0000 7f341c765640 1 --2- 172.21.15.19:0/3830672532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34140c26b0 0x7f34140ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.411+0000 7f341c765640 1 --2- 172.21.15.19:0/3830672532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f341406d010 0x7f34140c6fc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.411+0000 7f341c765640 1 --2- 172.21.15.19:0/3830672532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3414069e90 0x7f34140c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.411+0000 7f341c765640 1 -- 172.21.15.19:0/3830672532 >> 172.21.15.19:0/3830672532 conn(0x7f34140b0da0 msgr2=0x7f34140ae3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:46.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.411+0000 7f341c765640 1 -- 172.21.15.19:0/3830672532 shutdown_connections 2023-11-20T06:41:46.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.411+0000 7f341c765640 1 -- 172.21.15.19:0/3830672532 wait complete. 2023-11-20T06:41:46.438 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T06:41:46.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.579+0000 7ff748054640 1 Processor -- start 2023-11-20T06:41:46.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.579+0000 7ff748054640 1 -- start start 2023-11-20T06:41:46.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.579+0000 7ff748054640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff7400ade00 0x7ff7400c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:46.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.579+0000 7ff748054640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff74006a4d0 0x7ff7400ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:46.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.579+0000 7ff748054640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff74006c6d0 con 0x7ff74006a0f0 2023-11-20T06:41:46.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.579+0000 7ff748054640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74006c950 con 0x7ff74006a4d0 2023-11-20T06:41:46.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.579+0000 7ff748054640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7401654f0 con 0x7ff7400ade00 2023-11-20T06:41:46.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.579+0000 7ff745df0640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff74006a0f0 0x7ff7400ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40784/0 (socket says 172.21.15.19:40784) 2023-11-20T06:41:46.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.579+0000 7ff745df0640 1 -- 172.21.15.19:0/2427840083 learned_addr learned my addr 172.21.15.19:0/2427840083 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:46.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.579+0000 7ff7465f1640 1 --2- 172.21.15.19:0/2427840083 >> v2:172.21.15.19:3300/0 conn(0x7ff74006a4d0 0x7ff7400ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:46.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.579+0000 7ff7455ef640 1 --2- 172.21.15.19:0/2427840083 >> v2:172.21.15.190:3300/0 conn(0x7ff7400ade00 0x7ff7400c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:46.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.583+0000 7ff744dee640 1 -- 172.21.15.19:0/2427840083 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332379467 0 0) 0x7ff74006c6d0 con 0x7ff74006a0f0 2023-11-20T06:41:46.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.583+0000 7ff744dee640 1 -- 172.21.15.19:0/2427840083 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff72c003530 con 0x7ff74006a0f0 2023-11-20T06:41:46.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.583+0000 7ff7465f1640 1 -- 172.21.15.19:0/2427840083 >> v2:172.21.15.190:3300/0 conn(0x7ff7400ade00 msgr2=0x7ff7400c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:46.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.583+0000 7ff7465f1640 1 --2- 172.21.15.19:0/2427840083 >> v2:172.21.15.190:3300/0 conn(0x7ff7400ade00 0x7ff7400c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.583+0000 7ff7465f1640 1 -- 172.21.15.19:0/2427840083 >> v1:172.21.15.19:6789/0 conn(0x7ff74006a0f0 legacy=0x7ff7400ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:46.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.583+0000 7ff7465f1640 1 -- 172.21.15.19:0/2427840083 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7401657d0 con 0x7ff74006a4d0 2023-11-20T06:41:46.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.583+0000 7ff7465f1640 1 --2- 172.21.15.19:0/2427840083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74006a4d0 0x7ff7400ccd00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff740071390 tx=0x7ff73801d370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1b469cdf0833ac server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:46.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.583+0000 7ff744dee640 1 -- 172.21.15.19:0/2427840083 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7380a59f0 con 0x7ff74006a4d0 2023-11-20T06:41:46.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.583+0000 7ff744dee640 1 -- 172.21.15.19:0/2427840083 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7380a5b50 con 0x7ff74006a4d0 2023-11-20T06:41:46.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.583+0000 7ff744dee640 1 -- 172.21.15.19:0/2427840083 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7380ad440 con 0x7ff74006a4d0 2023-11-20T06:41:46.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff748054640 1 -- 172.21.15.19:0/2427840083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74006a4d0 msgr2=0x7ff7400ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:46.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff748054640 1 --2- 172.21.15.19:0/2427840083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74006a4d0 0x7ff7400ccd00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff740071390 tx=0x7ff73801d370 comp rx=0 tx=0).stop 2023-11-20T06:41:46.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff748054640 1 -- 172.21.15.19:0/2427840083 shutdown_connections 2023-11-20T06:41:46.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff748054640 1 --2- 172.21.15.19:0/2427840083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74006a4d0 0x7ff7400ccd00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff748054640 1 --2- 172.21.15.19:0/2427840083 >> v2:172.21.15.190:3300/0 conn(0x7ff7400ade00 0x7ff7400c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff748054640 1 -- 172.21.15.19:0/2427840083 >> 172.21.15.19:0/2427840083 conn(0x7ff7400b0da0 msgr2=0x7ff7400ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:46.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff748054640 1 -- 172.21.15.19:0/2427840083 shutdown_connections 2023-11-20T06:41:46.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff748054640 1 -- 172.21.15.19:0/2427840083 wait complete. 2023-11-20T06:41:46.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff748054640 1 Processor -- start 2023-11-20T06:41:46.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff748054640 1 -- start start 2023-11-20T06:41:46.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff748054640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff74006a0f0 0x7ff7400c4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:46.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff748054640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74006a4d0 0x7ff7400ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:46.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff748054640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7400ade00 0x7ff7400cd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:46.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff748054640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400c46b0 con 0x7ff74006a4d0 2023-11-20T06:41:46.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff748054640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400c59d0 con 0x7ff7400ade00 2023-11-20T06:41:46.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff748054640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400c5c90 con 0x7ff74006a0f0 2023-11-20T06:41:46.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff7455ef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74006a4d0 0x7ff7400ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:46.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff7455ef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74006a4d0 0x7ff7400ccd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48650/0 (socket says 172.21.15.19:48650) 2023-11-20T06:41:46.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff7455ef640 1 -- 172.21.15.19:0/232762827 learned_addr learned my addr 172.21.15.19:0/232762827 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:46.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff7455ef640 1 -- 172.21.15.19:0/232762827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff74006a0f0 msgr2=0x7ff7400c4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:46.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff7455ef640 1 --2- 172.21.15.19:0/232762827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff74006a0f0 0x7ff7400c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff7455ef640 1 -- 172.21.15.19:0/232762827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7400ade00 msgr2=0x7ff7400cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:46.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff7455ef640 1 --2- 172.21.15.19:0/232762827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7400ade00 0x7ff7400cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff7455ef640 1 -- 172.21.15.19:0/232762827 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff738009a70 con 0x7ff74006a4d0 2023-11-20T06:41:46.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.587+0000 7ff7455ef640 1 --2- 172.21.15.19:0/232762827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74006a4d0 0x7ff7400ccd00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff73000e840 tx=0x7ff73000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:46.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.591+0000 7ff7367fc640 1 -- 172.21.15.19:0/232762827 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730009510 con 0x7ff74006a4d0 2023-11-20T06:41:46.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.591+0000 7ff7367fc640 1 -- 172.21.15.19:0/232762827 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73000ee90 con 0x7ff74006a4d0 2023-11-20T06:41:46.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.591+0000 7ff7367fc640 1 -- 172.21.15.19:0/232762827 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73000cb60 con 0x7ff74006a4d0 2023-11-20T06:41:46.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.591+0000 7ff748054640 1 -- 172.21.15.19:0/232762827 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7400c5f70 con 0x7ff74006a4d0 2023-11-20T06:41:46.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.591+0000 7ff748054640 1 -- 172.21.15.19:0/232762827 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74015b2e0 con 0x7ff74006a4d0 2023-11-20T06:41:46.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.591+0000 7ff748054640 1 -- 172.21.15.19:0/232762827 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff74004e170 con 0x7ff74006a4d0 2023-11-20T06:41:46.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.591+0000 7ff7367fc640 1 -- 172.21.15.19:0/232762827 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff73000ccc0 con 0x7ff74006a4d0 2023-11-20T06:41:46.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.591+0000 7ff7367fc640 1 --2- 172.21.15.19:0/232762827 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff724066470 0x7ff724068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:46.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.591+0000 7ff7367fc640 1 -- 172.21.15.19:0/232762827 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff730084320 con 0x7ff74006a4d0 2023-11-20T06:41:46.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.591+0000 7ff745df0640 1 --2- 172.21.15.19:0/232762827 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff724066470 0x7ff724068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:46.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.595+0000 7ff745df0640 1 --2- 172.21.15.19:0/232762827 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff724066470 0x7ff724068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff73c007fd0 tx=0x7ff73c007940 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:46.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.595+0000 7ff7367fc640 1 -- 172.21.15.19:0/232762827 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff730051410 con 0x7ff74006a4d0 2023-11-20T06:41:46.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.755+0000 7ff748054640 1 -- 172.21.15.19:0/232762827 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff7400c6420 con 0x7ff74006a4d0 2023-11-20T06:41:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.755+0000 7ff7367fc640 1 -- 172.21.15.19:0/232762827 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff730054a30 con 0x7ff74006a4d0 2023-11-20T06:41:46.760 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:41:46.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.755+0000 7ff748054640 1 -- 172.21.15.19:0/232762827 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff724066470 msgr2=0x7ff724068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:46.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.755+0000 7ff748054640 1 --2- 172.21.15.19:0/232762827 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff724066470 0x7ff724068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff73c007fd0 tx=0x7ff73c007940 comp rx=0 tx=0).stop 2023-11-20T06:41:46.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.755+0000 7ff748054640 1 -- 172.21.15.19:0/232762827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74006a4d0 msgr2=0x7ff7400ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:46.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.755+0000 7ff748054640 1 --2- 172.21.15.19:0/232762827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74006a4d0 0x7ff7400ccd00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff73000e840 tx=0x7ff73000ec40 comp rx=0 tx=0).stop 2023-11-20T06:41:46.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.755+0000 7ff748054640 1 -- 172.21.15.19:0/232762827 shutdown_connections 2023-11-20T06:41:46.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.755+0000 7ff748054640 1 --2- 172.21.15.19:0/232762827 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff724066470 0x7ff724068930 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.755+0000 7ff748054640 1 --2- 172.21.15.19:0/232762827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7400ade00 0x7ff7400cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.755+0000 7ff748054640 1 --2- 172.21.15.19:0/232762827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74006a4d0 0x7ff7400ccd00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.755+0000 7ff748054640 1 --2- 172.21.15.19:0/232762827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff74006a0f0 0x7ff7400c4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.755+0000 7ff748054640 1 -- 172.21.15.19:0/232762827 >> 172.21.15.19:0/232762827 conn(0x7ff7400b0da0 msgr2=0x7ff740163ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:46.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.755+0000 7ff748054640 1 -- 172.21.15.19:0/232762827 shutdown_connections 2023-11-20T06:41:46.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.755+0000 7ff748054640 1 -- 172.21.15.19:0/232762827 wait complete. 2023-11-20T06:41:46.782 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T06:41:46.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.919+0000 7f23bef9d640 1 Processor -- start 2023-11-20T06:41:46.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.919+0000 7f23bef9d640 1 -- start start 2023-11-20T06:41:46.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.919+0000 7f23bef9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23b81597c0 0x7f23b80ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:46.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.919+0000 7f23bef9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f23b8159ba0 0x7f23b80cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:46.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.919+0000 7f23bef9d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b80723d0 con 0x7f23b80adc10 2023-11-20T06:41:46.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.919+0000 7f23bef9d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b80717c0 con 0x7f23b8159ba0 2023-11-20T06:41:46.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.919+0000 7f23bef9d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b8071aa0 con 0x7f23b81597c0 2023-11-20T06:41:46.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.919+0000 7f23b7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f23b8159ba0 0x7f23b80cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:46.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.919+0000 7f23b7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f23b8159ba0 0x7f23b80cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48658/0 (socket says 172.21.15.19:48658) 2023-11-20T06:41:46.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.919+0000 7f23b7fff640 1 -- 172.21.15.19:0/3031683105 learned_addr learned my addr 172.21.15.19:0/3031683105 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:46.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.919+0000 7f23bcd39640 1 --2- 172.21.15.19:0/3031683105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23b81597c0 0x7f23b80ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:46.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.919+0000 7f23b7fff640 1 -- 172.21.15.19:0/3031683105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23b81597c0 msgr2=0x7f23b80ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:46.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.919+0000 7f23b7fff640 1 --2- 172.21.15.19:0/3031683105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23b81597c0 0x7f23b80ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.919+0000 7f23b7fff640 1 -- 172.21.15.19:0/3031683105 >> v1:172.21.15.190:6789/0 conn(0x7f23b80adc10 legacy=0x7f23b80cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:46.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.919+0000 7f23b7fff640 1 -- 172.21.15.19:0/3031683105 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b8071d80 con 0x7f23b8159ba0 2023-11-20T06:41:46.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.923+0000 7f23bcd39640 1 --2- 172.21.15.19:0/3031683105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23b81597c0 0x7f23b80ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:46.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.923+0000 7f23b7fff640 1 --2- 172.21.15.19:0/3031683105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b8159ba0 0x7f23b80cae10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009870 tx=0x7f23a401e750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0f62f13a17518b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:46.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.923+0000 7f23b77fe640 1 -- 172.21.15.19:0/3031683105 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a40a86c0 con 0x7f23b8159ba0 2023-11-20T06:41:46.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.923+0000 7f23b77fe640 1 -- 172.21.15.19:0/3031683105 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a40a8820 con 0x7f23b8159ba0 2023-11-20T06:41:46.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.923+0000 7f23b77fe640 1 -- 172.21.15.19:0/3031683105 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a40a8bb0 con 0x7f23b8159ba0 2023-11-20T06:41:46.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.923+0000 7f23bef9d640 1 -- 172.21.15.19:0/3031683105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b8159ba0 msgr2=0x7f23b80cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:46.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.923+0000 7f23bef9d640 1 --2- 172.21.15.19:0/3031683105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b8159ba0 0x7f23b80cae10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009870 tx=0x7f23a401e750 comp rx=0 tx=0).stop 2023-11-20T06:41:46.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.923+0000 7f23bef9d640 1 -- 172.21.15.19:0/3031683105 shutdown_connections 2023-11-20T06:41:46.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.923+0000 7f23bef9d640 1 --2- 172.21.15.19:0/3031683105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b8159ba0 0x7f23b80cae10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.923+0000 7f23bef9d640 1 --2- 172.21.15.19:0/3031683105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23b81597c0 0x7f23b80ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.923+0000 7f23bef9d640 1 -- 172.21.15.19:0/3031683105 >> 172.21.15.19:0/3031683105 conn(0x7f23b806c190 msgr2=0x7f23b806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:46.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.923+0000 7f23bef9d640 1 -- 172.21.15.19:0/3031683105 shutdown_connections 2023-11-20T06:41:46.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.923+0000 7f23bef9d640 1 -- 172.21.15.19:0/3031683105 wait complete. 2023-11-20T06:41:46.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.927+0000 7f23bef9d640 1 Processor -- start 2023-11-20T06:41:46.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.927+0000 7f23bef9d640 1 -- start start 2023-11-20T06:41:46.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.927+0000 7f23bef9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23b80adc10 0x7f23b814a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:46.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.927+0000 7f23bef9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23b81597c0 0x7f23b8136e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:46.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.927+0000 7f23bef9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b8159ba0 0x7f23b8136090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:46.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.927+0000 7f23bef9d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b81365d0 con 0x7f23b8159ba0 2023-11-20T06:41:46.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.927+0000 7f23bef9d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b814a840 con 0x7f23b81597c0 2023-11-20T06:41:46.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.927+0000 7f23bef9d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b814ab20 con 0x7f23b80adc10 2023-11-20T06:41:46.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.927+0000 7f23bd53a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b8159ba0 0x7f23b8136090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:46.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.927+0000 7f23bcd39640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23b80adc10 0x7f23b814a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:46.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.927+0000 7f23bcd39640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23b80adc10 0x7f23b814a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:43564/0 (socket says 172.21.15.19:43564) 2023-11-20T06:41:46.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.927+0000 7f23b7fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23b81597c0 0x7f23b8136e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:46.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.927+0000 7f23bcd39640 1 -- 172.21.15.19:0/123537207 learned_addr learned my addr 172.21.15.19:0/123537207 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:46.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.927+0000 7f23bd53a640 1 -- 172.21.15.19:0/123537207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23b80adc10 msgr2=0x7f23b814a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:46.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.927+0000 7f23bd53a640 1 --2- 172.21.15.19:0/123537207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23b80adc10 0x7f23b814a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.927+0000 7f23bd53a640 1 -- 172.21.15.19:0/123537207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23b81597c0 msgr2=0x7f23b8136e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:46.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.927+0000 7f23bd53a640 1 --2- 172.21.15.19:0/123537207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23b81597c0 0x7f23b8136e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:46.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.927+0000 7f23bd53a640 1 -- 172.21.15.19:0/123537207 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a40094d0 con 0x7f23b8159ba0 2023-11-20T06:41:46.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.927+0000 7f23bd53a640 1 --2- 172.21.15.19:0/123537207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b8159ba0 0x7f23b8136090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f23b000c700 tx=0x7f23b000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:46.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.931+0000 7f23b57fa640 1 -- 172.21.15.19:0/123537207 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b0003b80 con 0x7f23b8159ba0 2023-11-20T06:41:46.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.931+0000 7f23b57fa640 1 -- 172.21.15.19:0/123537207 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b0003ce0 con 0x7f23b8159ba0 2023-11-20T06:41:46.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.931+0000 7f23b57fa640 1 -- 172.21.15.19:0/123537207 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b0005310 con 0x7f23b8159ba0 2023-11-20T06:41:46.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.931+0000 7f23bef9d640 1 -- 172.21.15.19:0/123537207 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b814ae00 con 0x7f23b8159ba0 2023-11-20T06:41:46.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.931+0000 7f23bef9d640 1 -- 172.21.15.19:0/123537207 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b815bcc0 con 0x7f23b8159ba0 2023-11-20T06:41:46.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.931+0000 7f23bef9d640 1 -- 172.21.15.19:0/123537207 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b8074010 con 0x7f23b8159ba0 2023-11-20T06:41:46.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.931+0000 7f23b57fa640 1 -- 172.21.15.19:0/123537207 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f23b0005470 con 0x7f23b8159ba0 2023-11-20T06:41:46.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.931+0000 7f23b57fa640 1 --2- 172.21.15.19:0/123537207 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f239c0664d0 0x7f239c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:46.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.931+0000 7f23b57fa640 1 -- 172.21.15.19:0/123537207 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f23b0083d80 con 0x7f23b8159ba0 2023-11-20T06:41:46.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.931+0000 7f23bcd39640 1 --2- 172.21.15.19:0/123537207 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f239c0664d0 0x7f239c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:46.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.931+0000 7f23bcd39640 1 --2- 172.21.15.19:0/123537207 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f239c0664d0 0x7f239c068990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f23ac009a10 tx=0x7f23ac008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:46.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:46.935+0000 7f23b57fa640 1 -- 172.21.15.19:0/123537207 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f23b0050f20 con 0x7f23b8159ba0 2023-11-20T06:41:47.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.127+0000 7f23bef9d640 1 -- 172.21.15.19:0/123537207 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23b80ce9e0 con 0x7f23b8159ba0 2023-11-20T06:41:47.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.127+0000 7f23b57fa640 1 -- 172.21.15.19:0/123537207 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f23b0054540 con 0x7f23b8159ba0 2023-11-20T06:41:47.132 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:47.132 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/212787745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":212787745},{"type":"v1","addr":"172.21.15.190:6836","nonce":212787745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1874314285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1874314285},{"type":"v1","addr":"172.21.15.190:6837","nonce":1874314285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3845638593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3845638593},{"type":"v1","addr":"172.21.15.19:6833","nonce":3845638593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T06:41:13.620144+0000","modified":"2023-11-20T06:41:37.768410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/1973335825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1973335825},{"type":"v1","addr":"172.21.15.19:6835","nonce":1973335825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-20T06:41:47.132 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 9 2023-11-20T06:41:47.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.127+0000 7f23bef9d640 1 -- 172.21.15.19:0/123537207 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f239c0664d0 msgr2=0x7f239c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:47.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.127+0000 7f23bef9d640 1 --2- 172.21.15.19:0/123537207 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f239c0664d0 0x7f239c068990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f23ac009a10 tx=0x7f23ac008040 comp rx=0 tx=0).stop 2023-11-20T06:41:47.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.127+0000 7f23bef9d640 1 -- 172.21.15.19:0/123537207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b8159ba0 msgr2=0x7f23b8136090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:47.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.127+0000 7f23bef9d640 1 --2- 172.21.15.19:0/123537207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b8159ba0 0x7f23b8136090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f23b000c700 tx=0x7f23b000cbc0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.127+0000 7f23bef9d640 1 -- 172.21.15.19:0/123537207 shutdown_connections 2023-11-20T06:41:47.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.127+0000 7f23bef9d640 1 --2- 172.21.15.19:0/123537207 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f239c0664d0 0x7f239c068990 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.127+0000 7f23bef9d640 1 --2- 172.21.15.19:0/123537207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b8159ba0 0x7f23b8136090 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.127+0000 7f23bef9d640 1 --2- 172.21.15.19:0/123537207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23b81597c0 0x7f23b8136e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.127+0000 7f23bef9d640 1 --2- 172.21.15.19:0/123537207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f23b80adc10 0x7f23b814a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.127+0000 7f23bef9d640 1 -- 172.21.15.19:0/123537207 >> 172.21.15.19:0/123537207 conn(0x7f23b806c190 msgr2=0x7f23b814cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:47.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.127+0000 7f23bef9d640 1 -- 172.21.15.19:0/123537207 shutdown_connections 2023-11-20T06:41:47.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.127+0000 7f23bef9d640 1 -- 172.21.15.19:0/123537207 wait complete. 2023-11-20T06:41:47.153 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:41:47.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.291+0000 7f015a7d3640 1 Processor -- start 2023-11-20T06:41:47.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.291+0000 7f015a7d3640 1 -- start start 2023-11-20T06:41:47.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.291+0000 7f015a7d3640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0154070c40 0x7f015415ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:47.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.291+0000 7f015a7d3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01540b07f0 0x7f0154164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:47.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.291+0000 7f015a7d3640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015415be60 con 0x7f01540b4020 2023-11-20T06:41:47.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.291+0000 7f015a7d3640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f015415b3b0 con 0x7f0154070c40 2023-11-20T06:41:47.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.291+0000 7f015a7d3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015415c1f0 con 0x7f01540b07f0 2023-11-20T06:41:47.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.291+0000 7f0153fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0154070c40 0x7f015415ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:47.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.291+0000 7f01537fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f01540b4020 0x7f01540b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40798/0 (socket says 172.21.15.19:40798) 2023-11-20T06:41:47.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.291+0000 7f01537fe640 1 -- 172.21.15.19:0/3190864528 learned_addr learned my addr 172.21.15.19:0/3190864528 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:47.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.291+0000 7f0158d70640 1 --2- 172.21.15.19:0/3190864528 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01540b07f0 0x7f0154164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:47.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.291+0000 7f0153fff640 1 -- 172.21.15.19:0/3190864528 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01540b07f0 msgr2=0x7f0154164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:47.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.291+0000 7f0153fff640 1 --2- 172.21.15.19:0/3190864528 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01540b07f0 0x7f0154164490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.291+0000 7f0153fff640 1 -- 172.21.15.19:0/3190864528 >> v1:172.21.15.19:6789/0 conn(0x7f01540b4020 legacy=0x7f01540b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:47.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.291+0000 7f0153fff640 1 -- 172.21.15.19:0/3190864528 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0154071020 con 0x7f0154070c40 2023-11-20T06:41:47.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.291+0000 7f0152ffd640 1 -- 172.21.15.19:0/3190864528 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954493633 0 0) 0x7f015415be60 con 0x7f01540b4020 2023-11-20T06:41:47.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.295+0000 7f0153fff640 1 --2- 172.21.15.19:0/3190864528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0154070c40 0x7f015415ae70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f01440097c0 tx=0x7f014401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247e3a5ca45adcf8 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:47.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.295+0000 7f0152ffd640 1 -- 172.21.15.19:0/3190864528 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01440ab5f0 con 0x7f0154070c40 2023-11-20T06:41:47.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.295+0000 7f0152ffd640 1 -- 172.21.15.19:0/3190864528 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01440ab750 con 0x7f0154070c40 2023-11-20T06:41:47.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.295+0000 7f0152ffd640 1 -- 172.21.15.19:0/3190864528 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01440abae0 con 0x7f0154070c40 2023-11-20T06:41:47.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.295+0000 7f015a7d3640 1 -- 172.21.15.19:0/3190864528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0154070c40 msgr2=0x7f015415ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:47.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.295+0000 7f015a7d3640 1 --2- 172.21.15.19:0/3190864528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0154070c40 0x7f015415ae70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f01440097c0 tx=0x7f014401c3f0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.295+0000 7f015a7d3640 1 -- 172.21.15.19:0/3190864528 shutdown_connections 2023-11-20T06:41:47.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.295+0000 7f015a7d3640 1 --2- 172.21.15.19:0/3190864528 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01540b07f0 0x7f0154164490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.295+0000 7f015a7d3640 1 --2- 172.21.15.19:0/3190864528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0154070c40 0x7f015415ae70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.295+0000 7f015a7d3640 1 -- 172.21.15.19:0/3190864528 >> 172.21.15.19:0/3190864528 conn(0x7f015406c190 msgr2=0x7f015406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:47.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.295+0000 7f015a7d3640 1 -- 172.21.15.19:0/3190864528 shutdown_connections 2023-11-20T06:41:47.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.295+0000 7f015a7d3640 1 -- 172.21.15.19:0/3190864528 wait complete. 2023-11-20T06:41:47.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f015a7d3640 1 Processor -- start 2023-11-20T06:41:47.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f015a7d3640 1 -- start start 2023-11-20T06:41:47.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f015a7d3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0154070c40 0x7f0154154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:47.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f015a7d3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01540b07f0 0x7f0154151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:47.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f015a7d3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01540b4020 0x7f0154153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:47.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f015a7d3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0154154a80 con 0x7f01540b07f0 2023-11-20T06:41:47.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f015a7d3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015414d910 con 0x7f0154070c40 2023-11-20T06:41:47.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f015a7d3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01541546e0 con 0x7f01540b4020 2023-11-20T06:41:47.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f01537fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01540b07f0 0x7f0154151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f01537fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01540b07f0 0x7f0154151af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48688/0 (socket says 172.21.15.19:48688) 2023-11-20T06:41:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f01537fe640 1 -- 172.21.15.19:0/3683578799 learned_addr learned my addr 172.21.15.19:0/3683578799 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f0158d70640 1 --2- 172.21.15.19:0/3683578799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01540b4020 0x7f0154153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f0153fff640 1 --2- 172.21.15.19:0/3683578799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0154070c40 0x7f0154154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f01537fe640 1 -- 172.21.15.19:0/3683578799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01540b4020 msgr2=0x7f0154153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f01537fe640 1 --2- 172.21.15.19:0/3683578799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01540b4020 0x7f0154153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f01537fe640 1 -- 172.21.15.19:0/3683578799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0154070c40 msgr2=0x7f0154154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f01537fe640 1 --2- 172.21.15.19:0/3683578799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0154070c40 0x7f0154154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f01537fe640 1 -- 172.21.15.19:0/3683578799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0144009420 con 0x7f01540b07f0 2023-11-20T06:41:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f0153fff640 1 --2- 172.21.15.19:0/3683578799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0154070c40 0x7f0154154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:47.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f01537fe640 1 --2- 172.21.15.19:0/3683578799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01540b07f0 0x7f0154151af0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f014800c480 tx=0x7f014800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:47.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f0150ff9640 1 -- 172.21.15.19:0/3683578799 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01480074e0 con 0x7f01540b07f0 2023-11-20T06:41:47.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f0150ff9640 1 -- 172.21.15.19:0/3683578799 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0148007660 con 0x7f01540b07f0 2023-11-20T06:41:47.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f0150ff9640 1 -- 172.21.15.19:0/3683578799 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148004a30 con 0x7f01540b07f0 2023-11-20T06:41:47.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f015a7d3640 1 -- 172.21.15.19:0/3683578799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0154155af0 con 0x7f01540b07f0 2023-11-20T06:41:47.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.299+0000 7f015a7d3640 1 -- 172.21.15.19:0/3683578799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0154155810 con 0x7f01540b07f0 2023-11-20T06:41:47.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.303+0000 7f015a7d3640 1 -- 172.21.15.19:0/3683578799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0154154540 con 0x7f01540b07f0 2023-11-20T06:41:47.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.303+0000 7f0150ff9640 1 -- 172.21.15.19:0/3683578799 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0148004b90 con 0x7f01540b07f0 2023-11-20T06:41:47.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.303+0000 7f0150ff9640 1 --2- 172.21.15.19:0/3683578799 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f01400664a0 0x7f0140068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:47.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.303+0000 7f0150ff9640 1 -- 172.21.15.19:0/3683578799 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0148083390 con 0x7f01540b07f0 2023-11-20T06:41:47.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.303+0000 7f0153fff640 1 --2- 172.21.15.19:0/3683578799 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f01400664a0 0x7f0140068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:47.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.303+0000 7f0153fff640 1 --2- 172.21.15.19:0/3683578799 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f01400664a0 0x7f0140068960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f01440af000 tx=0x7f0144008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:47.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.307+0000 7f0150ff9640 1 -- 172.21.15.19:0/3683578799 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0154154540 con 0x7f01540b07f0 2023-11-20T06:41:47.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.463+0000 7f015a7d3640 1 -- 172.21.15.19:0/3683578799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0154154540 con 0x7f01540b07f0 2023-11-20T06:41:47.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.467+0000 7f0150ff9640 1 -- 172.21.15.19:0/3683578799 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f0154154540 con 0x7f01540b07f0 2023-11-20T06:41:47.471 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:47.471 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":25,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:20.306335+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:41:47.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.467+0000 7f015a7d3640 1 -- 172.21.15.19:0/3683578799 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f01400664a0 msgr2=0x7f0140068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:47.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.467+0000 7f015a7d3640 1 --2- 172.21.15.19:0/3683578799 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f01400664a0 0x7f0140068960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f01440af000 tx=0x7f0144008040 comp rx=0 tx=0).stop 2023-11-20T06:41:47.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.467+0000 7f015a7d3640 1 -- 172.21.15.19:0/3683578799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01540b07f0 msgr2=0x7f0154151af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:47.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.467+0000 7f015a7d3640 1 --2- 172.21.15.19:0/3683578799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01540b07f0 0x7f0154151af0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f014800c480 tx=0x7f014800c940 comp rx=0 tx=0).stop 2023-11-20T06:41:47.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.467+0000 7f015a7d3640 1 -- 172.21.15.19:0/3683578799 shutdown_connections 2023-11-20T06:41:47.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.467+0000 7f015a7d3640 1 --2- 172.21.15.19:0/3683578799 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f01400664a0 0x7f0140068960 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.467+0000 7f015a7d3640 1 --2- 172.21.15.19:0/3683578799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01540b4020 0x7f0154153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.467+0000 7f015a7d3640 1 --2- 172.21.15.19:0/3683578799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01540b07f0 0x7f0154151af0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.467+0000 7f015a7d3640 1 --2- 172.21.15.19:0/3683578799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0154070c40 0x7f0154154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.467+0000 7f015a7d3640 1 -- 172.21.15.19:0/3683578799 >> 172.21.15.19:0/3683578799 conn(0x7f015406c190 msgr2=0x7f01540ceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:47.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.467+0000 7f015a7d3640 1 -- 172.21.15.19:0/3683578799 shutdown_connections 2023-11-20T06:41:47.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.467+0000 7f015a7d3640 1 -- 172.21.15.19:0/3683578799 wait complete. 2023-11-20T06:41:47.493 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T06:41:11.805111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T06:41:12.614034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T06:41:16.311206+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T06:41:47.494 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:41:47.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e174ea640 1 Processor -- start 2023-11-20T06:41:47.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e174ea640 1 -- start start 2023-11-20T06:41:47.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e174ea640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2e100b84e0 0x7f2e100d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:47.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e174ea640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e100d1670 con 0x7f2e1015cba0 2023-11-20T06:41:47.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e174ea640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e100d1950 con 0x7f2e100d0210 2023-11-20T06:41:47.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e174ea640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e100d1460 con 0x7f2e100b84e0 2023-11-20T06:41:47.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e15286640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2e1015cba0 0x7f2e100cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40800/0 (socket says 172.21.15.19:40800) 2023-11-20T06:41:47.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e15286640 1 -- 172.21.15.19:0/1329473754 learned_addr learned my addr 172.21.15.19:0/1329473754 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:47.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e15a87640 1 --2- 172.21.15.19:0/1329473754 >> v2:172.21.15.190:3300/0 conn(0x7f2e100b84e0 0x7f2e100d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:47.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e07fff640 1 -- 172.21.15.19:0/1329473754 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128079748 0 0) 0x7f2e100d1670 con 0x7f2e1015cba0 2023-11-20T06:41:47.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e07fff640 1 -- 172.21.15.19:0/1329473754 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dfc003530 con 0x7f2e1015cba0 2023-11-20T06:41:47.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e07fff640 1 -- 172.21.15.19:0/1329473754 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1198902705 0 0) 0x7f2dfc003530 con 0x7f2e1015cba0 2023-11-20T06:41:47.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e07fff640 1 -- 172.21.15.19:0/1329473754 >> v2:172.21.15.190:3300/0 conn(0x7f2e100b84e0 msgr2=0x7f2e100d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:47.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e07fff640 1 --2- 172.21.15.19:0/1329473754 >> v2:172.21.15.190:3300/0 conn(0x7f2e100b84e0 0x7f2e100d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e07fff640 1 -- 172.21.15.19:0/1329473754 >> v1:172.21.15.190:6789/0 conn(0x7f2e100d0210 legacy=0x7f2e100b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:47.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e07fff640 1 -- 172.21.15.19:0/1329473754 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e100d1c30 con 0x7f2e1015cba0 2023-11-20T06:41:47.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e07fff640 1 -- 172.21.15.19:0/1329473754 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7f2e0c001680 con 0x7f2e1015cba0 2023-11-20T06:41:47.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e07fff640 1 -- 172.21.15.19:0/1329473754 >> v1:172.21.15.19:6789/0 conn(0x7f2e1015cba0 legacy=0x7f2e100cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:47.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e07fff640 1 --2- 172.21.15.19:0/1329473754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dfc003980 0x7f2dfc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:47.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e07fff640 1 --2- 172.21.15.19:0/1329473754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2dfc0047d0 0x7f2dfc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:47.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e07fff640 1 --2- 172.21.15.19:0/1329473754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2dfc005190 0x7f2dfc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:47.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.635+0000 7f2e07fff640 1 -- 172.21.15.19:0/1329473754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e100d1460 con 0x7f2dfc003980 2023-11-20T06:41:47.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.639+0000 7f2e07fff640 1 -- 172.21.15.19:0/1329473754 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc00c130 con 0x7f2dfc005190 2023-11-20T06:41:47.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.639+0000 7f2e07fff640 1 -- 172.21.15.19:0/1329473754 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc00c2f0 con 0x7f2dfc0047d0 2023-11-20T06:41:47.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.639+0000 7f2e15286640 1 --2- 172.21.15.19:0/1329473754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dfc003980 0x7f2dfc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:47.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.639+0000 7f2e15a87640 1 --2- 172.21.15.19:0/1329473754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2dfc005190 0x7f2dfc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:47.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.639+0000 7f2e14a85640 1 --2- 172.21.15.19:0/1329473754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2dfc0047d0 0x7f2dfc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:47.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.639+0000 7f2e15286640 1 -- 172.21.15.19:0/1329473754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2dfc0047d0 msgr2=0x7f2dfc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:47.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.639+0000 7f2e15286640 1 --2- 172.21.15.19:0/1329473754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2dfc0047d0 0x7f2dfc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.639+0000 7f2e15286640 1 -- 172.21.15.19:0/1329473754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2dfc005190 msgr2=0x7f2dfc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:47.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.639+0000 7f2e15286640 1 --2- 172.21.15.19:0/1329473754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2dfc005190 0x7f2dfc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.639+0000 7f2e15286640 1 -- 172.21.15.19:0/1329473754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dfc003530 con 0x7f2dfc003980 2023-11-20T06:41:47.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.639+0000 7f2e15a87640 1 -- 172.21.15.19:0/1329473754 reap_dead start 2023-11-20T06:41:47.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.639+0000 7f2e15286640 1 --2- 172.21.15.19:0/1329473754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dfc003980 0x7f2dfc003da0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00c240 tx=0x7f2e0c01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f7ce237e1f7093 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:47.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.639+0000 7f2e07fff640 1 -- 172.21.15.19:0/1329473754 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c0a5b50 con 0x7f2dfc003980 2023-11-20T06:41:47.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.639+0000 7f2e07fff640 1 -- 172.21.15.19:0/1329473754 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c0a5cb0 con 0x7f2dfc003980 2023-11-20T06:41:47.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.639+0000 7f2e07fff640 1 -- 172.21.15.19:0/1329473754 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c0a5ea0 con 0x7f2dfc003980 2023-11-20T06:41:47.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e174ea640 1 -- 172.21.15.19:0/1329473754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dfc003980 msgr2=0x7f2dfc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:47.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e174ea640 1 --2- 172.21.15.19:0/1329473754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dfc003980 0x7f2dfc003da0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00c240 tx=0x7f2e0c01cbc0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e174ea640 1 -- 172.21.15.19:0/1329473754 shutdown_connections 2023-11-20T06:41:47.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e174ea640 1 --2- 172.21.15.19:0/1329473754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dfc003980 0x7f2dfc003da0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e174ea640 1 -- 172.21.15.19:0/1329473754 >> 172.21.15.19:0/1329473754 conn(0x7f2e100719c0 msgr2=0x7f2e10071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:47.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e174ea640 1 -- 172.21.15.19:0/1329473754 shutdown_connections 2023-11-20T06:41:47.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e174ea640 1 -- 172.21.15.19:0/1329473754 wait complete. 2023-11-20T06:41:47.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e174ea640 1 Processor -- start 2023-11-20T06:41:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e174ea640 1 -- start start 2023-11-20T06:41:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e174ea640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2dfc003980 0x7f2e100c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e174ea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e100c8f50 0x7f2e101f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e174ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e101522d0 0x7f2e10157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e174ea640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e100c8220 con 0x7f2e100c8f50 2023-11-20T06:41:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e174ea640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e101f5fd0 con 0x7f2dfc003980 2023-11-20T06:41:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e174ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e100c7ea0 con 0x7f2e101522d0 2023-11-20T06:41:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e14a85640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e100c8f50 0x7f2e101f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e14a85640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e100c8f50 0x7f2e101f5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48694/0 (socket says 172.21.15.19:48694) 2023-11-20T06:41:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e14a85640 1 -- 172.21.15.19:0/3714716573 learned_addr learned my addr 172.21.15.19:0/3714716573 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e15286640 1 --2- 172.21.15.19:0/3714716573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2dfc003980 0x7f2e100c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e15a87640 1 --2- 172.21.15.19:0/3714716573 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e101522d0 0x7f2e10157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:47.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e14a85640 1 -- 172.21.15.19:0/3714716573 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e101522d0 msgr2=0x7f2e10157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:47.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e14a85640 1 --2- 172.21.15.19:0/3714716573 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e101522d0 0x7f2e10157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e14a85640 1 -- 172.21.15.19:0/3714716573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2dfc003980 msgr2=0x7f2e100c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:47.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e14a85640 1 --2- 172.21.15.19:0/3714716573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2dfc003980 0x7f2e100c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.643+0000 7f2e14a85640 1 -- 172.21.15.19:0/3714716573 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e100c8470 con 0x7f2e100c8f50 2023-11-20T06:41:47.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.647+0000 7f2e14a85640 1 --2- 172.21.15.19:0/3714716573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e100c8f50 0x7f2e101f5a90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2e00007820 tx=0x7f2e0000e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:47.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.647+0000 7f2e05ffb640 1 -- 172.21.15.19:0/3714716573 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e000052e0 con 0x7f2e100c8f50 2023-11-20T06:41:47.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.647+0000 7f2e05ffb640 1 -- 172.21.15.19:0/3714716573 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e00005440 con 0x7f2e100c8f50 2023-11-20T06:41:47.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.647+0000 7f2e05ffb640 1 -- 172.21.15.19:0/3714716573 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e00003840 con 0x7f2e100c8f50 2023-11-20T06:41:47.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.647+0000 7f2e174ea640 1 -- 172.21.15.19:0/3714716573 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e100c8750 con 0x7f2e100c8f50 2023-11-20T06:41:47.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.647+0000 7f2e174ea640 1 -- 172.21.15.19:0/3714716573 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e100c93d0 con 0x7f2e100c8f50 2023-11-20T06:41:47.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.647+0000 7f2e174ea640 1 -- 172.21.15.19:0/3714716573 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e1004e170 con 0x7f2e100c8f50 2023-11-20T06:41:47.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.647+0000 7f2e05ffb640 1 -- 172.21.15.19:0/3714716573 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2e000039a0 con 0x7f2e100c8f50 2023-11-20T06:41:47.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.647+0000 7f2e05ffb640 1 --2- 172.21.15.19:0/3714716573 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2df40664a0 0x7f2df4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:47.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.647+0000 7f2e05ffb640 1 -- 172.21.15.19:0/3714716573 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2e00083940 con 0x7f2e100c8f50 2023-11-20T06:41:47.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.647+0000 7f2e15286640 1 --2- 172.21.15.19:0/3714716573 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2df40664a0 0x7f2df4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:47.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.651+0000 7f2e15286640 1 --2- 172.21.15.19:0/3714716573 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2df40664a0 0x7f2df4068960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0ab000 tx=0x7f2e0c0b0040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:47.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.651+0000 7f2e05ffb640 1 -- 172.21.15.19:0/3714716573 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2e00050ae0 con 0x7f2e100c8f50 2023-11-20T06:41:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.807+0000 7f2e174ea640 1 -- 172.21.15.19:0/3714716573 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2e101598f0 con 0x7f2e100c8f50 2023-11-20T06:41:47.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.807+0000 7f2e05ffb640 1 -- 172.21.15.19:0/3714716573 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2e000190a0 con 0x7f2e100c8f50 2023-11-20T06:41:47.815 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:41:47.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.811+0000 7f2e174ea640 1 -- 172.21.15.19:0/3714716573 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2df40664a0 msgr2=0x7f2df4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.811+0000 7f2e174ea640 1 --2- 172.21.15.19:0/3714716573 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2df40664a0 0x7f2df4068960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0ab000 tx=0x7f2e0c0b0040 comp rx=0 tx=0).stop 2023-11-20T06:41:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.811+0000 7f2e174ea640 1 -- 172.21.15.19:0/3714716573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e100c8f50 msgr2=0x7f2e101f5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.811+0000 7f2e174ea640 1 --2- 172.21.15.19:0/3714716573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e100c8f50 0x7f2e101f5a90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2e00007820 tx=0x7f2e0000e910 comp rx=0 tx=0).stop 2023-11-20T06:41:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.811+0000 7f2e174ea640 1 -- 172.21.15.19:0/3714716573 shutdown_connections 2023-11-20T06:41:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.811+0000 7f2e174ea640 1 --2- 172.21.15.19:0/3714716573 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2df40664a0 0x7f2df4068960 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.811+0000 7f2e174ea640 1 --2- 172.21.15.19:0/3714716573 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e101522d0 0x7f2e10157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.811+0000 7f2e174ea640 1 --2- 172.21.15.19:0/3714716573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e100c8f50 0x7f2e101f5a90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.811+0000 7f2e174ea640 1 --2- 172.21.15.19:0/3714716573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2dfc003980 0x7f2e100c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.811+0000 7f2e174ea640 1 -- 172.21.15.19:0/3714716573 >> 172.21.15.19:0/3714716573 conn(0x7f2e100719c0 msgr2=0x7f2e100b78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.811+0000 7f2e174ea640 1 -- 172.21.15.19:0/3714716573 shutdown_connections 2023-11-20T06:41:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.811+0000 7f2e174ea640 1 -- 172.21.15.19:0/3714716573 wait complete. 2023-11-20T06:41:47.836 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T06:41:47.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.975+0000 7f6962091640 1 Processor -- start 2023-11-20T06:41:47.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.975+0000 7f6962091640 1 -- start start 2023-11-20T06:41:47.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.975+0000 7f6962091640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f695c15cba0 0x7f695c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:47.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.975+0000 7f6962091640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f695c0d0210 0x7f695c0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:47.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.975+0000 7f6962091640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695c0d1670 con 0x7f695c0b84e0 2023-11-20T06:41:47.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.975+0000 7f6962091640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695c0d1460 con 0x7f695c0d0210 2023-11-20T06:41:47.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.975+0000 7f6962091640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695c0d1950 con 0x7f695c15cba0 2023-11-20T06:41:47.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.979+0000 7f695bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f695c0d0210 0x7f695c0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:47.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.979+0000 7f695affd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f695c0b84e0 0x7f695c0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40802/0 (socket says 172.21.15.19:40802) 2023-11-20T06:41:47.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.979+0000 7f695affd640 1 -- 172.21.15.19:0/692977205 learned_addr learned my addr 172.21.15.19:0/692977205 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:47.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.979+0000 7f695b7fe640 1 --2- 172.21.15.19:0/692977205 >> v2:172.21.15.190:3300/0 conn(0x7f695c15cba0 0x7f695c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:47.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.979+0000 7f695bfff640 1 -- 172.21.15.19:0/692977205 >> v2:172.21.15.190:3300/0 conn(0x7f695c15cba0 msgr2=0x7f695c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:47.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.979+0000 7f695bfff640 1 --2- 172.21.15.19:0/692977205 >> v2:172.21.15.190:3300/0 conn(0x7f695c15cba0 0x7f695c0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.979+0000 7f695bfff640 1 -- 172.21.15.19:0/692977205 >> v1:172.21.15.19:6789/0 conn(0x7f695c0b84e0 legacy=0x7f695c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:47.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.979+0000 7f695bfff640 1 -- 172.21.15.19:0/692977205 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c0d1c30 con 0x7f695c0d0210 2023-11-20T06:41:47.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.979+0000 7f695a7fc640 1 -- 172.21.15.19:0/692977205 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442545789 0 0) 0x7f695c0d1670 con 0x7f695c0b84e0 2023-11-20T06:41:47.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.979+0000 7f695bfff640 1 --2- 172.21.15.19:0/692977205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f695c0d0210 0x7f695c0b5cf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f695c0b4890 tx=0x7f695401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62af15d39ec9371b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:47.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.979+0000 7f695a7fc640 1 -- 172.21.15.19:0/692977205 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69540a5940 con 0x7f695c0d0210 2023-11-20T06:41:47.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.979+0000 7f695a7fc640 1 -- 172.21.15.19:0/692977205 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69540a5aa0 con 0x7f695c0d0210 2023-11-20T06:41:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.979+0000 7f695a7fc640 1 -- 172.21.15.19:0/692977205 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69540a5e30 con 0x7f695c0d0210 2023-11-20T06:41:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f6962091640 1 -- 172.21.15.19:0/692977205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f695c0d0210 msgr2=0x7f695c0b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f6962091640 1 --2- 172.21.15.19:0/692977205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f695c0d0210 0x7f695c0b5cf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f695c0b4890 tx=0x7f695401c880 comp rx=0 tx=0).stop 2023-11-20T06:41:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f6962091640 1 -- 172.21.15.19:0/692977205 shutdown_connections 2023-11-20T06:41:47.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f6962091640 1 --2- 172.21.15.19:0/692977205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f695c0d0210 0x7f695c0b5cf0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f6962091640 1 --2- 172.21.15.19:0/692977205 >> v2:172.21.15.190:3300/0 conn(0x7f695c15cba0 0x7f695c0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f6962091640 1 -- 172.21.15.19:0/692977205 >> 172.21.15.19:0/692977205 conn(0x7f695c0719c0 msgr2=0x7f695c071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:47.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f6962091640 1 -- 172.21.15.19:0/692977205 shutdown_connections 2023-11-20T06:41:47.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f6962091640 1 -- 172.21.15.19:0/692977205 wait complete. 2023-11-20T06:41:47.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f6962091640 1 Processor -- start 2023-11-20T06:41:47.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f6962091640 1 -- start start 2023-11-20T06:41:47.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f6962091640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f695c0b84e0 0x7f695c14b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:47.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f6962091640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f695c0d0210 0x7f695c152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:47.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f6962091640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f695c15cba0 0x7f695c152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:47.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f6962091640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c14d100 con 0x7f695c0b84e0 2023-11-20T06:41:47.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f6962091640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c0c7620 con 0x7f695c0d0210 2023-11-20T06:41:47.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f6962091640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c14c2d0 con 0x7f695c15cba0 2023-11-20T06:41:47.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f695b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f695c0b84e0 0x7f695c14b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:47.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f695b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f695c0b84e0 0x7f695c14b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48716/0 (socket says 172.21.15.19:48716) 2023-11-20T06:41:47.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f695b7fe640 1 -- 172.21.15.19:0/931192453 learned_addr learned my addr 172.21.15.19:0/931192453 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:47.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f695affd640 1 --2- 172.21.15.19:0/931192453 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f695c0d0210 0x7f695c152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:47.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f695bfff640 1 --2- 172.21.15.19:0/931192453 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f695c15cba0 0x7f695c152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:47.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f695b7fe640 1 -- 172.21.15.19:0/931192453 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f695c15cba0 msgr2=0x7f695c152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:47.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f695b7fe640 1 --2- 172.21.15.19:0/931192453 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f695c15cba0 0x7f695c152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f695b7fe640 1 -- 172.21.15.19:0/931192453 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f695c0d0210 msgr2=0x7f695c152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:47.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f695b7fe640 1 --2- 172.21.15.19:0/931192453 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f695c0d0210 0x7f695c152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:47.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f695b7fe640 1 -- 172.21.15.19:0/931192453 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6954009a70 con 0x7f695c0b84e0 2023-11-20T06:41:47.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.983+0000 7f695affd640 1 --2- 172.21.15.19:0/931192453 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f695c0d0210 0x7f695c152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:47.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.987+0000 7f695b7fe640 1 --2- 172.21.15.19:0/931192453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f695c0b84e0 0x7f695c14b060 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f694c00e870 tx=0x7f694c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:47.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.987+0000 7f6943fff640 1 -- 172.21.15.19:0/931192453 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c009510 con 0x7f695c0b84e0 2023-11-20T06:41:47.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.987+0000 7f6943fff640 1 -- 172.21.15.19:0/931192453 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c00eec0 con 0x7f695c0b84e0 2023-11-20T06:41:47.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.987+0000 7f6943fff640 1 -- 172.21.15.19:0/931192453 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c00cb40 con 0x7f695c0b84e0 2023-11-20T06:41:47.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.987+0000 7f6962091640 1 -- 172.21.15.19:0/931192453 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695c14c580 con 0x7f695c0b84e0 2023-11-20T06:41:47.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.987+0000 7f6962091640 1 -- 172.21.15.19:0/931192453 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695c14cb40 con 0x7f695c0b84e0 2023-11-20T06:41:47.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.987+0000 7f6962091640 1 -- 172.21.15.19:0/931192453 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695c04e170 con 0x7f695c0b84e0 2023-11-20T06:41:47.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.987+0000 7f6943fff640 1 -- 172.21.15.19:0/931192453 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f694c00cca0 con 0x7f695c0b84e0 2023-11-20T06:41:47.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.987+0000 7f6943fff640 1 --2- 172.21.15.19:0/931192453 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f69480664d0 0x7f6948068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:47.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.987+0000 7f6943fff640 1 -- 172.21.15.19:0/931192453 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f694c0842e0 con 0x7f695c0b84e0 2023-11-20T06:41:47.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.987+0000 7f695affd640 1 --2- 172.21.15.19:0/931192453 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f69480664d0 0x7f6948068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:47.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.991+0000 7f695affd640 1 --2- 172.21.15.19:0/931192453 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f69480664d0 0x7f6948068990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6950007fd0 tx=0x7f6950007c20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:47.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:47.991+0000 7f6943fff640 1 -- 172.21.15.19:0/931192453 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f694c0513d0 con 0x7f695c0b84e0 2023-11-20T06:41:48.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.151+0000 7f6962091640 1 -- 172.21.15.19:0/931192453 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f695c0d34a0 con 0x7f695c0b84e0 2023-11-20T06:41:48.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.151+0000 7f6943fff640 1 -- 172.21.15.19:0/931192453 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f694c0549f0 con 0x7f695c0b84e0 2023-11-20T06:41:48.157 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:41:48.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.155+0000 7f6962091640 1 -- 172.21.15.19:0/931192453 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f69480664d0 msgr2=0x7f6948068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:48.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.155+0000 7f6962091640 1 --2- 172.21.15.19:0/931192453 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f69480664d0 0x7f6948068990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6950007fd0 tx=0x7f6950007c20 comp rx=0 tx=0).stop 2023-11-20T06:41:48.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.155+0000 7f6962091640 1 -- 172.21.15.19:0/931192453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f695c0b84e0 msgr2=0x7f695c14b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:48.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.155+0000 7f6962091640 1 --2- 172.21.15.19:0/931192453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f695c0b84e0 0x7f695c14b060 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f694c00e870 tx=0x7f694c00ec70 comp rx=0 tx=0).stop 2023-11-20T06:41:48.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.155+0000 7f6962091640 1 -- 172.21.15.19:0/931192453 shutdown_connections 2023-11-20T06:41:48.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.155+0000 7f6962091640 1 --2- 172.21.15.19:0/931192453 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f69480664d0 0x7f6948068990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.155+0000 7f6962091640 1 --2- 172.21.15.19:0/931192453 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f695c15cba0 0x7f695c152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.155+0000 7f6962091640 1 --2- 172.21.15.19:0/931192453 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f695c0d0210 0x7f695c152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.155+0000 7f6962091640 1 --2- 172.21.15.19:0/931192453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f695c0b84e0 0x7f695c14b060 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.155+0000 7f6962091640 1 -- 172.21.15.19:0/931192453 >> 172.21.15.19:0/931192453 conn(0x7f695c0719c0 msgr2=0x7f695c153c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:48.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.155+0000 7f6962091640 1 -- 172.21.15.19:0/931192453 shutdown_connections 2023-11-20T06:41:48.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.155+0000 7f6962091640 1 -- 172.21.15.19:0/931192453 wait complete. 2023-11-20T06:41:48.179 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T06:41:48.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.319+0000 7ff0e526b640 1 Processor -- start 2023-11-20T06:41:48.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.319+0000 7ff0e526b640 1 -- start start 2023-11-20T06:41:48.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.319+0000 7ff0e526b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0e015cba0 0x7ff0e00d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:48.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.319+0000 7ff0e526b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff0e00b84e0 0x7ff0e00cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:48.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.319+0000 7ff0e526b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e00d1670 con 0x7ff0e00d0040 2023-11-20T06:41:48.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.319+0000 7ff0e526b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e00d1460 con 0x7ff0e00b84e0 2023-11-20T06:41:48.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.319+0000 7ff0e526b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00d04b0 con 0x7ff0e015cba0 2023-11-20T06:41:48.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.319+0000 7ff0deffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0e015cba0 0x7ff0e00d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:48.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.323+0000 7ff0df7fe640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7ff0e00d0040 0x7ff0e00d2ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:53410/0 (socket says 172.21.15.19:53410) 2023-11-20T06:41:48.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.323+0000 7ff0df7fe640 1 -- 172.21.15.19:0/795766678 learned_addr learned my addr 172.21.15.19:0/795766678 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:48.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.323+0000 7ff0d7fff640 1 --2- 172.21.15.19:0/795766678 >> v2:172.21.15.190:3300/0 conn(0x7ff0e00b84e0 0x7ff0e00cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:48.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.323+0000 7ff0de7fc640 1 -- 172.21.15.19:0/795766678 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016832297 0 0) 0x7ff0e00d1670 con 0x7ff0e00d0040 2023-11-20T06:41:48.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.323+0000 7ff0de7fc640 1 -- 172.21.15.19:0/795766678 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0cc003530 con 0x7ff0e00d0040 2023-11-20T06:41:48.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.323+0000 7ff0deffd640 1 -- 172.21.15.19:0/795766678 >> v2:172.21.15.190:3300/0 conn(0x7ff0e00b84e0 msgr2=0x7ff0e00cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:48.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.323+0000 7ff0deffd640 1 --2- 172.21.15.19:0/795766678 >> v2:172.21.15.190:3300/0 conn(0x7ff0e00b84e0 0x7ff0e00cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.323+0000 7ff0deffd640 1 -- 172.21.15.19:0/795766678 >> v1:172.21.15.190:6789/0 conn(0x7ff0e00d0040 legacy=0x7ff0e00d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:48.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.323+0000 7ff0deffd640 1 -- 172.21.15.19:0/795766678 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e00d1950 con 0x7ff0e015cba0 2023-11-20T06:41:48.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.323+0000 7ff0d7fff640 1 --2- 172.21.15.19:0/795766678 >> v2:172.21.15.190:3300/0 conn(0x7ff0e00b84e0 0x7ff0e00cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:41:48.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.323+0000 7ff0deffd640 1 --2- 172.21.15.19:0/795766678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0e015cba0 0x7ff0e00d0f20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00097c0 tx=0x7ff0d001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec0ac0b3bbbb52a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:48.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.323+0000 7ff0de7fc640 1 -- 172.21.15.19:0/795766678 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00ac600 con 0x7ff0e015cba0 2023-11-20T06:41:48.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.323+0000 7ff0de7fc640 1 -- 172.21.15.19:0/795766678 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d00a8050 con 0x7ff0e015cba0 2023-11-20T06:41:48.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.323+0000 7ff0de7fc640 1 -- 172.21.15.19:0/795766678 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00ac980 con 0x7ff0e015cba0 2023-11-20T06:41:48.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0e526b640 1 -- 172.21.15.19:0/795766678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0e015cba0 msgr2=0x7ff0e00d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:48.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0e526b640 1 --2- 172.21.15.19:0/795766678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0e015cba0 0x7ff0e00d0f20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00097c0 tx=0x7ff0d001c480 comp rx=0 tx=0).stop 2023-11-20T06:41:48.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0e526b640 1 -- 172.21.15.19:0/795766678 shutdown_connections 2023-11-20T06:41:48.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0e526b640 1 --2- 172.21.15.19:0/795766678 >> v2:172.21.15.190:3300/0 conn(0x7ff0e00b84e0 0x7ff0e00cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0e526b640 1 --2- 172.21.15.19:0/795766678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0e015cba0 0x7ff0e00d0f20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0e526b640 1 -- 172.21.15.19:0/795766678 >> 172.21.15.19:0/795766678 conn(0x7ff0e00719c0 msgr2=0x7ff0e0071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:48.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0e526b640 1 -- 172.21.15.19:0/795766678 shutdown_connections 2023-11-20T06:41:48.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0e526b640 1 -- 172.21.15.19:0/795766678 wait complete. 2023-11-20T06:41:48.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0e526b640 1 Processor -- start 2023-11-20T06:41:48.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0e526b640 1 -- start start 2023-11-20T06:41:48.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0e526b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0e00b84e0 0x7ff0e00b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:48.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0e526b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e00d0040 0x7ff0e014f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:48.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0e526b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0e015cba0 0x7ff0e014fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:48.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0e526b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e01505a0 con 0x7ff0e00b84e0 2023-11-20T06:41:48.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0e526b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0150110 con 0x7ff0e00d0040 2023-11-20T06:41:48.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0e526b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e01527b0 con 0x7ff0e015cba0 2023-11-20T06:41:48.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0deffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0e00b84e0 0x7ff0e00b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:48.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0deffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0e00b84e0 0x7ff0e00b5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48730/0 (socket says 172.21.15.19:48730) 2023-11-20T06:41:48.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0deffd640 1 -- 172.21.15.19:0/3459704861 learned_addr learned my addr 172.21.15.19:0/3459704861 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:48.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0d7fff640 1 --2- 172.21.15.19:0/3459704861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e00d0040 0x7ff0e014f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:48.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.327+0000 7ff0df7fe640 1 --2- 172.21.15.19:0/3459704861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0e015cba0 0x7ff0e014fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:48.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.331+0000 7ff0deffd640 1 -- 172.21.15.19:0/3459704861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0e015cba0 msgr2=0x7ff0e014fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:48.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.331+0000 7ff0deffd640 1 --2- 172.21.15.19:0/3459704861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0e015cba0 0x7ff0e014fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.331+0000 7ff0deffd640 1 -- 172.21.15.19:0/3459704861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e00d0040 msgr2=0x7ff0e014f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.331+0000 7ff0deffd640 1 --2- 172.21.15.19:0/3459704861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e00d0040 0x7ff0e014f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.331+0000 7ff0deffd640 1 -- 172.21.15.19:0/3459704861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c8009420 con 0x7ff0e00b84e0 2023-11-20T06:41:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.331+0000 7ff0deffd640 1 --2- 172.21.15.19:0/3459704861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0e00b84e0 0x7ff0e00b5f10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff0d001a0b0 tx=0x7ff0d0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.331+0000 7ff0d77fe640 1 -- 172.21.15.19:0/3459704861 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00b6470 con 0x7ff0e00b84e0 2023-11-20T06:41:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.331+0000 7ff0d77fe640 1 -- 172.21.15.19:0/3459704861 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d00b65f0 con 0x7ff0e00b84e0 2023-11-20T06:41:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.331+0000 7ff0d77fe640 1 -- 172.21.15.19:0/3459704861 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00b69a0 con 0x7ff0e00b84e0 2023-11-20T06:41:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.331+0000 7ff0e526b640 1 -- 172.21.15.19:0/3459704861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d0009420 con 0x7ff0e00b84e0 2023-11-20T06:41:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.331+0000 7ff0e526b640 1 -- 172.21.15.19:0/3459704861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e014e8d0 con 0x7ff0e00b84e0 2023-11-20T06:41:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.331+0000 7ff0e526b640 1 -- 172.21.15.19:0/3459704861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e004e170 con 0x7ff0e00b84e0 2023-11-20T06:41:48.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.331+0000 7ff0d77fe640 1 -- 172.21.15.19:0/3459704861 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff0d00b3040 con 0x7ff0e00b84e0 2023-11-20T06:41:48.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.331+0000 7ff0d77fe640 1 --2- 172.21.15.19:0/3459704861 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff0c00664a0 0x7ff0c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:48.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.331+0000 7ff0d77fe640 1 -- 172.21.15.19:0/3459704861 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff0d011e2c0 con 0x7ff0e00b84e0 2023-11-20T06:41:48.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.335+0000 7ff0d7fff640 1 --2- 172.21.15.19:0/3459704861 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff0c00664a0 0x7ff0c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:48.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.335+0000 7ff0d7fff640 1 --2- 172.21.15.19:0/3459704861 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff0c00664a0 0x7ff0c0068960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0160720 tx=0x7ff0c8009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:48.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.335+0000 7ff0d77fe640 1 -- 172.21.15.19:0/3459704861 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff0d00eb4f0 con 0x7ff0e00b84e0 2023-11-20T06:41:48.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.495+0000 7ff0e526b640 1 -- 172.21.15.19:0/3459704861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff0e00cfe20 con 0x7ff0e00b84e0 2023-11-20T06:41:48.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.495+0000 7ff0d77fe640 1 -- 172.21.15.19:0/3459704861 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff0d00eeb10 con 0x7ff0e00b84e0 2023-11-20T06:41:48.500 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-20T06:41:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.495+0000 7ff0e526b640 1 -- 172.21.15.19:0/3459704861 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff0c00664a0 msgr2=0x7ff0c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.495+0000 7ff0e526b640 1 --2- 172.21.15.19:0/3459704861 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff0c00664a0 0x7ff0c0068960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0160720 tx=0x7ff0c8009190 comp rx=0 tx=0).stop 2023-11-20T06:41:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.495+0000 7ff0e526b640 1 -- 172.21.15.19:0/3459704861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0e00b84e0 msgr2=0x7ff0e00b5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.495+0000 7ff0e526b640 1 --2- 172.21.15.19:0/3459704861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0e00b84e0 0x7ff0e00b5f10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff0d001a0b0 tx=0x7ff0d0019220 comp rx=0 tx=0).stop 2023-11-20T06:41:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.495+0000 7ff0e526b640 1 -- 172.21.15.19:0/3459704861 shutdown_connections 2023-11-20T06:41:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.495+0000 7ff0e526b640 1 --2- 172.21.15.19:0/3459704861 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff0c00664a0 0x7ff0c0068960 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.495+0000 7ff0e526b640 1 --2- 172.21.15.19:0/3459704861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0e015cba0 0x7ff0e014fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.495+0000 7ff0e526b640 1 --2- 172.21.15.19:0/3459704861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e00d0040 0x7ff0e014f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.495+0000 7ff0e526b640 1 --2- 172.21.15.19:0/3459704861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0e00b84e0 0x7ff0e00b5f10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.495+0000 7ff0e526b640 1 -- 172.21.15.19:0/3459704861 >> 172.21.15.19:0/3459704861 conn(0x7ff0e00719c0 msgr2=0x7ff0e015b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.495+0000 7ff0e526b640 1 -- 172.21.15.19:0/3459704861 shutdown_connections 2023-11-20T06:41:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.495+0000 7ff0e526b640 1 -- 172.21.15.19:0/3459704861 wait complete. 2023-11-20T06:41:48.521 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T06:41:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.659+0000 7f229af63640 1 Processor -- start 2023-11-20T06:41:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.659+0000 7f229af63640 1 -- start start 2023-11-20T06:41:48.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f229af63640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f229415cdc0 0x7f22940cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:48.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f229af63640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22940d0880 con 0x7f22940b3cb0 2023-11-20T06:41:48.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f229af63640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22940b1c00 con 0x7f22940cf210 2023-11-20T06:41:48.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f229af63640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22940b1ee0 con 0x7f229415cdc0 2023-11-20T06:41:48.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f229a762640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f22940b3cb0 0x7f22940cda00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40814/0 (socket says 172.21.15.19:40814) 2023-11-20T06:41:48.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f229a762640 1 -- 172.21.15.19:0/571745197 learned_addr learned my addr 172.21.15.19:0/571745197 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2299760640 1 --2- 172.21.15.19:0/571745197 >> v2:172.21.15.190:3300/0 conn(0x7f229415cdc0 0x7f22940cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2298f5f640 1 -- 172.21.15.19:0/571745197 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704871275 0 0) 0x7f22940d0880 con 0x7f22940b3cb0 2023-11-20T06:41:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2298f5f640 1 -- 172.21.15.19:0/571745197 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2280003530 con 0x7f22940b3cb0 2023-11-20T06:41:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2298f5f640 1 -- 172.21.15.19:0/571745197 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 951677099 0 0) 0x7f22940b1c00 con 0x7f22940cf210 2023-11-20T06:41:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2298f5f640 1 -- 172.21.15.19:0/571745197 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22940d0880 con 0x7f22940cf210 2023-11-20T06:41:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2298f5f640 1 -- 172.21.15.19:0/571745197 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2305285801 0 0) 0x7f2280003530 con 0x7f22940b3cb0 2023-11-20T06:41:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2298f5f640 1 -- 172.21.15.19:0/571745197 >> v2:172.21.15.190:3300/0 conn(0x7f229415cdc0 msgr2=0x7f22940cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2298f5f640 1 --2- 172.21.15.19:0/571745197 >> v2:172.21.15.190:3300/0 conn(0x7f229415cdc0 0x7f22940cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2298f5f640 1 -- 172.21.15.19:0/571745197 >> v1:172.21.15.190:6789/0 conn(0x7f22940cf210 legacy=0x7f22940cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2298f5f640 1 -- 172.21.15.19:0/571745197 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22940b21c0 con 0x7f22940b3cb0 2023-11-20T06:41:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2298f5f640 1 -- 172.21.15.19:0/571745197 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7f228c001a00 con 0x7f22940b3cb0 2023-11-20T06:41:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2298f5f640 1 -- 172.21.15.19:0/571745197 >> v1:172.21.15.19:6789/0 conn(0x7f22940b3cb0 legacy=0x7f22940cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2298f5f640 1 --2- 172.21.15.19:0/571745197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2280003b10 0x7f2280003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2298f5f640 1 --2- 172.21.15.19:0/571745197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22800047d0 0x7f2280004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2298f5f640 1 --2- 172.21.15.19:0/571745197 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2280005190 0x7f228000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2298f5f640 1 -- 172.21.15.19:0/571745197 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22940b1ee0 con 0x7f22800047d0 2023-11-20T06:41:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2298f5f640 1 -- 172.21.15.19:0/571745197 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228000c010 con 0x7f2280003b10 2023-11-20T06:41:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2298f5f640 1 -- 172.21.15.19:0/571745197 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228000c1d0 con 0x7f2280005190 2023-11-20T06:41:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2299760640 1 --2- 172.21.15.19:0/571745197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22800047d0 0x7f2280004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2299f61640 1 --2- 172.21.15.19:0/571745197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2280003b10 0x7f2280003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f229a762640 1 --2- 172.21.15.19:0/571745197 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2280005190 0x7f228000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2299760640 1 -- 172.21.15.19:0/571745197 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2280005190 msgr2=0x7f228000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2299760640 1 --2- 172.21.15.19:0/571745197 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2280005190 0x7f228000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2299760640 1 -- 172.21.15.19:0/571745197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2280003b10 msgr2=0x7f2280003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2299760640 1 --2- 172.21.15.19:0/571745197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2280003b10 0x7f2280003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2299760640 1 -- 172.21.15.19:0/571745197 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2280003530 con 0x7f22800047d0 2023-11-20T06:41:48.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f2299f61640 1 --2- 172.21.15.19:0/571745197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2280003b10 0x7f2280003f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:48.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.663+0000 7f229a762640 1 -- 172.21.15.19:0/571745197 reap_dead start 2023-11-20T06:41:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.667+0000 7f2299760640 1 --2- 172.21.15.19:0/571745197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22800047d0 0x7f2280004c50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2284009ae0 tx=0x7f228401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a672d55ee078030 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.667+0000 7f2298f5f640 1 -- 172.21.15.19:0/571745197 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22840a5660 con 0x7f22800047d0 2023-11-20T06:41:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.667+0000 7f2298f5f640 1 -- 172.21.15.19:0/571745197 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22840a57c0 con 0x7f22800047d0 2023-11-20T06:41:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.667+0000 7f2298f5f640 1 -- 172.21.15.19:0/571745197 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22840a5b70 con 0x7f22800047d0 2023-11-20T06:41:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.667+0000 7f229af63640 1 -- 172.21.15.19:0/571745197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22800047d0 msgr2=0x7f2280004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.667+0000 7f229af63640 1 --2- 172.21.15.19:0/571745197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22800047d0 0x7f2280004c50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2284009ae0 tx=0x7f228401ca70 comp rx=0 tx=0).stop 2023-11-20T06:41:48.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.667+0000 7f229af63640 1 -- 172.21.15.19:0/571745197 shutdown_connections 2023-11-20T06:41:48.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.667+0000 7f229af63640 1 --2- 172.21.15.19:0/571745197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22800047d0 0x7f2280004c50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.667+0000 7f229af63640 1 -- 172.21.15.19:0/571745197 >> 172.21.15.19:0/571745197 conn(0x7f22940d2800 msgr2=0x7f22940d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:48.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.667+0000 7f229af63640 1 -- 172.21.15.19:0/571745197 shutdown_connections 2023-11-20T06:41:48.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.667+0000 7f229af63640 1 -- 172.21.15.19:0/571745197 wait complete. 2023-11-20T06:41:48.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f229af63640 1 Processor -- start 2023-11-20T06:41:48.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f229af63640 1 -- start start 2023-11-20T06:41:48.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f229af63640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22800047d0 0x7f229414eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:48.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f229af63640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22940ca450 0x7f22940b6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:48.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f229af63640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22940b69b0 0x7f22940b0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:48.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f229af63640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229415d1a0 con 0x7f22940b69b0 2023-11-20T06:41:48.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f229af63640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22940b6f30 con 0x7f22800047d0 2023-11-20T06:41:48.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f229af63640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22940b7210 con 0x7f22940ca450 2023-11-20T06:41:48.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f229a762640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22940b69b0 0x7f22940b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:48.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f2299f61640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22800047d0 0x7f229414eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:48.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f229a762640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22940b69b0 0x7f22940b0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48756/0 (socket says 172.21.15.19:48756) 2023-11-20T06:41:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f229a762640 1 -- 172.21.15.19:0/2178882295 learned_addr learned my addr 172.21.15.19:0/2178882295 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f2299760640 1 --2- 172.21.15.19:0/2178882295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22940ca450 0x7f22940b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f229a762640 1 -- 172.21.15.19:0/2178882295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22940ca450 msgr2=0x7f22940b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f229a762640 1 --2- 172.21.15.19:0/2178882295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22940ca450 0x7f22940b6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f229a762640 1 -- 172.21.15.19:0/2178882295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22800047d0 msgr2=0x7f229414eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f229a762640 1 --2- 172.21.15.19:0/2178882295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22800047d0 0x7f229414eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f229a762640 1 -- 172.21.15.19:0/2178882295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229415d3f0 con 0x7f22940b69b0 2023-11-20T06:41:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f229a762640 1 --2- 172.21.15.19:0/2178882295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22940b69b0 0x7f22940b0080 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2280004750 tx=0x7f228c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f228a7fc640 1 -- 172.21.15.19:0/2178882295 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c001960 con 0x7f22940b69b0 2023-11-20T06:41:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f228a7fc640 1 -- 172.21.15.19:0/2178882295 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c00edc0 con 0x7f22940b69b0 2023-11-20T06:41:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f228a7fc640 1 -- 172.21.15.19:0/2178882295 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c013660 con 0x7f22940b69b0 2023-11-20T06:41:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f229af63640 1 -- 172.21.15.19:0/2178882295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f229415d6d0 con 0x7f22940b69b0 2023-11-20T06:41:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f229af63640 1 -- 172.21.15.19:0/2178882295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f229414f040 con 0x7f22940b69b0 2023-11-20T06:41:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.671+0000 7f229af63640 1 -- 172.21.15.19:0/2178882295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f229415d8c0 con 0x7f22940b69b0 2023-11-20T06:41:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.675+0000 7f228a7fc640 1 -- 172.21.15.19:0/2178882295 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f228c0137c0 con 0x7f22940b69b0 2023-11-20T06:41:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.675+0000 7f228a7fc640 1 --2- 172.21.15.19:0/2178882295 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f22780664d0 0x7f2278068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.675+0000 7f228a7fc640 1 -- 172.21.15.19:0/2178882295 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f228c084480 con 0x7f22940b69b0 2023-11-20T06:41:48.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.675+0000 7f2299f61640 1 --2- 172.21.15.19:0/2178882295 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f22780664d0 0x7f2278068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:48.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.675+0000 7f2299f61640 1 --2- 172.21.15.19:0/2178882295 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f22780664d0 0x7f2278068990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2290005680 tx=0x7f2290000f80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:48.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.679+0000 7f228a7fc640 1 -- 172.21.15.19:0/2178882295 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f228c051770 con 0x7f22940b69b0 2023-11-20T06:41:48.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.835+0000 7f229af63640 1 -- 172.21.15.19:0/2178882295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f229404e9c0 con 0x7f22940b69b0 2023-11-20T06:41:48.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.835+0000 7f228a7fc640 1 -- 172.21.15.19:0/2178882295 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f228c054d90 con 0x7f22940b69b0 2023-11-20T06:41:48.841 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:41:48.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.839+0000 7f229af63640 1 -- 172.21.15.19:0/2178882295 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f22780664d0 msgr2=0x7f2278068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:48.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.839+0000 7f229af63640 1 --2- 172.21.15.19:0/2178882295 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f22780664d0 0x7f2278068990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2290005680 tx=0x7f2290000f80 comp rx=0 tx=0).stop 2023-11-20T06:41:48.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.839+0000 7f229af63640 1 -- 172.21.15.19:0/2178882295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22940b69b0 msgr2=0x7f22940b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:48.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.839+0000 7f229af63640 1 --2- 172.21.15.19:0/2178882295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22940b69b0 0x7f22940b0080 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2280004750 tx=0x7f228c00e530 comp rx=0 tx=0).stop 2023-11-20T06:41:48.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.839+0000 7f229af63640 1 -- 172.21.15.19:0/2178882295 shutdown_connections 2023-11-20T06:41:48.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.839+0000 7f229af63640 1 --2- 172.21.15.19:0/2178882295 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f22780664d0 0x7f2278068990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.839+0000 7f229af63640 1 --2- 172.21.15.19:0/2178882295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22940b69b0 0x7f22940b0080 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.839+0000 7f229af63640 1 --2- 172.21.15.19:0/2178882295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22940ca450 0x7f22940b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.839+0000 7f229af63640 1 --2- 172.21.15.19:0/2178882295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22800047d0 0x7f229414eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:48.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.839+0000 7f229af63640 1 -- 172.21.15.19:0/2178882295 >> 172.21.15.19:0/2178882295 conn(0x7f22940d2800 msgr2=0x7f22940cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:48.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.839+0000 7f229af63640 1 -- 172.21.15.19:0/2178882295 shutdown_connections 2023-11-20T06:41:48.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.839+0000 7f229af63640 1 -- 172.21.15.19:0/2178882295 wait complete. 2023-11-20T06:41:48.863 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T06:41:49.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.999+0000 7fac2873e640 1 Processor -- start 2023-11-20T06:41:49.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:48.999+0000 7fac2873e640 1 -- start start 2023-11-20T06:41:49.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.003+0000 7fac2873e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fac2015ca50 0x7fac2006c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:49.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.003+0000 7fac2873e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac2015ce30 0x7fac200cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:49.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.003+0000 7fac2873e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac200b21c0 0x7fac200b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:49.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.003+0000 7fac2873e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac200b2b50 con 0x7fac200b21c0 2023-11-20T06:41:49.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.003+0000 7fac2873e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac201607e0 con 0x7fac2015ca50 2023-11-20T06:41:49.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.003+0000 7fac2873e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac200cf060 con 0x7fac2015ce30 2023-11-20T06:41:49.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.003+0000 7fac26cdb640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac200b21c0 0x7fac200b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:49.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.003+0000 7fac26cdb640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac200b21c0 0x7fac200b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48760/0 (socket says 172.21.15.19:48760) 2023-11-20T06:41:49.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.003+0000 7fac26cdb640 1 -- 172.21.15.19:0/842073907 learned_addr learned my addr 172.21.15.19:0/842073907 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:49.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.003+0000 7fac264da640 1 --2- 172.21.15.19:0/842073907 >> v2:172.21.15.190:3300/0 conn(0x7fac2015ca50 0x7fac2006c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:49.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.003+0000 7fac25cd9640 1 --2- 172.21.15.19:0/842073907 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac2015ce30 0x7fac200cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:49.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.003+0000 7fac26cdb640 1 -- 172.21.15.19:0/842073907 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac2015ce30 msgr2=0x7fac200cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:49.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.003+0000 7fac26cdb640 1 --2- 172.21.15.19:0/842073907 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac2015ce30 0x7fac200cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.003+0000 7fac26cdb640 1 -- 172.21.15.19:0/842073907 >> v2:172.21.15.190:3300/0 conn(0x7fac2015ca50 msgr2=0x7fac2006c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:49.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.003+0000 7fac26cdb640 1 --2- 172.21.15.19:0/842073907 >> v2:172.21.15.190:3300/0 conn(0x7fac2015ca50 0x7fac2006c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.003+0000 7fac26cdb640 1 -- 172.21.15.19:0/842073907 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac20070210 con 0x7fac200b21c0 2023-11-20T06:41:49.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.003+0000 7fac25cd9640 1 --2- 172.21.15.19:0/842073907 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac2015ce30 0x7fac200cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:49.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.003+0000 7fac26cdb640 1 --2- 172.21.15.19:0/842073907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac200b21c0 0x7fac200b2610 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fac200726c0 tx=0x7fac1801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e953ebc6e3ecbdff server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:49.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.003+0000 7fac254d8640 1 -- 172.21.15.19:0/842073907 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac180a5820 con 0x7fac200b21c0 2023-11-20T06:41:49.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac254d8640 1 -- 172.21.15.19:0/842073907 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac180a5980 con 0x7fac200b21c0 2023-11-20T06:41:49.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac254d8640 1 -- 172.21.15.19:0/842073907 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac180a5d10 con 0x7fac200b21c0 2023-11-20T06:41:49.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac2873e640 1 -- 172.21.15.19:0/842073907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac200b21c0 msgr2=0x7fac200b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:49.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac2873e640 1 --2- 172.21.15.19:0/842073907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac200b21c0 0x7fac200b2610 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fac200726c0 tx=0x7fac1801c9a0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac2873e640 1 -- 172.21.15.19:0/842073907 shutdown_connections 2023-11-20T06:41:49.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac2873e640 1 --2- 172.21.15.19:0/842073907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac200b21c0 0x7fac200b2610 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac2873e640 1 --2- 172.21.15.19:0/842073907 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac2015ce30 0x7fac200cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac2873e640 1 --2- 172.21.15.19:0/842073907 >> v2:172.21.15.190:3300/0 conn(0x7fac2015ca50 0x7fac2006c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac2873e640 1 -- 172.21.15.19:0/842073907 >> 172.21.15.19:0/842073907 conn(0x7fac200cd1c0 msgr2=0x7fac200cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:49.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac2873e640 1 -- 172.21.15.19:0/842073907 shutdown_connections 2023-11-20T06:41:49.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac2873e640 1 -- 172.21.15.19:0/842073907 wait complete. 2023-11-20T06:41:49.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac2873e640 1 Processor -- start 2023-11-20T06:41:49.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac2873e640 1 -- start start 2023-11-20T06:41:49.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac2873e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac200b21c0 0x7fac200ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:49.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac2873e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac2015ca50 0x7fac200c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:49.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac2873e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac2015ce30 0x7fac2015c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:49.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac2873e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac200c6240 con 0x7fac2015ce30 2023-11-20T06:41:49.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac2873e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac200c6520 con 0x7fac2015ca50 2023-11-20T06:41:49.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac2873e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac200c6800 con 0x7fac200b21c0 2023-11-20T06:41:49.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac26cdb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac2015ce30 0x7fac2015c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:49.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac26cdb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac2015ce30 0x7fac2015c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48776/0 (socket says 172.21.15.19:48776) 2023-11-20T06:41:49.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac26cdb640 1 -- 172.21.15.19:0/3219307558 learned_addr learned my addr 172.21.15.19:0/3219307558 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:49.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac25cd9640 1 --2- 172.21.15.19:0/3219307558 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac2015ca50 0x7fac200c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:49.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.007+0000 7fac264da640 1 --2- 172.21.15.19:0/3219307558 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac200b21c0 0x7fac200ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:49.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.011+0000 7fac26cdb640 1 -- 172.21.15.19:0/3219307558 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac200b21c0 msgr2=0x7fac200ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:49.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.011+0000 7fac26cdb640 1 --2- 172.21.15.19:0/3219307558 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac200b21c0 0x7fac200ae630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.011+0000 7fac26cdb640 1 -- 172.21.15.19:0/3219307558 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac2015ca50 msgr2=0x7fac200c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:49.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.011+0000 7fac26cdb640 1 --2- 172.21.15.19:0/3219307558 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac2015ca50 0x7fac200c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.011+0000 7fac26cdb640 1 -- 172.21.15.19:0/3219307558 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac18009b30 con 0x7fac2015ce30 2023-11-20T06:41:49.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.011+0000 7fac25cd9640 1 --2- 172.21.15.19:0/3219307558 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac2015ca50 0x7fac200c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:49.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.011+0000 7fac264da640 1 --2- 172.21.15.19:0/3219307558 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac200b21c0 0x7fac200ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:49.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.011+0000 7fac26cdb640 1 --2- 172.21.15.19:0/3219307558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac2015ce30 0x7fac2015c020 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fac180af040 tx=0x7fac18019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:49.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.011+0000 7fac16ffd640 1 -- 172.21.15.19:0/3219307558 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac180b8670 con 0x7fac2015ce30 2023-11-20T06:41:49.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.011+0000 7fac16ffd640 1 -- 172.21.15.19:0/3219307558 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac180b87d0 con 0x7fac2015ce30 2023-11-20T06:41:49.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.011+0000 7fac2873e640 1 -- 172.21.15.19:0/3219307558 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac200c6ae0 con 0x7fac2015ce30 2023-11-20T06:41:49.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.011+0000 7fac16ffd640 1 -- 172.21.15.19:0/3219307558 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac180b8b80 con 0x7fac2015ce30 2023-11-20T06:41:49.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.011+0000 7fac2873e640 1 -- 172.21.15.19:0/3219307558 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac200c7480 con 0x7fac2015ce30 2023-11-20T06:41:49.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.011+0000 7fac2873e640 1 -- 172.21.15.19:0/3219307558 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac200c7000 con 0x7fac2015ce30 2023-11-20T06:41:49.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.011+0000 7fac16ffd640 1 -- 172.21.15.19:0/3219307558 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fac180b8ce0 con 0x7fac2015ce30 2023-11-20T06:41:49.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.011+0000 7fac16ffd640 1 --2- 172.21.15.19:0/3219307558 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fac040664a0 0x7fac04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:49.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.011+0000 7fac16ffd640 1 -- 172.21.15.19:0/3219307558 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fac1811f7b0 con 0x7fac2015ce30 2023-11-20T06:41:49.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.011+0000 7fac264da640 1 --2- 172.21.15.19:0/3219307558 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fac040664a0 0x7fac04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:49.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.015+0000 7fac264da640 1 --2- 172.21.15.19:0/3219307558 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fac040664a0 0x7fac04068960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00b9f0 tx=0x7fac1c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:49.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.015+0000 7fac16ffd640 1 -- 172.21.15.19:0/3219307558 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fac200c7000 con 0x7fac2015ce30 2023-11-20T06:41:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.211+0000 7fac2873e640 1 -- 172.21.15.19:0/3219307558 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac200c7000 con 0x7fac2015ce30 2023-11-20T06:41:49.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.211+0000 7fac16ffd640 1 -- 172.21.15.19:0/3219307558 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fac200c7000 con 0x7fac2015ce30 2023-11-20T06:41:49.216 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:49.216 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/212787745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":212787745},{"type":"v1","addr":"172.21.15.190:6836","nonce":212787745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1874314285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1874314285},{"type":"v1","addr":"172.21.15.190:6837","nonce":1874314285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3845638593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3845638593},{"type":"v1","addr":"172.21.15.19:6833","nonce":3845638593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T06:41:13.620144+0000","modified":"2023-11-20T06:41:37.768410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/1973335825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1973335825},{"type":"v1","addr":"172.21.15.19:6835","nonce":1973335825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-20T06:41:49.217 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 9 2023-11-20T06:41:49.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.211+0000 7fac2873e640 1 -- 172.21.15.19:0/3219307558 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fac040664a0 msgr2=0x7fac04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:49.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.211+0000 7fac2873e640 1 --2- 172.21.15.19:0/3219307558 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fac040664a0 0x7fac04068960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00b9f0 tx=0x7fac1c008040 comp rx=0 tx=0).stop 2023-11-20T06:41:49.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.211+0000 7fac2873e640 1 -- 172.21.15.19:0/3219307558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac2015ce30 msgr2=0x7fac2015c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:49.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.211+0000 7fac2873e640 1 --2- 172.21.15.19:0/3219307558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac2015ce30 0x7fac2015c020 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fac180af040 tx=0x7fac18019740 comp rx=0 tx=0).stop 2023-11-20T06:41:49.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.211+0000 7fac2873e640 1 -- 172.21.15.19:0/3219307558 shutdown_connections 2023-11-20T06:41:49.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.211+0000 7fac2873e640 1 --2- 172.21.15.19:0/3219307558 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fac040664a0 0x7fac04068960 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.211+0000 7fac2873e640 1 --2- 172.21.15.19:0/3219307558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac2015ce30 0x7fac2015c020 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.211+0000 7fac2873e640 1 --2- 172.21.15.19:0/3219307558 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac2015ca50 0x7fac200c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.211+0000 7fac2873e640 1 --2- 172.21.15.19:0/3219307558 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac200b21c0 0x7fac200ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.211+0000 7fac2873e640 1 -- 172.21.15.19:0/3219307558 >> 172.21.15.19:0/3219307558 conn(0x7fac200cd1c0 msgr2=0x7fac200b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:49.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.211+0000 7fac2873e640 1 -- 172.21.15.19:0/3219307558 shutdown_connections 2023-11-20T06:41:49.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.211+0000 7fac2873e640 1 -- 172.21.15.19:0/3219307558 wait complete. 2023-11-20T06:41:49.238 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:41:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.375+0000 7f3e5472a640 1 Processor -- start 2023-11-20T06:41:49.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.375+0000 7f3e5472a640 1 -- start start 2023-11-20T06:41:49.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.375+0000 7f3e5472a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3e4c070c40 0x7f3e4c15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.375+0000 7f3e5472a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3e4c0b4020 0x7f3e4c0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.375+0000 7f3e5472a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4c15be60 con 0x7f3e4c0b0620 2023-11-20T06:41:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.375+0000 7f3e5472a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c15b3b0 con 0x7f3e4c070c40 2023-11-20T06:41:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.375+0000 7f3e5472a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c15c1f0 con 0x7f3e4c0b4020 2023-11-20T06:41:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.375+0000 7f3e524c6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3e4c070c40 0x7f3e4c15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.375+0000 7f3e524c6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3e4c070c40 0x7f3e4c15ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48790/0 (socket says 172.21.15.19:48790) 2023-11-20T06:41:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.375+0000 7f3e524c6640 1 -- 172.21.15.19:0/978806306 learned_addr learned my addr 172.21.15.19:0/978806306 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.375+0000 7f3e51cc5640 1 --2- 172.21.15.19:0/978806306 >> v2:172.21.15.190:3300/0 conn(0x7f3e4c0b4020 0x7f3e4c0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.375+0000 7f3e524c6640 1 -- 172.21.15.19:0/978806306 >> v2:172.21.15.190:3300/0 conn(0x7f3e4c0b4020 msgr2=0x7f3e4c0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.375+0000 7f3e524c6640 1 --2- 172.21.15.19:0/978806306 >> v2:172.21.15.190:3300/0 conn(0x7f3e4c0b4020 0x7f3e4c0b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.375+0000 7f3e524c6640 1 -- 172.21.15.19:0/978806306 >> v1:172.21.15.19:6789/0 conn(0x7f3e4c0b0620 legacy=0x7f3e4c15c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.375+0000 7f3e524c6640 1 -- 172.21.15.19:0/978806306 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c0b0a30 con 0x7f3e4c070c40 2023-11-20T06:41:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.379+0000 7f3e524c6640 1 --2- 172.21.15.19:0/978806306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e4c070c40 0x7f3e4c15ae70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0cc1e0 tx=0x7f3e4801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2775c95aae407f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.379+0000 7f3e514c4640 1 -- 172.21.15.19:0/978806306 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e480ab670 con 0x7f3e4c070c40 2023-11-20T06:41:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.379+0000 7f3e514c4640 1 -- 172.21.15.19:0/978806306 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e480ab7d0 con 0x7f3e4c070c40 2023-11-20T06:41:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.379+0000 7f3e514c4640 1 -- 172.21.15.19:0/978806306 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e480abb60 con 0x7f3e4c070c40 2023-11-20T06:41:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.379+0000 7f3e5472a640 1 -- 172.21.15.19:0/978806306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e4c070c40 msgr2=0x7f3e4c15ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.379+0000 7f3e5472a640 1 --2- 172.21.15.19:0/978806306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e4c070c40 0x7f3e4c15ae70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0cc1e0 tx=0x7f3e4801c470 comp rx=0 tx=0).stop 2023-11-20T06:41:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.379+0000 7f3e5472a640 1 -- 172.21.15.19:0/978806306 shutdown_connections 2023-11-20T06:41:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.379+0000 7f3e5472a640 1 --2- 172.21.15.19:0/978806306 >> v2:172.21.15.190:3300/0 conn(0x7f3e4c0b4020 0x7f3e4c0b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.379+0000 7f3e5472a640 1 --2- 172.21.15.19:0/978806306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e4c070c40 0x7f3e4c15ae70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.379+0000 7f3e5472a640 1 -- 172.21.15.19:0/978806306 >> 172.21.15.19:0/978806306 conn(0x7f3e4c06c190 msgr2=0x7f3e4c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.379+0000 7f3e5472a640 1 -- 172.21.15.19:0/978806306 shutdown_connections 2023-11-20T06:41:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.379+0000 7f3e5472a640 1 -- 172.21.15.19:0/978806306 wait complete. 2023-11-20T06:41:49.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e5472a640 1 Processor -- start 2023-11-20T06:41:49.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e5472a640 1 -- start start 2023-11-20T06:41:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e5472a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e4c070c40 0x7f3e4c1535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e5472a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e4c0b0620 0x7f3e4c153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e5472a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e4c0b4020 0x7f3e4c0c3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e5472a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0c48a0 con 0x7f3e4c070c40 2023-11-20T06:41:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e5472a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0c24a0 con 0x7f3e4c0b0620 2023-11-20T06:41:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e5472a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0c3c90 con 0x7f3e4c0b4020 2023-11-20T06:41:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e524c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e4c070c40 0x7f3e4c1535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e524c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e4c070c40 0x7f3e4c1535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48800/0 (socket says 172.21.15.19:48800) 2023-11-20T06:41:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e524c6640 1 -- 172.21.15.19:0/3315061668 learned_addr learned my addr 172.21.15.19:0/3315061668 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e524c6640 1 -- 172.21.15.19:0/3315061668 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e4c0b4020 msgr2=0x7f3e4c0c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e524c6640 1 --2- 172.21.15.19:0/3315061668 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e4c0b4020 0x7f3e4c0c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e524c6640 1 -- 172.21.15.19:0/3315061668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e4c0b0620 msgr2=0x7f3e4c153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e524c6640 1 --2- 172.21.15.19:0/3315061668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e4c0b0620 0x7f3e4c153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e524c6640 1 -- 172.21.15.19:0/3315061668 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e480094d0 con 0x7f3e4c070c40 2023-11-20T06:41:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e524c6640 1 --2- 172.21.15.19:0/3315061668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e4c070c40 0x7f3e4c1535c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3e480ad040 tx=0x7f3e4801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e42ffd640 1 -- 172.21.15.19:0/3315061668 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e480b4800 con 0x7f3e4c070c40 2023-11-20T06:41:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e42ffd640 1 -- 172.21.15.19:0/3315061668 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e480b4960 con 0x7f3e4c070c40 2023-11-20T06:41:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e42ffd640 1 -- 172.21.15.19:0/3315061668 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e480b4cf0 con 0x7f3e4c070c40 2023-11-20T06:41:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e5472a640 1 -- 172.21.15.19:0/3315061668 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4c0c3f70 con 0x7f3e4c070c40 2023-11-20T06:41:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.383+0000 7f3e5472a640 1 -- 172.21.15.19:0/3315061668 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4c0c4530 con 0x7f3e4c070c40 2023-11-20T06:41:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.387+0000 7f3e5472a640 1 -- 172.21.15.19:0/3315061668 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4c071b50 con 0x7f3e4c070c40 2023-11-20T06:41:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.387+0000 7f3e42ffd640 1 -- 172.21.15.19:0/3315061668 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3e480b3380 con 0x7f3e4c070c40 2023-11-20T06:41:49.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.387+0000 7f3e42ffd640 1 --2- 172.21.15.19:0/3315061668 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f3e300664a0 0x7f3e30068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:49.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.387+0000 7f3e42ffd640 1 -- 172.21.15.19:0/3315061668 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3e4811e600 con 0x7f3e4c070c40 2023-11-20T06:41:49.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.387+0000 7f3e51cc5640 1 --2- 172.21.15.19:0/3315061668 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f3e300664a0 0x7f3e30068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:49.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.387+0000 7f3e51cc5640 1 --2- 172.21.15.19:0/3315061668 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f3e300664a0 0x7f3e30068960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0c17f0 tx=0x7f3e3c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:49.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.391+0000 7f3e42ffd640 1 -- 172.21.15.19:0/3315061668 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3e480eb8c0 con 0x7f3e4c070c40 2023-11-20T06:41:49.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.551+0000 7f3e5472a640 1 -- 172.21.15.19:0/3315061668 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e4c074010 con 0x7f3e4c070c40 2023-11-20T06:41:49.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.551+0000 7f3e42ffd640 1 -- 172.21.15.19:0/3315061668 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f3e480eeee0 con 0x7f3e4c070c40 2023-11-20T06:41:49.558 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:49.558 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":25,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:20.306335+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:41:49.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.555+0000 7f3e5472a640 1 -- 172.21.15.19:0/3315061668 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f3e300664a0 msgr2=0x7f3e30068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:49.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.555+0000 7f3e5472a640 1 --2- 172.21.15.19:0/3315061668 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f3e300664a0 0x7f3e30068960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0c17f0 tx=0x7f3e3c008040 comp rx=0 tx=0).stop 2023-11-20T06:41:49.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.555+0000 7f3e5472a640 1 -- 172.21.15.19:0/3315061668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e4c070c40 msgr2=0x7f3e4c1535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:49.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.555+0000 7f3e5472a640 1 --2- 172.21.15.19:0/3315061668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e4c070c40 0x7f3e4c1535c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3e480ad040 tx=0x7f3e4801acb0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.555+0000 7f3e5472a640 1 -- 172.21.15.19:0/3315061668 shutdown_connections 2023-11-20T06:41:49.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.555+0000 7f3e5472a640 1 --2- 172.21.15.19:0/3315061668 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f3e300664a0 0x7f3e30068960 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.555+0000 7f3e5472a640 1 --2- 172.21.15.19:0/3315061668 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e4c0b4020 0x7f3e4c0c3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.555+0000 7f3e5472a640 1 --2- 172.21.15.19:0/3315061668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e4c0b0620 0x7f3e4c153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.555+0000 7f3e5472a640 1 --2- 172.21.15.19:0/3315061668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e4c070c40 0x7f3e4c1535c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.555+0000 7f3e5472a640 1 -- 172.21.15.19:0/3315061668 >> 172.21.15.19:0/3315061668 conn(0x7f3e4c06c190 msgr2=0x7f3e4c159940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:49.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.555+0000 7f3e5472a640 1 -- 172.21.15.19:0/3315061668 shutdown_connections 2023-11-20T06:41:49.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.555+0000 7f3e5472a640 1 -- 172.21.15.19:0/3315061668 wait complete. 2023-11-20T06:41:49.579 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T06:41:49.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.715+0000 7f371979d640 1 Processor -- start 2023-11-20T06:41:49.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.715+0000 7f371979d640 1 -- start start 2023-11-20T06:41:49.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.719+0000 7f371979d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f37141597c0 0x7f37140ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:49.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.719+0000 7f371979d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3714159ba0 0x7f37140cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:49.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.719+0000 7f371979d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37140723d0 con 0x7f37140adc10 2023-11-20T06:41:49.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.719+0000 7f371979d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37140717c0 con 0x7f3714159ba0 2023-11-20T06:41:49.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.719+0000 7f371979d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3714071aa0 con 0x7f37141597c0 2023-11-20T06:41:49.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.719+0000 7f37127fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3714159ba0 0x7f37140cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:49.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.719+0000 7f37127fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3714159ba0 0x7f37140cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48802/0 (socket says 172.21.15.19:48802) 2023-11-20T06:41:49.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.719+0000 7f37127fc640 1 -- 172.21.15.19:0/1089659357 learned_addr learned my addr 172.21.15.19:0/1089659357 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:49.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.719+0000 7f3712ffd640 1 --2- 172.21.15.19:0/1089659357 >> v2:172.21.15.190:3300/0 conn(0x7f37141597c0 0x7f37140ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:49.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.719+0000 7f37127fc640 1 -- 172.21.15.19:0/1089659357 >> v2:172.21.15.190:3300/0 conn(0x7f37141597c0 msgr2=0x7f37140ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:49.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.719+0000 7f37127fc640 1 --2- 172.21.15.19:0/1089659357 >> v2:172.21.15.190:3300/0 conn(0x7f37141597c0 0x7f37140ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.719+0000 7f37127fc640 1 -- 172.21.15.19:0/1089659357 >> v1:172.21.15.190:6789/0 conn(0x7f37140adc10 legacy=0x7f37140cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:49.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.719+0000 7f37127fc640 1 -- 172.21.15.19:0/1089659357 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3714071d80 con 0x7f3714159ba0 2023-11-20T06:41:49.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.719+0000 7f3712ffd640 1 --2- 172.21.15.19:0/1089659357 >> v2:172.21.15.190:3300/0 conn(0x7f37141597c0 0x7f37140ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:49.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.719+0000 7f37127fc640 1 --2- 172.21.15.19:0/1089659357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3714159ba0 0x7f37140cae10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f37140cdaf0 tx=0x7f370801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97bca561655de05 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:49.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.723+0000 7f3711ffb640 1 -- 172.21.15.19:0/1089659357 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37080ab660 con 0x7f3714159ba0 2023-11-20T06:41:49.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.723+0000 7f3711ffb640 1 -- 172.21.15.19:0/1089659357 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37080ab7c0 con 0x7f3714159ba0 2023-11-20T06:41:49.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.723+0000 7f3711ffb640 1 -- 172.21.15.19:0/1089659357 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37080abb50 con 0x7f3714159ba0 2023-11-20T06:41:49.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.723+0000 7f371979d640 1 -- 172.21.15.19:0/1089659357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3714159ba0 msgr2=0x7f37140cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:49.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.723+0000 7f371979d640 1 --2- 172.21.15.19:0/1089659357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3714159ba0 0x7f37140cae10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f37140cdaf0 tx=0x7f370801c4c0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.723+0000 7f371979d640 1 -- 172.21.15.19:0/1089659357 shutdown_connections 2023-11-20T06:41:49.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.723+0000 7f371979d640 1 --2- 172.21.15.19:0/1089659357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3714159ba0 0x7f37140cae10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.723+0000 7f371979d640 1 --2- 172.21.15.19:0/1089659357 >> v2:172.21.15.190:3300/0 conn(0x7f37141597c0 0x7f37140ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.723+0000 7f371979d640 1 -- 172.21.15.19:0/1089659357 >> 172.21.15.19:0/1089659357 conn(0x7f371406c190 msgr2=0x7f371406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:49.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.723+0000 7f371979d640 1 -- 172.21.15.19:0/1089659357 shutdown_connections 2023-11-20T06:41:49.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.723+0000 7f371979d640 1 -- 172.21.15.19:0/1089659357 wait complete. 2023-11-20T06:41:49.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.723+0000 7f371979d640 1 Processor -- start 2023-11-20T06:41:49.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.723+0000 7f371979d640 1 -- start start 2023-11-20T06:41:49.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.723+0000 7f371979d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37140adc10 0x7f37141470e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:49.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.723+0000 7f371979d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37141597c0 0x7f3714159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:49.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.723+0000 7f371979d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3714159ba0 0x7f371415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:49.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.723+0000 7f371979d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371415bbb0 con 0x7f37140adc10 2023-11-20T06:41:49.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.723+0000 7f371979d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3714147620 con 0x7f37141597c0 2023-11-20T06:41:49.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.723+0000 7f371979d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371415b210 con 0x7f3714159ba0 2023-11-20T06:41:49.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.723+0000 7f3712ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37140adc10 0x7f37141470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:49.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.727+0000 7f3712ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37140adc10 0x7f37141470e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48804/0 (socket says 172.21.15.19:48804) 2023-11-20T06:41:49.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.727+0000 7f3712ffd640 1 -- 172.21.15.19:0/418196470 learned_addr learned my addr 172.21.15.19:0/418196470 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:49.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.727+0000 7f37127fc640 1 --2- 172.21.15.19:0/418196470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37141597c0 0x7f3714159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:49.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.727+0000 7f37137fe640 1 --2- 172.21.15.19:0/418196470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3714159ba0 0x7f371415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:49.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.727+0000 7f3712ffd640 1 -- 172.21.15.19:0/418196470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3714159ba0 msgr2=0x7f371415a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:49.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.727+0000 7f3712ffd640 1 --2- 172.21.15.19:0/418196470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3714159ba0 0x7f371415a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.727+0000 7f3712ffd640 1 -- 172.21.15.19:0/418196470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37141597c0 msgr2=0x7f3714159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:49.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.727+0000 7f3712ffd640 1 --2- 172.21.15.19:0/418196470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37141597c0 0x7f3714159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.727+0000 7f3712ffd640 1 -- 172.21.15.19:0/418196470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37080094d0 con 0x7f37140adc10 2023-11-20T06:41:49.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.727+0000 7f37137fe640 1 --2- 172.21.15.19:0/418196470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3714159ba0 0x7f371415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:49.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.727+0000 7f3712ffd640 1 --2- 172.21.15.19:0/418196470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37140adc10 0x7f37141470e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f370400c7c0 tx=0x7f370400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:49.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.727+0000 7f36fb7fe640 1 -- 172.21.15.19:0/418196470 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3704007a30 con 0x7f37140adc10 2023-11-20T06:41:49.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.727+0000 7f36fb7fe640 1 -- 172.21.15.19:0/418196470 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3704007b90 con 0x7f37140adc10 2023-11-20T06:41:49.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.727+0000 7f371979d640 1 -- 172.21.15.19:0/418196470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371415b4f0 con 0x7f37140adc10 2023-11-20T06:41:49.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.727+0000 7f36fb7fe640 1 -- 172.21.15.19:0/418196470 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370400ce70 con 0x7f37140adc10 2023-11-20T06:41:49.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.727+0000 7f371979d640 1 -- 172.21.15.19:0/418196470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371415cb20 con 0x7f37140adc10 2023-11-20T06:41:49.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.727+0000 7f371979d640 1 -- 172.21.15.19:0/418196470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3714074010 con 0x7f37140adc10 2023-11-20T06:41:49.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.727+0000 7f36fb7fe640 1 -- 172.21.15.19:0/418196470 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f37040113f0 con 0x7f37140adc10 2023-11-20T06:41:49.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.727+0000 7f36fb7fe640 1 --2- 172.21.15.19:0/418196470 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f37000664a0 0x7f3700068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:49.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.727+0000 7f36fb7fe640 1 -- 172.21.15.19:0/418196470 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3704084550 con 0x7f37140adc10 2023-11-20T06:41:49.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.731+0000 7f37127fc640 1 --2- 172.21.15.19:0/418196470 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f37000664a0 0x7f3700068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:49.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.731+0000 7f37127fc640 1 --2- 172.21.15.19:0/418196470 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f37000664a0 0x7f3700068960 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f37080af000 tx=0x7f37080b6040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:49.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.731+0000 7f36fb7fe640 1 -- 172.21.15.19:0/418196470 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3704051780 con 0x7f37140adc10 2023-11-20T06:41:49.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.919+0000 7f371979d640 1 -- 172.21.15.19:0/418196470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37140cd3f0 con 0x7f37140adc10 2023-11-20T06:41:49.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.923+0000 7f36fb7fe640 1 -- 172.21.15.19:0/418196470 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f3704054da0 con 0x7f37140adc10 2023-11-20T06:41:49.927 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:41:49.927 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/212787745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":212787745},{"type":"v1","addr":"172.21.15.190:6836","nonce":212787745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1874314285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1874314285},{"type":"v1","addr":"172.21.15.190:6837","nonce":1874314285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3845638593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3845638593},{"type":"v1","addr":"172.21.15.19:6833","nonce":3845638593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T06:41:13.620144+0000","modified":"2023-11-20T06:41:37.768410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/1973335825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1973335825},{"type":"v1","addr":"172.21.15.19:6835","nonce":1973335825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-20T06:41:49.928 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 9 2023-11-20T06:41:49.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.923+0000 7f371979d640 1 -- 172.21.15.19:0/418196470 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f37000664a0 msgr2=0x7f3700068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:49.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.923+0000 7f371979d640 1 --2- 172.21.15.19:0/418196470 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f37000664a0 0x7f3700068960 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f37080af000 tx=0x7f37080b6040 comp rx=0 tx=0).stop 2023-11-20T06:41:49.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.923+0000 7f371979d640 1 -- 172.21.15.19:0/418196470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37140adc10 msgr2=0x7f37141470e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:49.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.923+0000 7f371979d640 1 --2- 172.21.15.19:0/418196470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37140adc10 0x7f37141470e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f370400c7c0 tx=0x7f370400cc80 comp rx=0 tx=0).stop 2023-11-20T06:41:49.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.923+0000 7f371979d640 1 -- 172.21.15.19:0/418196470 shutdown_connections 2023-11-20T06:41:49.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.923+0000 7f371979d640 1 --2- 172.21.15.19:0/418196470 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f37000664a0 0x7f3700068960 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.923+0000 7f371979d640 1 --2- 172.21.15.19:0/418196470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3714159ba0 0x7f371415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.923+0000 7f371979d640 1 --2- 172.21.15.19:0/418196470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37141597c0 0x7f3714159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.923+0000 7f371979d640 1 --2- 172.21.15.19:0/418196470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37140adc10 0x7f37141470e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:49.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.923+0000 7f371979d640 1 -- 172.21.15.19:0/418196470 >> 172.21.15.19:0/418196470 conn(0x7f371406c190 msgr2=0x7f371414bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:49.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.923+0000 7f371979d640 1 -- 172.21.15.19:0/418196470 shutdown_connections 2023-11-20T06:41:49.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:49.923+0000 7f371979d640 1 -- 172.21.15.19:0/418196470 wait complete. 2023-11-20T06:41:50.350 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-20T06:41:13.620144+0000', 'modified': '2023-11-20T06:41:37.768410+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.19:6835/1973335825', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6834', 'nonce': 1973335825}, {'type': 'v1', 'addr': '172.21.15.19:6835', 'nonce': 1973335825}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-20T06:41:50.351 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-20T06:41:50.351 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-20T06:41:50.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.491+0000 7f2e11674640 1 Processor -- start 2023-11-20T06:41:50.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.491+0000 7f2e11674640 1 -- start start 2023-11-20T06:41:50.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.491+0000 7f2e11674640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2e0c15c910 0x7f2e0c0d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.491+0000 7f2e11674640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e0c0d3170 0x7f2e0c0cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.491+0000 7f2e11674640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2e0c0cefe0 0x7f2e0c0cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.491+0000 7f2e11674640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0c0cf9a0 con 0x7f2e0c0cefe0 2023-11-20T06:41:50.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.491+0000 7f2e11674640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0c0d17a0 con 0x7f2e0c15c910 2023-11-20T06:41:50.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.491+0000 7f2e11674640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c0ce730 con 0x7f2e0c0d3170 2023-11-20T06:41:50.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.491+0000 7f2e10e73640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2e0c0cefe0 0x7f2e0c0cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.491+0000 7f2e0b7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e0c0d3170 0x7f2e0c0cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.491+0000 7f2e0bfff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2e0c15c910 0x7f2e0c0d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.491+0000 7f2e0b7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e0c0d3170 0x7f2e0c0cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:43694/0 (socket says 172.21.15.19:43694) 2023-11-20T06:41:50.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.491+0000 7f2e0b7fe640 1 -- 172.21.15.19:0/2156276403 learned_addr learned my addr 172.21.15.19:0/2156276403 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.491+0000 7f2e10e73640 1 -- 172.21.15.19:0/2156276403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e0c0d3170 msgr2=0x7f2e0c0cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.491+0000 7f2e10e73640 1 --2- 172.21.15.19:0/2156276403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e0c0d3170 0x7f2e0c0cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.491+0000 7f2e10e73640 1 -- 172.21.15.19:0/2156276403 >> v2:172.21.15.190:3300/0 conn(0x7f2e0c15c910 msgr2=0x7f2e0c0d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.491+0000 7f2e10e73640 1 --2- 172.21.15.19:0/2156276403 >> v2:172.21.15.190:3300/0 conn(0x7f2e0c15c910 0x7f2e0c0d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.491+0000 7f2e10e73640 1 -- 172.21.15.19:0/2156276403 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c0d0dd0 con 0x7f2e0c0cefe0 2023-11-20T06:41:50.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.499+0000 7f2e10e73640 1 --2- 172.21.15.19:0/2156276403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e0c0cefe0 0x7f2e0c0cf460 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c08b8d0 tx=0x7f2e0401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13f8e5f423cc91c server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:50.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.499+0000 7f2e0affd640 1 -- 172.21.15.19:0/2156276403 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e040a58d0 con 0x7f2e0c0cefe0 2023-11-20T06:41:50.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.499+0000 7f2e0affd640 1 -- 172.21.15.19:0/2156276403 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e040a5a30 con 0x7f2e0c0cefe0 2023-11-20T06:41:50.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.499+0000 7f2e0affd640 1 -- 172.21.15.19:0/2156276403 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e040a5dc0 con 0x7f2e0c0cefe0 2023-11-20T06:41:50.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.499+0000 7f2e11674640 1 -- 172.21.15.19:0/2156276403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e0c0cefe0 msgr2=0x7f2e0c0cf460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:50.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.499+0000 7f2e11674640 1 --2- 172.21.15.19:0/2156276403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e0c0cefe0 0x7f2e0c0cf460 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c08b8d0 tx=0x7f2e0401c850 comp rx=0 tx=0).stop 2023-11-20T06:41:50.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.499+0000 7f2e11674640 1 -- 172.21.15.19:0/2156276403 shutdown_connections 2023-11-20T06:41:50.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.499+0000 7f2e11674640 1 --2- 172.21.15.19:0/2156276403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e0c0cefe0 0x7f2e0c0cf460 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.499+0000 7f2e11674640 1 --2- 172.21.15.19:0/2156276403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e0c0d3170 0x7f2e0c0cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.499+0000 7f2e11674640 1 --2- 172.21.15.19:0/2156276403 >> v2:172.21.15.190:3300/0 conn(0x7f2e0c15c910 0x7f2e0c0d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.499+0000 7f2e11674640 1 -- 172.21.15.19:0/2156276403 >> 172.21.15.19:0/2156276403 conn(0x7f2e0c09bb50 msgr2=0x7f2e0c0d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:50.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.499+0000 7f2e11674640 1 -- 172.21.15.19:0/2156276403 shutdown_connections 2023-11-20T06:41:50.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.499+0000 7f2e11674640 1 -- 172.21.15.19:0/2156276403 wait complete. 2023-11-20T06:41:50.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.499+0000 7f2e11674640 1 Processor -- start 2023-11-20T06:41:50.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.499+0000 7f2e11674640 1 -- start start 2023-11-20T06:41:50.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e11674640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e0c0cefe0 0x7f2e0c0b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e11674640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e0c0d3170 0x7f2e0c0cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e11674640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e0c15c910 0x7f2e0c155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e11674640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c0cbd20 con 0x7f2e0c0d3170 2023-11-20T06:41:50.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e11674640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c0b59a0 con 0x7f2e0c15c910 2023-11-20T06:41:50.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e11674640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c0b5c80 con 0x7f2e0c0cefe0 2023-11-20T06:41:50.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e0c0d3170 0x7f2e0c0cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e0c0d3170 0x7f2e0c0cb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48816/0 (socket says 172.21.15.19:48816) 2023-11-20T06:41:50.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e0b7fe640 1 -- 172.21.15.19:0/3643700755 learned_addr learned my addr 172.21.15.19:0/3643700755 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:50.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e0bfff640 1 --2- 172.21.15.19:0/3643700755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e0c0cefe0 0x7f2e0c0b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e10e73640 1 --2- 172.21.15.19:0/3643700755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e0c15c910 0x7f2e0c155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e0b7fe640 1 -- 172.21.15.19:0/3643700755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e0c0cefe0 msgr2=0x7f2e0c0b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:50.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e0b7fe640 1 --2- 172.21.15.19:0/3643700755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e0c0cefe0 0x7f2e0c0b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e0b7fe640 1 -- 172.21.15.19:0/3643700755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e0c15c910 msgr2=0x7f2e0c155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:50.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e0b7fe640 1 --2- 172.21.15.19:0/3643700755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e0c15c910 0x7f2e0c155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e0b7fe640 1 -- 172.21.15.19:0/3643700755 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e04009a70 con 0x7f2e0c0d3170 2023-11-20T06:41:50.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e0b7fe640 1 --2- 172.21.15.19:0/3643700755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e0c0d3170 0x7f2e0c0cb7e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2e0000e820 tx=0x7f2e0000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:50.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e08ff9640 1 -- 172.21.15.19:0/3643700755 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0000c940 con 0x7f2e0c0d3170 2023-11-20T06:41:50.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e08ff9640 1 -- 172.21.15.19:0/3643700755 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0000caa0 con 0x7f2e0c0d3170 2023-11-20T06:41:50.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e08ff9640 1 -- 172.21.15.19:0/3643700755 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0000ce10 con 0x7f2e0c0d3170 2023-11-20T06:41:50.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e11674640 1 -- 172.21.15.19:0/3643700755 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0c0b5f60 con 0x7f2e0c0d3170 2023-11-20T06:41:50.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e11674640 1 -- 172.21.15.19:0/3643700755 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0c0b6520 con 0x7f2e0c0d3170 2023-11-20T06:41:50.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.503+0000 7f2e08ff9640 1 -- 172.21.15.19:0/3643700755 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2e00013470 con 0x7f2e0c0d3170 2023-11-20T06:41:50.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e08ff9640 1 --2- 172.21.15.19:0/3643700755 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2df80664a0 0x7f2df8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e08ff9640 1 -- 172.21.15.19:0/3643700755 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2e000841e0 con 0x7f2e0c0d3170 2023-11-20T06:41:50.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e0bfff640 1 --2- 172.21.15.19:0/3643700755 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2df80664a0 0x7f2df8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e15c50000 1 Processor -- start 2023-11-20T06:41:50.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e15c50000 1 -- start start 2023-11-20T06:41:50.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e0bfff640 1 --2- 172.21.15.19:0/3643700755 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2df80664a0 0x7f2df8068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009ac0 tx=0x7f2dfc006f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:50.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e15c50000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f66b840 0x55774f66bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e15c50000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f66c160 0x55774f6216b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e15c50000 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f621bf0 0x55774f621fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e15c50000 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f416cc0 con 0x55774f621bf0 2023-11-20T06:41:50.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e15c50000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f4798e0 con 0x55774f66b840 2023-11-20T06:41:50.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e15c50000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55774f476e10 con 0x55774f66c160 2023-11-20T06:41:50.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e10e73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f621bf0 0x55774f621fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e10e73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f621bf0 0x55774f621fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48820/0 (socket says 172.21.15.19:48820) 2023-11-20T06:41:50.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e10e73640 1 -- 172.21.15.19:0/1707768444 learned_addr learned my addr 172.21.15.19:0/1707768444 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:50.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e0bfff640 1 --2- 172.21.15.19:0/1707768444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f66b840 0x55774f66bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e0b7fe640 1 --2- 172.21.15.19:0/1707768444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f66c160 0x55774f6216b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e10e73640 1 -- 172.21.15.19:0/1707768444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f66c160 msgr2=0x55774f6216b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:50.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e10e73640 1 --2- 172.21.15.19:0/1707768444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f66c160 0x55774f6216b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e10e73640 1 -- 172.21.15.19:0/1707768444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f66b840 msgr2=0x55774f66bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:50.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e10e73640 1 --2- 172.21.15.19:0/1707768444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f66b840 0x55774f66bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e10e73640 1 -- 172.21.15.19:0/1707768444 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55774f16b890 con 0x55774f621bf0 2023-11-20T06:41:50.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.507+0000 7f2e10e73640 1 --2- 172.21.15.19:0/1707768444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f621bf0 0x55774f621fd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2e0401c890 tx=0x7f2e04004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480a885cb6d410bb server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:50.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2df1ffb640 1 -- 172.21.15.19:0/1707768444 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e040a5ba0 con 0x55774f621bf0 2023-11-20T06:41:50.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2df1ffb640 1 -- 172.21.15.19:0/1707768444 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e040a5d00 con 0x55774f621bf0 2023-11-20T06:41:50.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2df1ffb640 1 -- 172.21.15.19:0/1707768444 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e040ad640 con 0x55774f621bf0 2023-11-20T06:41:50.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e15c50000 1 -- 172.21.15.19:0/1707768444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f621bf0 msgr2=0x55774f621fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:50.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e15c50000 1 --2- 172.21.15.19:0/1707768444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f621bf0 0x55774f621fd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2e0401c890 tx=0x7f2e04004ac0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e15c50000 1 -- 172.21.15.19:0/1707768444 shutdown_connections 2023-11-20T06:41:50.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e15c50000 1 --2- 172.21.15.19:0/1707768444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f621bf0 0x55774f621fd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e15c50000 1 --2- 172.21.15.19:0/1707768444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f66c160 0x55774f6216b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e15c50000 1 --2- 172.21.15.19:0/1707768444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f66b840 0x55774f66bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e15c50000 1 -- 172.21.15.19:0/1707768444 >> 172.21.15.19:0/1707768444 conn(0x55774f618f60 msgr2=0x55774f61ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:50.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e15c50000 1 -- 172.21.15.19:0/1707768444 shutdown_connections 2023-11-20T06:41:50.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e15c50000 1 -- 172.21.15.19:0/1707768444 wait complete. 2023-11-20T06:41:50.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e15c50000 1 -- start start 2023-11-20T06:41:50.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e15c50000 1 Processor -- start 2023-11-20T06:41:50.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e15c50000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f621bf0 0x55774f66b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e15c50000 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f66b840 0x55774f626d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e15c50000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f66c160 0x55774f627280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e15c50000 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f472700 con 0x55774f66b840 2023-11-20T06:41:50.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e15c50000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f431d10 con 0x55774f621bf0 2023-11-20T06:41:50.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e15c50000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55774f4319b0 con 0x55774f66c160 2023-11-20T06:41:50.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e15c50000 10 client.0 _ll_register_callbacks cb 0x55774f60d330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-20T06:41:50.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f66b840 0x55774f626d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f66b840 0x55774f626d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48830/0 (socket says 172.21.15.19:48830) 2023-11-20T06:41:50.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e0b7fe640 1 -- 172.21.15.19:0/206834014 learned_addr learned my addr 172.21.15.19:0/206834014 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:50.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e0bfff640 1 --2- 172.21.15.19:0/206834014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f621bf0 0x55774f66b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e10e73640 1 --2- 172.21.15.19:0/206834014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f66c160 0x55774f627280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e0b7fe640 1 -- 172.21.15.19:0/206834014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f66c160 msgr2=0x55774f627280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:50.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e0b7fe640 1 --2- 172.21.15.19:0/206834014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f66c160 0x55774f627280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e0b7fe640 1 -- 172.21.15.19:0/206834014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f621bf0 msgr2=0x55774f66b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e0b7fe640 1 --2- 172.21.15.19:0/206834014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f621bf0 0x55774f66b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.511+0000 7f2e0b7fe640 1 -- 172.21.15.19:0/206834014 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0c0d0dd0 con 0x55774f66b840 2023-11-20T06:41:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e0b7fe640 1 --2- 172.21.15.19:0/206834014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f66b840 0x55774f626d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2e00051590 tx=0x7f2e00054ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97fa916a26d9efb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2deaffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2023-11-20T06:41:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2deaffd640 1 -- 172.21.15.19:0/206834014 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0005b2b0 con 0x55774f66b840 2023-11-20T06:41:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2deaffd640 1 -- 172.21.15.19:0/206834014 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2e0005d330 con 0x55774f66b840 2023-11-20T06:41:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 1 -- 172.21.15.19:0/206834014 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55774f426370 con 0x55774f66b840 2023-11-20T06:41:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2deaffd640 1 -- 172.21.15.19:0/206834014 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e0005cea0 con 0x55774f66b840 2023-11-20T06:41:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 10 client.4818 fetch_fsmap learned FSMap version 9 2023-11-20T06:41:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 1 -- 172.21.15.19:0/206834014 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55774f434460 con 0x55774f66b840 2023-11-20T06:41:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2deaffd640 1 -- 172.21.15.19:0/206834014 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55774f426370 con 0x55774f66b840 2023-11-20T06:41:50.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2deaffd640 1 -- 172.21.15.19:0/206834014 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f2e00011070 con 0x55774f66b840 2023-11-20T06:41:50.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 10 client.4818 fetch_fsmap finished waiting for FSMap version 9 2023-11-20T06:41:50.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 10 client.4818 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-20T06:41:50.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 20 client.4818 populate_metadata read hostname 'smithi019' 2023-11-20T06:41:50.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 1 --2- 172.21.15.19:0/206834014 >> [v2:172.21.15.19:6834/1973335825,v1:172.21.15.19:6835/1973335825] conn(0x55774f62e0b0 0x55774f67db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 4 client.4818 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-20T06:41:50.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 1 -- 172.21.15.19:0/206834014 --> [v2:172.21.15.19:6834/1973335825,v1:172.21.15.19:6835/1973335825] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55774f40c2d0 con 0x55774f62e0b0 2023-11-20T06:41:50.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e0bfff640 1 --2- 172.21.15.19:0/206834014 >> [v2:172.21.15.19:6834/1973335825,v1:172.21.15.19:6835/1973335825] conn(0x55774f62e0b0 0x55774f67db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e0bfff640 1 --2- 172.21.15.19:0/206834014 >> [v2:172.21.15.19:6834/1973335825,v1:172.21.15.19:6835/1973335825] conn(0x55774f62e0b0 0x55774f67db00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da82abb987a900bf server_cookie=ac46792adc62c555 in_seq=0 out_seq=0 2023-11-20T06:41:50.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2deaffd640 10 client.4818 ms_handle_connect on v2:172.21.15.19:6834/1973335825 2023-11-20T06:41:50.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2deaffd640 1 -- 172.21.15.19:0/206834014 <== mds.0 v2:172.21.15.19:6834/1973335825 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55774f40c2d0 con 0x55774f62e0b0 2023-11-20T06:41:50.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2deaffd640 10 client.4818 handle_command_reply: tid=0 2023-11-20T06:41:50.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 1 client.4818 shutdown 2023-11-20T06:41:50.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 1 -- 172.21.15.19:0/206834014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f66b840 msgr2=0x55774f626d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:50.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 1 --2- 172.21.15.19:0/206834014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f66b840 0x55774f626d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2e00051590 tx=0x7f2e00054ac0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 1 -- 172.21.15.19:0/206834014 shutdown_connections 2023-11-20T06:41:50.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 1 --2- 172.21.15.19:0/206834014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f66c160 0x55774f627280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 1 --2- 172.21.15.19:0/206834014 >> [v2:172.21.15.19:6834/1973335825,v1:172.21.15.19:6835/1973335825] conn(0x55774f62e0b0 0x55774f67db00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 1 --2- 172.21.15.19:0/206834014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f66b840 0x55774f626d40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 1 --2- 172.21.15.19:0/206834014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f621bf0 0x55774f66b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 1 -- 172.21.15.19:0/206834014 >> 172.21.15.19:0/206834014 conn(0x55774f618f60 msgr2=0x55774f620690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:50.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2deaffd640 0 client.4818 ms_handle_reset on v2:172.21.15.19:6834/1973335825 2023-11-20T06:41:50.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 1 -- 172.21.15.19:0/206834014 shutdown_connections 2023-11-20T06:41:50.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 1 -- 172.21.15.19:0/206834014 wait complete. 2023-11-20T06:41:50.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.515+0000 7f2e15c50000 20 client.4818 trim_cache size 0 max 16384 2023-11-20T06:41:50.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.531+0000 7f2e15c50000 1 Processor -- start 2023-11-20T06:41:50.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.531+0000 7f2e15c50000 1 -- start start 2023-11-20T06:41:50.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.531+0000 7f2e15c50000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f621bf0 0x55774f67eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.531+0000 7f2e15c50000 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f66b840 0x55774f67f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.531+0000 7f2e15c50000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f66c160 0x55774f666270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.531+0000 7f2e15c50000 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f12c940 con 0x55774f66b840 2023-11-20T06:41:50.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.531+0000 7f2e15c50000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f4489d0 con 0x55774f66c160 2023-11-20T06:41:50.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.531+0000 7f2e15c50000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55774f46fb00 con 0x55774f621bf0 2023-11-20T06:41:50.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.531+0000 7f2e0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f66b840 0x55774f67f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.531+0000 7f2e0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f66b840 0x55774f67f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48840/0 (socket says 172.21.15.19:48840) 2023-11-20T06:41:50.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.531+0000 7f2e0b7fe640 1 -- 172.21.15.19:0/2744809177 learned_addr learned my addr 172.21.15.19:0/2744809177 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:50.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e0bfff640 1 --2- 172.21.15.19:0/2744809177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f621bf0 0x55774f67eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e0b7fe640 1 -- 172.21.15.19:0/2744809177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f621bf0 msgr2=0x55774f67eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:50.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e0b7fe640 1 --2- 172.21.15.19:0/2744809177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f621bf0 0x55774f67eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e0b7fe640 1 -- 172.21.15.19:0/2744809177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f66c160 msgr2=0x55774f666270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:50.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e10e73640 1 --2- 172.21.15.19:0/2744809177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f66c160 0x55774f666270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e0b7fe640 1 --2- 172.21.15.19:0/2744809177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f66c160 0x55774f666270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e0b7fe640 1 -- 172.21.15.19:0/2744809177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55774f41a760 con 0x55774f66b840 2023-11-20T06:41:50.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e0bfff640 1 --2- 172.21.15.19:0/2744809177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f621bf0 0x55774f67eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:50.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e10e73640 1 --2- 172.21.15.19:0/2744809177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f66c160 0x55774f666270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:50.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e0b7fe640 1 --2- 172.21.15.19:0/2744809177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f66b840 0x55774f67f050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2e00055070 tx=0x7f2e00058000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed743d3c1ef32d0c server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2df27fc640 1 -- 172.21.15.19:0/2744809177 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0005b2b0 con 0x55774f66b840 2023-11-20T06:41:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2df27fc640 1 -- 172.21.15.19:0/2744809177 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e00054eb0 con 0x55774f66b840 2023-11-20T06:41:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2df27fc640 1 -- 172.21.15.19:0/2744809177 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0006cda0 con 0x55774f66b840 2023-11-20T06:41:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e15c50000 1 -- 172.21.15.19:0/2744809177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f66b840 msgr2=0x55774f67f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e15c50000 1 --2- 172.21.15.19:0/2744809177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f66b840 0x55774f67f050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2e00055070 tx=0x7f2e00058000 comp rx=0 tx=0).stop 2023-11-20T06:41:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e15c50000 1 -- 172.21.15.19:0/2744809177 shutdown_connections 2023-11-20T06:41:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e15c50000 1 --2- 172.21.15.19:0/2744809177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f66c160 0x55774f666270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e15c50000 1 --2- 172.21.15.19:0/2744809177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f66b840 0x55774f67f050 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e15c50000 1 --2- 172.21.15.19:0/2744809177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f621bf0 0x55774f67eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e15c50000 1 -- 172.21.15.19:0/2744809177 >> 172.21.15.19:0/2744809177 conn(0x55774f618f60 msgr2=0x55774f678e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e15c50000 1 -- 172.21.15.19:0/2744809177 shutdown_connections 2023-11-20T06:41:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e15c50000 1 -- 172.21.15.19:0/2744809177 wait complete. 2023-11-20T06:41:50.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e15c50000 1 -- start start 2023-11-20T06:41:50.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e15c50000 1 Processor -- start 2023-11-20T06:41:50.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e15c50000 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f621bf0 0x55774f6c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e15c50000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f66b840 0x55774f6ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e15c50000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f66c160 0x55774f668f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e15c50000 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f682490 con 0x55774f621bf0 2023-11-20T06:41:50.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e15c50000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f605570 con 0x55774f66b840 2023-11-20T06:41:50.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e15c50000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55774f40ce30 con 0x55774f66c160 2023-11-20T06:41:50.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.535+0000 7f2e15c50000 10 client.0 _ll_register_callbacks cb 0x7f2dfc009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-20T06:41:50.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e0bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f621bf0 0x55774f6c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e0bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f621bf0 0x55774f6c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48846/0 (socket says 172.21.15.19:48846) 2023-11-20T06:41:50.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e0bfff640 1 -- 172.21.15.19:0/2088415996 learned_addr learned my addr 172.21.15.19:0/2088415996 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:50.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e10e73640 1 --2- 172.21.15.19:0/2088415996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f66c160 0x55774f668f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e0b7fe640 1 --2- 172.21.15.19:0/2088415996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f66b840 0x55774f6ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e0bfff640 1 -- 172.21.15.19:0/2088415996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f66c160 msgr2=0x55774f668f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:50.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e0bfff640 1 --2- 172.21.15.19:0/2088415996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f66c160 0x55774f668f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e0bfff640 1 -- 172.21.15.19:0/2088415996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f66b840 msgr2=0x55774f6ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:50.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e0bfff640 1 --2- 172.21.15.19:0/2088415996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f66b840 0x55774f6ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e0bfff640 1 -- 172.21.15.19:0/2088415996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55774f434460 con 0x55774f621bf0 2023-11-20T06:41:50.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e0b7fe640 1 --2- 172.21.15.19:0/2088415996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f66b840 0x55774f6ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:50.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e0bfff640 1 --2- 172.21.15.19:0/2088415996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f621bf0 0x55774f6c9f10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc011f90 tx=0x7f2dfc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a5aeffc872a578 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:50.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2deaffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2023-11-20T06:41:50.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2deaffd640 1 -- 172.21.15.19:0/2088415996 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc028040 con 0x55774f621bf0 2023-11-20T06:41:50.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2deaffd640 1 -- 172.21.15.19:0/2088415996 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2dfc02a430 con 0x55774f621bf0 2023-11-20T06:41:50.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 1 -- 172.21.15.19:0/2088415996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55774f40a6f0 con 0x55774f621bf0 2023-11-20T06:41:50.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2deaffd640 1 -- 172.21.15.19:0/2088415996 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2dfc02a810 con 0x55774f621bf0 2023-11-20T06:41:50.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 10 client.4824 fetch_fsmap learned FSMap version 9 2023-11-20T06:41:50.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 1 -- 172.21.15.19:0/2088415996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55774f16bcc0 con 0x55774f621bf0 2023-11-20T06:41:50.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2deaffd640 1 -- 172.21.15.19:0/2088415996 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55774f40a6f0 con 0x55774f621bf0 2023-11-20T06:41:50.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2deaffd640 1 -- 172.21.15.19:0/2088415996 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f2dfc02a970 con 0x55774f621bf0 2023-11-20T06:41:50.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 10 client.4824 fetch_fsmap finished waiting for FSMap version 9 2023-11-20T06:41:50.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 10 client.4824 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-20T06:41:50.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 20 client.4824 populate_metadata read hostname 'smithi019' 2023-11-20T06:41:50.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 1 --2- 172.21.15.19:0/2088415996 >> [v2:172.21.15.19:6834/1973335825,v1:172.21.15.19:6835/1973335825] conn(0x55774f6d0d70 0x55774f6d3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:50.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 4 client.4824 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-20T06:41:50.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 1 -- 172.21.15.19:0/2088415996 --> [v2:172.21.15.19:6834/1973335825,v1:172.21.15.19:6835/1973335825] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55774f46b6e0 con 0x55774f6d0d70 2023-11-20T06:41:50.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e0b7fe640 1 --2- 172.21.15.19:0/2088415996 >> [v2:172.21.15.19:6834/1973335825,v1:172.21.15.19:6835/1973335825] conn(0x55774f6d0d70 0x55774f6d3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:50.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e0b7fe640 1 --2- 172.21.15.19:0/2088415996 >> [v2:172.21.15.19:6834/1973335825,v1:172.21.15.19:6835/1973335825] conn(0x55774f6d0d70 0x55774f6d3160 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dee594d3e98e9ab server_cookie=4d54ff1cd91eeb4e in_seq=0 out_seq=0 2023-11-20T06:41:50.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2deaffd640 10 client.4824 ms_handle_connect on v2:172.21.15.19:6834/1973335825 2023-11-20T06:41:50.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2deaffd640 1 -- 172.21.15.19:0/2088415996 <== mds.0 v2:172.21.15.19:6834/1973335825 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55774f46b6e0 con 0x55774f6d0d70 2023-11-20T06:41:50.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2deaffd640 10 client.4824 handle_command_reply: tid=0 2023-11-20T06:41:50.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 1 client.4824 shutdown 2023-11-20T06:41:50.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 1 -- 172.21.15.19:0/2088415996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f621bf0 msgr2=0x55774f6c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:50.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 1 --2- 172.21.15.19:0/2088415996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f621bf0 0x55774f6c9f10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc011f90 tx=0x7f2dfc004740 comp rx=0 tx=0).stop 2023-11-20T06:41:50.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 1 -- 172.21.15.19:0/2088415996 shutdown_connections 2023-11-20T06:41:50.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 1 --2- 172.21.15.19:0/2088415996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55774f66c160 0x55774f668f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 1 --2- 172.21.15.19:0/2088415996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774f66b840 0x55774f6ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 1 --2- 172.21.15.19:0/2088415996 >> [v2:172.21.15.19:6834/1973335825,v1:172.21.15.19:6835/1973335825] conn(0x55774f6d0d70 0x55774f6d3160 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 1 --2- 172.21.15.19:0/2088415996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55774f621bf0 0x55774f6c9f10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 1 -- 172.21.15.19:0/2088415996 >> 172.21.15.19:0/2088415996 conn(0x55774f618f60 msgr2=0x55774f67db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:50.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2deaffd640 0 client.4824 ms_handle_reset on v2:172.21.15.19:6834/1973335825 2023-11-20T06:41:50.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 1 -- 172.21.15.19:0/2088415996 shutdown_connections 2023-11-20T06:41:50.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 1 -- 172.21.15.19:0/2088415996 wait complete. 2023-11-20T06:41:50.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.539+0000 7f2e15c50000 20 client.4824 trim_cache size 0 max 16384 2023-11-20T06:41:50.551 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-20T06:41:50.551 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "c7c2bc89-520e-40d6-94f5-74b01db83356", 2023-11-20T06:41:50.551 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2023-11-20T06:41:50.551 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4272, 2023-11-20T06:41:50.551 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2023-11-20T06:41:50.551 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2023-11-20T06:41:50.551 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2023-11-20T06:41:50.551 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 36.301055245999997, 2023-11-20T06:41:50.551 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 9, 2023-11-20T06:41:50.551 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 25, 2023-11-20T06:41:50.551 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 25, 2023-11-20T06:41:50.551 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 43.493076870000003 2023-11-20T06:41:50.551 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-20T06:41:50.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.543+0000 7f2e11674640 1 -- 172.21.15.19:0/3643700755 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2df80664a0 msgr2=0x7f2df8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:50.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.543+0000 7f2e11674640 1 --2- 172.21.15.19:0/3643700755 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2df80664a0 0x7f2df8068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009ac0 tx=0x7f2dfc006f90 comp rx=0 tx=0).stop 2023-11-20T06:41:50.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.543+0000 7f2e11674640 1 -- 172.21.15.19:0/3643700755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e0c0d3170 msgr2=0x7f2e0c0cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:50.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.543+0000 7f2e11674640 1 --2- 172.21.15.19:0/3643700755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e0c0d3170 0x7f2e0c0cb7e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2e0000e820 tx=0x7f2e0000ece0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.543+0000 7f2e11674640 1 -- 172.21.15.19:0/3643700755 shutdown_connections 2023-11-20T06:41:50.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.543+0000 7f2e11674640 1 --2- 172.21.15.19:0/3643700755 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2df80664a0 0x7f2df8068960 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.543+0000 7f2e11674640 1 --2- 172.21.15.19:0/3643700755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e0c15c910 0x7f2e0c155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.543+0000 7f2e11674640 1 --2- 172.21.15.19:0/3643700755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e0c0d3170 0x7f2e0c0cb7e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.543+0000 7f2e11674640 1 --2- 172.21.15.19:0/3643700755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e0c0cefe0 0x7f2e0c0b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:50.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.543+0000 7f2e11674640 1 -- 172.21.15.19:0/3643700755 >> 172.21.15.19:0/3643700755 conn(0x7f2e0c09bb50 msgr2=0x7f2e0c154400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:50.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.543+0000 7f2e11674640 1 -- 172.21.15.19:0/3643700755 shutdown_connections 2023-11-20T06:41:50.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:50.543+0000 7f2e11674640 1 -- 172.21.15.19:0/3643700755 wait complete. 2023-11-20T06:41:50.567 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-20T06:41:50.631 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-20T06:41:50.631 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-20T06:41:50.631 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-20T06:41:50.631 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-20T06:41:50.631 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-20T06:41:50.631 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-20T06:41:50.631 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-20T06:41:50.632 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-20T06:41:50.632 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-20T06:41:50.632 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-20T06:41:50.632 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-20T06:41:50.632 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-20T06:41:50.632 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-20T06:41:50.632 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-20T06:41:50.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:50.632 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2023-11-20T06:41:50.643 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-11-20T06:41:50.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:50.644 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-20T06:41:50.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:50.713 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2023-11-20T06:41:50.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:50.941 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2023-11-20T06:41:50.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:50.952 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link delete ceph-brx 2023-11-20T06:41:51.020 INFO:teuthology.orchestra.run.smithi190.stderr:Cannot find device "ceph-brx" 2023-11-20T06:41:51.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:41:51.023 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-20T06:41:51.023 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-20T06:41:51.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.159+0000 7ff8022d6640 1 Processor -- start 2023-11-20T06:41:51.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.159+0000 7ff8022d6640 1 -- start start 2023-11-20T06:41:51.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.163+0000 7ff8022d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7fc159ba0 0x7ff7fc0cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:51.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.163+0000 7ff8022d6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7fc0723d0 con 0x7ff7fc0c8cb0 2023-11-20T06:41:51.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.163+0000 7ff8022d6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7fc0717c0 con 0x7ff7fc1597c0 2023-11-20T06:41:51.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.163+0000 7ff8022d6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc071aa0 con 0x7ff7fc159ba0 2023-11-20T06:41:51.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.163+0000 7ff800873640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff7fc0c8cb0 0x7ff7fc0cb350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40844/0 (socket says 172.21.15.19:40844) 2023-11-20T06:41:51.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.163+0000 7ff800873640 1 -- 172.21.15.19:0/2441684062 learned_addr learned my addr 172.21.15.19:0/2441684062 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:51.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.163+0000 7ff7fb7fe640 1 --2- 172.21.15.19:0/2441684062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7fc159ba0 0x7ff7fc0cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:51.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.163+0000 7ff7faffd640 1 -- 172.21.15.19:0/2441684062 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937342706 0 0) 0x7ff7fc0723d0 con 0x7ff7fc0c8cb0 2023-11-20T06:41:51.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.163+0000 7ff7faffd640 1 -- 172.21.15.19:0/2441684062 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7e4005740 con 0x7ff7fc0c8cb0 2023-11-20T06:41:51.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.163+0000 7ff7faffd640 1 -- 172.21.15.19:0/2441684062 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842706331 0 0) 0x7ff7fc0717c0 con 0x7ff7fc1597c0 2023-11-20T06:41:51.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.163+0000 7ff7faffd640 1 -- 172.21.15.19:0/2441684062 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7fc0723d0 con 0x7ff7fc1597c0 2023-11-20T06:41:51.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.163+0000 7ff7fb7fe640 1 -- 172.21.15.19:0/2441684062 >> v1:172.21.15.190:6789/0 conn(0x7ff7fc1597c0 legacy=0x7ff7fc0ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:51.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.163+0000 7ff7fb7fe640 1 -- 172.21.15.19:0/2441684062 >> v1:172.21.15.19:6789/0 conn(0x7ff7fc0c8cb0 legacy=0x7ff7fc0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:51.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.163+0000 7ff7faffd640 1 -- 172.21.15.19:0/2441684062 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3165108461 0 0) 0x7ff7e4005740 con 0x7ff7fc0c8cb0 2023-11-20T06:41:51.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.163+0000 7ff7fb7fe640 1 -- 172.21.15.19:0/2441684062 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc071d80 con 0x7ff7fc159ba0 2023-11-20T06:41:51.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.167+0000 7ff7fb7fe640 1 --2- 172.21.15.19:0/2441684062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7fc159ba0 0x7ff7fc0cae10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00097f0 tx=0x7ff7f001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65b1936643c37e0a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:51.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.167+0000 7ff7faffd640 1 -- 172.21.15.19:0/2441684062 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4001a00 con 0x7ff7fc159ba0 2023-11-20T06:41:51.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.167+0000 7ff7faffd640 1 -- 172.21.15.19:0/2441684062 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f00a7050 con 0x7ff7fc159ba0 2023-11-20T06:41:51.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.167+0000 7ff7faffd640 1 -- 172.21.15.19:0/2441684062 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f00ab620 con 0x7ff7fc159ba0 2023-11-20T06:41:51.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.167+0000 7ff8022d6640 1 -- 172.21.15.19:0/2441684062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7fc159ba0 msgr2=0x7ff7fc0cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:51.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.167+0000 7ff8022d6640 1 --2- 172.21.15.19:0/2441684062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7fc159ba0 0x7ff7fc0cae10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00097f0 tx=0x7ff7f001c3e0 comp rx=0 tx=0).stop 2023-11-20T06:41:51.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.167+0000 7ff8022d6640 1 -- 172.21.15.19:0/2441684062 shutdown_connections 2023-11-20T06:41:51.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.167+0000 7ff8022d6640 1 --2- 172.21.15.19:0/2441684062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7fc159ba0 0x7ff7fc0cae10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:51.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.167+0000 7ff8022d6640 1 -- 172.21.15.19:0/2441684062 >> 172.21.15.19:0/2441684062 conn(0x7ff7fc06c190 msgr2=0x7ff7fc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:51.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.167+0000 7ff8022d6640 1 -- 172.21.15.19:0/2441684062 shutdown_connections 2023-11-20T06:41:51.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.167+0000 7ff8022d6640 1 -- 172.21.15.19:0/2441684062 wait complete. 2023-11-20T06:41:51.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.167+0000 7ff8022d6640 1 Processor -- start 2023-11-20T06:41:51.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.167+0000 7ff8022d6640 1 -- start start 2023-11-20T06:41:51.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff8022d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7fc0c8cb0 0x7ff7fc0c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:51.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff8022d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7fc1597c0 0x7ff7fc0c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:51.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff8022d6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7fc159ba0 0x7ff7fc14a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:51.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff8022d6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc0ad620 con 0x7ff7fc1597c0 2023-11-20T06:41:51.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff8022d6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc0c76b0 con 0x7ff7fc159ba0 2023-11-20T06:41:51.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff8022d6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc0ad060 con 0x7ff7fc0c8cb0 2023-11-20T06:41:51.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff7fb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7fc1597c0 0x7ff7fc0c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:51.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff7fb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7fc1597c0 0x7ff7fc0c7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48860/0 (socket says 172.21.15.19:48860) 2023-11-20T06:41:51.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff7fb7fe640 1 -- 172.21.15.19:0/3983102944 learned_addr learned my addr 172.21.15.19:0/3983102944 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:51.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff7fbfff640 1 --2- 172.21.15.19:0/3983102944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7fc0c8cb0 0x7ff7fc0c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:51.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff800873640 1 --2- 172.21.15.19:0/3983102944 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7fc159ba0 0x7ff7fc14a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:51.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff7fb7fe640 1 -- 172.21.15.19:0/3983102944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7fc0c8cb0 msgr2=0x7ff7fc0c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:51.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff7fb7fe640 1 --2- 172.21.15.19:0/3983102944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7fc0c8cb0 0x7ff7fc0c6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:51.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff7fb7fe640 1 -- 172.21.15.19:0/3983102944 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7fc159ba0 msgr2=0x7ff7fc14a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:51.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff7fb7fe640 1 --2- 172.21.15.19:0/3983102944 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7fc159ba0 0x7ff7fc14a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:51.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff7fb7fe640 1 -- 172.21.15.19:0/3983102944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f0009420 con 0x7ff7fc1597c0 2023-11-20T06:41:51.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff800873640 1 --2- 172.21.15.19:0/3983102944 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7fc159ba0 0x7ff7fc14a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:51.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff7fb7fe640 1 --2- 172.21.15.19:0/3983102944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7fc1597c0 0x7ff7fc0c7170 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00097f0 tx=0x7ff7f0019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:51.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff7f8ff9640 1 -- 172.21.15.19:0/3983102944 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f00abd10 con 0x7ff7fc1597c0 2023-11-20T06:41:51.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff7f8ff9640 1 -- 172.21.15.19:0/3983102944 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f00a4e90 con 0x7ff7fc1597c0 2023-11-20T06:41:51.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff8022d6640 1 -- 172.21.15.19:0/3983102944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7fc0ad340 con 0x7ff7fc1597c0 2023-11-20T06:41:51.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff7f8ff9640 1 -- 172.21.15.19:0/3983102944 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0004220 con 0x7ff7fc1597c0 2023-11-20T06:41:51.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff8022d6640 1 -- 172.21.15.19:0/3983102944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7fc15a460 con 0x7ff7fc1597c0 2023-11-20T06:41:51.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff8022d6640 1 -- 172.21.15.19:0/3983102944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7fc15a650 con 0x7ff7fc1597c0 2023-11-20T06:41:51.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.171+0000 7ff7f8ff9640 1 -- 172.21.15.19:0/3983102944 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff7f00b2040 con 0x7ff7fc1597c0 2023-11-20T06:41:51.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.175+0000 7ff7f8ff9640 1 --2- 172.21.15.19:0/3983102944 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff7e80664a0 0x7ff7e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:51.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.175+0000 7ff7f8ff9640 1 -- 172.21.15.19:0/3983102944 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff7f011d7a0 con 0x7ff7fc1597c0 2023-11-20T06:41:51.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.175+0000 7ff7fbfff640 1 --2- 172.21.15.19:0/3983102944 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff7e80664a0 0x7ff7e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:51.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.175+0000 7ff7fbfff640 1 --2- 172.21.15.19:0/3983102944 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff7e80664a0 0x7ff7e8068960 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec0011f0 tx=0x7ff7ec009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:51.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.179+0000 7ff7f8ff9640 1 -- 172.21.15.19:0/3983102944 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff7f00ea920 con 0x7ff7fc1597c0 2023-11-20T06:41:51.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.367+0000 7ff8022d6640 1 -- 172.21.15.19:0/3983102944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff7fc074010 con 0x7ff7fc1597c0 2023-11-20T06:41:51.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.367+0000 7ff7f8ff9640 1 -- 172.21.15.19:0/3983102944 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7ff7f00b8070 con 0x7ff7fc1597c0 2023-11-20T06:41:51.374 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-20T06:41:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.371+0000 7ff8022d6640 1 -- 172.21.15.19:0/3983102944 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff7e80664a0 msgr2=0x7ff7e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.371+0000 7ff8022d6640 1 --2- 172.21.15.19:0/3983102944 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff7e80664a0 0x7ff7e8068960 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec0011f0 tx=0x7ff7ec009040 comp rx=0 tx=0).stop 2023-11-20T06:41:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.371+0000 7ff8022d6640 1 -- 172.21.15.19:0/3983102944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7fc1597c0 msgr2=0x7ff7fc0c7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.371+0000 7ff8022d6640 1 --2- 172.21.15.19:0/3983102944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7fc1597c0 0x7ff7fc0c7170 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00097f0 tx=0x7ff7f0019180 comp rx=0 tx=0).stop 2023-11-20T06:41:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.371+0000 7ff8022d6640 1 -- 172.21.15.19:0/3983102944 shutdown_connections 2023-11-20T06:41:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.371+0000 7ff8022d6640 1 --2- 172.21.15.19:0/3983102944 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff7e80664a0 0x7ff7e8068960 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.371+0000 7ff8022d6640 1 --2- 172.21.15.19:0/3983102944 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7fc159ba0 0x7ff7fc14a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.371+0000 7ff8022d6640 1 --2- 172.21.15.19:0/3983102944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7fc1597c0 0x7ff7fc0c7170 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.371+0000 7ff8022d6640 1 --2- 172.21.15.19:0/3983102944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7fc0c8cb0 0x7ff7fc0c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.371+0000 7ff8022d6640 1 -- 172.21.15.19:0/3983102944 >> 172.21.15.19:0/3983102944 conn(0x7ff7fc06c190 msgr2=0x7ff7fc155090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.371+0000 7ff8022d6640 1 -- 172.21.15.19:0/3983102944 shutdown_connections 2023-11-20T06:41:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:51.371+0000 7ff8022d6640 1 -- 172.21.15.19:0/3983102944 wait complete. 2023-11-20T06:41:51.395 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-20T06:41:51.396 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-20T06:41:51.396 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2023-11-20T06:41:51.396 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-20T06:41:51.396 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-20T06:41:51.396 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-20T06:41:51.396 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-20T06:41:51.396 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-20T06:41:51.396 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-20T06:41:51.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:51.396 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2023-11-20T06:41:51.406 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-20T06:41:51.406 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-20T06:41:51.406 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2023-11-20T06:41:51.406 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:51.406 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2023-11-20T06:41:51.406 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:51.406 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T06:41:51.407 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:51.407 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2023-11-20T06:41:51.407 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T06:41:51.407 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:51.407 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2023-11-20T06:41:51.407 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-20T06:41:51.407 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:51.407 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2023-11-20T06:41:51.407 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-20T06:41:51.407 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42403sec preferred_lft 42403sec 2023-11-20T06:41:51.407 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2023-11-20T06:41:51.407 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:51.407 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T06:41:51.408 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:51.408 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2023-11-20T06:41:51.408 INFO:teuthology.orchestra.run.smithi019.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-20T06:41:51.408 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:42:42:0b:69:dd brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:51.408 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-20T06:41:51.408 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:51.408 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-20T06:41:51.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:51.408 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2023-11-20T06:41:51.408 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2023-11-20T06:41:51.408 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add name ceph-brx type bridge 2023-11-20T06:41:51.409 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr flush dev ceph-brx 2023-11-20T06:41:51.409 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set ceph-brx up 2023-11-20T06:41:51.409 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-20T06:41:51.409 DEBUG:teuthology.orchestra.run.smithi019:> ') 2023-11-20T06:41:51.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:51.518 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-20T06:41:51.538 INFO:teuthology.orchestra.run.smithi019.stdout:1 2023-11-20T06:41:51.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:51.540 DEBUG:teuthology.orchestra.run.smithi019:> route 2023-11-20T06:41:51.596 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2023-11-20T06:41:51.596 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-20T06:41:51.596 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-20T06:41:51.596 INFO:teuthology.orchestra.run.smithi019.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-20T06:41:51.596 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-20T06:41:51.596 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-20T06:41:51.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:51.597 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2023-11-20T06:41:51.597 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2023-11-20T06:41:51.597 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-20T06:41:51.597 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-20T06:41:51.597 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-20T06:41:51.597 DEBUG:teuthology.orchestra.run.smithi019:> ') 2023-11-20T06:41:51.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:51.691 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2023-11-20T06:41:51.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:51.700 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list-id 2023-11-20T06:41:51.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:51.751 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2023-11-20T06:41:51.752 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2023-11-20T06:41:51.752 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T06:41:51.752 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-20T06:41:51.752 DEBUG:teuthology.orchestra.run.smithi019:> ') 2023-11-20T06:41:51.834 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-20T06:41:51.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:51.835 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2023-11-20T06:41:51.835 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2023-11-20T06:41:51.835 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-20T06:41:51.835 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-20T06:41:51.835 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-20T06:41:51.835 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-20T06:41:51.835 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-20T06:41:51.835 DEBUG:teuthology.orchestra.run.smithi019:> ') 2023-11-20T06:41:51.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:51.980 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2023-11-20T06:41:51.980 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2023-11-20T06:41:51.980 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2023-11-20T06:41:51.981 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set dev brx.0 master ceph-brx 2023-11-20T06:41:51.981 DEBUG:teuthology.orchestra.run.smithi019:> ') 2023-11-20T06:41:52.022 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-20T06:41:52.022 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T06:41:52.022 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-20T06:41:52.075 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-20T06:41:52.075 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T06:41:52.075 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-20T06:41:52.130 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2023-11-20T06:41:52.192 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T06:41:52.248 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2023-11-20T06:41:52.248 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2023-11-20T06:41:52.249 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2023-11-20T06:41:52.249 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2023-11-20T06:41:52.249 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2023-11-20T06:41:52.249 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2023-11-20T06:41:52.249 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2023-11-20T06:41:52.249 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2023-11-20T06:41:52.249 INFO:teuthology.orchestra.run.smithi019.stdout:/run/lock 2023-11-20T06:41:52.250 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2023-11-20T06:41:52.250 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2023-11-20T06:41:52.250 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2023-11-20T06:41:52.250 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T06:41:52.250 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2023-11-20T06:41:52.250 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2023-11-20T06:41:52.251 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2023-11-20T06:41:52.251 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2023-11-20T06:41:52.251 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/fs/nfsd 2023-11-20T06:41:52.251 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2023-11-20T06:41:52.251 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2023-11-20T06:41:52.251 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T06:41:52.251 INFO:teuthology.orchestra.run.smithi019.stdout:/run/rpc_pipefs 2023-11-20T06:41:52.251 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2023-11-20T06:41:52.252 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2023-11-20T06:41:52.252 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2023-11-20T06:41:52.252 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2023-11-20T06:41:52.252 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2023-11-20T06:41:52.252 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2023-11-20T06:41:52.252 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2023-11-20T06:41:52.252 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T06:41:52.253 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T06:41:52.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:52.254 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2023-11-20T06:41:52.302 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-20T06:41:52.303 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-20T06:41:52.349 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2023-11-20T06:41:52.371 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T06:41:52.424 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2023-11-20T06:41:52.424 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2023-11-20T06:41:52.425 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2023-11-20T06:41:52.425 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2023-11-20T06:41:52.425 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2023-11-20T06:41:52.425 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2023-11-20T06:41:52.425 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2023-11-20T06:41:52.425 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2023-11-20T06:41:52.425 INFO:teuthology.orchestra.run.smithi019.stdout:/run/lock 2023-11-20T06:41:52.425 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2023-11-20T06:41:52.425 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2023-11-20T06:41:52.425 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2023-11-20T06:41:52.425 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T06:41:52.425 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2023-11-20T06:41:52.426 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2023-11-20T06:41:52.426 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2023-11-20T06:41:52.426 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2023-11-20T06:41:52.426 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/fs/nfsd 2023-11-20T06:41:52.426 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2023-11-20T06:41:52.426 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2023-11-20T06:41:52.426 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T06:41:52.426 INFO:teuthology.orchestra.run.smithi019.stdout:/run/rpc_pipefs 2023-11-20T06:41:52.426 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2023-11-20T06:41:52.426 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2023-11-20T06:41:52.426 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2023-11-20T06:41:52.426 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2023-11-20T06:41:52.426 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2023-11-20T06:41:52.427 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2023-11-20T06:41:52.427 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2023-11-20T06:41:52.427 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T06:41:52.427 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T06:41:52.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:52.428 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2023-11-20T06:41:52.448 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:2023-11-20T06:41:52.443+0000 7f1048833580 -1 init, newargv = 0x55dab7673ca0 newargc=15 2023-11-20T06:41:52.449 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[45981]: starting ceph client 2023-11-20T06:41:52.456 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[45981]: starting fuse 2023-11-20T06:41:52.458 INFO:teuthology.orchestra.run.smithi019.stdout:43 2023-11-20T06:41:52.458 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-20T06:41:52.458 DEBUG:teuthology.orchestra.run.smithi019:> sudo stdin-killer -- python3 -c ' 2023-11-20T06:41:52.458 DEBUG:teuthology.orchestra.run.smithi019:> import glob 2023-11-20T06:41:52.458 DEBUG:teuthology.orchestra.run.smithi019:> import re 2023-11-20T06:41:52.458 DEBUG:teuthology.orchestra.run.smithi019:> import os 2023-11-20T06:41:52.459 DEBUG:teuthology.orchestra.run.smithi019:> import subprocess 2023-11-20T06:41:52.459 DEBUG:teuthology.orchestra.run.smithi019:> 2023-11-20T06:41:52.459 DEBUG:teuthology.orchestra.run.smithi019:> def _find_admin_socket(client_name): 2023-11-20T06:41:52.459 DEBUG:teuthology.orchestra.run.smithi019:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-20T06:41:52.459 DEBUG:teuthology.orchestra.run.smithi019:> files = glob.glob(asok_path) 2023-11-20T06:41:52.459 DEBUG:teuthology.orchestra.run.smithi019:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-20T06:41:52.459 DEBUG:teuthology.orchestra.run.smithi019:> 2023-11-20T06:41:52.459 DEBUG:teuthology.orchestra.run.smithi019:> # Given a non-glob path, it better be there 2023-11-20T06:41:52.459 DEBUG:teuthology.orchestra.run.smithi019:> if "*" not in asok_path: 2023-11-20T06:41:52.459 DEBUG:teuthology.orchestra.run.smithi019:> assert(len(files) == 1) 2023-11-20T06:41:52.459 DEBUG:teuthology.orchestra.run.smithi019:> return files[0] 2023-11-20T06:41:52.459 DEBUG:teuthology.orchestra.run.smithi019:> 2023-11-20T06:41:52.459 DEBUG:teuthology.orchestra.run.smithi019:> for f in files: 2023-11-20T06:41:52.460 DEBUG:teuthology.orchestra.run.smithi019:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-20T06:41:52.460 DEBUG:teuthology.orchestra.run.smithi019:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-20T06:41:52.460 DEBUG:teuthology.orchestra.run.smithi019:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-20T06:41:52.460 DEBUG:teuthology.orchestra.run.smithi019:> contents = proc_f.read() 2023-11-20T06:41:52.460 DEBUG:teuthology.orchestra.run.smithi019:> if mountpoint in contents: 2023-11-20T06:41:52.460 DEBUG:teuthology.orchestra.run.smithi019:> return f 2023-11-20T06:41:52.460 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-20T06:41:52.460 DEBUG:teuthology.orchestra.run.smithi019:> 2023-11-20T06:41:52.460 DEBUG:teuthology.orchestra.run.smithi019:> print(_find_admin_socket("client.0")) 2023-11-20T06:41:52.460 DEBUG:teuthology.orchestra.run.smithi019:> ' 2023-11-20T06:41:52.582 INFO:teuthology.orchestra.run.smithi019.stdout:/var/run/ceph/ceph-client.0.45981.asok 2023-11-20T06:41:52.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-20T06:41:52.594 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45981.asok 2023-11-20T06:41:52.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:52.594 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45981.asok status 2023-11-20T06:41:52.767 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-20T06:41:52.768 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": { 2023-11-20T06:41:52.768 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-20T06:41:52.768 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-20T06:41:52.768 INFO:teuthology.orchestra.run.smithi019.stdout: "entity_id": "0", 2023-11-20T06:41:52.769 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": "smithi019", 2023-11-20T06:41:52.769 INFO:teuthology.orchestra.run.smithi019.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-20T06:41:52.769 INFO:teuthology.orchestra.run.smithi019.stdout: "pid": "45981", 2023-11-20T06:41:52.769 INFO:teuthology.orchestra.run.smithi019.stdout: "root": "/" 2023-11-20T06:41:52.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:41:52.769 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_count": 0, 2023-11-20T06:41:52.769 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_pinned_count": 0, 2023-11-20T06:41:52.769 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4836, 2023-11-20T06:41:52.769 INFO:teuthology.orchestra.run.smithi019.stdout: "inst": { 2023-11-20T06:41:52.769 INFO:teuthology.orchestra.run.smithi019.stdout: "name": { 2023-11-20T06:41:52.769 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "client", 2023-11-20T06:41:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: "num": 4836 2023-11-20T06:41:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:41:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2023-11-20T06:41:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-11-20T06:41:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2023-11-20T06:41:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 362431579 2023-11-20T06:41:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:41:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:41:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2023-11-20T06:41:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-11-20T06:41:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2023-11-20T06:41:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 362431579 2023-11-20T06:41:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:41:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: "inst_str": "client.4836 192.168.0.1:0/362431579", 2023-11-20T06:41:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: "addr_str": "192.168.0.1:0/362431579", 2023-11-20T06:41:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: "inode_count": 1, 2023-11-20T06:41:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_epoch": 9, 2023-11-20T06:41:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch": 25, 2023-11-20T06:41:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch_barrier": 0, 2023-11-20T06:41:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklisted": false, 2023-11-20T06:41:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs" 2023-11-20T06:41:52.771 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-20T06:41:52.782 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-20T06:41:52.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.919+0000 7f99fa5d3640 1 Processor -- start 2023-11-20T06:41:52.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.919+0000 7f99fa5d3640 1 -- start start 2023-11-20T06:41:52.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.919+0000 7f99fa5d3640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f99f415ca70 0x7f99f40d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:52.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.919+0000 7f99fa5d3640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f40c65f0 con 0x7f99f40d3550 2023-11-20T06:41:52.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.919+0000 7f99fa5d3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f40cdf80 con 0x7f99f40cf7a0 2023-11-20T06:41:52.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.919+0000 7f99fa5d3640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f40ce820 con 0x7f99f415ca70 2023-11-20T06:41:52.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.919+0000 7f99f37fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f99f40d3550 0x7f99f40cf090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45094/0 (socket says 172.21.15.19:45094) 2023-11-20T06:41:52.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.919+0000 7f99f37fe640 1 -- 172.21.15.19:0/2047900632 learned_addr learned my addr 172.21.15.19:0/2047900632 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:52.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.919+0000 7f99f3fff640 1 --2- 172.21.15.19:0/2047900632 >> v2:172.21.15.190:3300/0 conn(0x7f99f415ca70 0x7f99f40d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:52.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.923+0000 7f99f2ffd640 1 -- 172.21.15.19:0/2047900632 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725738372 0 0) 0x7f99f40c65f0 con 0x7f99f40d3550 2023-11-20T06:41:52.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.923+0000 7f99f2ffd640 1 -- 172.21.15.19:0/2047900632 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99dc003530 con 0x7f99f40d3550 2023-11-20T06:41:52.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.923+0000 7f99f2ffd640 1 -- 172.21.15.19:0/2047900632 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968387985 0 0) 0x7f99f40cdf80 con 0x7f99f40cf7a0 2023-11-20T06:41:52.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.923+0000 7f99f2ffd640 1 -- 172.21.15.19:0/2047900632 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f40c65f0 con 0x7f99f40cf7a0 2023-11-20T06:41:52.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.923+0000 7f99f3fff640 1 -- 172.21.15.19:0/2047900632 >> v1:172.21.15.190:6789/0 conn(0x7f99f40cf7a0 legacy=0x7f99f40c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:52.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.923+0000 7f99f3fff640 1 -- 172.21.15.19:0/2047900632 >> v1:172.21.15.19:6789/0 conn(0x7f99f40d3550 legacy=0x7f99f40cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:52.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.923+0000 7f99f3fff640 1 -- 172.21.15.19:0/2047900632 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f40ce260 con 0x7f99f415ca70 2023-11-20T06:41:52.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.923+0000 7f99f3fff640 1 --2- 172.21.15.19:0/2047900632 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99f415ca70 0x7f99f40d3010 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f99e40097a0 tx=0x7f99e401c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eec7272e6ea1e601 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:52.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.923+0000 7f99f2ffd640 1 -- 172.21.15.19:0/2047900632 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e40a8050 con 0x7f99f415ca70 2023-11-20T06:41:52.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.923+0000 7f99f2ffd640 1 -- 172.21.15.19:0/2047900632 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e40ac5f0 con 0x7f99f415ca70 2023-11-20T06:41:52.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.923+0000 7f99f2ffd640 1 -- 172.21.15.19:0/2047900632 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e40ac980 con 0x7f99f415ca70 2023-11-20T06:41:52.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.927+0000 7f99fa5d3640 1 -- 172.21.15.19:0/2047900632 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99f415ca70 msgr2=0x7f99f40d3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:52.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.927+0000 7f99fa5d3640 1 --2- 172.21.15.19:0/2047900632 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99f415ca70 0x7f99f40d3010 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f99e40097a0 tx=0x7f99e401c430 comp rx=0 tx=0).stop 2023-11-20T06:41:52.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.927+0000 7f99fa5d3640 1 -- 172.21.15.19:0/2047900632 shutdown_connections 2023-11-20T06:41:52.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.927+0000 7f99fa5d3640 1 --2- 172.21.15.19:0/2047900632 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99f415ca70 0x7f99f40d3010 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:52.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.927+0000 7f99fa5d3640 1 -- 172.21.15.19:0/2047900632 >> 172.21.15.19:0/2047900632 conn(0x7f99f409bc50 msgr2=0x7f99f40d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:52.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.927+0000 7f99fa5d3640 1 -- 172.21.15.19:0/2047900632 shutdown_connections 2023-11-20T06:41:52.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.927+0000 7f99fa5d3640 1 -- 172.21.15.19:0/2047900632 wait complete. 2023-11-20T06:41:52.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.927+0000 7f99fa5d3640 1 Processor -- start 2023-11-20T06:41:52.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.927+0000 7f99fa5d3640 1 -- start start 2023-11-20T06:41:52.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.927+0000 7f99fa5d3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99f40cf7a0 0x7f99f41562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:52.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.927+0000 7f99fa5d3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99f40d3550 0x7f99f40b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:52.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.927+0000 7f99fa5d3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99f415ca70 0x7f99f40b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:52.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.927+0000 7f99fa5d3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f4158730 con 0x7f99f40d3550 2023-11-20T06:41:52.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.927+0000 7f99fa5d3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f40cbf50 con 0x7f99f415ca70 2023-11-20T06:41:52.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.927+0000 7f99fa5d3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f4158980 con 0x7f99f40cf7a0 2023-11-20T06:41:52.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.927+0000 7f99f37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99f40d3550 0x7f99f40b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:52.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.927+0000 7f99f37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99f40d3550 0x7f99f40b66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36340/0 (socket says 172.21.15.19:36340) 2023-11-20T06:41:52.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.927+0000 7f99f37fe640 1 -- 172.21.15.19:0/2166106556 learned_addr learned my addr 172.21.15.19:0/2166106556 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:52.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.931+0000 7f99f3fff640 1 --2- 172.21.15.19:0/2166106556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99f40cf7a0 0x7f99f41562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:52.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.931+0000 7f99f8b70640 1 --2- 172.21.15.19:0/2166106556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99f415ca70 0x7f99f40b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:52.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.931+0000 7f99f37fe640 1 -- 172.21.15.19:0/2166106556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99f40cf7a0 msgr2=0x7f99f41562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:52.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.931+0000 7f99f37fe640 1 --2- 172.21.15.19:0/2166106556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99f40cf7a0 0x7f99f41562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:52.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.931+0000 7f99f37fe640 1 -- 172.21.15.19:0/2166106556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99f415ca70 msgr2=0x7f99f40b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:52.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.931+0000 7f99f37fe640 1 --2- 172.21.15.19:0/2166106556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99f415ca70 0x7f99f40b6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:52.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.931+0000 7f99f37fe640 1 -- 172.21.15.19:0/2166106556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e40093b0 con 0x7f99f40d3550 2023-11-20T06:41:52.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.931+0000 7f99f3fff640 1 --2- 172.21.15.19:0/2166106556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99f40cf7a0 0x7f99f41562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:52.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.931+0000 7f99f8b70640 1 --2- 172.21.15.19:0/2166106556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99f415ca70 0x7f99f40b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:41:52.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.931+0000 7f99f37fe640 1 --2- 172.21.15.19:0/2166106556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99f40d3550 0x7f99f40b66a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f99e800c4d0 tx=0x7f99e800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:52.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.931+0000 7f99f0ff9640 1 -- 172.21.15.19:0/2166106556 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e8005cf0 con 0x7f99f40d3550 2023-11-20T06:41:52.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.931+0000 7f99f0ff9640 1 -- 172.21.15.19:0/2166106556 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e8005e50 con 0x7f99f40d3550 2023-11-20T06:41:52.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.931+0000 7f99f0ff9640 1 -- 172.21.15.19:0/2166106556 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e80072b0 con 0x7f99f40d3550 2023-11-20T06:41:52.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.931+0000 7f99fa5d3640 1 -- 172.21.15.19:0/2166106556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f4158c60 con 0x7f99f40d3550 2023-11-20T06:41:52.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.931+0000 7f99fa5d3640 1 -- 172.21.15.19:0/2166106556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f4157030 con 0x7f99f40d3550 2023-11-20T06:41:52.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.931+0000 7f99fa5d3640 1 -- 172.21.15.19:0/2166106556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f4074010 con 0x7f99f40d3550 2023-11-20T06:41:52.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.931+0000 7f99f0ff9640 1 -- 172.21.15.19:0/2166106556 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f99e8007410 con 0x7f99f40d3550 2023-11-20T06:41:52.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.931+0000 7f99f0ff9640 1 --2- 172.21.15.19:0/2166106556 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f99e00664a0 0x7f99e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:52.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.931+0000 7f99f0ff9640 1 -- 172.21.15.19:0/2166106556 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f99e8083700 con 0x7f99f40d3550 2023-11-20T06:41:52.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.935+0000 7f99f3fff640 1 --2- 172.21.15.19:0/2166106556 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f99e00664a0 0x7f99e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:52.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.935+0000 7f99f3fff640 1 --2- 172.21.15.19:0/2166106556 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f99e00664a0 0x7f99e0068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f99e40ae000 tx=0x7f99e4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:52.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:52.935+0000 7f99f0ff9640 1 -- 172.21.15.19:0/2166106556 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f99e8050920 con 0x7f99f40d3550 2023-11-20T06:41:53.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:53.127+0000 7f99fa5d3640 1 -- 172.21.15.19:0/2166106556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f99f4157370 con 0x7f99f40d3550 2023-11-20T06:41:53.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:53.127+0000 7f99f0ff9640 1 -- 172.21.15.19:0/2166106556 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f99e8017070 con 0x7f99f40d3550 2023-11-20T06:41:53.133 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-20T06:41:53.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:53.131+0000 7f99fa5d3640 1 -- 172.21.15.19:0/2166106556 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f99e00664a0 msgr2=0x7f99e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:53.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:53.131+0000 7f99fa5d3640 1 --2- 172.21.15.19:0/2166106556 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f99e00664a0 0x7f99e0068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f99e40ae000 tx=0x7f99e4008040 comp rx=0 tx=0).stop 2023-11-20T06:41:53.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:53.131+0000 7f99fa5d3640 1 -- 172.21.15.19:0/2166106556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99f40d3550 msgr2=0x7f99f40b66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:53.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:53.131+0000 7f99fa5d3640 1 --2- 172.21.15.19:0/2166106556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99f40d3550 0x7f99f40b66a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f99e800c4d0 tx=0x7f99e800c990 comp rx=0 tx=0).stop 2023-11-20T06:41:53.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:53.131+0000 7f99fa5d3640 1 -- 172.21.15.19:0/2166106556 shutdown_connections 2023-11-20T06:41:53.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:53.131+0000 7f99fa5d3640 1 --2- 172.21.15.19:0/2166106556 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f99e00664a0 0x7f99e0068960 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:53.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:53.131+0000 7f99fa5d3640 1 --2- 172.21.15.19:0/2166106556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99f415ca70 0x7f99f40b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:53.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:53.131+0000 7f99fa5d3640 1 --2- 172.21.15.19:0/2166106556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99f40d3550 0x7f99f40b66a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:53.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:53.131+0000 7f99fa5d3640 1 --2- 172.21.15.19:0/2166106556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99f40cf7a0 0x7f99f41562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:53.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:53.131+0000 7f99fa5d3640 1 -- 172.21.15.19:0/2166106556 >> 172.21.15.19:0/2166106556 conn(0x7f99f409bc50 msgr2=0x7f99f406b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:53.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:53.131+0000 7f99fa5d3640 1 -- 172.21.15.19:0/2166106556 shutdown_connections 2023-11-20T06:41:53.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:53.131+0000 7f99fa5d3640 1 -- 172.21.15.19:0/2166106556 wait complete. 2023-11-20T06:41:53.154 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-20T06:41:53.154 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-20T06:41:53.155 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2023-11-20T06:41:53.155 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-20T06:41:53.155 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-20T06:41:53.155 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-20T06:41:53.155 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-20T06:41:53.155 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-20T06:41:53.155 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-20T06:41:53.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:53.155 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2023-11-20T06:41:53.165 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-20T06:41:53.165 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-20T06:41:53.165 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2023-11-20T06:41:53.165 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:53.166 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2023-11-20T06:41:53.166 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:53.166 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T06:41:53.166 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:53.166 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2023-11-20T06:41:53.166 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T06:41:53.166 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:53.166 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2023-11-20T06:41:53.166 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-20T06:41:53.166 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:53.166 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2023-11-20T06:41:53.166 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-20T06:41:53.167 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42402sec preferred_lft 42402sec 2023-11-20T06:41:53.167 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2023-11-20T06:41:53.167 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:53.167 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T06:41:53.167 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:53.167 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2023-11-20T06:41:53.167 INFO:teuthology.orchestra.run.smithi019.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-20T06:41:53.167 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:42:42:0b:69:dd brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:53.167 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-20T06:41:53.167 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:53.167 INFO:teuthology.orchestra.run.smithi019.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-20T06:41:53.167 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:53.167 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-20T06:41:53.168 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:53.168 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-11-20T06:41:53.168 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:53.168 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-20T06:41:53.168 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T06:41:53.168 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-11-20T06:41:53.168 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:53.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:53.168 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-20T06:41:53.226 INFO:teuthology.orchestra.run.smithi019.stdout:1 2023-11-20T06:41:53.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:53.229 DEBUG:teuthology.orchestra.run.smithi019:> route 2023-11-20T06:41:53.280 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2023-11-20T06:41:53.280 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-20T06:41:53.280 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-20T06:41:53.280 INFO:teuthology.orchestra.run.smithi019.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-20T06:41:53.281 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-20T06:41:53.281 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-20T06:41:53.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:53.281 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2023-11-20T06:41:53.281 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2023-11-20T06:41:53.281 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-20T06:41:53.281 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-20T06:41:53.281 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-20T06:41:53.281 DEBUG:teuthology.orchestra.run.smithi019:> ') 2023-11-20T06:41:53.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:53.375 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2023-11-20T06:41:53.384 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-20T06:41:53.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:53.385 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list-id 2023-11-20T06:41:53.435 INFO:teuthology.orchestra.run.smithi019.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-20T06:41:53.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:53.435 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2023-11-20T06:41:53.435 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2023-11-20T06:41:53.436 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T06:41:53.436 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-20T06:41:53.436 DEBUG:teuthology.orchestra.run.smithi019:> ') 2023-11-20T06:41:53.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:53.519 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-20T06:41:53.584 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-20T06:41:53.584 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-20T06:41:53.584 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2023-11-20T06:41:53.584 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:53.584 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2023-11-20T06:41:53.584 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:53.584 INFO:teuthology.orchestra.run.smithi019.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-20T06:41:53.584 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether e6:60:af:87:96:5f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-20T06:41:53.584 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-20T06:41:53.584 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:53.584 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::e460:afff:fe87:965f/64 scope link 2023-11-20T06:41:53.585 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:53.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:53.586 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-20T06:41:53.652 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-20T06:41:53.652 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-20T06:41:53.652 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2023-11-20T06:41:53.652 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:53.652 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2023-11-20T06:41:53.652 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:53.652 INFO:teuthology.orchestra.run.smithi019.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-20T06:41:53.652 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether e6:60:af:87:96:5f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-20T06:41:53.652 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-20T06:41:53.652 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:53.653 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::e460:afff:fe87:965f/64 scope link 2023-11-20T06:41:53.653 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:53.654 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-20T06:41:53.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:53.654 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2023-11-20T06:41:53.654 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2023-11-20T06:41:53.654 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-20T06:41:53.654 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-20T06:41:53.654 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-20T06:41:53.654 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-20T06:41:53.654 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-20T06:41:53.655 DEBUG:teuthology.orchestra.run.smithi019:> ') 2023-11-20T06:41:53.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:53.797 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2023-11-20T06:41:53.797 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2023-11-20T06:41:53.797 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.1 up 2023-11-20T06:41:53.797 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set dev brx.1 master ceph-brx 2023-11-20T06:41:53.797 DEBUG:teuthology.orchestra.run.smithi019:> ') 2023-11-20T06:41:53.838 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-20T06:41:53.838 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T06:41:53.839 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-20T06:41:53.891 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-20T06:41:53.891 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T06:41:53.891 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-20T06:41:53.942 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2023-11-20T06:41:54.008 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T06:41:54.060 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2023-11-20T06:41:54.061 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2023-11-20T06:41:54.061 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2023-11-20T06:41:54.061 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2023-11-20T06:41:54.061 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2023-11-20T06:41:54.061 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2023-11-20T06:41:54.061 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2023-11-20T06:41:54.061 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2023-11-20T06:41:54.061 INFO:teuthology.orchestra.run.smithi019.stdout:/run/lock 2023-11-20T06:41:54.061 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2023-11-20T06:41:54.061 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2023-11-20T06:41:54.061 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2023-11-20T06:41:54.061 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T06:41:54.061 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2023-11-20T06:41:54.062 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2023-11-20T06:41:54.062 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2023-11-20T06:41:54.062 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2023-11-20T06:41:54.062 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/fs/nfsd 2023-11-20T06:41:54.062 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2023-11-20T06:41:54.062 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2023-11-20T06:41:54.062 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T06:41:54.062 INFO:teuthology.orchestra.run.smithi019.stdout:/run/rpc_pipefs 2023-11-20T06:41:54.062 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2023-11-20T06:41:54.062 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2023-11-20T06:41:54.062 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2023-11-20T06:41:54.063 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2023-11-20T06:41:54.063 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2023-11-20T06:41:54.063 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2023-11-20T06:41:54.063 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2023-11-20T06:41:54.063 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T06:41:54.063 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T06:41:54.063 INFO:teuthology.orchestra.run.smithi019.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-20T06:41:54.063 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T06:41:54.063 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T06:41:54.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:54.064 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2023-11-20T06:41:54.115 INFO:teuthology.orchestra.run.smithi019.stdout:43 2023-11-20T06:41:54.115 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-11-20T06:41:54.115 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-20T06:41:54.165 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2023-11-20T06:41:54.187 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T06:41:54.240 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2023-11-20T06:41:54.240 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2023-11-20T06:41:54.241 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2023-11-20T06:41:54.241 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2023-11-20T06:41:54.241 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2023-11-20T06:41:54.241 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2023-11-20T06:41:54.241 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2023-11-20T06:41:54.241 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2023-11-20T06:41:54.241 INFO:teuthology.orchestra.run.smithi019.stdout:/run/lock 2023-11-20T06:41:54.241 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2023-11-20T06:41:54.241 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2023-11-20T06:41:54.241 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2023-11-20T06:41:54.241 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T06:41:54.241 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2023-11-20T06:41:54.242 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2023-11-20T06:41:54.242 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2023-11-20T06:41:54.242 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2023-11-20T06:41:54.242 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/fs/nfsd 2023-11-20T06:41:54.242 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2023-11-20T06:41:54.242 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2023-11-20T06:41:54.242 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T06:41:54.242 INFO:teuthology.orchestra.run.smithi019.stdout:/run/rpc_pipefs 2023-11-20T06:41:54.242 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2023-11-20T06:41:54.242 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2023-11-20T06:41:54.242 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2023-11-20T06:41:54.242 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2023-11-20T06:41:54.243 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2023-11-20T06:41:54.243 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2023-11-20T06:41:54.243 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2023-11-20T06:41:54.243 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T06:41:54.243 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T06:41:54.243 INFO:teuthology.orchestra.run.smithi019.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-20T06:41:54.243 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T06:41:54.243 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T06:41:54.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:54.244 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2023-11-20T06:41:54.265 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi019.stderr:2023-11-20T06:41:54.259+0000 7f56bf24a580 -1 init, newargv = 0x55ccbfc21bf0 newargc=15 2023-11-20T06:41:54.265 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi019.stderr:ceph-fuse[46116]: starting ceph client 2023-11-20T06:41:54.273 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi019.stderr:ceph-fuse[46116]: starting fuse 2023-11-20T06:41:54.275 INFO:teuthology.orchestra.run.smithi019.stdout:43 2023-11-20T06:41:54.275 INFO:teuthology.orchestra.run.smithi019.stdout:44 2023-11-20T06:41:54.276 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-11-20T06:41:54.276 DEBUG:teuthology.orchestra.run.smithi019:> sudo stdin-killer -- python3 -c ' 2023-11-20T06:41:54.276 DEBUG:teuthology.orchestra.run.smithi019:> import glob 2023-11-20T06:41:54.276 DEBUG:teuthology.orchestra.run.smithi019:> import re 2023-11-20T06:41:54.276 DEBUG:teuthology.orchestra.run.smithi019:> import os 2023-11-20T06:41:54.276 DEBUG:teuthology.orchestra.run.smithi019:> import subprocess 2023-11-20T06:41:54.276 DEBUG:teuthology.orchestra.run.smithi019:> 2023-11-20T06:41:54.276 DEBUG:teuthology.orchestra.run.smithi019:> def _find_admin_socket(client_name): 2023-11-20T06:41:54.276 DEBUG:teuthology.orchestra.run.smithi019:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-20T06:41:54.276 DEBUG:teuthology.orchestra.run.smithi019:> files = glob.glob(asok_path) 2023-11-20T06:41:54.277 DEBUG:teuthology.orchestra.run.smithi019:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-20T06:41:54.277 DEBUG:teuthology.orchestra.run.smithi019:> 2023-11-20T06:41:54.277 DEBUG:teuthology.orchestra.run.smithi019:> # Given a non-glob path, it better be there 2023-11-20T06:41:54.277 DEBUG:teuthology.orchestra.run.smithi019:> if "*" not in asok_path: 2023-11-20T06:41:54.277 DEBUG:teuthology.orchestra.run.smithi019:> assert(len(files) == 1) 2023-11-20T06:41:54.277 DEBUG:teuthology.orchestra.run.smithi019:> return files[0] 2023-11-20T06:41:54.277 DEBUG:teuthology.orchestra.run.smithi019:> 2023-11-20T06:41:54.277 DEBUG:teuthology.orchestra.run.smithi019:> for f in files: 2023-11-20T06:41:54.277 DEBUG:teuthology.orchestra.run.smithi019:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-20T06:41:54.277 DEBUG:teuthology.orchestra.run.smithi019:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-20T06:41:54.277 DEBUG:teuthology.orchestra.run.smithi019:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-20T06:41:54.277 DEBUG:teuthology.orchestra.run.smithi019:> contents = proc_f.read() 2023-11-20T06:41:54.277 DEBUG:teuthology.orchestra.run.smithi019:> if mountpoint in contents: 2023-11-20T06:41:54.278 DEBUG:teuthology.orchestra.run.smithi019:> return f 2023-11-20T06:41:54.278 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-20T06:41:54.278 DEBUG:teuthology.orchestra.run.smithi019:> 2023-11-20T06:41:54.278 DEBUG:teuthology.orchestra.run.smithi019:> print(_find_admin_socket("client.2")) 2023-11-20T06:41:54.278 DEBUG:teuthology.orchestra.run.smithi019:> ' 2023-11-20T06:41:54.406 INFO:teuthology.orchestra.run.smithi019.stdout:/var/run/ceph/ceph-client.2.46116.asok 2023-11-20T06:41:54.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-20T06:41:54.417 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.46116.asok 2023-11-20T06:41:54.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:54.417 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.46116.asok status 2023-11-20T06:41:54.602 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-20T06:41:54.602 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": { 2023-11-20T06:41:54.602 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-20T06:41:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-20T06:41:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: "entity_id": "2", 2023-11-20T06:41:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": "smithi019", 2023-11-20T06:41:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-20T06:41:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: "pid": "46116", 2023-11-20T06:41:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: "root": "/" 2023-11-20T06:41:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:41:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_count": 0, 2023-11-20T06:41:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_pinned_count": 0, 2023-11-20T06:41:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4848, 2023-11-20T06:41:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: "inst": { 2023-11-20T06:41:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: "name": { 2023-11-20T06:41:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "client", 2023-11-20T06:41:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: "num": 4848 2023-11-20T06:41:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:41:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2023-11-20T06:41:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-11-20T06:41:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.2:0", 2023-11-20T06:41:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 909180006 2023-11-20T06:41:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:41:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:41:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2023-11-20T06:41:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-11-20T06:41:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.2:0", 2023-11-20T06:41:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 909180006 2023-11-20T06:41:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:41:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "inst_str": "client.4848 192.168.0.2:0/909180006", 2023-11-20T06:41:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "addr_str": "192.168.0.2:0/909180006", 2023-11-20T06:41:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "inode_count": 1, 2023-11-20T06:41:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_epoch": 9, 2023-11-20T06:41:54.606 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch": 25, 2023-11-20T06:41:54.606 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch_barrier": 0, 2023-11-20T06:41:54.606 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklisted": false, 2023-11-20T06:41:54.606 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs" 2023-11-20T06:41:54.606 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-20T06:41:54.617 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-20T06:41:54.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.755+0000 7f7662d9d640 1 Processor -- start 2023-11-20T06:41:54.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.755+0000 7f7662d9d640 1 -- start start 2023-11-20T06:41:54.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.755+0000 7f7662d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f765c15cb90 0x7f765c0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:54.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.755+0000 7f7662d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f765c0d15d0 0x7f765c0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:54.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.755+0000 7f7662d9d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765c0ce770 con 0x7f765c0d3010 2023-11-20T06:41:54.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.755+0000 7f7662d9d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765c0d0600 con 0x7f765c0d15d0 2023-11-20T06:41:54.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.755+0000 7f7662d9d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c0c6450 con 0x7f765c15cb90 2023-11-20T06:41:54.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.755+0000 7f766133a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f765c0d15d0 0x7f765c0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:54.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.755+0000 7f765bfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f765c0d3010 0x7f765c0d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45110/0 (socket says 172.21.15.19:45110) 2023-11-20T06:41:54.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.755+0000 7f765bfff640 1 -- 172.21.15.19:0/1234304157 learned_addr learned my addr 172.21.15.19:0/1234304157 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:54.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.755+0000 7f7660b39640 1 --2- 172.21.15.19:0/1234304157 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f765c15cb90 0x7f765c0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:54.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.755+0000 7f766133a640 1 -- 172.21.15.19:0/1234304157 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f765c15cb90 msgr2=0x7f765c0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:41:54.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.755+0000 7f766133a640 1 --2- 172.21.15.19:0/1234304157 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f765c15cb90 0x7f765c0cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:54.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.755+0000 7f766133a640 1 -- 172.21.15.19:0/1234304157 >> v1:172.21.15.19:6789/0 conn(0x7f765c0d3010 legacy=0x7f765c0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:54.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.755+0000 7f766133a640 1 -- 172.21.15.19:0/1234304157 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c0d08a0 con 0x7f765c0d15d0 2023-11-20T06:41:54.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.755+0000 7f7660b39640 1 --2- 172.21.15.19:0/1234304157 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f765c15cb90 0x7f765c0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:54.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.759+0000 7f766133a640 1 --2- 172.21.15.19:0/1234304157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f765c0d15d0 0x7f765c0c6c10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7654009d90 tx=0x7f765401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf333b511c49b61 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:54.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.759+0000 7f765b7fe640 1 -- 172.21.15.19:0/1234304157 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76540a5950 con 0x7f765c0d15d0 2023-11-20T06:41:54.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.759+0000 7f765b7fe640 1 -- 172.21.15.19:0/1234304157 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76540a5ab0 con 0x7f765c0d15d0 2023-11-20T06:41:54.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.759+0000 7f765b7fe640 1 -- 172.21.15.19:0/1234304157 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76540a5e40 con 0x7f765c0d15d0 2023-11-20T06:41:54.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.759+0000 7f7662d9d640 1 -- 172.21.15.19:0/1234304157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f765c0d15d0 msgr2=0x7f765c0c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:54.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.759+0000 7f7662d9d640 1 --2- 172.21.15.19:0/1234304157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f765c0d15d0 0x7f765c0c6c10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7654009d90 tx=0x7f765401c890 comp rx=0 tx=0).stop 2023-11-20T06:41:54.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.759+0000 7f7662d9d640 1 -- 172.21.15.19:0/1234304157 shutdown_connections 2023-11-20T06:41:54.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.759+0000 7f7662d9d640 1 --2- 172.21.15.19:0/1234304157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f765c0d15d0 0x7f765c0c6c10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:54.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.759+0000 7f7662d9d640 1 --2- 172.21.15.19:0/1234304157 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f765c15cb90 0x7f765c0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:54.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.759+0000 7f7662d9d640 1 -- 172.21.15.19:0/1234304157 >> 172.21.15.19:0/1234304157 conn(0x7f765c09bc50 msgr2=0x7f765c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:54.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.759+0000 7f7662d9d640 1 -- 172.21.15.19:0/1234304157 shutdown_connections 2023-11-20T06:41:54.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.759+0000 7f7662d9d640 1 -- 172.21.15.19:0/1234304157 wait complete. 2023-11-20T06:41:54.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f7662d9d640 1 Processor -- start 2023-11-20T06:41:54.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f7662d9d640 1 -- start start 2023-11-20T06:41:54.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f7662d9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f765c0d15d0 0x7f765c14f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:54.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f7662d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f765c0d3010 0x7f765c0d19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:54.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f7662d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f765c15cb90 0x7f765c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:54.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f7662d9d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c06c1c0 con 0x7f765c15cb90 2023-11-20T06:41:54.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f7662d9d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c15a470 con 0x7f765c0d15d0 2023-11-20T06:41:54.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f7662d9d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c0cc640 con 0x7f765c0d3010 2023-11-20T06:41:54.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f766133a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f765c15cb90 0x7f765c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:54.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f766133a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f765c15cb90 0x7f765c0d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36354/0 (socket says 172.21.15.19:36354) 2023-11-20T06:41:54.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f766133a640 1 -- 172.21.15.19:0/1557877489 learned_addr learned my addr 172.21.15.19:0/1557877489 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:54.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f765bfff640 1 --2- 172.21.15.19:0/1557877489 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f765c0d3010 0x7f765c0d19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:54.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f766133a640 1 -- 172.21.15.19:0/1557877489 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f765c0d3010 msgr2=0x7f765c0d19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:54.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f7660b39640 1 --2- 172.21.15.19:0/1557877489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f765c0d15d0 0x7f765c14f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:54.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f766133a640 1 --2- 172.21.15.19:0/1557877489 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f765c0d3010 0x7f765c0d19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:54.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f766133a640 1 -- 172.21.15.19:0/1557877489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f765c0d15d0 msgr2=0x7f765c14f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:54.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f766133a640 1 --2- 172.21.15.19:0/1557877489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f765c0d15d0 0x7f765c14f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:54.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f766133a640 1 -- 172.21.15.19:0/1557877489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7654009a70 con 0x7f765c15cb90 2023-11-20T06:41:54.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f765bfff640 1 --2- 172.21.15.19:0/1557877489 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f765c0d3010 0x7f765c0d19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:54.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f7660b39640 1 --2- 172.21.15.19:0/1557877489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f765c0d15d0 0x7f765c14f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:41:54.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f766133a640 1 --2- 172.21.15.19:0/1557877489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f765c15cb90 0x7f765c0d1ef0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f76540b0040 tx=0x7f7654019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:54.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f76597fa640 1 -- 172.21.15.19:0/1557877489 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76540ade40 con 0x7f765c15cb90 2023-11-20T06:41:54.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f76597fa640 1 -- 172.21.15.19:0/1557877489 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76540b9450 con 0x7f765c15cb90 2023-11-20T06:41:54.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f7662d9d640 1 -- 172.21.15.19:0/1557877489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765c0cc920 con 0x7f765c15cb90 2023-11-20T06:41:54.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f76597fa640 1 -- 172.21.15.19:0/1557877489 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76540b9800 con 0x7f765c15cb90 2023-11-20T06:41:54.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.763+0000 7f7662d9d640 1 -- 172.21.15.19:0/1557877489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765c15a100 con 0x7f765c15cb90 2023-11-20T06:41:54.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.767+0000 7f7662d9d640 1 -- 172.21.15.19:0/1557877489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f765c15a600 con 0x7f765c15cb90 2023-11-20T06:41:54.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.767+0000 7f76597fa640 1 -- 172.21.15.19:0/1557877489 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f76540b9960 con 0x7f765c15cb90 2023-11-20T06:41:54.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.767+0000 7f76597fa640 1 --2- 172.21.15.19:0/1557877489 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f76400664a0 0x7f7640068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:54.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.767+0000 7f76597fa640 1 -- 172.21.15.19:0/1557877489 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f765411fc20 con 0x7f765c15cb90 2023-11-20T06:41:54.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.767+0000 7f7660b39640 1 --2- 172.21.15.19:0/1557877489 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f76400664a0 0x7f7640068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:54.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.767+0000 7f7660b39640 1 --2- 172.21.15.19:0/1557877489 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f76400664a0 0x7f7640068960 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7650006fd0 tx=0x7f7650008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:54.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.771+0000 7f76597fa640 1 -- 172.21.15.19:0/1557877489 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f76540ecd90 con 0x7f765c15cb90 2023-11-20T06:41:54.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.963+0000 7f7662d9d640 1 -- 172.21.15.19:0/1557877489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f765c074010 con 0x7f765c15cb90 2023-11-20T06:41:54.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.963+0000 7f76597fa640 1 -- 172.21.15.19:0/1557877489 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f76540f03b0 con 0x7f765c15cb90 2023-11-20T06:41:54.969 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-20T06:41:54.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.963+0000 7f7662d9d640 1 -- 172.21.15.19:0/1557877489 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f76400664a0 msgr2=0x7f7640068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:54.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.963+0000 7f7662d9d640 1 --2- 172.21.15.19:0/1557877489 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f76400664a0 0x7f7640068960 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7650006fd0 tx=0x7f7650008040 comp rx=0 tx=0).stop 2023-11-20T06:41:54.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.963+0000 7f7662d9d640 1 -- 172.21.15.19:0/1557877489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f765c15cb90 msgr2=0x7f765c0d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:54.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.963+0000 7f7662d9d640 1 --2- 172.21.15.19:0/1557877489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f765c15cb90 0x7f765c0d1ef0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f76540b0040 tx=0x7f7654019630 comp rx=0 tx=0).stop 2023-11-20T06:41:54.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.963+0000 7f7662d9d640 1 -- 172.21.15.19:0/1557877489 shutdown_connections 2023-11-20T06:41:54.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.963+0000 7f7662d9d640 1 --2- 172.21.15.19:0/1557877489 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f76400664a0 0x7f7640068960 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:54.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.963+0000 7f7662d9d640 1 --2- 172.21.15.19:0/1557877489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f765c15cb90 0x7f765c0d1ef0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:54.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.963+0000 7f7662d9d640 1 --2- 172.21.15.19:0/1557877489 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f765c0d3010 0x7f765c0d19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:54.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.963+0000 7f7662d9d640 1 --2- 172.21.15.19:0/1557877489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f765c0d15d0 0x7f765c14f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:54.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.963+0000 7f7662d9d640 1 -- 172.21.15.19:0/1557877489 >> 172.21.15.19:0/1557877489 conn(0x7f765c09bc50 msgr2=0x7f765c06c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:54.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.963+0000 7f7662d9d640 1 -- 172.21.15.19:0/1557877489 shutdown_connections 2023-11-20T06:41:54.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:54.963+0000 7f7662d9d640 1 -- 172.21.15.19:0/1557877489 wait complete. 2023-11-20T06:41:54.989 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-20T06:41:54.989 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-20T06:41:54.989 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi190.front.sepia.ceph.com 2023-11-20T06:41:54.990 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-20T06:41:54.990 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-20T06:41:54.990 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-20T06:41:54.990 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-20T06:41:54.990 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-20T06:41:54.990 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-20T06:41:54.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:54.990 DEBUG:teuthology.orchestra.run.smithi190:> ip addr 2023-11-20T06:41:55.000 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-20T06:41:55.001 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-20T06:41:55.001 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2023-11-20T06:41:55.001 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:55.001 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2023-11-20T06:41:55.001 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:55.001 INFO:teuthology.orchestra.run.smithi190.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T06:41:55.001 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d0 brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:55.001 INFO:teuthology.orchestra.run.smithi190.stdout: altname enp7s0f0 2023-11-20T06:41:55.001 INFO:teuthology.orchestra.run.smithi190.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T06:41:55.001 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d1 brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:55.001 INFO:teuthology.orchestra.run.smithi190.stdout: altname enp7s0f1 2023-11-20T06:41:55.002 INFO:teuthology.orchestra.run.smithi190.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T06:41:55.002 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:62 brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:55.002 INFO:teuthology.orchestra.run.smithi190.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-20T06:41:55.002 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:63 brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:55.002 INFO:teuthology.orchestra.run.smithi190.stdout: inet 172.21.15.190/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-20T06:41:55.002 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft 42389sec preferred_lft 42389sec 2023-11-20T06:41:55.002 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::ec4:7aff:fe88:7763/64 scope link 2023-11-20T06:41:55.002 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:55.002 INFO:teuthology.orchestra.run.smithi190.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-20T06:41:55.002 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 02:42:f0:6a:30:10 brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:55.002 INFO:teuthology.orchestra.run.smithi190.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-20T06:41:55.002 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:55.003 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-20T06:41:55.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:55.004 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-11-20T06:41:55.004 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-11-20T06:41:55.004 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link add name ceph-brx type bridge 2023-11-20T06:41:55.004 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip addr flush dev ceph-brx 2023-11-20T06:41:55.004 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set ceph-brx up 2023-11-20T06:41:55.004 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-20T06:41:55.004 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-11-20T06:41:55.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:55.123 DEBUG:teuthology.orchestra.run.smithi190:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-20T06:41:55.143 INFO:teuthology.orchestra.run.smithi190.stdout:1 2023-11-20T06:41:55.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:55.145 DEBUG:teuthology.orchestra.run.smithi190:> route 2023-11-20T06:41:55.220 INFO:teuthology.orchestra.run.smithi190.stdout:Kernel IP routing table 2023-11-20T06:41:55.220 INFO:teuthology.orchestra.run.smithi190.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-20T06:41:55.220 INFO:teuthology.orchestra.run.smithi190.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-20T06:41:55.221 INFO:teuthology.orchestra.run.smithi190.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-20T06:41:55.221 INFO:teuthology.orchestra.run.smithi190.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-20T06:41:55.221 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-20T06:41:55.221 INFO:teuthology.orchestra.run.smithi190.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T06:41:55.221 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T06:41:55.221 INFO:teuthology.orchestra.run.smithi190.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T06:41:55.221 INFO:teuthology.orchestra.run.smithi190.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-20T06:41:55.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:55.221 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-11-20T06:41:55.221 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-11-20T06:41:55.222 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-20T06:41:55.222 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-20T06:41:55.222 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-20T06:41:55.222 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-11-20T06:41:55.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:55.314 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2023-11-20T06:41:55.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:55.324 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list-id 2023-11-20T06:41:55.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:55.376 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-11-20T06:41:55.376 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-11-20T06:41:55.376 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T06:41:55.376 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-20T06:41:55.376 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-11-20T06:41:55.460 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-20T06:41:55.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:55.460 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-11-20T06:41:55.460 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-11-20T06:41:55.460 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-20T06:41:55.460 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-20T06:41:55.460 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-20T06:41:55.460 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-20T06:41:55.461 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-20T06:41:55.461 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-11-20T06:41:55.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:55.624 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-11-20T06:41:55.624 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-11-20T06:41:55.624 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set brx.0 up 2023-11-20T06:41:55.625 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set dev brx.0 master ceph-brx 2023-11-20T06:41:55.625 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-11-20T06:41:55.666 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-20T06:41:55.666 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T06:41:55.666 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-20T06:41:55.719 INFO:teuthology.orchestra.run.smithi190.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-20T06:41:55.720 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T06:41:55.720 DEBUG:teuthology.orchestra.run.smithi190:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-20T06:41:55.775 DEBUG:teuthology.orchestra.run.smithi190:> sudo modprobe fuse 2023-11-20T06:41:55.836 DEBUG:teuthology.orchestra.run.smithi190:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T06:41:55.889 INFO:teuthology.orchestra.run.smithi190.stdout:/sys 2023-11-20T06:41:55.889 INFO:teuthology.orchestra.run.smithi190.stdout:/proc 2023-11-20T06:41:55.889 INFO:teuthology.orchestra.run.smithi190.stdout:/dev 2023-11-20T06:41:55.889 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/pts 2023-11-20T06:41:55.889 INFO:teuthology.orchestra.run.smithi190.stdout:/run 2023-11-20T06:41:55.890 INFO:teuthology.orchestra.run.smithi190.stdout:/ 2023-11-20T06:41:55.890 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/security 2023-11-20T06:41:55.890 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/shm 2023-11-20T06:41:55.890 INFO:teuthology.orchestra.run.smithi190.stdout:/run/lock 2023-11-20T06:41:55.890 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/cgroup 2023-11-20T06:41:55.890 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/pstore 2023-11-20T06:41:55.891 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/bpf 2023-11-20T06:41:55.891 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T06:41:55.891 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/hugepages 2023-11-20T06:41:55.891 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/mqueue 2023-11-20T06:41:55.891 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/debug 2023-11-20T06:41:55.891 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/tracing 2023-11-20T06:41:55.891 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/fs/nfsd 2023-11-20T06:41:55.891 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/fuse/connections 2023-11-20T06:41:55.891 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/config 2023-11-20T06:41:55.892 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T06:41:55.892 INFO:teuthology.orchestra.run.smithi190.stdout:/run/rpc_pipefs 2023-11-20T06:41:55.892 INFO:teuthology.orchestra.run.smithi190.stdout:/run/user/1000 2023-11-20T06:41:55.892 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph 2023-11-20T06:41:55.892 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-4 2023-11-20T06:41:55.892 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-5 2023-11-20T06:41:55.892 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-6 2023-11-20T06:41:55.892 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-7 2023-11-20T06:41:55.892 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns 2023-11-20T06:41:55.893 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T06:41:55.893 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T06:41:55.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:55.894 DEBUG:teuthology.orchestra.run.smithi190:> ls /sys/fs/fuse/connections 2023-11-20T06:41:55.943 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-20T06:41:55.943 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-20T06:41:55.990 DEBUG:teuthology.orchestra.run.smithi190:> sudo modprobe fuse 2023-11-20T06:41:56.011 DEBUG:teuthology.orchestra.run.smithi190:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T06:41:56.065 INFO:teuthology.orchestra.run.smithi190.stdout:/sys 2023-11-20T06:41:56.065 INFO:teuthology.orchestra.run.smithi190.stdout:/proc 2023-11-20T06:41:56.065 INFO:teuthology.orchestra.run.smithi190.stdout:/dev 2023-11-20T06:41:56.065 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/pts 2023-11-20T06:41:56.065 INFO:teuthology.orchestra.run.smithi190.stdout:/run 2023-11-20T06:41:56.066 INFO:teuthology.orchestra.run.smithi190.stdout:/ 2023-11-20T06:41:56.066 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/security 2023-11-20T06:41:56.066 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/shm 2023-11-20T06:41:56.066 INFO:teuthology.orchestra.run.smithi190.stdout:/run/lock 2023-11-20T06:41:56.066 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/cgroup 2023-11-20T06:41:56.066 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/pstore 2023-11-20T06:41:56.066 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/bpf 2023-11-20T06:41:56.066 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T06:41:56.066 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/hugepages 2023-11-20T06:41:56.066 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/mqueue 2023-11-20T06:41:56.066 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/debug 2023-11-20T06:41:56.066 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/tracing 2023-11-20T06:41:56.067 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/fs/nfsd 2023-11-20T06:41:56.067 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/fuse/connections 2023-11-20T06:41:56.067 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/config 2023-11-20T06:41:56.067 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T06:41:56.067 INFO:teuthology.orchestra.run.smithi190.stdout:/run/rpc_pipefs 2023-11-20T06:41:56.067 INFO:teuthology.orchestra.run.smithi190.stdout:/run/user/1000 2023-11-20T06:41:56.067 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph 2023-11-20T06:41:56.067 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-4 2023-11-20T06:41:56.067 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-5 2023-11-20T06:41:56.067 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-6 2023-11-20T06:41:56.067 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-7 2023-11-20T06:41:56.067 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns 2023-11-20T06:41:56.067 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T06:41:56.068 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T06:41:56.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:56.068 DEBUG:teuthology.orchestra.run.smithi190:> ls /sys/fs/fuse/connections 2023-11-20T06:41:56.094 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi190.stderr:2023-11-20T06:41:56.091+0000 7fbbc3f13580 -1 init, newargv = 0x557174fddd50 newargc=15 2023-11-20T06:41:56.094 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi190.stderr:ceph-fuse[44337]: starting ceph client 2023-11-20T06:41:56.103 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi190.stderr:ceph-fuse[44337]: starting fuse 2023-11-20T06:41:57.204 DEBUG:teuthology.orchestra.run.smithi190:> sudo modprobe fuse 2023-11-20T06:41:57.226 DEBUG:teuthology.orchestra.run.smithi190:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T06:41:57.277 INFO:teuthology.orchestra.run.smithi190.stdout:/sys 2023-11-20T06:41:57.277 INFO:teuthology.orchestra.run.smithi190.stdout:/proc 2023-11-20T06:41:57.277 INFO:teuthology.orchestra.run.smithi190.stdout:/dev 2023-11-20T06:41:57.277 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/pts 2023-11-20T06:41:57.277 INFO:teuthology.orchestra.run.smithi190.stdout:/run 2023-11-20T06:41:57.277 INFO:teuthology.orchestra.run.smithi190.stdout:/ 2023-11-20T06:41:57.277 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/security 2023-11-20T06:41:57.277 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/shm 2023-11-20T06:41:57.278 INFO:teuthology.orchestra.run.smithi190.stdout:/run/lock 2023-11-20T06:41:57.278 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/cgroup 2023-11-20T06:41:57.278 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/pstore 2023-11-20T06:41:57.278 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/bpf 2023-11-20T06:41:57.278 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T06:41:57.278 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/hugepages 2023-11-20T06:41:57.278 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/mqueue 2023-11-20T06:41:57.278 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/debug 2023-11-20T06:41:57.278 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/tracing 2023-11-20T06:41:57.278 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/fs/nfsd 2023-11-20T06:41:57.278 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/fuse/connections 2023-11-20T06:41:57.278 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/config 2023-11-20T06:41:57.278 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T06:41:57.279 INFO:teuthology.orchestra.run.smithi190.stdout:/run/rpc_pipefs 2023-11-20T06:41:57.279 INFO:teuthology.orchestra.run.smithi190.stdout:/run/user/1000 2023-11-20T06:41:57.279 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph 2023-11-20T06:41:57.279 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-4 2023-11-20T06:41:57.279 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-5 2023-11-20T06:41:57.279 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-6 2023-11-20T06:41:57.279 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-7 2023-11-20T06:41:57.279 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns 2023-11-20T06:41:57.279 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T06:41:57.279 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T06:41:57.279 INFO:teuthology.orchestra.run.smithi190.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-20T06:41:57.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:57.280 DEBUG:teuthology.orchestra.run.smithi190:> ls /sys/fs/fuse/connections 2023-11-20T06:41:57.331 INFO:teuthology.orchestra.run.smithi190.stdout:43 2023-11-20T06:41:57.332 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-20T06:41:57.332 DEBUG:teuthology.orchestra.run.smithi190:> sudo stdin-killer -- python3 -c ' 2023-11-20T06:41:57.332 DEBUG:teuthology.orchestra.run.smithi190:> import glob 2023-11-20T06:41:57.332 DEBUG:teuthology.orchestra.run.smithi190:> import re 2023-11-20T06:41:57.332 DEBUG:teuthology.orchestra.run.smithi190:> import os 2023-11-20T06:41:57.332 DEBUG:teuthology.orchestra.run.smithi190:> import subprocess 2023-11-20T06:41:57.332 DEBUG:teuthology.orchestra.run.smithi190:> 2023-11-20T06:41:57.332 DEBUG:teuthology.orchestra.run.smithi190:> def _find_admin_socket(client_name): 2023-11-20T06:41:57.332 DEBUG:teuthology.orchestra.run.smithi190:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-20T06:41:57.332 DEBUG:teuthology.orchestra.run.smithi190:> files = glob.glob(asok_path) 2023-11-20T06:41:57.333 DEBUG:teuthology.orchestra.run.smithi190:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-20T06:41:57.333 DEBUG:teuthology.orchestra.run.smithi190:> 2023-11-20T06:41:57.333 DEBUG:teuthology.orchestra.run.smithi190:> # Given a non-glob path, it better be there 2023-11-20T06:41:57.333 DEBUG:teuthology.orchestra.run.smithi190:> if "*" not in asok_path: 2023-11-20T06:41:57.333 DEBUG:teuthology.orchestra.run.smithi190:> assert(len(files) == 1) 2023-11-20T06:41:57.333 DEBUG:teuthology.orchestra.run.smithi190:> return files[0] 2023-11-20T06:41:57.333 DEBUG:teuthology.orchestra.run.smithi190:> 2023-11-20T06:41:57.333 DEBUG:teuthology.orchestra.run.smithi190:> for f in files: 2023-11-20T06:41:57.333 DEBUG:teuthology.orchestra.run.smithi190:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-20T06:41:57.333 DEBUG:teuthology.orchestra.run.smithi190:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-20T06:41:57.333 DEBUG:teuthology.orchestra.run.smithi190:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-20T06:41:57.333 DEBUG:teuthology.orchestra.run.smithi190:> contents = proc_f.read() 2023-11-20T06:41:57.333 DEBUG:teuthology.orchestra.run.smithi190:> if mountpoint in contents: 2023-11-20T06:41:57.333 DEBUG:teuthology.orchestra.run.smithi190:> return f 2023-11-20T06:41:57.334 DEBUG:teuthology.orchestra.run.smithi190:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-20T06:41:57.334 DEBUG:teuthology.orchestra.run.smithi190:> 2023-11-20T06:41:57.334 DEBUG:teuthology.orchestra.run.smithi190:> print(_find_admin_socket("client.1")) 2023-11-20T06:41:57.334 DEBUG:teuthology.orchestra.run.smithi190:> ' 2023-11-20T06:41:57.457 INFO:teuthology.orchestra.run.smithi190.stdout:/var/run/ceph/ceph-client.1.44337.asok 2023-11-20T06:41:57.459 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:41:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-20T06:41:57.467 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44337.asok 2023-11-20T06:41:57.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:57.467 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44337.asok status 2023-11-20T06:41:57.640 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2023-11-20T06:41:57.640 INFO:teuthology.orchestra.run.smithi190.stdout: "metadata": { 2023-11-20T06:41:57.640 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-20T06:41:57.640 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-20T06:41:57.640 INFO:teuthology.orchestra.run.smithi190.stdout: "entity_id": "1", 2023-11-20T06:41:57.640 INFO:teuthology.orchestra.run.smithi190.stdout: "hostname": "smithi190", 2023-11-20T06:41:57.640 INFO:teuthology.orchestra.run.smithi190.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-20T06:41:57.640 INFO:teuthology.orchestra.run.smithi190.stdout: "pid": "44337", 2023-11-20T06:41:57.640 INFO:teuthology.orchestra.run.smithi190.stdout: "root": "/" 2023-11-20T06:41:57.641 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-11-20T06:41:57.641 INFO:teuthology.orchestra.run.smithi190.stdout: "dentry_count": 0, 2023-11-20T06:41:57.641 INFO:teuthology.orchestra.run.smithi190.stdout: "dentry_pinned_count": 0, 2023-11-20T06:41:57.641 INFO:teuthology.orchestra.run.smithi190.stdout: "id": 4813, 2023-11-20T06:41:57.641 INFO:teuthology.orchestra.run.smithi190.stdout: "inst": { 2023-11-20T06:41:57.641 INFO:teuthology.orchestra.run.smithi190.stdout: "name": { 2023-11-20T06:41:57.641 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "client", 2023-11-20T06:41:57.641 INFO:teuthology.orchestra.run.smithi190.stdout: "num": 4813 2023-11-20T06:41:57.641 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-11-20T06:41:57.641 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": { 2023-11-20T06:41:57.641 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "v1", 2023-11-20T06:41:57.641 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": "192.168.0.1:0", 2023-11-20T06:41:57.642 INFO:teuthology.orchestra.run.smithi190.stdout: "nonce": 1178245538 2023-11-20T06:41:57.642 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-11-20T06:41:57.642 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-11-20T06:41:57.642 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": { 2023-11-20T06:41:57.642 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "v1", 2023-11-20T06:41:57.642 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": "192.168.0.1:0", 2023-11-20T06:41:57.642 INFO:teuthology.orchestra.run.smithi190.stdout: "nonce": 1178245538 2023-11-20T06:41:57.642 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-11-20T06:41:57.642 INFO:teuthology.orchestra.run.smithi190.stdout: "inst_str": "client.4813 192.168.0.1:0/1178245538", 2023-11-20T06:41:57.642 INFO:teuthology.orchestra.run.smithi190.stdout: "addr_str": "192.168.0.1:0/1178245538", 2023-11-20T06:41:57.642 INFO:teuthology.orchestra.run.smithi190.stdout: "inode_count": 1, 2023-11-20T06:41:57.642 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_epoch": 9, 2023-11-20T06:41:57.643 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_epoch": 27, 2023-11-20T06:41:57.643 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_epoch_barrier": 0, 2023-11-20T06:41:57.643 INFO:teuthology.orchestra.run.smithi190.stdout: "blocklisted": false, 2023-11-20T06:41:57.643 INFO:teuthology.orchestra.run.smithi190.stdout: "fs_name": "cephfs" 2023-11-20T06:41:57.643 INFO:teuthology.orchestra.run.smithi190.stdout:} 2023-11-20T06:41:57.655 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-20T06:41:57.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.803+0000 7f467c194640 1 Processor -- start 2023-11-20T06:41:57.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.803+0000 7f467c194640 1 -- start start 2023-11-20T06:41:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.803+0000 7f467c194640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f46740cf520 0x7f46740c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.803+0000 7f467c194640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46740c65f0 con 0x7f467415ca70 2023-11-20T06:41:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.803+0000 7f467c194640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46740cdf80 con 0x7f46740cf090 2023-11-20T06:41:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.803+0000 7f467c194640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46740ce820 con 0x7f46740cf520 2023-11-20T06:41:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.807+0000 7f4679f30640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f467415ca70 0x7f46740d3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45118/0 (socket says 172.21.15.19:45118) 2023-11-20T06:41:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.807+0000 7f4679f30640 1 -- 172.21.15.19:0/2483472327 learned_addr learned my addr 172.21.15.19:0/2483472327 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:41:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.807+0000 7f467a731640 1 --2- 172.21.15.19:0/2483472327 >> v2:172.21.15.190:3300/0 conn(0x7f46740cf520 0x7f46740c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:57.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.807+0000 7f4678f2e640 1 -- 172.21.15.19:0/2483472327 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238856142 0 0) 0x7f46740c65f0 con 0x7f467415ca70 2023-11-20T06:41:57.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.807+0000 7f4678f2e640 1 -- 172.21.15.19:0/2483472327 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4660003530 con 0x7f467415ca70 2023-11-20T06:41:57.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.807+0000 7f4678f2e640 1 -- 172.21.15.19:0/2483472327 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1567990340 0 0) 0x7f46740cdf80 con 0x7f46740cf090 2023-11-20T06:41:57.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.807+0000 7f4678f2e640 1 -- 172.21.15.19:0/2483472327 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46740c65f0 con 0x7f46740cf090 2023-11-20T06:41:57.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.807+0000 7f467a731640 1 -- 172.21.15.19:0/2483472327 >> v1:172.21.15.190:6789/0 conn(0x7f46740cf090 legacy=0x7f46740c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:57.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.807+0000 7f467a731640 1 -- 172.21.15.19:0/2483472327 >> v1:172.21.15.19:6789/0 conn(0x7f467415ca70 legacy=0x7f46740d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:57.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.807+0000 7f467a731640 1 -- 172.21.15.19:0/2483472327 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46740ce260 con 0x7f46740cf520 2023-11-20T06:41:57.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.807+0000 7f467a731640 1 --2- 172.21.15.19:0/2483472327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46740cf520 0x7f46740c71e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f466c009d90 tx=0x7f466c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f199e8109841503a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:57.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.807+0000 7f4678f2e640 1 -- 172.21.15.19:0/2483472327 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c0a59a0 con 0x7f46740cf520 2023-11-20T06:41:57.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f4678f2e640 1 -- 172.21.15.19:0/2483472327 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466c0a5b00 con 0x7f46740cf520 2023-11-20T06:41:57.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f4678f2e640 1 -- 172.21.15.19:0/2483472327 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c0a5e90 con 0x7f46740cf520 2023-11-20T06:41:57.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f467c194640 1 -- 172.21.15.19:0/2483472327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46740cf520 msgr2=0x7f46740c71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:57.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f467c194640 1 --2- 172.21.15.19:0/2483472327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46740cf520 0x7f46740c71e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f466c009d90 tx=0x7f466c01c920 comp rx=0 tx=0).stop 2023-11-20T06:41:57.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f467c194640 1 -- 172.21.15.19:0/2483472327 shutdown_connections 2023-11-20T06:41:57.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f467c194640 1 --2- 172.21.15.19:0/2483472327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46740cf520 0x7f46740c71e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:57.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f467c194640 1 -- 172.21.15.19:0/2483472327 >> 172.21.15.19:0/2483472327 conn(0x7f467409bc50 msgr2=0x7f46740d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:57.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f467c194640 1 -- 172.21.15.19:0/2483472327 shutdown_connections 2023-11-20T06:41:57.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f467c194640 1 -- 172.21.15.19:0/2483472327 wait complete. 2023-11-20T06:41:57.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f467c194640 1 Processor -- start 2023-11-20T06:41:57.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f467c194640 1 -- start start 2023-11-20T06:41:57.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f467c194640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46740cf090 0x7f4674156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:57.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f467c194640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46740cf520 0x7f46740cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:57.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f467c194640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f467415ca70 0x7f46740d2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:57.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f467c194640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46740cc870 con 0x7f467415ca70 2023-11-20T06:41:57.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f467c194640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467415a750 con 0x7f46740cf520 2023-11-20T06:41:57.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f467c194640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467415aa30 con 0x7f46740cf090 2023-11-20T06:41:57.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f467a731640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f467415ca70 0x7f46740d2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:57.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f4679f30640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46740cf090 0x7f4674156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:57.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f467a731640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f467415ca70 0x7f46740d2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36356/0 (socket says 172.21.15.19:36356) 2023-11-20T06:41:57.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f467a731640 1 -- 172.21.15.19:0/3255685415 learned_addr learned my addr 172.21.15.19:0/3255685415 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:41:57.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.811+0000 7f467972f640 1 --2- 172.21.15.19:0/3255685415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46740cf520 0x7f46740cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:57.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.815+0000 7f467a731640 1 -- 172.21.15.19:0/3255685415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46740cf090 msgr2=0x7f4674156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:57.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.815+0000 7f467a731640 1 --2- 172.21.15.19:0/3255685415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46740cf090 0x7f4674156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:57.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.815+0000 7f467a731640 1 -- 172.21.15.19:0/3255685415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46740cf520 msgr2=0x7f46740cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:57.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.815+0000 7f467a731640 1 --2- 172.21.15.19:0/3255685415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46740cf520 0x7f46740cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:57.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.815+0000 7f467a731640 1 -- 172.21.15.19:0/3255685415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c009a70 con 0x7f467415ca70 2023-11-20T06:41:57.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.815+0000 7f467a731640 1 --2- 172.21.15.19:0/3255685415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f467415ca70 0x7f46740d2840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f466c0b0040 tx=0x7f46740c7f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:57.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.815+0000 7f466a7fc640 1 -- 172.21.15.19:0/3255685415 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c0adcc0 con 0x7f467415ca70 2023-11-20T06:41:57.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.815+0000 7f466a7fc640 1 -- 172.21.15.19:0/3255685415 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466c0ade20 con 0x7f467415ca70 2023-11-20T06:41:57.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.815+0000 7f466a7fc640 1 -- 172.21.15.19:0/3255685415 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c0b8660 con 0x7f467415ca70 2023-11-20T06:41:57.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.815+0000 7f467c194640 1 -- 172.21.15.19:0/3255685415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46740d38a0 con 0x7f467415ca70 2023-11-20T06:41:57.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.815+0000 7f467c194640 1 -- 172.21.15.19:0/3255685415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467415aff0 con 0x7f467415ca70 2023-11-20T06:41:57.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.815+0000 7f467c194640 1 -- 172.21.15.19:0/3255685415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467415a4a0 con 0x7f467415ca70 2023-11-20T06:41:57.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.815+0000 7f466a7fc640 1 -- 172.21.15.19:0/3255685415 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f466c0b4040 con 0x7f467415ca70 2023-11-20T06:41:57.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.815+0000 7f466a7fc640 1 --2- 172.21.15.19:0/3255685415 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f46580664a0 0x7f4658068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:41:57.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.815+0000 7f466a7fc640 1 -- 172.21.15.19:0/3255685415 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f466c11e5d0 con 0x7f467415ca70 2023-11-20T06:41:57.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.819+0000 7f4679f30640 1 --2- 172.21.15.19:0/3255685415 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f46580664a0 0x7f4658068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:41:57.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.819+0000 7f4679f30640 1 --2- 172.21.15.19:0/3255685415 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f46580664a0 0x7f4658068960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4670001010 tx=0x7f4670009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:41:57.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:57.819+0000 7f466a7fc640 1 -- 172.21.15.19:0/3255685415 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f466c0eb740 con 0x7f467415ca70 2023-11-20T06:41:58.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:58.011+0000 7f467c194640 1 -- 172.21.15.19:0/3255685415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4674074010 con 0x7f467415ca70 2023-11-20T06:41:58.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:58.011+0000 7f466a7fc640 1 -- 172.21.15.19:0/3255685415 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f466c009450 con 0x7f467415ca70 2023-11-20T06:41:58.018 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-20T06:41:58.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:58.015+0000 7f467c194640 1 -- 172.21.15.19:0/3255685415 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f46580664a0 msgr2=0x7f4658068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:58.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:58.015+0000 7f467c194640 1 --2- 172.21.15.19:0/3255685415 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f46580664a0 0x7f4658068960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4670001010 tx=0x7f4670009040 comp rx=0 tx=0).stop 2023-11-20T06:41:58.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:58.015+0000 7f467c194640 1 -- 172.21.15.19:0/3255685415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f467415ca70 msgr2=0x7f46740d2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:41:58.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:58.015+0000 7f467c194640 1 --2- 172.21.15.19:0/3255685415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f467415ca70 0x7f46740d2840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f466c0b0040 tx=0x7f46740c7f30 comp rx=0 tx=0).stop 2023-11-20T06:41:58.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:58.015+0000 7f467c194640 1 -- 172.21.15.19:0/3255685415 shutdown_connections 2023-11-20T06:41:58.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:58.015+0000 7f467c194640 1 --2- 172.21.15.19:0/3255685415 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f46580664a0 0x7f4658068960 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:58.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:58.015+0000 7f467c194640 1 --2- 172.21.15.19:0/3255685415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f467415ca70 0x7f46740d2840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:58.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:58.015+0000 7f467c194640 1 --2- 172.21.15.19:0/3255685415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46740cf520 0x7f46740cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:58.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:58.015+0000 7f467c194640 1 --2- 172.21.15.19:0/3255685415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46740cf090 0x7f4674156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:41:58.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:58.015+0000 7f467c194640 1 -- 172.21.15.19:0/3255685415 >> 172.21.15.19:0/3255685415 conn(0x7f467409bc50 msgr2=0x7f46740ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:41:58.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:58.015+0000 7f467c194640 1 -- 172.21.15.19:0/3255685415 shutdown_connections 2023-11-20T06:41:58.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:41:58.015+0000 7f467c194640 1 -- 172.21.15.19:0/3255685415 wait complete. 2023-11-20T06:41:58.038 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-20T06:41:58.038 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-20T06:41:58.039 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi190.front.sepia.ceph.com 2023-11-20T06:41:58.039 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-20T06:41:58.039 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-20T06:41:58.039 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-20T06:41:58.039 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-20T06:41:58.039 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-20T06:41:58.039 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-20T06:41:58.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:58.039 DEBUG:teuthology.orchestra.run.smithi190:> ip addr 2023-11-20T06:41:58.048 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-20T06:41:58.049 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-20T06:41:58.049 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2023-11-20T06:41:58.049 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:58.049 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2023-11-20T06:41:58.049 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:58.049 INFO:teuthology.orchestra.run.smithi190.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T06:41:58.049 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d0 brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:58.049 INFO:teuthology.orchestra.run.smithi190.stdout: altname enp7s0f0 2023-11-20T06:41:58.049 INFO:teuthology.orchestra.run.smithi190.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T06:41:58.049 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d1 brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:58.049 INFO:teuthology.orchestra.run.smithi190.stdout: altname enp7s0f1 2023-11-20T06:41:58.050 INFO:teuthology.orchestra.run.smithi190.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T06:41:58.050 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:62 brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:58.050 INFO:teuthology.orchestra.run.smithi190.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-20T06:41:58.050 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:63 brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:58.050 INFO:teuthology.orchestra.run.smithi190.stdout: inet 172.21.15.190/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-20T06:41:58.050 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft 42386sec preferred_lft 42386sec 2023-11-20T06:41:58.050 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::ec4:7aff:fe88:7763/64 scope link 2023-11-20T06:41:58.050 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:58.050 INFO:teuthology.orchestra.run.smithi190.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-20T06:41:58.050 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 02:42:f0:6a:30:10 brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:58.050 INFO:teuthology.orchestra.run.smithi190.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-20T06:41:58.050 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:58.051 INFO:teuthology.orchestra.run.smithi190.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-20T06:41:58.051 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-20T06:41:58.051 INFO:teuthology.orchestra.run.smithi190.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-20T06:41:58.051 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:58.051 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-20T06:41:58.051 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:58.051 INFO:teuthology.orchestra.run.smithi190.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-20T06:41:58.051 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T06:41:58.051 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-20T06:41:58.051 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:58.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:58.052 DEBUG:teuthology.orchestra.run.smithi190:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-20T06:41:58.113 INFO:teuthology.orchestra.run.smithi190.stdout:1 2023-11-20T06:41:58.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:58.116 DEBUG:teuthology.orchestra.run.smithi190:> route 2023-11-20T06:41:58.170 INFO:teuthology.orchestra.run.smithi190.stdout:Kernel IP routing table 2023-11-20T06:41:58.170 INFO:teuthology.orchestra.run.smithi190.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-20T06:41:58.170 INFO:teuthology.orchestra.run.smithi190.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-20T06:41:58.170 INFO:teuthology.orchestra.run.smithi190.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-20T06:41:58.171 INFO:teuthology.orchestra.run.smithi190.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-20T06:41:58.171 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-20T06:41:58.171 INFO:teuthology.orchestra.run.smithi190.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T06:41:58.171 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T06:41:58.171 INFO:teuthology.orchestra.run.smithi190.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T06:41:58.171 INFO:teuthology.orchestra.run.smithi190.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-20T06:41:58.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:58.171 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-11-20T06:41:58.171 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-11-20T06:41:58.172 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-20T06:41:58.172 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-20T06:41:58.172 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-20T06:41:58.172 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-11-20T06:41:58.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:58.267 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2023-11-20T06:41:58.275 INFO:teuthology.orchestra.run.smithi190.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-20T06:41:58.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:58.276 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list-id 2023-11-20T06:41:58.331 INFO:teuthology.orchestra.run.smithi190.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-20T06:41:58.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:58.332 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-11-20T06:41:58.332 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-11-20T06:41:58.333 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-20T06:41:58.333 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-20T06:41:58.333 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-11-20T06:41:58.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:58.415 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-20T06:41:58.476 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-20T06:41:58.476 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-20T06:41:58.476 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2023-11-20T06:41:58.476 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:58.476 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2023-11-20T06:41:58.476 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:58.477 INFO:teuthology.orchestra.run.smithi190.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-20T06:41:58.477 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 16:df:af:75:5e:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-20T06:41:58.477 INFO:teuthology.orchestra.run.smithi190.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-20T06:41:58.477 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:58.477 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::14df:afff:fe75:5e39/64 scope link 2023-11-20T06:41:58.477 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:58.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:58.478 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-20T06:41:58.540 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-20T06:41:58.540 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-20T06:41:58.540 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2023-11-20T06:41:58.540 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:58.540 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2023-11-20T06:41:58.540 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:58.540 INFO:teuthology.orchestra.run.smithi190.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-20T06:41:58.540 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 16:df:af:75:5e:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-20T06:41:58.541 INFO:teuthology.orchestra.run.smithi190.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-20T06:41:58.541 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:58.541 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::14df:afff:fe75:5e39/64 scope link 2023-11-20T06:41:58.541 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:41:58.542 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-20T06:41:58.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:58.542 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-11-20T06:41:58.542 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-11-20T06:41:58.542 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-20T06:41:58.542 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-20T06:41:58.542 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-20T06:41:58.542 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-20T06:41:58.543 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-20T06:41:58.543 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-11-20T06:41:58.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:58.682 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-11-20T06:41:58.682 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-11-20T06:41:58.682 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set brx.1 up 2023-11-20T06:41:58.682 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set dev brx.1 master ceph-brx 2023-11-20T06:41:58.682 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-11-20T06:41:58.721 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-20T06:41:58.721 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T06:41:58.721 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-20T06:41:58.771 INFO:teuthology.orchestra.run.smithi190.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-20T06:41:58.772 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T06:41:58.772 DEBUG:teuthology.orchestra.run.smithi190:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-20T06:41:58.827 DEBUG:teuthology.orchestra.run.smithi190:> sudo modprobe fuse 2023-11-20T06:41:58.887 DEBUG:teuthology.orchestra.run.smithi190:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T06:41:58.945 INFO:teuthology.orchestra.run.smithi190.stdout:/sys 2023-11-20T06:41:58.946 INFO:teuthology.orchestra.run.smithi190.stdout:/proc 2023-11-20T06:41:58.946 INFO:teuthology.orchestra.run.smithi190.stdout:/dev 2023-11-20T06:41:58.946 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/pts 2023-11-20T06:41:58.946 INFO:teuthology.orchestra.run.smithi190.stdout:/run 2023-11-20T06:41:58.947 INFO:teuthology.orchestra.run.smithi190.stdout:/ 2023-11-20T06:41:58.947 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/security 2023-11-20T06:41:58.947 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/shm 2023-11-20T06:41:58.947 INFO:teuthology.orchestra.run.smithi190.stdout:/run/lock 2023-11-20T06:41:58.948 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/cgroup 2023-11-20T06:41:58.948 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/pstore 2023-11-20T06:41:58.948 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/bpf 2023-11-20T06:41:58.948 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T06:41:58.948 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/hugepages 2023-11-20T06:41:58.949 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/mqueue 2023-11-20T06:41:58.949 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/debug 2023-11-20T06:41:58.949 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/tracing 2023-11-20T06:41:58.949 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/fs/nfsd 2023-11-20T06:41:58.950 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/fuse/connections 2023-11-20T06:41:58.950 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/config 2023-11-20T06:41:58.950 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T06:41:58.950 INFO:teuthology.orchestra.run.smithi190.stdout:/run/rpc_pipefs 2023-11-20T06:41:58.950 INFO:teuthology.orchestra.run.smithi190.stdout:/run/user/1000 2023-11-20T06:41:58.951 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph 2023-11-20T06:41:58.951 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-4 2023-11-20T06:41:58.951 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-5 2023-11-20T06:41:58.951 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-6 2023-11-20T06:41:58.951 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-7 2023-11-20T06:41:58.952 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns 2023-11-20T06:41:58.952 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T06:41:58.952 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T06:41:58.952 INFO:teuthology.orchestra.run.smithi190.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-20T06:41:58.952 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-20T06:41:58.952 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-20T06:41:58.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:58.954 DEBUG:teuthology.orchestra.run.smithi190:> ls /sys/fs/fuse/connections 2023-11-20T06:41:59.007 INFO:teuthology.orchestra.run.smithi190.stdout:43 2023-11-20T06:41:59.007 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-11-20T06:41:59.007 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-20T06:41:59.054 DEBUG:teuthology.orchestra.run.smithi190:> sudo modprobe fuse 2023-11-20T06:41:59.076 DEBUG:teuthology.orchestra.run.smithi190:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T06:41:59.131 INFO:teuthology.orchestra.run.smithi190.stdout:/sys 2023-11-20T06:41:59.131 INFO:teuthology.orchestra.run.smithi190.stdout:/proc 2023-11-20T06:41:59.131 INFO:teuthology.orchestra.run.smithi190.stdout:/dev 2023-11-20T06:41:59.131 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/pts 2023-11-20T06:41:59.131 INFO:teuthology.orchestra.run.smithi190.stdout:/run 2023-11-20T06:41:59.131 INFO:teuthology.orchestra.run.smithi190.stdout:/ 2023-11-20T06:41:59.131 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/security 2023-11-20T06:41:59.131 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/shm 2023-11-20T06:41:59.131 INFO:teuthology.orchestra.run.smithi190.stdout:/run/lock 2023-11-20T06:41:59.131 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/cgroup 2023-11-20T06:41:59.131 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/pstore 2023-11-20T06:41:59.132 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/bpf 2023-11-20T06:41:59.132 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T06:41:59.132 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/hugepages 2023-11-20T06:41:59.132 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/mqueue 2023-11-20T06:41:59.132 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/debug 2023-11-20T06:41:59.132 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/tracing 2023-11-20T06:41:59.132 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/fs/nfsd 2023-11-20T06:41:59.132 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/fuse/connections 2023-11-20T06:41:59.132 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/config 2023-11-20T06:41:59.132 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T06:41:59.132 INFO:teuthology.orchestra.run.smithi190.stdout:/run/rpc_pipefs 2023-11-20T06:41:59.132 INFO:teuthology.orchestra.run.smithi190.stdout:/run/user/1000 2023-11-20T06:41:59.133 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph 2023-11-20T06:41:59.133 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-4 2023-11-20T06:41:59.133 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-5 2023-11-20T06:41:59.133 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-6 2023-11-20T06:41:59.133 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-7 2023-11-20T06:41:59.133 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns 2023-11-20T06:41:59.133 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T06:41:59.133 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T06:41:59.133 INFO:teuthology.orchestra.run.smithi190.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-20T06:41:59.133 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-20T06:41:59.133 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-20T06:41:59.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:59.134 DEBUG:teuthology.orchestra.run.smithi190:> ls /sys/fs/fuse/connections 2023-11-20T06:41:59.151 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi190.stderr:2023-11-20T06:41:59.147+0000 7f4cbf04c580 -1 init, newargv = 0x55d7c5625cb0 newargc=15 2023-11-20T06:41:59.151 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi190.stderr:ceph-fuse[44451]: starting ceph client 2023-11-20T06:41:59.159 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi190.stderr:ceph-fuse[44451]: starting fuse 2023-11-20T06:41:59.160 INFO:teuthology.orchestra.run.smithi190.stdout:43 2023-11-20T06:41:59.160 INFO:teuthology.orchestra.run.smithi190.stdout:44 2023-11-20T06:41:59.160 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-11-20T06:41:59.160 DEBUG:teuthology.orchestra.run.smithi190:> sudo stdin-killer -- python3 -c ' 2023-11-20T06:41:59.160 DEBUG:teuthology.orchestra.run.smithi190:> import glob 2023-11-20T06:41:59.161 DEBUG:teuthology.orchestra.run.smithi190:> import re 2023-11-20T06:41:59.161 DEBUG:teuthology.orchestra.run.smithi190:> import os 2023-11-20T06:41:59.161 DEBUG:teuthology.orchestra.run.smithi190:> import subprocess 2023-11-20T06:41:59.161 DEBUG:teuthology.orchestra.run.smithi190:> 2023-11-20T06:41:59.161 DEBUG:teuthology.orchestra.run.smithi190:> def _find_admin_socket(client_name): 2023-11-20T06:41:59.161 DEBUG:teuthology.orchestra.run.smithi190:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-20T06:41:59.161 DEBUG:teuthology.orchestra.run.smithi190:> files = glob.glob(asok_path) 2023-11-20T06:41:59.161 DEBUG:teuthology.orchestra.run.smithi190:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-20T06:41:59.161 DEBUG:teuthology.orchestra.run.smithi190:> 2023-11-20T06:41:59.161 DEBUG:teuthology.orchestra.run.smithi190:> # Given a non-glob path, it better be there 2023-11-20T06:41:59.161 DEBUG:teuthology.orchestra.run.smithi190:> if "*" not in asok_path: 2023-11-20T06:41:59.161 DEBUG:teuthology.orchestra.run.smithi190:> assert(len(files) == 1) 2023-11-20T06:41:59.161 DEBUG:teuthology.orchestra.run.smithi190:> return files[0] 2023-11-20T06:41:59.162 DEBUG:teuthology.orchestra.run.smithi190:> 2023-11-20T06:41:59.162 DEBUG:teuthology.orchestra.run.smithi190:> for f in files: 2023-11-20T06:41:59.162 DEBUG:teuthology.orchestra.run.smithi190:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-20T06:41:59.162 DEBUG:teuthology.orchestra.run.smithi190:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-20T06:41:59.162 DEBUG:teuthology.orchestra.run.smithi190:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-20T06:41:59.162 DEBUG:teuthology.orchestra.run.smithi190:> contents = proc_f.read() 2023-11-20T06:41:59.162 DEBUG:teuthology.orchestra.run.smithi190:> if mountpoint in contents: 2023-11-20T06:41:59.162 DEBUG:teuthology.orchestra.run.smithi190:> return f 2023-11-20T06:41:59.162 DEBUG:teuthology.orchestra.run.smithi190:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-20T06:41:59.162 DEBUG:teuthology.orchestra.run.smithi190:> 2023-11-20T06:41:59.163 DEBUG:teuthology.orchestra.run.smithi190:> print(_find_admin_socket("client.3")) 2023-11-20T06:41:59.163 DEBUG:teuthology.orchestra.run.smithi190:> ' 2023-11-20T06:41:59.284 INFO:teuthology.orchestra.run.smithi190.stdout:/var/run/ceph/ceph-client.3.44451.asok 2023-11-20T06:41:59.287 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-20T06:41:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-20T06:41:59.295 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.44451.asok 2023-11-20T06:41:59.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:59.295 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.44451.asok status 2023-11-20T06:41:59.464 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2023-11-20T06:41:59.464 INFO:teuthology.orchestra.run.smithi190.stdout: "metadata": { 2023-11-20T06:41:59.465 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-20T06:41:59.465 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-20T06:41:59.465 INFO:teuthology.orchestra.run.smithi190.stdout: "entity_id": "3", 2023-11-20T06:41:59.465 INFO:teuthology.orchestra.run.smithi190.stdout: "hostname": "smithi190", 2023-11-20T06:41:59.465 INFO:teuthology.orchestra.run.smithi190.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-20T06:41:59.465 INFO:teuthology.orchestra.run.smithi190.stdout: "pid": "44451", 2023-11-20T06:41:59.465 INFO:teuthology.orchestra.run.smithi190.stdout: "root": "/" 2023-11-20T06:41:59.465 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-11-20T06:41:59.465 INFO:teuthology.orchestra.run.smithi190.stdout: "dentry_count": 0, 2023-11-20T06:41:59.465 INFO:teuthology.orchestra.run.smithi190.stdout: "dentry_pinned_count": 0, 2023-11-20T06:41:59.465 INFO:teuthology.orchestra.run.smithi190.stdout: "id": 4828, 2023-11-20T06:41:59.465 INFO:teuthology.orchestra.run.smithi190.stdout: "inst": { 2023-11-20T06:41:59.466 INFO:teuthology.orchestra.run.smithi190.stdout: "name": { 2023-11-20T06:41:59.466 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "client", 2023-11-20T06:41:59.466 INFO:teuthology.orchestra.run.smithi190.stdout: "num": 4828 2023-11-20T06:41:59.466 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-11-20T06:41:59.466 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": { 2023-11-20T06:41:59.466 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "v1", 2023-11-20T06:41:59.466 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": "192.168.0.2:0", 2023-11-20T06:41:59.466 INFO:teuthology.orchestra.run.smithi190.stdout: "nonce": 766424161 2023-11-20T06:41:59.466 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-11-20T06:41:59.466 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-11-20T06:41:59.466 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": { 2023-11-20T06:41:59.467 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "v1", 2023-11-20T06:41:59.467 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": "192.168.0.2:0", 2023-11-20T06:41:59.467 INFO:teuthology.orchestra.run.smithi190.stdout: "nonce": 766424161 2023-11-20T06:41:59.467 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-11-20T06:41:59.467 INFO:teuthology.orchestra.run.smithi190.stdout: "inst_str": "client.4828 192.168.0.2:0/766424161", 2023-11-20T06:41:59.467 INFO:teuthology.orchestra.run.smithi190.stdout: "addr_str": "192.168.0.2:0/766424161", 2023-11-20T06:41:59.467 INFO:teuthology.orchestra.run.smithi190.stdout: "inode_count": 1, 2023-11-20T06:41:59.467 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_epoch": 9, 2023-11-20T06:41:59.467 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_epoch": 27, 2023-11-20T06:41:59.467 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_epoch_barrier": 0, 2023-11-20T06:41:59.467 INFO:teuthology.orchestra.run.smithi190.stdout: "blocklisted": false, 2023-11-20T06:41:59.467 INFO:teuthology.orchestra.run.smithi190.stdout: "fs_name": "cephfs" 2023-11-20T06:41:59.468 INFO:teuthology.orchestra.run.smithi190.stdout:} 2023-11-20T06:41:59.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:59.479 DEBUG:teuthology.orchestra.run.smithi019:> stat --file-system '--printf=%T 2023-11-20T06:41:59.480 DEBUG:teuthology.orchestra.run.smithi019:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-20T06:41:59.490 INFO:teuthology.orchestra.run.smithi019.stdout:fuseblk 2023-11-20T06:41:59.491 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-20T06:41:59.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:59.491 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-20T06:41:59.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:59.559 DEBUG:teuthology.orchestra.run.smithi019:> stat --file-system '--printf=%T 2023-11-20T06:41:59.560 DEBUG:teuthology.orchestra.run.smithi019:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-20T06:41:59.616 INFO:teuthology.orchestra.run.smithi019.stdout:fuseblk 2023-11-20T06:41:59.617 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-20T06:41:59.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:59.617 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-20T06:41:59.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:59.682 DEBUG:teuthology.orchestra.run.smithi190:> stat --file-system '--printf=%T 2023-11-20T06:41:59.682 DEBUG:teuthology.orchestra.run.smithi190:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-20T06:41:59.691 INFO:teuthology.orchestra.run.smithi190.stdout:fuseblk 2023-11-20T06:41:59.692 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-20T06:41:59.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:59.692 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-20T06:41:59.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:59.757 DEBUG:teuthology.orchestra.run.smithi190:> stat --file-system '--printf=%T 2023-11-20T06:41:59.757 DEBUG:teuthology.orchestra.run.smithi190:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-20T06:41:59.808 INFO:teuthology.orchestra.run.smithi190.stdout:fuseblk 2023-11-20T06:41:59.808 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-20T06:41:59.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:41:59.809 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-20T06:41:59.871 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-20T06:42:00.106 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:00.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.255+0000 7f340c5d3640 1 Processor -- start 2023-11-20T06:42:00.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.255+0000 7f340c5d3640 1 -- start start 2023-11-20T06:42:00.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.255+0000 7f340c5d3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f340415cb90 0x7f34040cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:00.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.255+0000 7f340c5d3640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f34040d3010 0x7f34040d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:00.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.255+0000 7f340c5d3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34040ce770 con 0x7f34040d1400 2023-11-20T06:42:00.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.255+0000 7f340c5d3640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34040d1890 con 0x7f34040d3010 2023-11-20T06:42:00.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.255+0000 7f340c5d3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34040d0600 con 0x7f340415cb90 2023-11-20T06:42:00.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.255+0000 7f3409b6e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f34040d3010 0x7f34040d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:00.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.255+0000 7f3409b6e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f34040d3010 0x7f34040d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36370/0 (socket says 172.21.15.19:36370) 2023-11-20T06:42:00.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.255+0000 7f3409b6e640 1 -- 172.21.15.19:0/21086926 learned_addr learned my addr 172.21.15.19:0/21086926 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:00.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.255+0000 7f340a36f640 1 --2- 172.21.15.19:0/21086926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f340415cb90 0x7f34040cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:00.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.255+0000 7f3409b6e640 1 -- 172.21.15.19:0/21086926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f340415cb90 msgr2=0x7f34040cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:00.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.255+0000 7f3409b6e640 1 --2- 172.21.15.19:0/21086926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f340415cb90 0x7f34040cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.255+0000 7f3409b6e640 1 -- 172.21.15.19:0/21086926 >> v1:172.21.15.190:6789/0 conn(0x7f34040d1400 legacy=0x7f34040cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:00.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.255+0000 7f3409b6e640 1 -- 172.21.15.19:0/21086926 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34040c6450 con 0x7f34040d3010 2023-11-20T06:42:00.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.259+0000 7f3409b6e640 1 --2- 172.21.15.19:0/21086926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34040d3010 0x7f34040d0ec0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009870 tx=0x7f33f401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b273aefecac941 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:00.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.259+0000 7f340936d640 1 -- 172.21.15.19:0/21086926 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f40ab680 con 0x7f34040d3010 2023-11-20T06:42:00.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.259+0000 7f340936d640 1 -- 172.21.15.19:0/21086926 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f40ab7e0 con 0x7f34040d3010 2023-11-20T06:42:00.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.259+0000 7f340936d640 1 -- 172.21.15.19:0/21086926 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f40abb70 con 0x7f34040d3010 2023-11-20T06:42:00.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.259+0000 7f340c5d3640 1 -- 172.21.15.19:0/21086926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34040d3010 msgr2=0x7f34040d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:00.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.259+0000 7f340c5d3640 1 --2- 172.21.15.19:0/21086926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34040d3010 0x7f34040d0ec0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009870 tx=0x7f33f401c480 comp rx=0 tx=0).stop 2023-11-20T06:42:00.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.259+0000 7f340c5d3640 1 -- 172.21.15.19:0/21086926 shutdown_connections 2023-11-20T06:42:00.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.259+0000 7f340c5d3640 1 --2- 172.21.15.19:0/21086926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34040d3010 0x7f34040d0ec0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.259+0000 7f340c5d3640 1 --2- 172.21.15.19:0/21086926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f340415cb90 0x7f34040cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.259+0000 7f340c5d3640 1 -- 172.21.15.19:0/21086926 >> 172.21.15.19:0/21086926 conn(0x7f340409bc50 msgr2=0x7f34040d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:00.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.259+0000 7f340c5d3640 1 -- 172.21.15.19:0/21086926 shutdown_connections 2023-11-20T06:42:00.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.259+0000 7f340c5d3640 1 -- 172.21.15.19:0/21086926 wait complete. 2023-11-20T06:42:00.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340c5d3640 1 Processor -- start 2023-11-20T06:42:00.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340c5d3640 1 -- start start 2023-11-20T06:42:00.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340c5d3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34040d1400 0x7f3404159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:00.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340c5d3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34040d3010 0x7f340415a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:00.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340c5d3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f340415cb90 0x7f340415a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:00.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340c5d3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3404157fc0 con 0x7f34040d3010 2023-11-20T06:42:00.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340c5d3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3404155880 con 0x7f340415cb90 2023-11-20T06:42:00.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340c5d3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3404156090 con 0x7f34040d1400 2023-11-20T06:42:00.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f3409b6e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34040d3010 0x7f340415a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:00.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340a36f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34040d1400 0x7f3404159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:00.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340a36f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34040d1400 0x7f3404159f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:47846/0 (socket says 172.21.15.19:47846) 2023-11-20T06:42:00.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340a36f640 1 -- 172.21.15.19:0/4258164735 learned_addr learned my addr 172.21.15.19:0/4258164735 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:00.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f3409b6e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34040d3010 0x7f340415a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36382/0 (socket says 172.21.15.19:36382) 2023-11-20T06:42:00.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340ab70640 1 --2- 172.21.15.19:0/4258164735 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f340415cb90 0x7f340415a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:00.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340a36f640 1 -- 172.21.15.19:0/4258164735 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f340415cb90 msgr2=0x7f340415a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:00.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340a36f640 1 --2- 172.21.15.19:0/4258164735 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f340415cb90 0x7f340415a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340a36f640 1 -- 172.21.15.19:0/4258164735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34040d3010 msgr2=0x7f340415a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:00.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340a36f640 1 --2- 172.21.15.19:0/4258164735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34040d3010 0x7f340415a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340a36f640 1 -- 172.21.15.19:0/4258164735 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f40094d0 con 0x7f34040d1400 2023-11-20T06:42:00.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340ab70640 1 --2- 172.21.15.19:0/4258164735 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f340415cb90 0x7f340415a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:00.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340a36f640 1 --2- 172.21.15.19:0/4258164735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34040d1400 0x7f3404159f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f340000e9b0 tx=0x7f340000ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:00.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f33faffd640 1 -- 172.21.15.19:0/4258164735 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400009670 con 0x7f34040d1400 2023-11-20T06:42:00.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f33faffd640 1 -- 172.21.15.19:0/4258164735 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340000c9a0 con 0x7f34040d1400 2023-11-20T06:42:00.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f33faffd640 1 -- 172.21.15.19:0/4258164735 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340000cd10 con 0x7f34040d1400 2023-11-20T06:42:00.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340c5d3640 1 -- 172.21.15.19:0/4258164735 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3404155ad0 con 0x7f34040d1400 2023-11-20T06:42:00.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.263+0000 7f340c5d3640 1 -- 172.21.15.19:0/4258164735 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34041581a0 con 0x7f34040d1400 2023-11-20T06:42:00.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.267+0000 7f340c5d3640 1 -- 172.21.15.19:0/4258164735 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3404074010 con 0x7f34040d1400 2023-11-20T06:42:00.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.267+0000 7f33faffd640 1 -- 172.21.15.19:0/4258164735 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3400013470 con 0x7f34040d1400 2023-11-20T06:42:00.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.267+0000 7f33faffd640 1 --2- 172.21.15.19:0/4258164735 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f33e80664a0 0x7f33e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:00.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.267+0000 7f33faffd640 1 -- 172.21.15.19:0/4258164735 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f34000848a0 con 0x7f34040d1400 2023-11-20T06:42:00.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.267+0000 7f3409b6e640 1 --2- 172.21.15.19:0/4258164735 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f33e80664a0 0x7f33e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:00.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.267+0000 7f3409b6e640 1 --2- 172.21.15.19:0/4258164735 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f33e80664a0 0x7f33e8068960 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f33f40af000 tx=0x7f33f40b6040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:00.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.275+0000 7f33faffd640 1 -- 172.21.15.19:0/4258164735 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3400051970 con 0x7f34040d1400 2023-11-20T06:42:00.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.435+0000 7f340c5d3640 1 -- 172.21.15.19:0/4258164735 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34040c66c0 con 0x7f34040d1400 2023-11-20T06:42:00.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.435+0000 7f33faffd640 1 -- 172.21.15.19:0/4258164735 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18720 (secure 0 0 0) 0x7f3400017090 con 0x7f34040d1400 2023-11-20T06:42:00.442 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:00.442 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:55.472006+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:00.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.439+0000 7f340c5d3640 1 -- 172.21.15.19:0/4258164735 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f33e80664a0 msgr2=0x7f33e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:00.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.439+0000 7f340c5d3640 1 --2- 172.21.15.19:0/4258164735 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f33e80664a0 0x7f33e8068960 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f33f40af000 tx=0x7f33f40b6040 comp rx=0 tx=0).stop 2023-11-20T06:42:00.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.439+0000 7f340c5d3640 1 -- 172.21.15.19:0/4258164735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34040d1400 msgr2=0x7f3404159f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:00.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.439+0000 7f340c5d3640 1 --2- 172.21.15.19:0/4258164735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34040d1400 0x7f3404159f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f340000e9b0 tx=0x7f340000ee70 comp rx=0 tx=0).stop 2023-11-20T06:42:00.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.439+0000 7f340c5d3640 1 -- 172.21.15.19:0/4258164735 shutdown_connections 2023-11-20T06:42:00.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.439+0000 7f340c5d3640 1 --2- 172.21.15.19:0/4258164735 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f33e80664a0 0x7f33e8068960 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.439+0000 7f340c5d3640 1 --2- 172.21.15.19:0/4258164735 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f340415cb90 0x7f340415a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.439+0000 7f340c5d3640 1 --2- 172.21.15.19:0/4258164735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34040d3010 0x7f340415a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.439+0000 7f340c5d3640 1 --2- 172.21.15.19:0/4258164735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34040d1400 0x7f3404159f30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.439+0000 7f340c5d3640 1 -- 172.21.15.19:0/4258164735 >> 172.21.15.19:0/4258164735 conn(0x7f340409bc50 msgr2=0x7f3404072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:00.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.439+0000 7f340c5d3640 1 -- 172.21.15.19:0/4258164735 shutdown_connections 2023-11-20T06:42:00.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.439+0000 7f340c5d3640 1 -- 172.21.15.19:0/4258164735 wait complete. 2023-11-20T06:42:00.463 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T06:41:11.805111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T06:41:12.614034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T06:41:16.311206+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T06:42:00.463 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:42:00.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.603+0000 7f189e365640 1 Processor -- start 2023-11-20T06:42:00.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.603+0000 7f189e365640 1 -- start start 2023-11-20T06:42:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.607+0000 7f189e365640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f189806df40 0x7f18980702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.607+0000 7f189e365640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1898070c60 con 0x7f18981590d0 2023-11-20T06:42:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.607+0000 7f189e365640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18980c9600 con 0x7f1898070830 2023-11-20T06:42:00.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.607+0000 7f189e365640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18980c98e0 con 0x7f189806df40 2023-11-20T06:42:00.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.607+0000 7f1897fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f18981590d0 0x7f18980c8dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45130/0 (socket says 172.21.15.19:45130) 2023-11-20T06:42:00.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.607+0000 7f1897fff640 1 -- 172.21.15.19:0/800197530 learned_addr learned my addr 172.21.15.19:0/800197530 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:00.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.607+0000 7f18977fe640 1 --2- 172.21.15.19:0/800197530 >> v2:172.21.15.190:3300/0 conn(0x7f189806df40 0x7f18980702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:00.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.607+0000 7f1896ffd640 1 -- 172.21.15.19:0/800197530 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315176741 0 0) 0x7f1898070c60 con 0x7f18981590d0 2023-11-20T06:42:00.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.607+0000 7f1896ffd640 1 -- 172.21.15.19:0/800197530 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1880003530 con 0x7f18981590d0 2023-11-20T06:42:00.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.607+0000 7f1896ffd640 1 -- 172.21.15.19:0/800197530 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426227088 0 0) 0x7f18980c9600 con 0x7f1898070830 2023-11-20T06:42:00.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.607+0000 7f1896ffd640 1 -- 172.21.15.19:0/800197530 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1898070c60 con 0x7f1898070830 2023-11-20T06:42:00.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.607+0000 7f18977fe640 1 -- 172.21.15.19:0/800197530 >> v1:172.21.15.190:6789/0 conn(0x7f1898070830 legacy=0x7f18980cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:00.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.607+0000 7f18977fe640 1 -- 172.21.15.19:0/800197530 >> v1:172.21.15.19:6789/0 conn(0x7f18981590d0 legacy=0x7f18980c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:00.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.607+0000 7f18977fe640 1 -- 172.21.15.19:0/800197530 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18980c9bc0 con 0x7f189806df40 2023-11-20T06:42:00.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.611+0000 7f18977fe640 1 --2- 172.21.15.19:0/800197530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f189806df40 0x7f18980702f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f188c0097c0 tx=0x7f188c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b4137f8c07ffd2e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:00.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.611+0000 7f1896ffd640 1 -- 172.21.15.19:0/800197530 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c0ac630 con 0x7f189806df40 2023-11-20T06:42:00.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.611+0000 7f1896ffd640 1 -- 172.21.15.19:0/800197530 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c0ac790 con 0x7f189806df40 2023-11-20T06:42:00.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.611+0000 7f1896ffd640 1 -- 172.21.15.19:0/800197530 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c0acb20 con 0x7f189806df40 2023-11-20T06:42:00.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.611+0000 7f189e365640 1 -- 172.21.15.19:0/800197530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f189806df40 msgr2=0x7f18980702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:00.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.611+0000 7f189e365640 1 --2- 172.21.15.19:0/800197530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f189806df40 0x7f18980702f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f188c0097c0 tx=0x7f188c01c450 comp rx=0 tx=0).stop 2023-11-20T06:42:00.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.611+0000 7f189e365640 1 -- 172.21.15.19:0/800197530 shutdown_connections 2023-11-20T06:42:00.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.611+0000 7f189e365640 1 --2- 172.21.15.19:0/800197530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f189806df40 0x7f18980702f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.611+0000 7f189e365640 1 -- 172.21.15.19:0/800197530 >> 172.21.15.19:0/800197530 conn(0x7f18980b0da0 msgr2=0x7f18980ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:00.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.611+0000 7f189e365640 1 -- 172.21.15.19:0/800197530 shutdown_connections 2023-11-20T06:42:00.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.611+0000 7f189e365640 1 -- 172.21.15.19:0/800197530 wait complete. 2023-11-20T06:42:00.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.611+0000 7f189e365640 1 Processor -- start 2023-11-20T06:42:00.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.611+0000 7f189e365640 1 -- start start 2023-11-20T06:42:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.611+0000 7f189e365640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f189806df40 0x7f18980c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.611+0000 7f189e365640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1898070830 0x7f189814d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.611+0000 7f189e365640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18981590d0 0x7f189814dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.611+0000 7f189e365640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18981518d0 con 0x7f1898070830 2023-11-20T06:42:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.611+0000 7f189e365640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1898151bb0 con 0x7f189806df40 2023-11-20T06:42:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.611+0000 7f189e365640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189814c4c0 con 0x7f18981590d0 2023-11-20T06:42:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.615+0000 7f18977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1898070830 0x7f189814d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.615+0000 7f18977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1898070830 0x7f189814d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36384/0 (socket says 172.21.15.19:36384) 2023-11-20T06:42:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.615+0000 7f18977fe640 1 -- 172.21.15.19:0/2450794110 learned_addr learned my addr 172.21.15.19:0/2450794110 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.615+0000 7f1897fff640 1 --2- 172.21.15.19:0/2450794110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f189806df40 0x7f18980c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.615+0000 7f189c902640 1 --2- 172.21.15.19:0/2450794110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18981590d0 0x7f189814dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.615+0000 7f18977fe640 1 -- 172.21.15.19:0/2450794110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18981590d0 msgr2=0x7f189814dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.615+0000 7f18977fe640 1 --2- 172.21.15.19:0/2450794110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18981590d0 0x7f189814dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.615+0000 7f18977fe640 1 -- 172.21.15.19:0/2450794110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f189806df40 msgr2=0x7f18980c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.615+0000 7f18977fe640 1 --2- 172.21.15.19:0/2450794110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f189806df40 0x7f18980c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.615+0000 7f18977fe640 1 -- 172.21.15.19:0/2450794110 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c009420 con 0x7f1898070830 2023-11-20T06:42:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.615+0000 7f18977fe640 1 --2- 172.21.15.19:0/2450794110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1898070830 0x7f189814d280 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f188c0af040 tx=0x7f188c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.615+0000 7f1894ff9640 1 -- 172.21.15.19:0/2450794110 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c0b5610 con 0x7f1898070830 2023-11-20T06:42:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.615+0000 7f1894ff9640 1 -- 172.21.15.19:0/2450794110 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c0b5790 con 0x7f1898070830 2023-11-20T06:42:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.615+0000 7f1894ff9640 1 -- 172.21.15.19:0/2450794110 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c0b5b40 con 0x7f1898070830 2023-11-20T06:42:00.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.615+0000 7f189e365640 1 -- 172.21.15.19:0/2450794110 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18980ca820 con 0x7f1898070830 2023-11-20T06:42:00.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.615+0000 7f189e365640 1 -- 172.21.15.19:0/2450794110 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f189814ca80 con 0x7f1898070830 2023-11-20T06:42:00.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.615+0000 7f189e365640 1 -- 172.21.15.19:0/2450794110 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f189804e170 con 0x7f1898070830 2023-11-20T06:42:00.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.615+0000 7f1894ff9640 1 -- 172.21.15.19:0/2450794110 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f188c0b3040 con 0x7f1898070830 2023-11-20T06:42:00.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.619+0000 7f1894ff9640 1 --2- 172.21.15.19:0/2450794110 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f18840664a0 0x7f1884068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:00.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.619+0000 7f1894ff9640 1 -- 172.21.15.19:0/2450794110 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f188c11e240 con 0x7f1898070830 2023-11-20T06:42:00.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.619+0000 7f1897fff640 1 --2- 172.21.15.19:0/2450794110 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f18840664a0 0x7f1884068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:00.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.619+0000 7f1897fff640 1 --2- 172.21.15.19:0/2450794110 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f18840664a0 0x7f1884068960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1888007fd0 tx=0x7f1888007d80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:00.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.623+0000 7f1894ff9640 1 -- 172.21.15.19:0/2450794110 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f188c0eb3a0 con 0x7f1898070830 2023-11-20T06:42:00.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.779+0000 7f189e365640 1 -- 172.21.15.19:0/2450794110 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1898071270 con 0x7f1898070830 2023-11-20T06:42:00.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.779+0000 7f1894ff9640 1 -- 172.21.15.19:0/2450794110 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f188c0ee9c0 con 0x7f1898070830 2023-11-20T06:42:00.786 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:42:00.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.783+0000 7f189e365640 1 -- 172.21.15.19:0/2450794110 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f18840664a0 msgr2=0x7f1884068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.783+0000 7f189e365640 1 --2- 172.21.15.19:0/2450794110 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f18840664a0 0x7f1884068960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1888007fd0 tx=0x7f1888007d80 comp rx=0 tx=0).stop 2023-11-20T06:42:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.783+0000 7f189e365640 1 -- 172.21.15.19:0/2450794110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1898070830 msgr2=0x7f189814d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.783+0000 7f189e365640 1 --2- 172.21.15.19:0/2450794110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1898070830 0x7f189814d280 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f188c0af040 tx=0x7f188c0191f0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.783+0000 7f189e365640 1 -- 172.21.15.19:0/2450794110 shutdown_connections 2023-11-20T06:42:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.783+0000 7f189e365640 1 --2- 172.21.15.19:0/2450794110 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f18840664a0 0x7f1884068960 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.783+0000 7f189e365640 1 --2- 172.21.15.19:0/2450794110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18981590d0 0x7f189814dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.783+0000 7f189e365640 1 --2- 172.21.15.19:0/2450794110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1898070830 0x7f189814d280 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.783+0000 7f189e365640 1 --2- 172.21.15.19:0/2450794110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f189806df40 0x7f18980c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.783+0000 7f189e365640 1 -- 172.21.15.19:0/2450794110 >> 172.21.15.19:0/2450794110 conn(0x7f18980b0da0 msgr2=0x7f18980cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.783+0000 7f189e365640 1 -- 172.21.15.19:0/2450794110 shutdown_connections 2023-11-20T06:42:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.783+0000 7f189e365640 1 -- 172.21.15.19:0/2450794110 wait complete. 2023-11-20T06:42:00.807 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T06:42:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.947+0000 7f2f64565640 1 Processor -- start 2023-11-20T06:42:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.947+0000 7f2f64565640 1 -- start start 2023-11-20T06:42:00.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.947+0000 7f2f64565640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f5c0d0210 0x7f2f5c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:00.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.947+0000 7f2f64565640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5c0d1670 con 0x7f2f5c15cba0 2023-11-20T06:42:00.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.947+0000 7f2f64565640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5c0d1950 con 0x7f2f5c0b84e0 2023-11-20T06:42:00.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.947+0000 7f2f64565640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c0d1460 con 0x7f2f5c0d0210 2023-11-20T06:42:00.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.951+0000 7f2f62301640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2f5c15cba0 0x7f2f5c0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45134/0 (socket says 172.21.15.19:45134) 2023-11-20T06:42:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.951+0000 7f2f62301640 1 -- 172.21.15.19:0/4021785791 learned_addr learned my addr 172.21.15.19:0/4021785791 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.951+0000 7f2f61b00640 1 --2- 172.21.15.19:0/4021785791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f5c0d0210 0x7f2f5c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.951+0000 7f2f612ff640 1 -- 172.21.15.19:0/4021785791 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2487530735 0 0) 0x7f2f5c0d1670 con 0x7f2f5c15cba0 2023-11-20T06:42:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.951+0000 7f2f612ff640 1 -- 172.21.15.19:0/4021785791 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f48003530 con 0x7f2f5c15cba0 2023-11-20T06:42:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.951+0000 7f2f612ff640 1 -- 172.21.15.19:0/4021785791 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102263962 0 0) 0x7f2f5c0d1950 con 0x7f2f5c0b84e0 2023-11-20T06:42:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.951+0000 7f2f612ff640 1 -- 172.21.15.19:0/4021785791 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f5c0d1670 con 0x7f2f5c0b84e0 2023-11-20T06:42:00.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.951+0000 7f2f61b00640 1 -- 172.21.15.19:0/4021785791 >> v1:172.21.15.190:6789/0 conn(0x7f2f5c0b84e0 legacy=0x7f2f5c0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:00.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.951+0000 7f2f61b00640 1 -- 172.21.15.19:0/4021785791 >> v1:172.21.15.19:6789/0 conn(0x7f2f5c15cba0 legacy=0x7f2f5c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:00.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.951+0000 7f2f61b00640 1 -- 172.21.15.19:0/4021785791 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c0d1c30 con 0x7f2f5c0d0210 2023-11-20T06:42:00.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.951+0000 7f2f61b00640 1 --2- 172.21.15.19:0/4021785791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f5c0d0210 0x7f2f5c0d0f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c0097f0 tx=0x7f2f4c01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeb520652ff2d32f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.951+0000 7f2f612ff640 1 -- 172.21.15.19:0/4021785791 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c0aa620 con 0x7f2f5c0d0210 2023-11-20T06:42:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.951+0000 7f2f612ff640 1 -- 172.21.15.19:0/4021785791 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4c0aa780 con 0x7f2f5c0d0210 2023-11-20T06:42:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.951+0000 7f2f612ff640 1 -- 172.21.15.19:0/4021785791 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c0aab10 con 0x7f2f5c0d0210 2023-11-20T06:42:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.955+0000 7f2f64565640 1 -- 172.21.15.19:0/4021785791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f5c0d0210 msgr2=0x7f2f5c0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.955+0000 7f2f64565640 1 --2- 172.21.15.19:0/4021785791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f5c0d0210 0x7f2f5c0d0f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c0097f0 tx=0x7f2f4c01c4c0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.955+0000 7f2f64565640 1 -- 172.21.15.19:0/4021785791 shutdown_connections 2023-11-20T06:42:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.955+0000 7f2f64565640 1 --2- 172.21.15.19:0/4021785791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f5c0d0210 0x7f2f5c0d0f20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.955+0000 7f2f64565640 1 -- 172.21.15.19:0/4021785791 >> 172.21.15.19:0/4021785791 conn(0x7f2f5c0719c0 msgr2=0x7f2f5c071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.955+0000 7f2f64565640 1 -- 172.21.15.19:0/4021785791 shutdown_connections 2023-11-20T06:42:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.955+0000 7f2f64565640 1 -- 172.21.15.19:0/4021785791 wait complete. 2023-11-20T06:42:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.955+0000 7f2f64565640 1 Processor -- start 2023-11-20T06:42:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.955+0000 7f2f64565640 1 -- start start 2023-11-20T06:42:00.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.955+0000 7f2f64565640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f5c0b84e0 0x7f2f5c14f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:00.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.955+0000 7f2f64565640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f5c0d0210 0x7f2f5c1585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.955+0000 7f2f64565640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f5c15cba0 0x7f2f5c15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.955+0000 7f2f64565640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c159990 con 0x7f2f5c15cba0 2023-11-20T06:42:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.955+0000 7f2f64565640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c158ae0 con 0x7f2f5c0b84e0 2023-11-20T06:42:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.955+0000 7f2f64565640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c158d80 con 0x7f2f5c0d0210 2023-11-20T06:42:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.955+0000 7f2f62b02640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f5c15cba0 0x7f2f5c15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.955+0000 7f2f62b02640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f5c15cba0 0x7f2f5c15fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36396/0 (socket says 172.21.15.19:36396) 2023-11-20T06:42:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.955+0000 7f2f62301640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f5c0b84e0 0x7f2f5c14f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.955+0000 7f2f62b02640 1 -- 172.21.15.19:0/158659823 learned_addr learned my addr 172.21.15.19:0/158659823 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.955+0000 7f2f61b00640 1 --2- 172.21.15.19:0/158659823 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f5c0d0210 0x7f2f5c1585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.959+0000 7f2f62b02640 1 -- 172.21.15.19:0/158659823 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f5c0d0210 msgr2=0x7f2f5c1585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.959+0000 7f2f62b02640 1 --2- 172.21.15.19:0/158659823 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f5c0d0210 0x7f2f5c1585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.959+0000 7f2f62b02640 1 -- 172.21.15.19:0/158659823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f5c0b84e0 msgr2=0x7f2f5c14f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.959+0000 7f2f62b02640 1 --2- 172.21.15.19:0/158659823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f5c0b84e0 0x7f2f5c14f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.959+0000 7f2f62b02640 1 -- 172.21.15.19:0/158659823 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4c009420 con 0x7f2f5c15cba0 2023-11-20T06:42:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.959+0000 7f2f62b02640 1 --2- 172.21.15.19:0/158659823 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f5c15cba0 0x7f2f5c15fab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400c790 tx=0x7f2f5400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.959+0000 7f2f52ffd640 1 -- 172.21.15.19:0/158659823 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400cea0 con 0x7f2f5c15cba0 2023-11-20T06:42:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.959+0000 7f2f52ffd640 1 -- 172.21.15.19:0/158659823 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f54003b80 con 0x7f2f5c15cba0 2023-11-20T06:42:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.959+0000 7f2f52ffd640 1 -- 172.21.15.19:0/158659823 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400a850 con 0x7f2f5c15cba0 2023-11-20T06:42:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.959+0000 7f2f64565640 1 -- 172.21.15.19:0/158659823 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5c159060 con 0x7f2f5c15cba0 2023-11-20T06:42:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.959+0000 7f2f64565640 1 -- 172.21.15.19:0/158659823 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5c159620 con 0x7f2f5c15cba0 2023-11-20T06:42:00.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.959+0000 7f2f64565640 1 -- 172.21.15.19:0/158659823 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5c159b00 con 0x7f2f5c15cba0 2023-11-20T06:42:00.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.959+0000 7f2f52ffd640 1 -- 172.21.15.19:0/158659823 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2f5400a9b0 con 0x7f2f5c15cba0 2023-11-20T06:42:00.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.959+0000 7f2f52ffd640 1 --2- 172.21.15.19:0/158659823 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2f400664a0 0x7f2f40068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:00.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.959+0000 7f2f52ffd640 1 -- 172.21.15.19:0/158659823 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2f54083ff0 con 0x7f2f5c15cba0 2023-11-20T06:42:00.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.959+0000 7f2f62301640 1 --2- 172.21.15.19:0/158659823 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2f400664a0 0x7f2f40068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:00.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.963+0000 7f2f62301640 1 --2- 172.21.15.19:0/158659823 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2f400664a0 0x7f2f40068960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2f58007fd0 tx=0x7f2f58007d60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:00.963+0000 7f2f52ffd640 1 -- 172.21.15.19:0/158659823 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2f54051120 con 0x7f2f5c15cba0 2023-11-20T06:42:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.119+0000 7f2f64565640 1 -- 172.21.15.19:0/158659823 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2f5c04e170 con 0x7f2f5c15cba0 2023-11-20T06:42:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.119+0000 7f2f52ffd640 1 -- 172.21.15.19:0/158659823 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2f54054740 con 0x7f2f5c15cba0 2023-11-20T06:42:01.126 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.123+0000 7f2f64565640 1 -- 172.21.15.19:0/158659823 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2f400664a0 msgr2=0x7f2f40068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.123+0000 7f2f64565640 1 --2- 172.21.15.19:0/158659823 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2f400664a0 0x7f2f40068960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2f58007fd0 tx=0x7f2f58007d60 comp rx=0 tx=0).stop 2023-11-20T06:42:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.123+0000 7f2f64565640 1 -- 172.21.15.19:0/158659823 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f5c15cba0 msgr2=0x7f2f5c15fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.123+0000 7f2f64565640 1 --2- 172.21.15.19:0/158659823 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f5c15cba0 0x7f2f5c15fab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400c790 tx=0x7f2f5400cc50 comp rx=0 tx=0).stop 2023-11-20T06:42:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.123+0000 7f2f64565640 1 -- 172.21.15.19:0/158659823 shutdown_connections 2023-11-20T06:42:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.123+0000 7f2f64565640 1 --2- 172.21.15.19:0/158659823 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2f400664a0 0x7f2f40068960 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.123+0000 7f2f64565640 1 --2- 172.21.15.19:0/158659823 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f5c15cba0 0x7f2f5c15fab0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.123+0000 7f2f64565640 1 --2- 172.21.15.19:0/158659823 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f5c0d0210 0x7f2f5c1585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.123+0000 7f2f64565640 1 --2- 172.21.15.19:0/158659823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f5c0b84e0 0x7f2f5c14f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.123+0000 7f2f64565640 1 -- 172.21.15.19:0/158659823 >> 172.21.15.19:0/158659823 conn(0x7f2f5c0719c0 msgr2=0x7f2f5c15a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.123+0000 7f2f64565640 1 -- 172.21.15.19:0/158659823 shutdown_connections 2023-11-20T06:42:01.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.123+0000 7f2f64565640 1 -- 172.21.15.19:0/158659823 wait complete. 2023-11-20T06:42:01.147 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T06:42:01.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.287+0000 7f2920409640 1 Processor -- start 2023-11-20T06:42:01.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.287+0000 7f2920409640 1 -- start start 2023-11-20T06:42:01.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.291+0000 7f2920409640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2918069e90 0x7f291806d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:01.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.291+0000 7f2920409640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29180c26b0 0x7f29180c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:01.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.291+0000 7f2920409640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f291815ae30 con 0x7f291806a270 2023-11-20T06:42:01.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.291+0000 7f2920409640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29180cb090 con 0x7f2918069e90 2023-11-20T06:42:01.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.291+0000 7f2920409640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29180ca510 con 0x7f29180c26b0 2023-11-20T06:42:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.291+0000 7f291e1a5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2918069e90 0x7f291806d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.291+0000 7f291e9a6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29180c26b0 0x7f29180c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.291+0000 7f291d9a4640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f291806a270 0x7f29180c9ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:60516/0 (socket says 172.21.15.19:60516) 2023-11-20T06:42:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.291+0000 7f291e1a5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2918069e90 0x7f291806d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:39442/0 (socket says 172.21.15.19:39442) 2023-11-20T06:42:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.291+0000 7f291d9a4640 1 -- 172.21.15.19:0/3562693897 learned_addr learned my addr 172.21.15.19:0/3562693897 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.291+0000 7f291e1a5640 1 -- 172.21.15.19:0/3562693897 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29180c26b0 msgr2=0x7f29180c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.291+0000 7f291e1a5640 1 --2- 172.21.15.19:0/3562693897 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29180c26b0 0x7f29180c2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.291+0000 7f291e1a5640 1 -- 172.21.15.19:0/3562693897 >> v1:172.21.15.190:6789/0 conn(0x7f291806a270 legacy=0x7f29180c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.291+0000 7f291e1a5640 1 -- 172.21.15.19:0/3562693897 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29180ca7f0 con 0x7f2918069e90 2023-11-20T06:42:01.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.291+0000 7f291e9a6640 1 --2- 172.21.15.19:0/3562693897 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29180c26b0 0x7f29180c2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:42:01.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.291+0000 7f291d1a3640 1 -- 172.21.15.19:0/3562693897 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257260710 0 0) 0x7f291815ae30 con 0x7f291806a270 2023-11-20T06:42:01.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.295+0000 7f291e1a5640 1 --2- 172.21.15.19:0/3562693897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2918069e90 0x7f291806d010 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f29140097c0 tx=0x7f291401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d1941c5f5f70d63 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:01.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.295+0000 7f291d1a3640 1 -- 172.21.15.19:0/3562693897 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29140ab650 con 0x7f2918069e90 2023-11-20T06:42:01.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.295+0000 7f291d1a3640 1 -- 172.21.15.19:0/3562693897 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29140ab7b0 con 0x7f2918069e90 2023-11-20T06:42:01.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.295+0000 7f291d1a3640 1 -- 172.21.15.19:0/3562693897 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29140abb40 con 0x7f2918069e90 2023-11-20T06:42:01.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.295+0000 7f2920409640 1 -- 172.21.15.19:0/3562693897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2918069e90 msgr2=0x7f291806d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:01.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.295+0000 7f2920409640 1 --2- 172.21.15.19:0/3562693897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2918069e90 0x7f291806d010 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f29140097c0 tx=0x7f291401c450 comp rx=0 tx=0).stop 2023-11-20T06:42:01.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.295+0000 7f2920409640 1 -- 172.21.15.19:0/3562693897 shutdown_connections 2023-11-20T06:42:01.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.295+0000 7f2920409640 1 --2- 172.21.15.19:0/3562693897 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29180c26b0 0x7f29180c2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.295+0000 7f2920409640 1 --2- 172.21.15.19:0/3562693897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2918069e90 0x7f291806d010 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.295+0000 7f2920409640 1 -- 172.21.15.19:0/3562693897 >> 172.21.15.19:0/3562693897 conn(0x7f29180b0da0 msgr2=0x7f29180ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:01.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.295+0000 7f2920409640 1 -- 172.21.15.19:0/3562693897 shutdown_connections 2023-11-20T06:42:01.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.295+0000 7f2920409640 1 -- 172.21.15.19:0/3562693897 wait complete. 2023-11-20T06:42:01.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.295+0000 7f2920409640 1 Processor -- start 2023-11-20T06:42:01.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.295+0000 7f2920409640 1 -- start start 2023-11-20T06:42:01.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f2920409640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2918069e90 0x7f2918148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:01.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f2920409640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f291806a270 0x7f29181496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:01.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f2920409640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29180c26b0 0x7f291814d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:01.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f2920409640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2918149510 con 0x7f2918069e90 2023-11-20T06:42:01.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f2920409640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291814a9d0 con 0x7f29180c26b0 2023-11-20T06:42:01.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f2920409640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291814a130 con 0x7f291806a270 2023-11-20T06:42:01.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f291e1a5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2918069e90 0x7f2918148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:01.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f291e1a5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2918069e90 0x7f2918148fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36404/0 (socket says 172.21.15.19:36404) 2023-11-20T06:42:01.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f291e1a5640 1 -- 172.21.15.19:0/1938194693 learned_addr learned my addr 172.21.15.19:0/1938194693 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:01.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f291e9a6640 1 --2- 172.21.15.19:0/1938194693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29180c26b0 0x7f291814d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:01.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f291d9a4640 1 --2- 172.21.15.19:0/1938194693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f291806a270 0x7f29181496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:01.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f291e1a5640 1 -- 172.21.15.19:0/1938194693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f291806a270 msgr2=0x7f29181496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:01.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f291e1a5640 1 --2- 172.21.15.19:0/1938194693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f291806a270 0x7f29181496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f291e1a5640 1 -- 172.21.15.19:0/1938194693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29180c26b0 msgr2=0x7f291814d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:01.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f291e1a5640 1 --2- 172.21.15.19:0/1938194693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29180c26b0 0x7f291814d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f291e1a5640 1 -- 172.21.15.19:0/1938194693 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2910009a70 con 0x7f2918069e90 2023-11-20T06:42:01.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f291e1a5640 1 --2- 172.21.15.19:0/1938194693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2918069e90 0x7f2918148fd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f29140ad040 tx=0x7f291401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:01.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f290effd640 1 -- 172.21.15.19:0/1938194693 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914004220 con 0x7f2918069e90 2023-11-20T06:42:01.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f290effd640 1 -- 172.21.15.19:0/1938194693 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29140b9070 con 0x7f2918069e90 2023-11-20T06:42:01.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f2920409640 1 -- 172.21.15.19:0/1938194693 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2914009420 con 0x7f2918069e90 2023-11-20T06:42:01.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f290effd640 1 -- 172.21.15.19:0/1938194693 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914003620 con 0x7f2918069e90 2023-11-20T06:42:01.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f2920409640 1 -- 172.21.15.19:0/1938194693 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291814a6f0 con 0x7f2918069e90 2023-11-20T06:42:01.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f2920409640 1 -- 172.21.15.19:0/1938194693 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291804e170 con 0x7f2918069e90 2023-11-20T06:42:01.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.299+0000 7f290effd640 1 -- 172.21.15.19:0/1938194693 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2914003780 con 0x7f2918069e90 2023-11-20T06:42:01.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.303+0000 7f290effd640 1 --2- 172.21.15.19:0/1938194693 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f28fc0664d0 0x7f28fc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:01.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.303+0000 7f290effd640 1 -- 172.21.15.19:0/1938194693 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f29140bb070 con 0x7f2918069e90 2023-11-20T06:42:01.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.303+0000 7f291d9a4640 1 --2- 172.21.15.19:0/1938194693 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f28fc0664d0 0x7f28fc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:01.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.303+0000 7f291d9a4640 1 --2- 172.21.15.19:0/1938194693 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f28fc0664d0 0x7f28fc068990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f291814e870 tx=0x7f2908007b80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:01.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.307+0000 7f290effd640 1 -- 172.21.15.19:0/1938194693 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f29140ebda0 con 0x7f2918069e90 2023-11-20T06:42:01.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.463+0000 7f2920409640 1 -- 172.21.15.19:0/1938194693 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29180c1d40 con 0x7f2918069e90 2023-11-20T06:42:01.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.467+0000 7f290effd640 1 -- 172.21.15.19:0/1938194693 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f29140c4070 con 0x7f2918069e90 2023-11-20T06:42:01.471 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-20T06:42:01.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.467+0000 7f2920409640 1 -- 172.21.15.19:0/1938194693 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f28fc0664d0 msgr2=0x7f28fc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:01.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.467+0000 7f2920409640 1 --2- 172.21.15.19:0/1938194693 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f28fc0664d0 0x7f28fc068990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f291814e870 tx=0x7f2908007b80 comp rx=0 tx=0).stop 2023-11-20T06:42:01.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.467+0000 7f2920409640 1 -- 172.21.15.19:0/1938194693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2918069e90 msgr2=0x7f2918148fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:01.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.467+0000 7f2920409640 1 --2- 172.21.15.19:0/1938194693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2918069e90 0x7f2918148fd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f29140ad040 tx=0x7f291401ac90 comp rx=0 tx=0).stop 2023-11-20T06:42:01.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.467+0000 7f2920409640 1 -- 172.21.15.19:0/1938194693 shutdown_connections 2023-11-20T06:42:01.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.467+0000 7f2920409640 1 --2- 172.21.15.19:0/1938194693 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f28fc0664d0 0x7f28fc068990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.467+0000 7f2920409640 1 --2- 172.21.15.19:0/1938194693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29180c26b0 0x7f291814d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.467+0000 7f2920409640 1 --2- 172.21.15.19:0/1938194693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f291806a270 0x7f29181496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.467+0000 7f2920409640 1 --2- 172.21.15.19:0/1938194693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2918069e90 0x7f2918148fd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.467+0000 7f2920409640 1 -- 172.21.15.19:0/1938194693 >> 172.21.15.19:0/1938194693 conn(0x7f29180b0da0 msgr2=0x7f29180ae2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:01.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.467+0000 7f2920409640 1 -- 172.21.15.19:0/1938194693 shutdown_connections 2023-11-20T06:42:01.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.467+0000 7f2920409640 1 -- 172.21.15.19:0/1938194693 wait complete. 2023-11-20T06:42:01.492 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T06:42:01.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.635+0000 7f493993e640 1 Processor -- start 2023-11-20T06:42:01.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.635+0000 7f493993e640 1 -- start start 2023-11-20T06:42:01.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.635+0000 7f493993e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4934159900 0x7f493406e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:01.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.635+0000 7f493993e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49340b3f00 0x7f4934069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:01.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.635+0000 7f493993e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f493406a3d0 0x7f49340cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:01.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.635+0000 7f493993e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49340cd740 con 0x7f4934159900 2023-11-20T06:42:01.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.635+0000 7f493993e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493406a840 con 0x7f493406a3d0 2023-11-20T06:42:01.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.635+0000 7f493993e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49340b4360 con 0x7f49340b3f00 2023-11-20T06:42:01.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.635+0000 7f4932ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4934159900 0x7f493406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:01.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.635+0000 7f4932ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4934159900 0x7f493406e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36418/0 (socket says 172.21.15.19:36418) 2023-11-20T06:42:01.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.635+0000 7f4932ffd640 1 -- 172.21.15.19:0/3224124356 learned_addr learned my addr 172.21.15.19:0/3224124356 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:01.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.635+0000 7f492bfff640 1 --2- 172.21.15.19:0/3224124356 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49340b3f00 0x7f4934069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:01.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.635+0000 7f49337fe640 1 --2- 172.21.15.19:0/3224124356 >> v2:172.21.15.190:3300/0 conn(0x7f493406a3d0 0x7f49340cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:01.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.635+0000 7f4932ffd640 1 -- 172.21.15.19:0/3224124356 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49340b3f00 msgr2=0x7f4934069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:01.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.635+0000 7f4932ffd640 1 --2- 172.21.15.19:0/3224124356 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49340b3f00 0x7f4934069e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.635+0000 7f4932ffd640 1 -- 172.21.15.19:0/3224124356 >> v2:172.21.15.190:3300/0 conn(0x7f493406a3d0 msgr2=0x7f49340cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:01.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.635+0000 7f4932ffd640 1 --2- 172.21.15.19:0/3224124356 >> v2:172.21.15.190:3300/0 conn(0x7f493406a3d0 0x7f49340cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.635+0000 7f4932ffd640 1 -- 172.21.15.19:0/3224124356 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49340b4600 con 0x7f4934159900 2023-11-20T06:42:01.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.639+0000 7f4932ffd640 1 --2- 172.21.15.19:0/3224124356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4934159900 0x7f493406e260 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f49340c8d10 tx=0x7f492401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9daae17504c67817 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:01.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.639+0000 7f49327fc640 1 -- 172.21.15.19:0/3224124356 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49240ab600 con 0x7f4934159900 2023-11-20T06:42:01.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.639+0000 7f49327fc640 1 -- 172.21.15.19:0/3224124356 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49240a7050 con 0x7f4934159900 2023-11-20T06:42:01.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.639+0000 7f49327fc640 1 -- 172.21.15.19:0/3224124356 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49240ab980 con 0x7f4934159900 2023-11-20T06:42:01.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.639+0000 7f493993e640 1 -- 172.21.15.19:0/3224124356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4934159900 msgr2=0x7f493406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:01.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.639+0000 7f493993e640 1 --2- 172.21.15.19:0/3224124356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4934159900 0x7f493406e260 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f49340c8d10 tx=0x7f492401c210 comp rx=0 tx=0).stop 2023-11-20T06:42:01.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.639+0000 7f493993e640 1 -- 172.21.15.19:0/3224124356 shutdown_connections 2023-11-20T06:42:01.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.639+0000 7f493993e640 1 --2- 172.21.15.19:0/3224124356 >> v2:172.21.15.190:3300/0 conn(0x7f493406a3d0 0x7f49340cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.639+0000 7f493993e640 1 --2- 172.21.15.19:0/3224124356 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49340b3f00 0x7f4934069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.639+0000 7f493993e640 1 --2- 172.21.15.19:0/3224124356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4934159900 0x7f493406e260 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.639+0000 7f493993e640 1 -- 172.21.15.19:0/3224124356 >> 172.21.15.19:0/3224124356 conn(0x7f49340b0da0 msgr2=0x7f49340ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:01.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.639+0000 7f493993e640 1 -- 172.21.15.19:0/3224124356 shutdown_connections 2023-11-20T06:42:01.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.639+0000 7f493993e640 1 -- 172.21.15.19:0/3224124356 wait complete. 2023-11-20T06:42:01.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f493993e640 1 Processor -- start 2023-11-20T06:42:01.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f493993e640 1 -- start start 2023-11-20T06:42:01.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f493993e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f493406a3d0 0x7f49340c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:01.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f493993e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49340b3f00 0x7f4934155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:01.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f493993e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4934159900 0x7f4934153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:01.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f493993e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49340c46b0 con 0x7f493406a3d0 2023-11-20T06:42:01.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f493993e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49340c3e10 con 0x7f49340b3f00 2023-11-20T06:42:01.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f493993e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49340c40f0 con 0x7f4934159900 2023-11-20T06:42:01.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f4932ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f493406a3d0 0x7f49340c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:01.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f4932ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f493406a3d0 0x7f49340c3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36434/0 (socket says 172.21.15.19:36434) 2023-11-20T06:42:01.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f492bfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49340b3f00 0x7f4934155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:01.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f4932ffd640 1 -- 172.21.15.19:0/598293410 learned_addr learned my addr 172.21.15.19:0/598293410 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:01.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f49337fe640 1 --2- 172.21.15.19:0/598293410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4934159900 0x7f4934153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:01.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f4932ffd640 1 -- 172.21.15.19:0/598293410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4934159900 msgr2=0x7f4934153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:01.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f4932ffd640 1 --2- 172.21.15.19:0/598293410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4934159900 0x7f4934153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f4932ffd640 1 -- 172.21.15.19:0/598293410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49340b3f00 msgr2=0x7f4934155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:01.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f4932ffd640 1 --2- 172.21.15.19:0/598293410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49340b3f00 0x7f4934155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f4932ffd640 1 -- 172.21.15.19:0/598293410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49240094d0 con 0x7f493406a3d0 2023-11-20T06:42:01.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f4932ffd640 1 --2- 172.21.15.19:0/598293410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f493406a3d0 0x7f49340c3780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f49240ae040 tx=0x7f4924018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:01.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f4930ff9640 1 -- 172.21.15.19:0/598293410 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49240abe90 con 0x7f493406a3d0 2023-11-20T06:42:01.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f4930ff9640 1 -- 172.21.15.19:0/598293410 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49240b4440 con 0x7f493406a3d0 2023-11-20T06:42:01.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f4930ff9640 1 -- 172.21.15.19:0/598293410 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49240b47d0 con 0x7f493406a3d0 2023-11-20T06:42:01.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f493993e640 1 -- 172.21.15.19:0/598293410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49340c43d0 con 0x7f493406a3d0 2023-11-20T06:42:01.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.643+0000 7f493993e640 1 -- 172.21.15.19:0/598293410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4934153e70 con 0x7f493406a3d0 2023-11-20T06:42:01.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.647+0000 7f493993e640 1 -- 172.21.15.19:0/598293410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493404e170 con 0x7f493406a3d0 2023-11-20T06:42:01.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.647+0000 7f4930ff9640 1 -- 172.21.15.19:0/598293410 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f49240b2070 con 0x7f493406a3d0 2023-11-20T06:42:01.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.647+0000 7f4930ff9640 1 --2- 172.21.15.19:0/598293410 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f49140664a0 0x7f4914068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:01.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.647+0000 7f4930ff9640 1 -- 172.21.15.19:0/598293410 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f492411dd50 con 0x7f493406a3d0 2023-11-20T06:42:01.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.647+0000 7f492bfff640 1 --2- 172.21.15.19:0/598293410 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f49140664a0 0x7f4914068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:01.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.647+0000 7f492bfff640 1 --2- 172.21.15.19:0/598293410 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f49140664a0 0x7f4914068960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f49340c5260 tx=0x7f491c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:01.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.651+0000 7f4930ff9640 1 -- 172.21.15.19:0/598293410 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4924121030 con 0x7f493406a3d0 2023-11-20T06:42:01.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.811+0000 7f493993e640 1 -- 172.21.15.19:0/598293410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f49341f8550 con 0x7f493406a3d0 2023-11-20T06:42:01.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.811+0000 7f4930ff9640 1 -- 172.21.15.19:0/598293410 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f49240eaec0 con 0x7f493406a3d0 2023-11-20T06:42:01.816 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:01.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.811+0000 7f493993e640 1 -- 172.21.15.19:0/598293410 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f49140664a0 msgr2=0x7f4914068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:01.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.811+0000 7f493993e640 1 --2- 172.21.15.19:0/598293410 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f49140664a0 0x7f4914068960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f49340c5260 tx=0x7f491c009190 comp rx=0 tx=0).stop 2023-11-20T06:42:01.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.811+0000 7f493993e640 1 -- 172.21.15.19:0/598293410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f493406a3d0 msgr2=0x7f49340c3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:01.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.811+0000 7f493993e640 1 --2- 172.21.15.19:0/598293410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f493406a3d0 0x7f49340c3780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f49240ae040 tx=0x7f4924018fb0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.811+0000 7f493993e640 1 -- 172.21.15.19:0/598293410 shutdown_connections 2023-11-20T06:42:01.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.811+0000 7f493993e640 1 --2- 172.21.15.19:0/598293410 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f49140664a0 0x7f4914068960 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.811+0000 7f493993e640 1 --2- 172.21.15.19:0/598293410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4934159900 0x7f4934153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.811+0000 7f493993e640 1 --2- 172.21.15.19:0/598293410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49340b3f00 0x7f4934155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.811+0000 7f493993e640 1 --2- 172.21.15.19:0/598293410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f493406a3d0 0x7f49340c3780 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.811+0000 7f493993e640 1 -- 172.21.15.19:0/598293410 >> 172.21.15.19:0/598293410 conn(0x7f49340b0da0 msgr2=0x7f49340ae2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:01.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.811+0000 7f493993e640 1 -- 172.21.15.19:0/598293410 shutdown_connections 2023-11-20T06:42:01.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.811+0000 7f493993e640 1 -- 172.21.15.19:0/598293410 wait complete. 2023-11-20T06:42:01.837 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:01.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.975+0000 7fe13e83c640 1 Processor -- start 2023-11-20T06:42:01.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.975+0000 7fe13e83c640 1 -- start start 2023-11-20T06:42:01.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.975+0000 7fe13e83c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe13815c980 0x7fe13806af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:01.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.975+0000 7fe13e83c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe13815cd60 0x7fe1380b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:01.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.975+0000 7fe13e83c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1380d3510 con 0x7fe1380d0d80 2023-11-20T06:42:01.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.975+0000 7fe13e83c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1380cd2b0 con 0x7fe13815cd60 2023-11-20T06:42:01.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.975+0000 7fe13e83c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1380d2f50 con 0x7fe13815c980 2023-11-20T06:42:01.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.975+0000 7fe13d039640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe13815cd60 0x7fe1380b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:01.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.975+0000 7fe13e03b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe1380d0d80 0x7fe1380cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45138/0 (socket says 172.21.15.19:45138) 2023-11-20T06:42:01.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.975+0000 7fe13e03b640 1 -- 172.21.15.19:0/2931846605 learned_addr learned my addr 172.21.15.19:0/2931846605 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:01.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.975+0000 7fe13d83a640 1 --2- 172.21.15.19:0/2931846605 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe13815c980 0x7fe13806af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:01.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.975+0000 7fe13d039640 1 -- 172.21.15.19:0/2931846605 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe13815c980 msgr2=0x7fe13806af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:01.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.975+0000 7fe13d039640 1 --2- 172.21.15.19:0/2931846605 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe13815c980 0x7fe13806af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.975+0000 7fe13d039640 1 -- 172.21.15.19:0/2931846605 >> v1:172.21.15.19:6789/0 conn(0x7fe1380d0d80 legacy=0x7fe1380cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:01.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.975+0000 7fe13d039640 1 -- 172.21.15.19:0/2931846605 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1380d3230 con 0x7fe13815cd60 2023-11-20T06:42:01.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.975+0000 7fe13d83a640 1 --2- 172.21.15.19:0/2931846605 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe13815c980 0x7fe13806af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:01.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.979+0000 7fe13d039640 1 --2- 172.21.15.19:0/2931846605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe13815cd60 0x7fe1380b1b90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe1280097c0 tx=0x7fe12801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa2ec58a40de66 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:01.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.979+0000 7fe13c838640 1 -- 172.21.15.19:0/2931846605 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1280ad640 con 0x7fe13815cd60 2023-11-20T06:42:01.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.979+0000 7fe13c838640 1 -- 172.21.15.19:0/2931846605 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1280ad7a0 con 0x7fe13815cd60 2023-11-20T06:42:01.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.979+0000 7fe13c838640 1 -- 172.21.15.19:0/2931846605 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1280adb30 con 0x7fe13815cd60 2023-11-20T06:42:01.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.979+0000 7fe13e83c640 1 -- 172.21.15.19:0/2931846605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe13815cd60 msgr2=0x7fe1380b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:01.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.979+0000 7fe13e83c640 1 --2- 172.21.15.19:0/2931846605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe13815cd60 0x7fe1380b1b90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe1280097c0 tx=0x7fe12801c480 comp rx=0 tx=0).stop 2023-11-20T06:42:01.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.979+0000 7fe13e83c640 1 -- 172.21.15.19:0/2931846605 shutdown_connections 2023-11-20T06:42:01.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.979+0000 7fe13e83c640 1 --2- 172.21.15.19:0/2931846605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe13815cd60 0x7fe1380b1b90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.979+0000 7fe13e83c640 1 --2- 172.21.15.19:0/2931846605 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe13815c980 0x7fe13806af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.979+0000 7fe13e83c640 1 -- 172.21.15.19:0/2931846605 >> 172.21.15.19:0/2931846605 conn(0x7fe13809ba80 msgr2=0x7fe1380d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:01.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.979+0000 7fe13e83c640 1 -- 172.21.15.19:0/2931846605 shutdown_connections 2023-11-20T06:42:01.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.979+0000 7fe13e83c640 1 -- 172.21.15.19:0/2931846605 wait complete. 2023-11-20T06:42:01.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13e83c640 1 Processor -- start 2023-11-20T06:42:01.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13e83c640 1 -- start start 2023-11-20T06:42:01.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13e83c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1380d0d80 0x7fe138155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:01.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13e83c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe13815c980 0x7fe138156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:01.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13e83c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe13815cd60 0x7fe138156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:01.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13e83c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe138156230 con 0x7fe1380d0d80 2023-11-20T06:42:01.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13e83c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1380cbf60 con 0x7fe13815c980 2023-11-20T06:42:01.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13e83c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13815d160 con 0x7fe13815cd60 2023-11-20T06:42:01.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13d83a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1380d0d80 0x7fe138155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:01.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13d83a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1380d0d80 0x7fe138155cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36452/0 (socket says 172.21.15.19:36452) 2023-11-20T06:42:01.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13d83a640 1 -- 172.21.15.19:0/2809342541 learned_addr learned my addr 172.21.15.19:0/2809342541 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:01.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13e03b640 1 --2- 172.21.15.19:0/2809342541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe13815cd60 0x7fe138156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:01.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13d039640 1 --2- 172.21.15.19:0/2809342541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe13815c980 0x7fe138156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:01.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13d83a640 1 -- 172.21.15.19:0/2809342541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe13815cd60 msgr2=0x7fe138156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:01.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13d83a640 1 --2- 172.21.15.19:0/2809342541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe13815cd60 0x7fe138156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13d83a640 1 -- 172.21.15.19:0/2809342541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe13815c980 msgr2=0x7fe138156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:01.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13d83a640 1 --2- 172.21.15.19:0/2809342541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe13815c980 0x7fe138156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:01.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13d83a640 1 -- 172.21.15.19:0/2809342541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe128009420 con 0x7fe1380d0d80 2023-11-20T06:42:01.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13d039640 1 --2- 172.21.15.19:0/2809342541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe13815c980 0x7fe138156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:01.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13e03b640 1 --2- 172.21.15.19:0/2809342541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe13815cd60 0x7fe138156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:01.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13d83a640 1 --2- 172.21.15.19:0/2809342541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1380d0d80 0x7fe138155cf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe13400c7f0 tx=0x7fe13400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:01.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe12e7fc640 1 -- 172.21.15.19:0/2809342541 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134005ba0 con 0x7fe1380d0d80 2023-11-20T06:42:01.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe12e7fc640 1 -- 172.21.15.19:0/2809342541 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe134005d00 con 0x7fe1380d0d80 2023-11-20T06:42:01.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe12e7fc640 1 -- 172.21.15.19:0/2809342541 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134007a50 con 0x7fe1380d0d80 2023-11-20T06:42:01.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13e83c640 1 -- 172.21.15.19:0/2809342541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1380d1720 con 0x7fe1380d0d80 2023-11-20T06:42:01.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.983+0000 7fe13e83c640 1 -- 172.21.15.19:0/2809342541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1380cc200 con 0x7fe1380d0d80 2023-11-20T06:42:01.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.987+0000 7fe13e83c640 1 -- 172.21.15.19:0/2809342541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe13804e9c0 con 0x7fe1380d0d80 2023-11-20T06:42:01.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.987+0000 7fe12e7fc640 1 -- 172.21.15.19:0/2809342541 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe134007bb0 con 0x7fe1380d0d80 2023-11-20T06:42:01.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.987+0000 7fe12e7fc640 1 --2- 172.21.15.19:0/2809342541 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe11c0664a0 0x7fe11c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:01.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.987+0000 7fe12e7fc640 1 -- 172.21.15.19:0/2809342541 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe134084310 con 0x7fe1380d0d80 2023-11-20T06:42:01.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.987+0000 7fe13d039640 1 --2- 172.21.15.19:0/2809342541 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe11c0664a0 0x7fe11c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:01.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.987+0000 7fe13d039640 1 --2- 172.21.15.19:0/2809342541 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe11c0664a0 0x7fe11c068960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe1280af000 tx=0x7fe1280a7070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:01.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:01.991+0000 7fe12e7fc640 1 -- 172.21.15.19:0/2809342541 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe134051330 con 0x7fe1380d0d80 2023-11-20T06:42:02.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.147+0000 7fe13e83c640 1 -- 172.21.15.19:0/2809342541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1380d36b0 con 0x7fe1380d0d80 2023-11-20T06:42:02.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.147+0000 7fe12e7fc640 1 -- 172.21.15.19:0/2809342541 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18720 (secure 0 0 0) 0x7fe134007e60 con 0x7fe1380d0d80 2023-11-20T06:42:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:02.155 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:55.472006+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:02.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.151+0000 7fe13e83c640 1 -- 172.21.15.19:0/2809342541 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe11c0664a0 msgr2=0x7fe11c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:02.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.151+0000 7fe13e83c640 1 --2- 172.21.15.19:0/2809342541 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe11c0664a0 0x7fe11c068960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe1280af000 tx=0x7fe1280a7070 comp rx=0 tx=0).stop 2023-11-20T06:42:02.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.151+0000 7fe13e83c640 1 -- 172.21.15.19:0/2809342541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1380d0d80 msgr2=0x7fe138155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:02.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.151+0000 7fe13e83c640 1 --2- 172.21.15.19:0/2809342541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1380d0d80 0x7fe138155cf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe13400c7f0 tx=0x7fe13400cbf0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.151+0000 7fe13e83c640 1 -- 172.21.15.19:0/2809342541 shutdown_connections 2023-11-20T06:42:02.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.151+0000 7fe13e83c640 1 --2- 172.21.15.19:0/2809342541 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe11c0664a0 0x7fe11c068960 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.151+0000 7fe13e83c640 1 --2- 172.21.15.19:0/2809342541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe13815cd60 0x7fe138156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.151+0000 7fe13e83c640 1 --2- 172.21.15.19:0/2809342541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe13815c980 0x7fe138156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.151+0000 7fe13e83c640 1 --2- 172.21.15.19:0/2809342541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1380d0d80 0x7fe138155cf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.151+0000 7fe13e83c640 1 -- 172.21.15.19:0/2809342541 >> 172.21.15.19:0/2809342541 conn(0x7fe13809ba80 msgr2=0x7fe13806b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:02.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.151+0000 7fe13e83c640 1 -- 172.21.15.19:0/2809342541 shutdown_connections 2023-11-20T06:42:02.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.151+0000 7fe13e83c640 1 -- 172.21.15.19:0/2809342541 wait complete. 2023-11-20T06:42:02.176 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T06:41:11.805111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T06:41:12.614034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T06:41:16.311206+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T06:42:02.176 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:42:02.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.319+0000 7f2496dd9640 1 Processor -- start 2023-11-20T06:42:02.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.319+0000 7f2496dd9640 1 -- start start 2023-11-20T06:42:02.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.319+0000 7f2496dd9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2490159900 0x7f249006e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:02.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.319+0000 7f2496dd9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f249006a5a0 0x7f24900c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:02.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.319+0000 7f2496dd9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24900b4390 con 0x7f24900b3f00 2023-11-20T06:42:02.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.319+0000 7f2496dd9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24900cd740 con 0x7f249006a5a0 2023-11-20T06:42:02.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.319+0000 7f2496dd9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24900b4600 con 0x7f2490159900 2023-11-20T06:42:02.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.319+0000 7f2495376640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f249006a5a0 0x7f24900c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:02.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.319+0000 7f2495376640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f249006a5a0 0x7f24900c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60202/0 (socket says 172.21.15.19:60202) 2023-11-20T06:42:02.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.319+0000 7f2495376640 1 -- 172.21.15.19:0/1959657707 learned_addr learned my addr 172.21.15.19:0/1959657707 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:02.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.319+0000 7f2494b75640 1 --2- 172.21.15.19:0/1959657707 >> v2:172.21.15.190:3300/0 conn(0x7f2490159900 0x7f249006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:02.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.323+0000 7f2495376640 1 -- 172.21.15.19:0/1959657707 >> v2:172.21.15.190:3300/0 conn(0x7f2490159900 msgr2=0x7f249006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:02.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.323+0000 7f2495376640 1 --2- 172.21.15.19:0/1959657707 >> v2:172.21.15.190:3300/0 conn(0x7f2490159900 0x7f249006e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.323+0000 7f2495376640 1 -- 172.21.15.19:0/1959657707 >> v1:172.21.15.190:6789/0 conn(0x7f24900b3f00 legacy=0x7f2490069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:02.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.323+0000 7f2495376640 1 -- 172.21.15.19:0/1959657707 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24900c8dd0 con 0x7f249006a5a0 2023-11-20T06:42:02.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.323+0000 7f2495376640 1 --2- 172.21.15.19:0/1959657707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f249006a5a0 0x7f24900c9b90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f249006ab70 tx=0x7f248801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22592c240f5dd4f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:02.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.323+0000 7f248f7fe640 1 -- 172.21.15.19:0/1959657707 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24880a5820 con 0x7f249006a5a0 2023-11-20T06:42:02.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.323+0000 7f248f7fe640 1 -- 172.21.15.19:0/1959657707 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24880a5980 con 0x7f249006a5a0 2023-11-20T06:42:02.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.323+0000 7f248f7fe640 1 -- 172.21.15.19:0/1959657707 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24880a5d10 con 0x7f249006a5a0 2023-11-20T06:42:02.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.323+0000 7f2496dd9640 1 -- 172.21.15.19:0/1959657707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f249006a5a0 msgr2=0x7f24900c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:02.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.323+0000 7f2496dd9640 1 --2- 172.21.15.19:0/1959657707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f249006a5a0 0x7f24900c9b90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f249006ab70 tx=0x7f248801c960 comp rx=0 tx=0).stop 2023-11-20T06:42:02.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.323+0000 7f2496dd9640 1 -- 172.21.15.19:0/1959657707 shutdown_connections 2023-11-20T06:42:02.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.323+0000 7f2496dd9640 1 --2- 172.21.15.19:0/1959657707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f249006a5a0 0x7f24900c9b90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.323+0000 7f2496dd9640 1 --2- 172.21.15.19:0/1959657707 >> v2:172.21.15.190:3300/0 conn(0x7f2490159900 0x7f249006e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.323+0000 7f2496dd9640 1 -- 172.21.15.19:0/1959657707 >> 172.21.15.19:0/1959657707 conn(0x7f24900b0da0 msgr2=0x7f24900ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:02.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.323+0000 7f2496dd9640 1 -- 172.21.15.19:0/1959657707 shutdown_connections 2023-11-20T06:42:02.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.323+0000 7f2496dd9640 1 -- 172.21.15.19:0/1959657707 wait complete. 2023-11-20T06:42:02.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f2496dd9640 1 Processor -- start 2023-11-20T06:42:02.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f2496dd9640 1 -- start start 2023-11-20T06:42:02.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f2496dd9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f249006a5a0 0x7f2490155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:02.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f2496dd9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24900b3f00 0x7f24900cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:02.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f2496dd9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2490159900 0x7f24900ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:02.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f2496dd9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24900c3e50 con 0x7f2490159900 2023-11-20T06:42:02.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f2496dd9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24900b16e0 con 0x7f24900b3f00 2023-11-20T06:42:02.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f2496dd9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24900c8ad0 con 0x7f249006a5a0 2023-11-20T06:42:02.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f2495376640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2490159900 0x7f24900ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:02.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f2495376640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2490159900 0x7f24900ccd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60212/0 (socket says 172.21.15.19:60212) 2023-11-20T06:42:02.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f2495376640 1 -- 172.21.15.19:0/1719012921 learned_addr learned my addr 172.21.15.19:0/1719012921 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:02.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f248ffff640 1 --2- 172.21.15.19:0/1719012921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24900b3f00 0x7f24900cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:02.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f2494b75640 1 --2- 172.21.15.19:0/1719012921 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f249006a5a0 0x7f2490155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:02.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f2495376640 1 -- 172.21.15.19:0/1719012921 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f249006a5a0 msgr2=0x7f2490155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:02.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f2495376640 1 --2- 172.21.15.19:0/1719012921 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f249006a5a0 0x7f2490155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f2495376640 1 -- 172.21.15.19:0/1719012921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24900b3f00 msgr2=0x7f24900cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:02.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f2495376640 1 --2- 172.21.15.19:0/1719012921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24900b3f00 0x7f24900cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f2495376640 1 -- 172.21.15.19:0/1719012921 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2488009b30 con 0x7f2490159900 2023-11-20T06:42:02.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f2494b75640 1 --2- 172.21.15.19:0/1719012921 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f249006a5a0 0x7f2490155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:02.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f2495376640 1 --2- 172.21.15.19:0/1719012921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2490159900 0x7f24900ccd90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f24880af040 tx=0x7f2488019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:02.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f248d7fa640 1 -- 172.21.15.19:0/1719012921 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24880b8670 con 0x7f2490159900 2023-11-20T06:42:02.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f248d7fa640 1 -- 172.21.15.19:0/1719012921 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24880b87d0 con 0x7f2490159900 2023-11-20T06:42:02.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f248d7fa640 1 -- 172.21.15.19:0/1719012921 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24880b8b80 con 0x7f2490159900 2023-11-20T06:42:02.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.327+0000 7f2496dd9640 1 -- 172.21.15.19:0/1719012921 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24900c34b0 con 0x7f2490159900 2023-11-20T06:42:02.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.331+0000 7f2496dd9640 1 -- 172.21.15.19:0/1719012921 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24900c3a70 con 0x7f2490159900 2023-11-20T06:42:02.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.331+0000 7f2496dd9640 1 -- 172.21.15.19:0/1719012921 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24900c3f90 con 0x7f2490159900 2023-11-20T06:42:02.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.331+0000 7f248d7fa640 1 -- 172.21.15.19:0/1719012921 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f24880b8ce0 con 0x7f2490159900 2023-11-20T06:42:02.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.331+0000 7f248d7fa640 1 --2- 172.21.15.19:0/1719012921 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f24740664a0 0x7f2474068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:02.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.331+0000 7f248d7fa640 1 -- 172.21.15.19:0/1719012921 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f248811f820 con 0x7f2490159900 2023-11-20T06:42:02.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.331+0000 7f2494b75640 1 --2- 172.21.15.19:0/1719012921 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f24740664a0 0x7f2474068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:02.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.331+0000 7f2494b75640 1 --2- 172.21.15.19:0/1719012921 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f24740664a0 0x7f2474068960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f248400b9f0 tx=0x7f2484008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.335+0000 7f248d7fa640 1 -- 172.21.15.19:0/1719012921 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f24900c3f90 con 0x7f2490159900 2023-11-20T06:42:02.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.491+0000 7f2496dd9640 1 -- 172.21.15.19:0/1719012921 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f24900c3f90 con 0x7f2490159900 2023-11-20T06:42:02.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.495+0000 7f248d7fa640 1 -- 172.21.15.19:0/1719012921 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f24900c3f90 con 0x7f2490159900 2023-11-20T06:42:02.499 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:42:02.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.495+0000 7f2496dd9640 1 -- 172.21.15.19:0/1719012921 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f24740664a0 msgr2=0x7f2474068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:02.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.495+0000 7f2496dd9640 1 --2- 172.21.15.19:0/1719012921 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f24740664a0 0x7f2474068960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f248400b9f0 tx=0x7f2484008040 comp rx=0 tx=0).stop 2023-11-20T06:42:02.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.495+0000 7f2496dd9640 1 -- 172.21.15.19:0/1719012921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2490159900 msgr2=0x7f24900ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:02.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.495+0000 7f2496dd9640 1 --2- 172.21.15.19:0/1719012921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2490159900 0x7f24900ccd90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f24880af040 tx=0x7f2488019700 comp rx=0 tx=0).stop 2023-11-20T06:42:02.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.495+0000 7f2496dd9640 1 -- 172.21.15.19:0/1719012921 shutdown_connections 2023-11-20T06:42:02.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.495+0000 7f2496dd9640 1 --2- 172.21.15.19:0/1719012921 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f24740664a0 0x7f2474068960 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.495+0000 7f2496dd9640 1 --2- 172.21.15.19:0/1719012921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2490159900 0x7f24900ccd90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.495+0000 7f2496dd9640 1 --2- 172.21.15.19:0/1719012921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24900b3f00 0x7f24900cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.495+0000 7f2496dd9640 1 --2- 172.21.15.19:0/1719012921 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f249006a5a0 0x7f2490155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.495+0000 7f2496dd9640 1 -- 172.21.15.19:0/1719012921 >> 172.21.15.19:0/1719012921 conn(0x7f24900b0da0 msgr2=0x7f2490158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:02.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.495+0000 7f2496dd9640 1 -- 172.21.15.19:0/1719012921 shutdown_connections 2023-11-20T06:42:02.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.495+0000 7f2496dd9640 1 -- 172.21.15.19:0/1719012921 wait complete. 2023-11-20T06:42:02.520 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T06:42:02.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.659+0000 7fc1a55f8640 1 Processor -- start 2023-11-20T06:42:02.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.659+0000 7fc1a55f8640 1 -- start start 2023-11-20T06:42:02.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc1a55f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1a00b84e0 0x7fc1a00d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:02.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc1a55f8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a00d1670 con 0x7fc1a015cba0 2023-11-20T06:42:02.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc1a55f8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a00d1950 con 0x7fc1a00d0210 2023-11-20T06:42:02.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc1a55f8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a00d1460 con 0x7fc1a00b84e0 2023-11-20T06:42:02.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19effd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc1a015cba0 0x7fc1a00cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57736/0 (socket says 172.21.15.19:57736) 2023-11-20T06:42:02.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19effd640 1 -- 172.21.15.19:0/3088691618 learned_addr learned my addr 172.21.15.19:0/3088691618 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:02.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19f7fe640 1 --2- 172.21.15.19:0/3088691618 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1a00b84e0 0x7fc1a00d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:02.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19e7fc640 1 -- 172.21.15.19:0/3088691618 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179386723 0 0) 0x7fc1a00d1670 con 0x7fc1a015cba0 2023-11-20T06:42:02.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19e7fc640 1 -- 172.21.15.19:0/3088691618 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc18c003530 con 0x7fc1a015cba0 2023-11-20T06:42:02.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19e7fc640 1 -- 172.21.15.19:0/3088691618 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626053714 0 0) 0x7fc1a00d1950 con 0x7fc1a00d0210 2023-11-20T06:42:02.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19e7fc640 1 -- 172.21.15.19:0/3088691618 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1a00d1670 con 0x7fc1a00d0210 2023-11-20T06:42:02.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19e7fc640 1 -- 172.21.15.19:0/3088691618 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4211569065 0 0) 0x7fc18c003530 con 0x7fc1a015cba0 2023-11-20T06:42:02.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19e7fc640 1 -- 172.21.15.19:0/3088691618 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1a00b84e0 msgr2=0x7fc1a00d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:02.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19e7fc640 1 --2- 172.21.15.19:0/3088691618 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1a00b84e0 0x7fc1a00d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19e7fc640 1 -- 172.21.15.19:0/3088691618 >> v1:172.21.15.190:6789/0 conn(0x7fc1a00d0210 legacy=0x7fc1a00b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:02.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19e7fc640 1 -- 172.21.15.19:0/3088691618 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a00d1c30 con 0x7fc1a015cba0 2023-11-20T06:42:02.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19e7fc640 1 -- 172.21.15.19:0/3088691618 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7fc190001680 con 0x7fc1a015cba0 2023-11-20T06:42:02.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19e7fc640 1 -- 172.21.15.19:0/3088691618 >> v1:172.21.15.19:6789/0 conn(0x7fc1a015cba0 legacy=0x7fc1a00cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:02.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19e7fc640 1 --2- 172.21.15.19:0/3088691618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc18c003b40 0x7fc18c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:02.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19e7fc640 1 --2- 172.21.15.19:0/3088691618 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1a00b84e0 0x7fc18c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:02.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19e7fc640 1 --2- 172.21.15.19:0/3088691618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc18c004d10 0x7fc18c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:02.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19e7fc640 1 -- 172.21.15.19:0/3088691618 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a00d1460 con 0x7fc18c003b40 2023-11-20T06:42:02.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19e7fc640 1 -- 172.21.15.19:0/3088691618 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c00ba40 con 0x7fc18c004d10 2023-11-20T06:42:02.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19e7fc640 1 -- 172.21.15.19:0/3088691618 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c00bbb0 con 0x7fc1a00b84e0 2023-11-20T06:42:02.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19effd640 1 --2- 172.21.15.19:0/3088691618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc18c003b40 0x7fc18c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:02.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19f7fe640 1 --2- 172.21.15.19:0/3088691618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc18c004d10 0x7fc18c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:02.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc197fff640 1 --2- 172.21.15.19:0/3088691618 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1a00b84e0 0x7fc18c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:02.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19effd640 1 -- 172.21.15.19:0/3088691618 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1a00b84e0 msgr2=0x7fc18c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:02.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19effd640 1 --2- 172.21.15.19:0/3088691618 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1a00b84e0 0x7fc18c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19effd640 1 -- 172.21.15.19:0/3088691618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc18c004d10 msgr2=0x7fc18c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:02.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19effd640 1 --2- 172.21.15.19:0/3088691618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc18c004d10 0x7fc18c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19effd640 1 -- 172.21.15.19:0/3088691618 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c003530 con 0x7fc18c003b40 2023-11-20T06:42:02.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.663+0000 7fc19f7fe640 1 --2- 172.21.15.19:0/3088691618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc18c004d10 0x7fc18c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:42:02.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.667+0000 7fc19effd640 1 --2- 172.21.15.19:0/3088691618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc18c003b40 0x7fc18c003f40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc19000c160 tx=0x7fc19001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06fd49afa222c19 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:02.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.667+0000 7fc19e7fc640 1 -- 172.21.15.19:0/3088691618 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1900058e0 con 0x7fc18c003b40 2023-11-20T06:42:02.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.667+0000 7fc19e7fc640 1 -- 172.21.15.19:0/3088691618 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc190005a60 con 0x7fc18c003b40 2023-11-20T06:42:02.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.667+0000 7fc19e7fc640 1 -- 172.21.15.19:0/3088691618 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc190005e10 con 0x7fc18c003b40 2023-11-20T06:42:02.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.667+0000 7fc1a55f8640 1 -- 172.21.15.19:0/3088691618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc18c003b40 msgr2=0x7fc18c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:02.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.667+0000 7fc1a55f8640 1 --2- 172.21.15.19:0/3088691618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc18c003b40 0x7fc18c003f40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc19000c160 tx=0x7fc19001cbc0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.667+0000 7fc19f7fe640 1 -- 172.21.15.19:0/3088691618 reap_dead start 2023-11-20T06:42:02.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.667+0000 7fc1a55f8640 1 -- 172.21.15.19:0/3088691618 shutdown_connections 2023-11-20T06:42:02.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.667+0000 7fc1a55f8640 1 -- 172.21.15.19:0/3088691618 >> 172.21.15.19:0/3088691618 conn(0x7fc1a00719c0 msgr2=0x7fc1a0071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:02.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.667+0000 7fc1a55f8640 1 -- 172.21.15.19:0/3088691618 shutdown_connections 2023-11-20T06:42:02.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.667+0000 7fc1a55f8640 1 -- 172.21.15.19:0/3088691618 wait complete. 2023-11-20T06:42:02.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc1a55f8640 1 Processor -- start 2023-11-20T06:42:02.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc1a55f8640 1 -- start start 2023-11-20T06:42:02.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc1a55f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc18c003b40 0x7fc1a0153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:02.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc1a55f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1a014aa10 0x7fc1a014a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:02.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc1a55f8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1a0152b80 0x7fc1a0157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:02.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc1a55f8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a00ca210 con 0x7fc1a014aa10 2023-11-20T06:42:02.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc1a55f8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a00c9c20 con 0x7fc1a0152b80 2023-11-20T06:42:02.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc1a55f8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a0153ed0 con 0x7fc18c003b40 2023-11-20T06:42:02.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc197fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1a014aa10 0x7fc1a014a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:02.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc19effd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc18c003b40 0x7fc1a0153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:02.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc197fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1a014aa10 0x7fc1a014a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60236/0 (socket says 172.21.15.19:60236) 2023-11-20T06:42:02.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc197fff640 1 -- 172.21.15.19:0/1436189490 learned_addr learned my addr 172.21.15.19:0/1436189490 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:02.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc19f7fe640 1 --2- 172.21.15.19:0/1436189490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1a0152b80 0x7fc1a0157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:02.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc197fff640 1 -- 172.21.15.19:0/1436189490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc18c003b40 msgr2=0x7fc1a0153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:02.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc197fff640 1 --2- 172.21.15.19:0/1436189490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc18c003b40 0x7fc1a0153990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc197fff640 1 -- 172.21.15.19:0/1436189490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1a0152b80 msgr2=0x7fc1a0157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:02.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc197fff640 1 --2- 172.21.15.19:0/1436189490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1a0152b80 0x7fc1a0157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc197fff640 1 -- 172.21.15.19:0/1436189490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a014a7b0 con 0x7fc1a014aa10 2023-11-20T06:42:02.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc197fff640 1 --2- 172.21.15.19:0/1436189490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1a014aa10 0x7fc1a014a270 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc18800f720 tx=0x7fc18800fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:02.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc1977fe640 1 -- 172.21.15.19:0/1436189490 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1880050d0 con 0x7fc1a014aa10 2023-11-20T06:42:02.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc1977fe640 1 -- 172.21.15.19:0/1436189490 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc188005250 con 0x7fc1a014aa10 2023-11-20T06:42:02.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc1977fe640 1 -- 172.21.15.19:0/1436189490 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18800d6d0 con 0x7fc1a014aa10 2023-11-20T06:42:02.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc1a55f8640 1 -- 172.21.15.19:0/1436189490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a015fd30 con 0x7fc1a014aa10 2023-11-20T06:42:02.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc1a55f8640 1 -- 172.21.15.19:0/1436189490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a00c9e30 con 0x7fc1a014aa10 2023-11-20T06:42:02.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.671+0000 7fc1a55f8640 1 -- 172.21.15.19:0/1436189490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a00c9ff0 con 0x7fc1a014aa10 2023-11-20T06:42:02.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.675+0000 7fc1977fe640 1 -- 172.21.15.19:0/1436189490 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc18800d830 con 0x7fc1a014aa10 2023-11-20T06:42:02.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.675+0000 7fc1977fe640 1 --2- 172.21.15.19:0/1436189490 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc1800664d0 0x7fc180068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:02.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.675+0000 7fc1977fe640 1 -- 172.21.15.19:0/1436189490 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc1880841a0 con 0x7fc1a014aa10 2023-11-20T06:42:02.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.675+0000 7fc19effd640 1 --2- 172.21.15.19:0/1436189490 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc1800664d0 0x7fc180068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:02.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.675+0000 7fc19effd640 1 --2- 172.21.15.19:0/1436189490 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc1800664d0 0x7fc180068990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc1900aa000 tx=0x7fc190001a00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:02.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.679+0000 7fc1977fe640 1 -- 172.21.15.19:0/1436189490 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc1880511c0 con 0x7fc1a014aa10 2023-11-20T06:42:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.835+0000 7fc1a55f8640 1 -- 172.21.15.19:0/1436189490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc1a0160250 con 0x7fc1a014aa10 2023-11-20T06:42:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.835+0000 7fc1977fe640 1 -- 172.21.15.19:0/1436189490 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc1880547e0 con 0x7fc1a014aa10 2023-11-20T06:42:02.840 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:02.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.835+0000 7fc1a55f8640 1 -- 172.21.15.19:0/1436189490 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc1800664d0 msgr2=0x7fc180068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:02.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.835+0000 7fc1a55f8640 1 --2- 172.21.15.19:0/1436189490 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc1800664d0 0x7fc180068990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc1900aa000 tx=0x7fc190001a00 comp rx=0 tx=0).stop 2023-11-20T06:42:02.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.835+0000 7fc1a55f8640 1 -- 172.21.15.19:0/1436189490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1a014aa10 msgr2=0x7fc1a014a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:02.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.835+0000 7fc1a55f8640 1 --2- 172.21.15.19:0/1436189490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1a014aa10 0x7fc1a014a270 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc18800f720 tx=0x7fc18800fbe0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.835+0000 7fc1a55f8640 1 -- 172.21.15.19:0/1436189490 shutdown_connections 2023-11-20T06:42:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.835+0000 7fc1a55f8640 1 --2- 172.21.15.19:0/1436189490 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc1800664d0 0x7fc180068990 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.835+0000 7fc1a55f8640 1 --2- 172.21.15.19:0/1436189490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1a0152b80 0x7fc1a0157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.835+0000 7fc1a55f8640 1 --2- 172.21.15.19:0/1436189490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1a014aa10 0x7fc1a014a270 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.835+0000 7fc1a55f8640 1 --2- 172.21.15.19:0/1436189490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc18c003b40 0x7fc1a0153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.835+0000 7fc1a55f8640 1 -- 172.21.15.19:0/1436189490 >> 172.21.15.19:0/1436189490 conn(0x7fc1a00719c0 msgr2=0x7fc1a015b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.835+0000 7fc1a55f8640 1 -- 172.21.15.19:0/1436189490 shutdown_connections 2023-11-20T06:42:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:02.835+0000 7fc1a55f8640 1 -- 172.21.15.19:0/1436189490 wait complete. 2023-11-20T06:42:02.861 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T06:42:03.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.003+0000 7f7eb3c91640 1 Processor -- start 2023-11-20T06:42:03.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.003+0000 7f7eb3c91640 1 -- start start 2023-11-20T06:42:03.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.003+0000 7f7eb3c91640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eac15cba0 0x7f7eac0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:03.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.003+0000 7f7eb3c91640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eac0d1670 con 0x7f7eac0d0210 2023-11-20T06:42:03.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.003+0000 7f7eb3c91640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eac0d1950 con 0x7f7eac0b84e0 2023-11-20T06:42:03.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.003+0000 7f7eb3c91640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0d1460 con 0x7f7eac15cba0 2023-11-20T06:42:03.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.003+0000 7f7eb222e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7eac0d0210 0x7f7eac0b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57750/0 (socket says 172.21.15.19:57750) 2023-11-20T06:42:03.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.003+0000 7f7eb222e640 1 -- 172.21.15.19:0/3817451864 learned_addr learned my addr 172.21.15.19:0/3817451864 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:03.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.003+0000 7f7eb1a2d640 1 --2- 172.21.15.19:0/3817451864 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eac15cba0 0x7f7eac0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:03.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.003+0000 7f7eb0a2b640 1 -- 172.21.15.19:0/3817451864 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075107377 0 0) 0x7f7eac0d1670 con 0x7f7eac0d0210 2023-11-20T06:42:03.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.003+0000 7f7eb0a2b640 1 -- 172.21.15.19:0/3817451864 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e98003530 con 0x7f7eac0d0210 2023-11-20T06:42:03.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.003+0000 7f7eb0a2b640 1 -- 172.21.15.19:0/3817451864 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141834390 0 0) 0x7f7eac0d1950 con 0x7f7eac0b84e0 2023-11-20T06:42:03.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.003+0000 7f7eb0a2b640 1 -- 172.21.15.19:0/3817451864 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eac0d1670 con 0x7f7eac0b84e0 2023-11-20T06:42:03.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.003+0000 7f7eb1a2d640 1 -- 172.21.15.19:0/3817451864 >> v1:172.21.15.190:6789/0 conn(0x7f7eac0b84e0 legacy=0x7f7eac0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:03.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.003+0000 7f7eb0a2b640 1 -- 172.21.15.19:0/3817451864 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1007909671 0 0) 0x7f7e98003530 con 0x7f7eac0d0210 2023-11-20T06:42:03.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.003+0000 7f7eb1a2d640 1 -- 172.21.15.19:0/3817451864 >> v1:172.21.15.19:6789/0 conn(0x7f7eac0d0210 legacy=0x7f7eac0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:03.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.003+0000 7f7eb1a2d640 1 -- 172.21.15.19:0/3817451864 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac0d1c30 con 0x7f7eac15cba0 2023-11-20T06:42:03.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.007+0000 7f7eb1a2d640 1 --2- 172.21.15.19:0/3817451864 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eac15cba0 0x7f7eac0d0f20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7ea80097f0 tx=0x7f7ea801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69cd4d3ca3dffdc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:03.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.007+0000 7f7eb0a2b640 1 -- 172.21.15.19:0/3817451864 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4001a00 con 0x7f7eac15cba0 2023-11-20T06:42:03.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.007+0000 7f7eb0a2b640 1 -- 172.21.15.19:0/3817451864 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea80ad460 con 0x7f7eac15cba0 2023-11-20T06:42:03.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.007+0000 7f7eb0a2b640 1 -- 172.21.15.19:0/3817451864 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea80ad7f0 con 0x7f7eac15cba0 2023-11-20T06:42:03.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.007+0000 7f7eb3c91640 1 -- 172.21.15.19:0/3817451864 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eac15cba0 msgr2=0x7f7eac0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:03.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.007+0000 7f7eb3c91640 1 --2- 172.21.15.19:0/3817451864 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eac15cba0 0x7f7eac0d0f20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7ea80097f0 tx=0x7f7ea801c3e0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.007+0000 7f7eb3c91640 1 -- 172.21.15.19:0/3817451864 shutdown_connections 2023-11-20T06:42:03.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.007+0000 7f7eb3c91640 1 --2- 172.21.15.19:0/3817451864 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eac15cba0 0x7f7eac0d0f20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.007+0000 7f7eb3c91640 1 -- 172.21.15.19:0/3817451864 >> 172.21.15.19:0/3817451864 conn(0x7f7eac0719c0 msgr2=0x7f7eac071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:03.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.007+0000 7f7eb3c91640 1 -- 172.21.15.19:0/3817451864 shutdown_connections 2023-11-20T06:42:03.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.007+0000 7f7eb3c91640 1 -- 172.21.15.19:0/3817451864 wait complete. 2023-11-20T06:42:03.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb3c91640 1 Processor -- start 2023-11-20T06:42:03.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb3c91640 1 -- start start 2023-11-20T06:42:03.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb3c91640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7eac0b84e0 0x7f7eac1f5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:03.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb3c91640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eac0d0210 0x7f7eac0c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:03.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb3c91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eac15cba0 0x7f7eac151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:03.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb3c91640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac1f5d80 con 0x7f7eac15cba0 2023-11-20T06:42:03.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb3c91640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac1f5f40 con 0x7f7eac0b84e0 2023-11-20T06:42:03.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb3c91640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac1f6220 con 0x7f7eac0d0210 2023-11-20T06:42:03.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb222e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eac15cba0 0x7f7eac151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:03.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb222e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eac15cba0 0x7f7eac151150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60248/0 (socket says 172.21.15.19:60248) 2023-11-20T06:42:03.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb222e640 1 -- 172.21.15.19:0/3019677650 learned_addr learned my addr 172.21.15.19:0/3019677650 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:03.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb1a2d640 1 --2- 172.21.15.19:0/3019677650 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7eac0b84e0 0x7f7eac1f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:03.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb122c640 1 --2- 172.21.15.19:0/3019677650 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eac0d0210 0x7f7eac0c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:03.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb222e640 1 -- 172.21.15.19:0/3019677650 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eac0d0210 msgr2=0x7f7eac0c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:03.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb222e640 1 --2- 172.21.15.19:0/3019677650 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eac0d0210 0x7f7eac0c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb222e640 1 -- 172.21.15.19:0/3019677650 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7eac0b84e0 msgr2=0x7f7eac1f5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:03.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb222e640 1 --2- 172.21.15.19:0/3019677650 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7eac0b84e0 0x7f7eac1f5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb222e640 1 -- 172.21.15.19:0/3019677650 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea8009420 con 0x7f7eac15cba0 2023-11-20T06:42:03.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb222e640 1 --2- 172.21.15.19:0/3019677650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eac15cba0 0x7f7eac151150 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4001fb0 tx=0x7f7ea400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:03.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7ea27fc640 1 -- 172.21.15.19:0/3019677650 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4012400 con 0x7f7eac15cba0 2023-11-20T06:42:03.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7ea27fc640 1 -- 172.21.15.19:0/3019677650 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea4012560 con 0x7f7eac15cba0 2023-11-20T06:42:03.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7ea27fc640 1 -- 172.21.15.19:0/3019677650 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4012910 con 0x7f7eac15cba0 2023-11-20T06:42:03.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb3c91640 1 -- 172.21.15.19:0/3019677650 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eac1f6500 con 0x7f7eac15cba0 2023-11-20T06:42:03.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.011+0000 7f7eb3c91640 1 -- 172.21.15.19:0/3019677650 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eac1f6ac0 con 0x7f7eac15cba0 2023-11-20T06:42:03.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.015+0000 7f7eb3c91640 1 -- 172.21.15.19:0/3019677650 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eac04e170 con 0x7f7eac15cba0 2023-11-20T06:42:03.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.015+0000 7f7ea27fc640 1 -- 172.21.15.19:0/3019677650 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7ea4012a70 con 0x7f7eac15cba0 2023-11-20T06:42:03.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.015+0000 7f7ea27fc640 1 --2- 172.21.15.19:0/3019677650 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7e900664a0 0x7f7e90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:03.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.015+0000 7f7ea27fc640 1 -- 172.21.15.19:0/3019677650 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7ea40848d0 con 0x7f7eac15cba0 2023-11-20T06:42:03.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.015+0000 7f7eb1a2d640 1 --2- 172.21.15.19:0/3019677650 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7e900664a0 0x7f7e90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:03.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.015+0000 7f7eb1a2d640 1 --2- 172.21.15.19:0/3019677650 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7e900664a0 0x7f7e90068960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7ea80af000 tx=0x7f7ea80a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:03.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.019+0000 7f7ea27fc640 1 -- 172.21.15.19:0/3019677650 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7ea4051a40 con 0x7f7eac15cba0 2023-11-20T06:42:03.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.179+0000 7f7eb3c91640 1 -- 172.21.15.19:0/3019677650 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7eac0b5f90 con 0x7f7eac15cba0 2023-11-20T06:42:03.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.179+0000 7f7ea27fc640 1 -- 172.21.15.19:0/3019677650 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7ea4082e60 con 0x7f7eac15cba0 2023-11-20T06:42:03.184 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-20T06:42:03.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.179+0000 7f7eb3c91640 1 -- 172.21.15.19:0/3019677650 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7e900664a0 msgr2=0x7f7e90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:03.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.179+0000 7f7eb3c91640 1 --2- 172.21.15.19:0/3019677650 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7e900664a0 0x7f7e90068960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7ea80af000 tx=0x7f7ea80a7000 comp rx=0 tx=0).stop 2023-11-20T06:42:03.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.179+0000 7f7eb3c91640 1 -- 172.21.15.19:0/3019677650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eac15cba0 msgr2=0x7f7eac151150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:03.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.179+0000 7f7eb3c91640 1 --2- 172.21.15.19:0/3019677650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eac15cba0 0x7f7eac151150 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4001fb0 tx=0x7f7ea400a430 comp rx=0 tx=0).stop 2023-11-20T06:42:03.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.179+0000 7f7eb3c91640 1 -- 172.21.15.19:0/3019677650 shutdown_connections 2023-11-20T06:42:03.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.179+0000 7f7eb3c91640 1 --2- 172.21.15.19:0/3019677650 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7e900664a0 0x7f7e90068960 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.179+0000 7f7eb3c91640 1 --2- 172.21.15.19:0/3019677650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eac15cba0 0x7f7eac151150 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.179+0000 7f7eb3c91640 1 --2- 172.21.15.19:0/3019677650 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eac0d0210 0x7f7eac0c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.179+0000 7f7eb3c91640 1 --2- 172.21.15.19:0/3019677650 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7eac0b84e0 0x7f7eac1f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.179+0000 7f7eb3c91640 1 -- 172.21.15.19:0/3019677650 >> 172.21.15.19:0/3019677650 conn(0x7f7eac0719c0 msgr2=0x7f7eac15ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:03.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.179+0000 7f7eb3c91640 1 -- 172.21.15.19:0/3019677650 shutdown_connections 2023-11-20T06:42:03.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.179+0000 7f7eb3c91640 1 -- 172.21.15.19:0/3019677650 wait complete. 2023-11-20T06:42:03.204 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T06:42:03.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.347+0000 7fb60ff72640 1 Processor -- start 2023-11-20T06:42:03.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.347+0000 7fb60ff72640 1 -- start start 2023-11-20T06:42:03.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.347+0000 7fb60ff72640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb60815cba0 0x7fb6080d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:03.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.347+0000 7fb60ff72640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb6080b84e0 0x7fb6080cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:03.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.347+0000 7fb60ff72640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6080d1670 con 0x7fb6080d0040 2023-11-20T06:42:03.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.347+0000 7fb60ff72640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6080d1460 con 0x7fb60815cba0 2023-11-20T06:42:03.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.347+0000 7fb60ff72640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6080d04b0 con 0x7fb6080b84e0 2023-11-20T06:42:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.347+0000 7fb60dd0e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb60815cba0 0x7fb6080d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.347+0000 7fb60dd0e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb60815cba0 0x7fb6080d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60262/0 (socket says 172.21.15.19:60262) 2023-11-20T06:42:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.347+0000 7fb60dd0e640 1 -- 172.21.15.19:0/872964620 learned_addr learned my addr 172.21.15.19:0/872964620 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.347+0000 7fb60d50d640 1 --2- 172.21.15.19:0/872964620 >> v2:172.21.15.190:3300/0 conn(0x7fb6080b84e0 0x7fb6080cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.347+0000 7fb60dd0e640 1 -- 172.21.15.19:0/872964620 >> v2:172.21.15.190:3300/0 conn(0x7fb6080b84e0 msgr2=0x7fb6080cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.347+0000 7fb60dd0e640 1 --2- 172.21.15.19:0/872964620 >> v2:172.21.15.190:3300/0 conn(0x7fb6080b84e0 0x7fb6080cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.347+0000 7fb60dd0e640 1 -- 172.21.15.19:0/872964620 >> v1:172.21.15.190:6789/0 conn(0x7fb6080d0040 legacy=0x7fb6080d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.347+0000 7fb60dd0e640 1 -- 172.21.15.19:0/872964620 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6080d1950 con 0x7fb60815cba0 2023-11-20T06:42:03.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.351+0000 7fb60dd0e640 1 --2- 172.21.15.19:0/872964620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb60815cba0 0x7fb6080d0f20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb6080cf2f0 tx=0x7fb60401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8071005673d86a26 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:03.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.351+0000 7fb60cd0c640 1 -- 172.21.15.19:0/872964620 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb604004230 con 0x7fb60815cba0 2023-11-20T06:42:03.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.351+0000 7fb60cd0c640 1 -- 172.21.15.19:0/872964620 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6040a7050 con 0x7fb60815cba0 2023-11-20T06:42:03.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.351+0000 7fb60cd0c640 1 -- 172.21.15.19:0/872964620 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb604003620 con 0x7fb60815cba0 2023-11-20T06:42:03.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.351+0000 7fb60ff72640 1 -- 172.21.15.19:0/872964620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb60815cba0 msgr2=0x7fb6080d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:03.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.351+0000 7fb60ff72640 1 --2- 172.21.15.19:0/872964620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb60815cba0 0x7fb6080d0f20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb6080cf2f0 tx=0x7fb60401c430 comp rx=0 tx=0).stop 2023-11-20T06:42:03.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.351+0000 7fb60ff72640 1 -- 172.21.15.19:0/872964620 shutdown_connections 2023-11-20T06:42:03.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.351+0000 7fb60ff72640 1 --2- 172.21.15.19:0/872964620 >> v2:172.21.15.190:3300/0 conn(0x7fb6080b84e0 0x7fb6080cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.351+0000 7fb60ff72640 1 --2- 172.21.15.19:0/872964620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb60815cba0 0x7fb6080d0f20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.351+0000 7fb60ff72640 1 -- 172.21.15.19:0/872964620 >> 172.21.15.19:0/872964620 conn(0x7fb6080719c0 msgr2=0x7fb608071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:03.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.351+0000 7fb60ff72640 1 -- 172.21.15.19:0/872964620 shutdown_connections 2023-11-20T06:42:03.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.351+0000 7fb60ff72640 1 -- 172.21.15.19:0/872964620 wait complete. 2023-11-20T06:42:03.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60ff72640 1 Processor -- start 2023-11-20T06:42:03.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60ff72640 1 -- start start 2023-11-20T06:42:03.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60ff72640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6080b84e0 0x7fb608150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:03.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60ff72640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6080d0040 0x7fb608155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:03.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60ff72640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb60815cba0 0x7fb6080c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:03.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60ff72640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6080c6710 con 0x7fb6080b84e0 2023-11-20T06:42:03.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60ff72640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60806c120 con 0x7fb6080d0040 2023-11-20T06:42:03.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60ff72640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6081580b0 con 0x7fb60815cba0 2023-11-20T06:42:03.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60dd0e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6080b84e0 0x7fb608150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:03.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60dd0e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6080b84e0 0x7fb608150060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60264/0 (socket says 172.21.15.19:60264) 2023-11-20T06:42:03.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60dd0e640 1 -- 172.21.15.19:0/2493355111 learned_addr learned my addr 172.21.15.19:0/2493355111 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:03.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60d50d640 1 --2- 172.21.15.19:0/2493355111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6080d0040 0x7fb608155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:03.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60e50f640 1 --2- 172.21.15.19:0/2493355111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb60815cba0 0x7fb6080c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:03.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60dd0e640 1 -- 172.21.15.19:0/2493355111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb60815cba0 msgr2=0x7fb6080c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:03.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60dd0e640 1 --2- 172.21.15.19:0/2493355111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb60815cba0 0x7fb6080c6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60dd0e640 1 -- 172.21.15.19:0/2493355111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6080d0040 msgr2=0x7fb608155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:03.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60dd0e640 1 --2- 172.21.15.19:0/2493355111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6080d0040 0x7fb608155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60dd0e640 1 -- 172.21.15.19:0/2493355111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6040094d0 con 0x7fb6080b84e0 2023-11-20T06:42:03.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60e50f640 1 --2- 172.21.15.19:0/2493355111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb60815cba0 0x7fb6080c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:03.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60dd0e640 1 --2- 172.21.15.19:0/2493355111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6080b84e0 0x7fb608150060 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb6040ae040 tx=0x7fb6040191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:03.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb5fe7fc640 1 -- 172.21.15.19:0/2493355111 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb604003c70 con 0x7fb6080b84e0 2023-11-20T06:42:03.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb5fe7fc640 1 -- 172.21.15.19:0/2493355111 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb604003df0 con 0x7fb6080b84e0 2023-11-20T06:42:03.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb5fe7fc640 1 -- 172.21.15.19:0/2493355111 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6040ab680 con 0x7fb6080b84e0 2023-11-20T06:42:03.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60ff72640 1 -- 172.21.15.19:0/2493355111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb608158390 con 0x7fb6080b84e0 2023-11-20T06:42:03.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60ff72640 1 -- 172.21.15.19:0/2493355111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb608158950 con 0x7fb6080b84e0 2023-11-20T06:42:03.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.355+0000 7fb60ff72640 1 -- 172.21.15.19:0/2493355111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb60804e170 con 0x7fb6080b84e0 2023-11-20T06:42:03.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.359+0000 7fb5fe7fc640 1 -- 172.21.15.19:0/2493355111 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb6040b2040 con 0x7fb6080b84e0 2023-11-20T06:42:03.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.359+0000 7fb5fe7fc640 1 --2- 172.21.15.19:0/2493355111 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb5ec0664d0 0x7fb5ec068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:03.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.359+0000 7fb5fe7fc640 1 -- 172.21.15.19:0/2493355111 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb60411e4d0 con 0x7fb6080b84e0 2023-11-20T06:42:03.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.359+0000 7fb60d50d640 1 --2- 172.21.15.19:0/2493355111 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb5ec0664d0 0x7fb5ec068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:03.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.359+0000 7fb60d50d640 1 --2- 172.21.15.19:0/2493355111 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb5ec0664d0 0x7fb5ec068990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb6080b6810 tx=0x7fb5f8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:03.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.363+0000 7fb5fe7fc640 1 -- 172.21.15.19:0/2493355111 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb6040eb4f0 con 0x7fb6080b84e0 2023-11-20T06:42:03.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.519+0000 7fb60ff72640 1 -- 172.21.15.19:0/2493355111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb60815b3d0 con 0x7fb6080b84e0 2023-11-20T06:42:03.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.519+0000 7fb5fe7fc640 1 -- 172.21.15.19:0/2493355111 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb6040eeb10 con 0x7fb6080b84e0 2023-11-20T06:42:03.526 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:03.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.523+0000 7fb60ff72640 1 -- 172.21.15.19:0/2493355111 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb5ec0664d0 msgr2=0x7fb5ec068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:03.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.523+0000 7fb60ff72640 1 --2- 172.21.15.19:0/2493355111 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb5ec0664d0 0x7fb5ec068990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb6080b6810 tx=0x7fb5f8008040 comp rx=0 tx=0).stop 2023-11-20T06:42:03.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.523+0000 7fb60ff72640 1 -- 172.21.15.19:0/2493355111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6080b84e0 msgr2=0x7fb608150060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:03.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.523+0000 7fb60ff72640 1 --2- 172.21.15.19:0/2493355111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6080b84e0 0x7fb608150060 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb6040ae040 tx=0x7fb6040191d0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.523+0000 7fb60ff72640 1 -- 172.21.15.19:0/2493355111 shutdown_connections 2023-11-20T06:42:03.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.523+0000 7fb60ff72640 1 --2- 172.21.15.19:0/2493355111 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb5ec0664d0 0x7fb5ec068990 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.523+0000 7fb60ff72640 1 --2- 172.21.15.19:0/2493355111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb60815cba0 0x7fb6080c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.523+0000 7fb60ff72640 1 --2- 172.21.15.19:0/2493355111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6080d0040 0x7fb608155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.523+0000 7fb60ff72640 1 --2- 172.21.15.19:0/2493355111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6080b84e0 0x7fb608150060 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.523+0000 7fb60ff72640 1 -- 172.21.15.19:0/2493355111 >> 172.21.15.19:0/2493355111 conn(0x7fb6080719c0 msgr2=0x7fb60815b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:03.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.523+0000 7fb60ff72640 1 -- 172.21.15.19:0/2493355111 shutdown_connections 2023-11-20T06:42:03.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.523+0000 7fb60ff72640 1 -- 172.21.15.19:0/2493355111 wait complete. 2023-11-20T06:42:03.547 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:03.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.683+0000 7f0c18b72640 1 Processor -- start 2023-11-20T06:42:03.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c18b72640 1 -- start start 2023-11-20T06:42:03.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c18b72640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c1415ca70 0x7f0c140d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:03.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c18b72640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c140c65f0 con 0x7f0c140d3550 2023-11-20T06:42:03.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c18b72640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c140cdf80 con 0x7f0c140cf7a0 2023-11-20T06:42:03.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c18b72640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c140ce820 con 0x7f0c1415ca70 2023-11-20T06:42:03.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c0bfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0c140d3550 0x7f0c140cf090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57752/0 (socket says 172.21.15.19:57752) 2023-11-20T06:42:03.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c0bfff640 1 -- 172.21.15.19:0/1873636262 learned_addr learned my addr 172.21.15.19:0/1873636262 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:03.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c1259c640 1 --2- 172.21.15.19:0/1873636262 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c1415ca70 0x7f0c140d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:03.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c11d9b640 1 -- 172.21.15.19:0/1873636262 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398198268 0 0) 0x7f0c140c65f0 con 0x7f0c140d3550 2023-11-20T06:42:03.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c11d9b640 1 -- 172.21.15.19:0/1873636262 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c00003530 con 0x7f0c140d3550 2023-11-20T06:42:03.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c11d9b640 1 -- 172.21.15.19:0/1873636262 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636335145 0 0) 0x7f0c140cdf80 con 0x7f0c140cf7a0 2023-11-20T06:42:03.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c11d9b640 1 -- 172.21.15.19:0/1873636262 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c140c65f0 con 0x7f0c140cf7a0 2023-11-20T06:42:03.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c11d9b640 1 -- 172.21.15.19:0/1873636262 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 43085344 0 0) 0x7f0c00003530 con 0x7f0c140d3550 2023-11-20T06:42:03.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c11d9b640 1 -- 172.21.15.19:0/1873636262 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c1415ca70 msgr2=0x7f0c140d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:03.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c11d9b640 1 --2- 172.21.15.19:0/1873636262 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c1415ca70 0x7f0c140d3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c11d9b640 1 -- 172.21.15.19:0/1873636262 >> v1:172.21.15.190:6789/0 conn(0x7f0c140cf7a0 legacy=0x7f0c140c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:03.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c11d9b640 1 -- 172.21.15.19:0/1873636262 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c140ce260 con 0x7f0c140d3550 2023-11-20T06:42:03.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c11d9b640 1 -- 172.21.15.19:0/1873636262 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7f0bfc001680 con 0x7f0c140d3550 2023-11-20T06:42:03.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c11d9b640 1 -- 172.21.15.19:0/1873636262 >> v1:172.21.15.19:6789/0 conn(0x7f0c140d3550 legacy=0x7f0c140cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:03.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c11d9b640 1 --2- 172.21.15.19:0/1873636262 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c00003b40 0x7f0c00003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:03.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c11d9b640 1 --2- 172.21.15.19:0/1873636262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c000047d0 0x7f0c00004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:03.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c11d9b640 1 --2- 172.21.15.19:0/1873636262 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c00005190 0x7f0c0000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:03.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c11d9b640 1 -- 172.21.15.19:0/1873636262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c140ce820 con 0x7f0c000047d0 2023-11-20T06:42:03.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c11d9b640 1 -- 172.21.15.19:0/1873636262 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0000bfb0 con 0x7f0c00003b40 2023-11-20T06:42:03.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c11d9b640 1 -- 172.21.15.19:0/1873636262 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0000c170 con 0x7f0c00005190 2023-11-20T06:42:03.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c1259c640 1 --2- 172.21.15.19:0/1873636262 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c1415ca70 0x7f0c140d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:42:03.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c0bfff640 1 --2- 172.21.15.19:0/1873636262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c000047d0 0x7f0c00004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:03.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c12d9d640 1 --2- 172.21.15.19:0/1873636262 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c00005190 0x7f0c0000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:03.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c1259c640 1 --2- 172.21.15.19:0/1873636262 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c00003b40 0x7f0c00003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:03.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c0bfff640 1 -- 172.21.15.19:0/1873636262 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c00005190 msgr2=0x7f0c0000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:03.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c0bfff640 1 --2- 172.21.15.19:0/1873636262 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c00005190 0x7f0c0000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c0bfff640 1 -- 172.21.15.19:0/1873636262 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c00003b40 msgr2=0x7f0c00003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:03.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c0bfff640 1 --2- 172.21.15.19:0/1873636262 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c00003b40 0x7f0c00003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c0bfff640 1 -- 172.21.15.19:0/1873636262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c00003530 con 0x7f0c000047d0 2023-11-20T06:42:03.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c12d9d640 1 --2- 172.21.15.19:0/1873636262 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c00005190 0x7f0c0000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:03.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.687+0000 7f0c1259c640 1 --2- 172.21.15.19:0/1873636262 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c00003b40 0x7f0c00003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:03.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.691+0000 7f0c0bfff640 1 --2- 172.21.15.19:0/1873636262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c000047d0 0x7f0c00004c50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc007fb0 tx=0x7f0bfc01cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571d391322a89872 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:03.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.691+0000 7f0c11d9b640 1 -- 172.21.15.19:0/1873636262 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc005ae0 con 0x7f0c000047d0 2023-11-20T06:42:03.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.691+0000 7f0c11d9b640 1 -- 172.21.15.19:0/1873636262 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bfc005c60 con 0x7f0c000047d0 2023-11-20T06:42:03.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.691+0000 7f0c11d9b640 1 -- 172.21.15.19:0/1873636262 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc0a57e0 con 0x7f0c000047d0 2023-11-20T06:42:03.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.691+0000 7f0c18b72640 1 -- 172.21.15.19:0/1873636262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c000047d0 msgr2=0x7f0c00004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:03.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.691+0000 7f0c18b72640 1 --2- 172.21.15.19:0/1873636262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c000047d0 0x7f0c00004c50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc007fb0 tx=0x7f0bfc01cae0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.691+0000 7f0c12d9d640 1 -- 172.21.15.19:0/1873636262 reap_dead start 2023-11-20T06:42:03.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.691+0000 7f0c18b72640 1 -- 172.21.15.19:0/1873636262 shutdown_connections 2023-11-20T06:42:03.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.691+0000 7f0c18b72640 1 -- 172.21.15.19:0/1873636262 >> 172.21.15.19:0/1873636262 conn(0x7f0c1409bc50 msgr2=0x7f0c140d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:03.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.691+0000 7f0c18b72640 1 -- 172.21.15.19:0/1873636262 shutdown_connections 2023-11-20T06:42:03.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.691+0000 7f0c18b72640 1 -- 172.21.15.19:0/1873636262 wait complete. 2023-11-20T06:42:03.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c18b72640 1 Processor -- start 2023-11-20T06:42:03.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c18b72640 1 -- start start 2023-11-20T06:42:03.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c18b72640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c000047d0 0x7f0c1415fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:03.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c18b72640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c140cacf0 0x7f0c140cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:03.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c18b72640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c140b7b30 0x7f0c140b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:03.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c18b72640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c140b5c00 con 0x7f0c000047d0 2023-11-20T06:42:03.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c18b72640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c140cb6b0 con 0x7f0c140cacf0 2023-11-20T06:42:03.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c18b72640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c140cb900 con 0x7f0c140b7b30 2023-11-20T06:42:03.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c1259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c000047d0 0x7f0c1415fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:03.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c1259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c000047d0 0x7f0c1415fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60292/0 (socket says 172.21.15.19:60292) 2023-11-20T06:42:03.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c1259c640 1 -- 172.21.15.19:0/2438618942 learned_addr learned my addr 172.21.15.19:0/2438618942 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:03.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c0bfff640 1 --2- 172.21.15.19:0/2438618942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c140cacf0 0x7f0c140cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:03.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c12d9d640 1 --2- 172.21.15.19:0/2438618942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c140b7b30 0x7f0c140b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:03.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c1259c640 1 -- 172.21.15.19:0/2438618942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c140b7b30 msgr2=0x7f0c140b7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:03.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c1259c640 1 --2- 172.21.15.19:0/2438618942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c140b7b30 0x7f0c140b7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c1259c640 1 -- 172.21.15.19:0/2438618942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c140cacf0 msgr2=0x7f0c140cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:03.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c1259c640 1 --2- 172.21.15.19:0/2438618942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c140cacf0 0x7f0c140cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c1259c640 1 -- 172.21.15.19:0/2438618942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c140cbbe0 con 0x7f0c000047d0 2023-11-20T06:42:03.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c12d9d640 1 --2- 172.21.15.19:0/2438618942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c140b7b30 0x7f0c140b7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:03.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c1259c640 1 --2- 172.21.15.19:0/2438618942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c000047d0 0x7f0c1415fae0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0c04011660 tx=0x7f0c04011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:03.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c0affd640 1 -- 172.21.15.19:0/2438618942 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0400f9c0 con 0x7f0c000047d0 2023-11-20T06:42:03.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c0affd640 1 -- 172.21.15.19:0/2438618942 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0400fb20 con 0x7f0c000047d0 2023-11-20T06:42:03.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c0affd640 1 -- 172.21.15.19:0/2438618942 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0400fe90 con 0x7f0c000047d0 2023-11-20T06:42:03.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c18b72640 1 -- 172.21.15.19:0/2438618942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c140cbec0 con 0x7f0c000047d0 2023-11-20T06:42:03.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.695+0000 7f0c18b72640 1 -- 172.21.15.19:0/2438618942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c140cc480 con 0x7f0c000047d0 2023-11-20T06:42:03.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.699+0000 7f0c18b72640 1 -- 172.21.15.19:0/2438618942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c14074010 con 0x7f0c000047d0 2023-11-20T06:42:03.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.699+0000 7f0c0affd640 1 -- 172.21.15.19:0/2438618942 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0c04015460 con 0x7f0c000047d0 2023-11-20T06:42:03.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.699+0000 7f0c0affd640 1 --2- 172.21.15.19:0/2438618942 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0bf40664a0 0x7f0bf4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:03.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.699+0000 7f0c0affd640 1 -- 172.21.15.19:0/2438618942 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0c04084b20 con 0x7f0c000047d0 2023-11-20T06:42:03.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.699+0000 7f0c0bfff640 1 --2- 172.21.15.19:0/2438618942 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0bf40664a0 0x7f0bf4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:03.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.699+0000 7f0c0bfff640 1 --2- 172.21.15.19:0/2438618942 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0bf40664a0 0x7f0bf4068960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc0ab000 tx=0x7f0bfc0a7070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:03.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.703+0000 7f0c0affd640 1 -- 172.21.15.19:0/2438618942 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0c04051b40 con 0x7f0c000047d0 2023-11-20T06:42:03.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.863+0000 7f0c18b72640 1 -- 172.21.15.19:0/2438618942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c1408c950 con 0x7f0c000047d0 2023-11-20T06:42:03.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.863+0000 7f0c0affd640 1 -- 172.21.15.19:0/2438618942 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18720 (secure 0 0 0) 0x7f0c04022090 con 0x7f0c000047d0 2023-11-20T06:42:03.871 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:03.871 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:55.472006+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:03.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.867+0000 7f0c18b72640 1 -- 172.21.15.19:0/2438618942 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0bf40664a0 msgr2=0x7f0bf4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:03.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.867+0000 7f0c18b72640 1 --2- 172.21.15.19:0/2438618942 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0bf40664a0 0x7f0bf4068960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc0ab000 tx=0x7f0bfc0a7070 comp rx=0 tx=0).stop 2023-11-20T06:42:03.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.867+0000 7f0c18b72640 1 -- 172.21.15.19:0/2438618942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c000047d0 msgr2=0x7f0c1415fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:03.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.867+0000 7f0c18b72640 1 --2- 172.21.15.19:0/2438618942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c000047d0 0x7f0c1415fae0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0c04011660 tx=0x7f0c04011b20 comp rx=0 tx=0).stop 2023-11-20T06:42:03.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.867+0000 7f0c18b72640 1 -- 172.21.15.19:0/2438618942 shutdown_connections 2023-11-20T06:42:03.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.867+0000 7f0c18b72640 1 --2- 172.21.15.19:0/2438618942 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0bf40664a0 0x7f0bf4068960 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.867+0000 7f0c18b72640 1 --2- 172.21.15.19:0/2438618942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c140b7b30 0x7f0c140b7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.867+0000 7f0c18b72640 1 --2- 172.21.15.19:0/2438618942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c140cacf0 0x7f0c140cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.867+0000 7f0c18b72640 1 --2- 172.21.15.19:0/2438618942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c000047d0 0x7f0c1415fae0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:03.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.867+0000 7f0c18b72640 1 -- 172.21.15.19:0/2438618942 >> 172.21.15.19:0/2438618942 conn(0x7f0c1409bc50 msgr2=0x7f0c140c6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:03.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.867+0000 7f0c18b72640 1 -- 172.21.15.19:0/2438618942 shutdown_connections 2023-11-20T06:42:03.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:03.867+0000 7f0c18b72640 1 -- 172.21.15.19:0/2438618942 wait complete. 2023-11-20T06:42:03.892 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T06:41:11.805111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T06:41:12.614034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T06:41:16.311206+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T06:42:03.893 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:42:04.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.031+0000 7f18306d6640 1 Processor -- start 2023-11-20T06:42:04.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.035+0000 7f18306d6640 1 -- start start 2023-11-20T06:42:04.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.035+0000 7f18306d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1828069e90 0x7f182806d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:04.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.035+0000 7f18306d6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182815ae30 con 0x7f18280c26b0 2023-11-20T06:42:04.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.035+0000 7f18306d6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18280ca510 con 0x7f182806a270 2023-11-20T06:42:04.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.035+0000 7f18306d6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18280cb090 con 0x7f1828069e90 2023-11-20T06:42:04.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.035+0000 7f182ec73640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f18280c26b0 0x7f18280c2b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57754/0 (socket says 172.21.15.19:57754) 2023-11-20T06:42:04.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.035+0000 7f182ec73640 1 -- 172.21.15.19:0/3551038904 learned_addr learned my addr 172.21.15.19:0/3551038904 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:04.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.035+0000 7f182e472640 1 --2- 172.21.15.19:0/3551038904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1828069e90 0x7f182806d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:04.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.035+0000 7f182d470640 1 -- 172.21.15.19:0/3551038904 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195166228 0 0) 0x7f182815ae30 con 0x7f18280c26b0 2023-11-20T06:42:04.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.035+0000 7f182d470640 1 -- 172.21.15.19:0/3551038904 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1814003530 con 0x7f18280c26b0 2023-11-20T06:42:04.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.035+0000 7f182d470640 1 -- 172.21.15.19:0/3551038904 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225161199 0 0) 0x7f18280ca510 con 0x7f182806a270 2023-11-20T06:42:04.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.035+0000 7f182d470640 1 -- 172.21.15.19:0/3551038904 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f182815ae30 con 0x7f182806a270 2023-11-20T06:42:04.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.035+0000 7f182e472640 1 -- 172.21.15.19:0/3551038904 >> v1:172.21.15.190:6789/0 conn(0x7f182806a270 legacy=0x7f18280c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:04.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.035+0000 7f182e472640 1 -- 172.21.15.19:0/3551038904 >> v1:172.21.15.19:6789/0 conn(0x7f18280c26b0 legacy=0x7f18280c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:04.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.035+0000 7f182e472640 1 -- 172.21.15.19:0/3551038904 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18280ca7f0 con 0x7f1828069e90 2023-11-20T06:42:04.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.039+0000 7f182e472640 1 --2- 172.21.15.19:0/3551038904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1828069e90 0x7f182806d010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f18240097f0 tx=0x7f182401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2be0b08c294b5cc6 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:04.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.039+0000 7f182d470640 1 -- 172.21.15.19:0/3551038904 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18240aa5f0 con 0x7f1828069e90 2023-11-20T06:42:04.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.039+0000 7f182d470640 1 -- 172.21.15.19:0/3551038904 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18240aa750 con 0x7f1828069e90 2023-11-20T06:42:04.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.039+0000 7f182d470640 1 -- 172.21.15.19:0/3551038904 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18240aaae0 con 0x7f1828069e90 2023-11-20T06:42:04.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.039+0000 7f18306d6640 1 -- 172.21.15.19:0/3551038904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1828069e90 msgr2=0x7f182806d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:04.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.039+0000 7f18306d6640 1 --2- 172.21.15.19:0/3551038904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1828069e90 0x7f182806d010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f18240097f0 tx=0x7f182401c490 comp rx=0 tx=0).stop 2023-11-20T06:42:04.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.039+0000 7f18306d6640 1 -- 172.21.15.19:0/3551038904 shutdown_connections 2023-11-20T06:42:04.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.039+0000 7f18306d6640 1 --2- 172.21.15.19:0/3551038904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1828069e90 0x7f182806d010 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.039+0000 7f18306d6640 1 -- 172.21.15.19:0/3551038904 >> 172.21.15.19:0/3551038904 conn(0x7f18280b0da0 msgr2=0x7f18280ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:04.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.039+0000 7f18306d6640 1 -- 172.21.15.19:0/3551038904 shutdown_connections 2023-11-20T06:42:04.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.039+0000 7f18306d6640 1 -- 172.21.15.19:0/3551038904 wait complete. 2023-11-20T06:42:04.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f18306d6640 1 Processor -- start 2023-11-20T06:42:04.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f18306d6640 1 -- start start 2023-11-20T06:42:04.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f18306d6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1828069e90 0x7f1828153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:04.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f18306d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f182806a270 0x7f18280ac760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:04.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f18306d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18280c26b0 0x7f18280acca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:04.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f18306d6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182815c150 con 0x7f18280c26b0 2023-11-20T06:42:04.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f18306d6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182815b4d0 con 0x7f1828069e90 2023-11-20T06:42:04.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f18306d6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182815b7b0 con 0x7f182806a270 2023-11-20T06:42:04.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f182ec73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18280c26b0 0x7f18280acca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:04.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f182ec73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18280c26b0 0x7f18280acca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60306/0 (socket says 172.21.15.19:60306) 2023-11-20T06:42:04.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f182ec73640 1 -- 172.21.15.19:0/3544176386 learned_addr learned my addr 172.21.15.19:0/3544176386 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:04.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f182dc71640 1 --2- 172.21.15.19:0/3544176386 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f182806a270 0x7f18280ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:04.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f182e472640 1 --2- 172.21.15.19:0/3544176386 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1828069e90 0x7f1828153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:04.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f182ec73640 1 -- 172.21.15.19:0/3544176386 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f182806a270 msgr2=0x7f18280ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:04.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f182ec73640 1 --2- 172.21.15.19:0/3544176386 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f182806a270 0x7f18280ac760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f182ec73640 1 -- 172.21.15.19:0/3544176386 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1828069e90 msgr2=0x7f1828153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:04.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f182ec73640 1 --2- 172.21.15.19:0/3544176386 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1828069e90 0x7f1828153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f182ec73640 1 -- 172.21.15.19:0/3544176386 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1824009420 con 0x7f18280c26b0 2023-11-20T06:42:04.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f182ec73640 1 --2- 172.21.15.19:0/3544176386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18280c26b0 0x7f18280acca0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f182000caa0 tx=0x7f182000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:04.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f181effd640 1 -- 172.21.15.19:0/3544176386 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182000ac00 con 0x7f18280c26b0 2023-11-20T06:42:04.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f181effd640 1 -- 172.21.15.19:0/3544176386 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182000ad80 con 0x7f18280c26b0 2023-11-20T06:42:04.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f181effd640 1 -- 172.21.15.19:0/3544176386 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1820012640 con 0x7f18280c26b0 2023-11-20T06:42:04.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f18306d6640 1 -- 172.21.15.19:0/3544176386 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182815ba90 con 0x7f18280c26b0 2023-11-20T06:42:04.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f18306d6640 1 -- 172.21.15.19:0/3544176386 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1828154110 con 0x7f18280c26b0 2023-11-20T06:42:04.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.043+0000 7f18306d6640 1 -- 172.21.15.19:0/3544176386 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182815c290 con 0x7f18280c26b0 2023-11-20T06:42:04.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.047+0000 7f181effd640 1 -- 172.21.15.19:0/3544176386 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1820007070 con 0x7f18280c26b0 2023-11-20T06:42:04.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.047+0000 7f181effd640 1 --2- 172.21.15.19:0/3544176386 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f180c0664a0 0x7f180c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:04.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.047+0000 7f181effd640 1 -- 172.21.15.19:0/3544176386 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1820084180 con 0x7f18280c26b0 2023-11-20T06:42:04.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.047+0000 7f182e472640 1 --2- 172.21.15.19:0/3544176386 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f180c0664a0 0x7f180c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:04.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.047+0000 7f182e472640 1 --2- 172.21.15.19:0/3544176386 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f180c0664a0 0x7f180c068960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f18240ae000 tx=0x7f18240a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:04.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.051+0000 7f181effd640 1 -- 172.21.15.19:0/3544176386 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f182815c290 con 0x7f18280c26b0 2023-11-20T06:42:04.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.207+0000 7f18306d6640 1 -- 172.21.15.19:0/3544176386 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f182815c290 con 0x7f18280c26b0 2023-11-20T06:42:04.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.207+0000 7f181effd640 1 -- 172.21.15.19:0/3544176386 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f182815c290 con 0x7f18280c26b0 2023-11-20T06:42:04.214 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:42:04.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.211+0000 7f18306d6640 1 -- 172.21.15.19:0/3544176386 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f180c0664a0 msgr2=0x7f180c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:04.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.211+0000 7f18306d6640 1 --2- 172.21.15.19:0/3544176386 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f180c0664a0 0x7f180c068960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f18240ae000 tx=0x7f18240a7000 comp rx=0 tx=0).stop 2023-11-20T06:42:04.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.211+0000 7f18306d6640 1 -- 172.21.15.19:0/3544176386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18280c26b0 msgr2=0x7f18280acca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:04.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.211+0000 7f18306d6640 1 --2- 172.21.15.19:0/3544176386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18280c26b0 0x7f18280acca0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f182000caa0 tx=0x7f182000cf60 comp rx=0 tx=0).stop 2023-11-20T06:42:04.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.211+0000 7f18306d6640 1 -- 172.21.15.19:0/3544176386 shutdown_connections 2023-11-20T06:42:04.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.211+0000 7f18306d6640 1 --2- 172.21.15.19:0/3544176386 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f180c0664a0 0x7f180c068960 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.211+0000 7f18306d6640 1 --2- 172.21.15.19:0/3544176386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18280c26b0 0x7f18280acca0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.211+0000 7f18306d6640 1 --2- 172.21.15.19:0/3544176386 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f182806a270 0x7f18280ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.211+0000 7f18306d6640 1 --2- 172.21.15.19:0/3544176386 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1828069e90 0x7f1828153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.211+0000 7f18306d6640 1 -- 172.21.15.19:0/3544176386 >> 172.21.15.19:0/3544176386 conn(0x7f18280b0da0 msgr2=0x7f1828070840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:04.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.211+0000 7f18306d6640 1 -- 172.21.15.19:0/3544176386 shutdown_connections 2023-11-20T06:42:04.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.211+0000 7f18306d6640 1 -- 172.21.15.19:0/3544176386 wait complete. 2023-11-20T06:42:04.235 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T06:42:04.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.375+0000 7fd803046640 1 Processor -- start 2023-11-20T06:42:04.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.375+0000 7fd803046640 1 -- start start 2023-11-20T06:42:04.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.375+0000 7fd803046640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd7fc15cba0 0x7fd7fc0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:04.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.375+0000 7fd803046640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd7fc0b84e0 0x7fd7fc0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:04.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.375+0000 7fd803046640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7fc0d0040 0x7fd7fc0d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:04.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.375+0000 7fd803046640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7fc0d1460 con 0x7fd7fc15cba0 2023-11-20T06:42:04.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.375+0000 7fd803046640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7fc0d04b0 con 0x7fd7fc0b84e0 2023-11-20T06:42:04.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.375+0000 7fd803046640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc0d1670 con 0x7fd7fc0d0040 2023-11-20T06:42:04.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.379+0000 7fd800de2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd7fc15cba0 0x7fd7fc0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:04.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.379+0000 7fd800de2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd7fc15cba0 0x7fd7fc0d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60318/0 (socket says 172.21.15.19:60318) 2023-11-20T06:42:04.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.379+0000 7fd800de2640 1 -- 172.21.15.19:0/3792906706 learned_addr learned my addr 172.21.15.19:0/3792906706 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:04.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.379+0000 7fd7fbfff640 1 --2- 172.21.15.19:0/3792906706 >> v2:172.21.15.190:3300/0 conn(0x7fd7fc0b84e0 0x7fd7fc0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:04.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.379+0000 7fd8015e3640 1 --2- 172.21.15.19:0/3792906706 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7fc0d0040 0x7fd7fc0d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:04.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.379+0000 7fd800de2640 1 -- 172.21.15.19:0/3792906706 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7fc0d0040 msgr2=0x7fd7fc0d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:04.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.379+0000 7fd800de2640 1 --2- 172.21.15.19:0/3792906706 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7fc0d0040 0x7fd7fc0d2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.379+0000 7fd800de2640 1 -- 172.21.15.19:0/3792906706 >> v2:172.21.15.190:3300/0 conn(0x7fd7fc0b84e0 msgr2=0x7fd7fc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:04.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.379+0000 7fd800de2640 1 --2- 172.21.15.19:0/3792906706 >> v2:172.21.15.190:3300/0 conn(0x7fd7fc0b84e0 0x7fd7fc0cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.379+0000 7fd800de2640 1 -- 172.21.15.19:0/3792906706 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc0d1950 con 0x7fd7fc15cba0 2023-11-20T06:42:04.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.379+0000 7fd800de2640 1 --2- 172.21.15.19:0/3792906706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7fc15cba0 0x7fd7fc0d0f20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0cf2f0 tx=0x7fd7f001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f989fe1ebef12410 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:04.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.379+0000 7fd7fb7fe640 1 -- 172.21.15.19:0/3792906706 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f00ab600 con 0x7fd7fc15cba0 2023-11-20T06:42:04.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.379+0000 7fd7fb7fe640 1 -- 172.21.15.19:0/3792906706 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f00a7050 con 0x7fd7fc15cba0 2023-11-20T06:42:04.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.379+0000 7fd7fb7fe640 1 -- 172.21.15.19:0/3792906706 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f00ab980 con 0x7fd7fc15cba0 2023-11-20T06:42:04.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd803046640 1 -- 172.21.15.19:0/3792906706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7fc15cba0 msgr2=0x7fd7fc0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:04.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd803046640 1 --2- 172.21.15.19:0/3792906706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7fc15cba0 0x7fd7fc0d0f20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0cf2f0 tx=0x7fd7f001c240 comp rx=0 tx=0).stop 2023-11-20T06:42:04.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd803046640 1 -- 172.21.15.19:0/3792906706 shutdown_connections 2023-11-20T06:42:04.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd803046640 1 --2- 172.21.15.19:0/3792906706 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7fc0d0040 0x7fd7fc0d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd803046640 1 --2- 172.21.15.19:0/3792906706 >> v2:172.21.15.190:3300/0 conn(0x7fd7fc0b84e0 0x7fd7fc0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd803046640 1 --2- 172.21.15.19:0/3792906706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7fc15cba0 0x7fd7fc0d0f20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd803046640 1 -- 172.21.15.19:0/3792906706 >> 172.21.15.19:0/3792906706 conn(0x7fd7fc0719c0 msgr2=0x7fd7fc071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:04.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd803046640 1 -- 172.21.15.19:0/3792906706 shutdown_connections 2023-11-20T06:42:04.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd803046640 1 -- 172.21.15.19:0/3792906706 wait complete. 2023-11-20T06:42:04.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd803046640 1 Processor -- start 2023-11-20T06:42:04.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd803046640 1 -- start start 2023-11-20T06:42:04.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd803046640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7fc0b84e0 0x7fd7fc14f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:04.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd803046640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7fc0d0040 0x7fd7fc15f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:04.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd803046640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7fc15cba0 0x7fd7fc0c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:04.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd803046640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc160470 con 0x7fd7fc0d0040 2023-11-20T06:42:04.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd803046640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc0c9fd0 con 0x7fd7fc15cba0 2023-11-20T06:42:04.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd803046640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc15fbd0 con 0x7fd7fc0b84e0 2023-11-20T06:42:04.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd7fbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7fc0d0040 0x7fd7fc15f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:04.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd7fbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7fc0d0040 0x7fd7fc15f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60326/0 (socket says 172.21.15.19:60326) 2023-11-20T06:42:04.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd7fbfff640 1 -- 172.21.15.19:0/830306899 learned_addr learned my addr 172.21.15.19:0/830306899 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:04.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd8015e3640 1 --2- 172.21.15.19:0/830306899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7fc15cba0 0x7fd7fc0c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:04.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.383+0000 7fd800de2640 1 --2- 172.21.15.19:0/830306899 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7fc0b84e0 0x7fd7fc14f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:04.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.387+0000 7fd7fbfff640 1 -- 172.21.15.19:0/830306899 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7fc0b84e0 msgr2=0x7fd7fc14f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:04.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.387+0000 7fd7fbfff640 1 --2- 172.21.15.19:0/830306899 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7fc0b84e0 0x7fd7fc14f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.387+0000 7fd7fbfff640 1 -- 172.21.15.19:0/830306899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7fc15cba0 msgr2=0x7fd7fc0c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:04.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.387+0000 7fd7fbfff640 1 --2- 172.21.15.19:0/830306899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7fc15cba0 0x7fd7fc0c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.387+0000 7fd7fbfff640 1 -- 172.21.15.19:0/830306899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f00094d0 con 0x7fd7fc0d0040 2023-11-20T06:42:04.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.387+0000 7fd800de2640 1 --2- 172.21.15.19:0/830306899 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7fc0b84e0 0x7fd7fc14f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:04.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.387+0000 7fd7fbfff640 1 --2- 172.21.15.19:0/830306899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7fc0d0040 0x7fd7fc15f120 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800d800 tx=0x7fd7e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.387+0000 7fd7f97fa640 1 -- 172.21.15.19:0/830306899 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80096a0 con 0x7fd7fc0d0040 2023-11-20T06:42:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.387+0000 7fd7f97fa640 1 -- 172.21.15.19:0/830306899 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e8009800 con 0x7fd7fc0d0040 2023-11-20T06:42:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.387+0000 7fd803046640 1 -- 172.21.15.19:0/830306899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7fc15feb0 con 0x7fd7fc0d0040 2023-11-20T06:42:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.387+0000 7fd7f97fa640 1 -- 172.21.15.19:0/830306899 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8009b70 con 0x7fd7fc0d0040 2023-11-20T06:42:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.387+0000 7fd803046640 1 -- 172.21.15.19:0/830306899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7fc150440 con 0x7fd7fc0d0040 2023-11-20T06:42:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.387+0000 7fd803046640 1 -- 172.21.15.19:0/830306899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7fc04e170 con 0x7fd7fc0d0040 2023-11-20T06:42:04.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.387+0000 7fd7f97fa640 1 -- 172.21.15.19:0/830306899 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd7e8009cd0 con 0x7fd7fc0d0040 2023-11-20T06:42:04.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.387+0000 7fd7f97fa640 1 --2- 172.21.15.19:0/830306899 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd7e00664a0 0x7fd7e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:04.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.387+0000 7fd7f97fa640 1 -- 172.21.15.19:0/830306899 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd7e8084920 con 0x7fd7fc0d0040 2023-11-20T06:42:04.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.391+0000 7fd800de2640 1 --2- 172.21.15.19:0/830306899 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd7e00664a0 0x7fd7e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:04.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.391+0000 7fd800de2640 1 --2- 172.21.15.19:0/830306899 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd7e00664a0 0x7fd7e0068960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00ad000 tx=0x7fd7f0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:04.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.391+0000 7fd7f97fa640 1 -- 172.21.15.19:0/830306899 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd7e80519d0 con 0x7fd7fc0d0040 2023-11-20T06:42:04.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.551+0000 7fd803046640 1 -- 172.21.15.19:0/830306899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd7fc15b520 con 0x7fd7fc0d0040 2023-11-20T06:42:04.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.551+0000 7fd7f97fa640 1 -- 172.21.15.19:0/830306899 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd7e8054ff0 con 0x7fd7fc0d0040 2023-11-20T06:42:04.557 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:04.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.551+0000 7fd803046640 1 -- 172.21.15.19:0/830306899 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd7e00664a0 msgr2=0x7fd7e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:04.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.551+0000 7fd803046640 1 --2- 172.21.15.19:0/830306899 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd7e00664a0 0x7fd7e0068960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00ad000 tx=0x7fd7f0008040 comp rx=0 tx=0).stop 2023-11-20T06:42:04.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.551+0000 7fd803046640 1 -- 172.21.15.19:0/830306899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7fc0d0040 msgr2=0x7fd7fc15f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:04.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.551+0000 7fd803046640 1 --2- 172.21.15.19:0/830306899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7fc0d0040 0x7fd7fc15f120 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800d800 tx=0x7fd7e800dcc0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.555+0000 7fd803046640 1 -- 172.21.15.19:0/830306899 shutdown_connections 2023-11-20T06:42:04.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.555+0000 7fd803046640 1 --2- 172.21.15.19:0/830306899 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd7e00664a0 0x7fd7e0068960 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.555+0000 7fd803046640 1 --2- 172.21.15.19:0/830306899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7fc15cba0 0x7fd7fc0c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.555+0000 7fd803046640 1 --2- 172.21.15.19:0/830306899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7fc0d0040 0x7fd7fc15f120 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.555+0000 7fd803046640 1 --2- 172.21.15.19:0/830306899 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7fc0b84e0 0x7fd7fc14f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.555+0000 7fd803046640 1 -- 172.21.15.19:0/830306899 >> 172.21.15.19:0/830306899 conn(0x7fd7fc0719c0 msgr2=0x7fd7fc06b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:04.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.555+0000 7fd803046640 1 -- 172.21.15.19:0/830306899 shutdown_connections 2023-11-20T06:42:04.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.555+0000 7fd803046640 1 -- 172.21.15.19:0/830306899 wait complete. 2023-11-20T06:42:04.579 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T06:42:04.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.719+0000 7f4e2fac9640 1 Processor -- start 2023-11-20T06:42:04.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.719+0000 7f4e2fac9640 1 -- start start 2023-11-20T06:42:04.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.719+0000 7f4e2fac9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4e2806e260 0x7f4e280b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:04.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.719+0000 7f4e2fac9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e280b4600 con 0x7f4e2806a5a0 2023-11-20T06:42:04.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.719+0000 7f4e2fac9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e280c8dd0 con 0x7f4e28159900 2023-11-20T06:42:04.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.719+0000 7f4e2fac9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e280cd740 con 0x7f4e2806e260 2023-11-20T06:42:04.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.719+0000 7f4e2d064640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4e2806a5a0 0x7f4e280c9b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57764/0 (socket says 172.21.15.19:57764) 2023-11-20T06:42:04.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.719+0000 7f4e2d064640 1 -- 172.21.15.19:0/3578170174 learned_addr learned my addr 172.21.15.19:0/3578170174 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:04.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.719+0000 7f4e2e066640 1 --2- 172.21.15.19:0/3578170174 >> v2:172.21.15.190:3300/0 conn(0x7f4e2806e260 0x7f4e280b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.723+0000 7f4e2c863640 1 -- 172.21.15.19:0/3578170174 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 690826511 0 0) 0x7f4e280b4600 con 0x7f4e2806a5a0 2023-11-20T06:42:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.723+0000 7f4e2c863640 1 -- 172.21.15.19:0/3578170174 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e14005740 con 0x7f4e2806a5a0 2023-11-20T06:42:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.723+0000 7f4e2c863640 1 -- 172.21.15.19:0/3578170174 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270371921 0 0) 0x7f4e280c8dd0 con 0x7f4e28159900 2023-11-20T06:42:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.723+0000 7f4e2c863640 1 -- 172.21.15.19:0/3578170174 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e280b4600 con 0x7f4e28159900 2023-11-20T06:42:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.723+0000 7f4e2c863640 1 -- 172.21.15.19:0/3578170174 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4032436938 0 0) 0x7f4e14005740 con 0x7f4e2806a5a0 2023-11-20T06:42:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.723+0000 7f4e2e066640 1 -- 172.21.15.19:0/3578170174 >> v1:172.21.15.190:6789/0 conn(0x7f4e28159900 legacy=0x7f4e28069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.723+0000 7f4e2e066640 1 -- 172.21.15.19:0/3578170174 >> v1:172.21.15.19:6789/0 conn(0x7f4e2806a5a0 legacy=0x7f4e280c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.723+0000 7f4e2e066640 1 -- 172.21.15.19:0/3578170174 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e280c90b0 con 0x7f4e2806e260 2023-11-20T06:42:04.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.723+0000 7f4e2e066640 1 --2- 172.21.15.19:0/3578170174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e2806e260 0x7f4e280b3f00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4e20009d90 tx=0x7f4e2001c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ba679ae2e63d5f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:04.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.723+0000 7f4e2c863640 1 -- 172.21.15.19:0/3578170174 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18001680 con 0x7f4e2806e260 2023-11-20T06:42:04.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.723+0000 7f4e2c863640 1 -- 172.21.15.19:0/3578170174 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e200a56b0 con 0x7f4e2806e260 2023-11-20T06:42:04.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.723+0000 7f4e2c863640 1 -- 172.21.15.19:0/3578170174 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e200a5a40 con 0x7f4e2806e260 2023-11-20T06:42:04.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2fac9640 1 -- 172.21.15.19:0/3578170174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e2806e260 msgr2=0x7f4e280b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:04.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2fac9640 1 --2- 172.21.15.19:0/3578170174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e2806e260 0x7f4e280b3f00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4e20009d90 tx=0x7f4e2001c870 comp rx=0 tx=0).stop 2023-11-20T06:42:04.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2fac9640 1 -- 172.21.15.19:0/3578170174 shutdown_connections 2023-11-20T06:42:04.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2fac9640 1 --2- 172.21.15.19:0/3578170174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e2806e260 0x7f4e280b3f00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2fac9640 1 -- 172.21.15.19:0/3578170174 >> 172.21.15.19:0/3578170174 conn(0x7f4e280b0da0 msgr2=0x7f4e280ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:04.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2fac9640 1 -- 172.21.15.19:0/3578170174 shutdown_connections 2023-11-20T06:42:04.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2fac9640 1 -- 172.21.15.19:0/3578170174 wait complete. 2023-11-20T06:42:04.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2fac9640 1 Processor -- start 2023-11-20T06:42:04.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2fac9640 1 -- start start 2023-11-20T06:42:04.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2fac9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e2806a5a0 0x7f4e28149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:04.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2fac9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e2806e260 0x7f4e28145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:04.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2fac9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e28159900 0x7f4e280b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:04.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2fac9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e280b2680 con 0x7f4e28159900 2023-11-20T06:42:04.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2fac9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e280b2960 con 0x7f4e2806a5a0 2023-11-20T06:42:04.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2fac9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e280b2c40 con 0x7f4e2806e260 2023-11-20T06:42:04.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2e066640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e28159900 0x7f4e280b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:04.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2e066640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e28159900 0x7f4e280b3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60334/0 (socket says 172.21.15.19:60334) 2023-11-20T06:42:04.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2e066640 1 -- 172.21.15.19:0/368308088 learned_addr learned my addr 172.21.15.19:0/368308088 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:04.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2d865640 1 --2- 172.21.15.19:0/368308088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e2806a5a0 0x7f4e28149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:04.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2d064640 1 --2- 172.21.15.19:0/368308088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e2806e260 0x7f4e28145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:04.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2e066640 1 -- 172.21.15.19:0/368308088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e2806e260 msgr2=0x7f4e28145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:04.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2e066640 1 --2- 172.21.15.19:0/368308088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e2806e260 0x7f4e28145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2e066640 1 -- 172.21.15.19:0/368308088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e2806a5a0 msgr2=0x7f4e28149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:04.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2e066640 1 --2- 172.21.15.19:0/368308088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e2806a5a0 0x7f4e28149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2e066640 1 -- 172.21.15.19:0/368308088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e20009a70 con 0x7f4e28159900 2023-11-20T06:42:04.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.727+0000 7f4e2d865640 1 --2- 172.21.15.19:0/368308088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e2806a5a0 0x7f4e28149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:04.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.731+0000 7f4e2e066640 1 --2- 172.21.15.19:0/368308088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e28159900 0x7f4e280b3720 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4e2001cd50 tx=0x7f4e20019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:04.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.731+0000 7f4e1e7fc640 1 -- 172.21.15.19:0/368308088 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e200b9860 con 0x7f4e28159900 2023-11-20T06:42:04.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.731+0000 7f4e1e7fc640 1 -- 172.21.15.19:0/368308088 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e200b99c0 con 0x7f4e28159900 2023-11-20T06:42:04.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.731+0000 7f4e2fac9640 1 -- 172.21.15.19:0/368308088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e280b2f20 con 0x7f4e28159900 2023-11-20T06:42:04.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.731+0000 7f4e1e7fc640 1 -- 172.21.15.19:0/368308088 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e200b9d70 con 0x7f4e28159900 2023-11-20T06:42:04.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.731+0000 7f4e2fac9640 1 -- 172.21.15.19:0/368308088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e281462e0 con 0x7f4e28159900 2023-11-20T06:42:04.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.731+0000 7f4e2fac9640 1 -- 172.21.15.19:0/368308088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e280b3440 con 0x7f4e28159900 2023-11-20T06:42:04.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.731+0000 7f4e1e7fc640 1 -- 172.21.15.19:0/368308088 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4e200c4460 con 0x7f4e28159900 2023-11-20T06:42:04.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.731+0000 7f4e1e7fc640 1 --2- 172.21.15.19:0/368308088 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4e0c0664a0 0x7f4e0c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.735+0000 7f4e1e7fc640 1 -- 172.21.15.19:0/368308088 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4e2011f420 con 0x7f4e28159900 2023-11-20T06:42:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.735+0000 7f4e2d865640 1 --2- 172.21.15.19:0/368308088 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4e0c0664a0 0x7f4e0c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:04.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.735+0000 7f4e2d865640 1 --2- 172.21.15.19:0/368308088 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4e0c0664a0 0x7f4e0c068960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e240011f0 tx=0x7f4e24009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:04.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.739+0000 7f4e1e7fc640 1 -- 172.21.15.19:0/368308088 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4e280b3440 con 0x7f4e28159900 2023-11-20T06:42:04.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.891+0000 7f4e2fac9640 1 -- 172.21.15.19:0/368308088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4e280b3440 con 0x7f4e28159900 2023-11-20T06:42:04.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.891+0000 7f4e1e7fc640 1 -- 172.21.15.19:0/368308088 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4e280b3440 con 0x7f4e28159900 2023-11-20T06:42:04.898 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-20T06:42:04.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.895+0000 7f4e2fac9640 1 -- 172.21.15.19:0/368308088 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4e0c0664a0 msgr2=0x7f4e0c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:04.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.895+0000 7f4e2fac9640 1 --2- 172.21.15.19:0/368308088 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4e0c0664a0 0x7f4e0c068960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e240011f0 tx=0x7f4e24009040 comp rx=0 tx=0).stop 2023-11-20T06:42:04.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.895+0000 7f4e2fac9640 1 -- 172.21.15.19:0/368308088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e28159900 msgr2=0x7f4e280b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:04.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.895+0000 7f4e2fac9640 1 --2- 172.21.15.19:0/368308088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e28159900 0x7f4e280b3720 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4e2001cd50 tx=0x7f4e20019610 comp rx=0 tx=0).stop 2023-11-20T06:42:04.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.895+0000 7f4e2fac9640 1 -- 172.21.15.19:0/368308088 shutdown_connections 2023-11-20T06:42:04.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.895+0000 7f4e2fac9640 1 --2- 172.21.15.19:0/368308088 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4e0c0664a0 0x7f4e0c068960 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.895+0000 7f4e2fac9640 1 --2- 172.21.15.19:0/368308088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e28159900 0x7f4e280b3720 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.895+0000 7f4e2fac9640 1 --2- 172.21.15.19:0/368308088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e2806e260 0x7f4e28145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.895+0000 7f4e2fac9640 1 --2- 172.21.15.19:0/368308088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e2806a5a0 0x7f4e28149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:04.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.895+0000 7f4e2fac9640 1 -- 172.21.15.19:0/368308088 >> 172.21.15.19:0/368308088 conn(0x7f4e280b0da0 msgr2=0x7f4e28150180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:04.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.895+0000 7f4e2fac9640 1 -- 172.21.15.19:0/368308088 shutdown_connections 2023-11-20T06:42:04.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:04.895+0000 7f4e2fac9640 1 -- 172.21.15.19:0/368308088 wait complete. 2023-11-20T06:42:04.920 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T06:42:05.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.059+0000 7ff02d054640 1 Processor -- start 2023-11-20T06:42:05.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.059+0000 7ff02d054640 1 -- start start 2023-11-20T06:42:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.063+0000 7ff02d054640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff0280d0210 0x7ff0280d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.063+0000 7ff02d054640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0280d1670 con 0x7ff0280b84e0 2023-11-20T06:42:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.063+0000 7ff02d054640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0280d1950 con 0x7ff02815cba0 2023-11-20T06:42:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.063+0000 7ff02d054640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0280d1460 con 0x7ff0280d0210 2023-11-20T06:42:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.063+0000 7ff01ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff0280d0210 0x7ff0280d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.063+0000 7ff02759e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff0280b84e0 0x7ff0280b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57766/0 (socket says 172.21.15.19:57766) 2023-11-20T06:42:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.063+0000 7ff01ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff0280d0210 0x7ff0280d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60338/0 (socket says 172.21.15.19:60338) 2023-11-20T06:42:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.063+0000 7ff02759e640 1 -- 172.21.15.19:0/3851644305 learned_addr learned my addr 172.21.15.19:0/3851644305 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:05.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.063+0000 7ff01ffff640 1 -- 172.21.15.19:0/3851644305 >> v1:172.21.15.190:6789/0 conn(0x7ff02815cba0 legacy=0x7ff0280cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:05.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.063+0000 7ff01ffff640 1 -- 172.21.15.19:0/3851644305 >> v1:172.21.15.19:6789/0 conn(0x7ff0280b84e0 legacy=0x7ff0280b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:05.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.063+0000 7ff01ffff640 1 -- 172.21.15.19:0/3851644305 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0280d1c30 con 0x7ff0280d0210 2023-11-20T06:42:05.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.067+0000 7ff01ffff640 1 --2- 172.21.15.19:0/3851644305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0280d0210 0x7ff0280d0f20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff0100097c0 tx=0x7ff01001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ccf09eb05ede732 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:05.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.067+0000 7ff02659c640 1 -- 172.21.15.19:0/3851644305 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0100ab5f0 con 0x7ff0280d0210 2023-11-20T06:42:05.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.067+0000 7ff02659c640 1 -- 172.21.15.19:0/3851644305 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0100ab750 con 0x7ff0280d0210 2023-11-20T06:42:05.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.067+0000 7ff02659c640 1 -- 172.21.15.19:0/3851644305 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0100abae0 con 0x7ff0280d0210 2023-11-20T06:42:05.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.067+0000 7ff02d054640 1 -- 172.21.15.19:0/3851644305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0280d0210 msgr2=0x7ff0280d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:05.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.067+0000 7ff02d054640 1 --2- 172.21.15.19:0/3851644305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0280d0210 0x7ff0280d0f20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff0100097c0 tx=0x7ff01001c3f0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.067+0000 7ff02d054640 1 -- 172.21.15.19:0/3851644305 shutdown_connections 2023-11-20T06:42:05.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.067+0000 7ff02d054640 1 --2- 172.21.15.19:0/3851644305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0280d0210 0x7ff0280d0f20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.067+0000 7ff02d054640 1 -- 172.21.15.19:0/3851644305 >> 172.21.15.19:0/3851644305 conn(0x7ff0280719c0 msgr2=0x7ff028071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:05.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.067+0000 7ff02d054640 1 -- 172.21.15.19:0/3851644305 shutdown_connections 2023-11-20T06:42:05.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.067+0000 7ff02d054640 1 -- 172.21.15.19:0/3851644305 wait complete. 2023-11-20T06:42:05.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.067+0000 7ff02d054640 1 Processor -- start 2023-11-20T06:42:05.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.067+0000 7ff02d054640 1 -- start start 2023-11-20T06:42:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.067+0000 7ff02d054640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0280b84e0 0x7ff028149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.067+0000 7ff02d054640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0280d0210 0x7ff02814f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.067+0000 7ff02d054640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff02815cba0 0x7ff0280c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.067+0000 7ff02d054640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02814dd20 con 0x7ff0280d0210 2023-11-20T06:42:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.067+0000 7ff02d054640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02814e000 con 0x7ff02815cba0 2023-11-20T06:42:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.067+0000 7ff02d054640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02814e2e0 con 0x7ff0280b84e0 2023-11-20T06:42:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.071+0000 7ff01ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0280d0210 0x7ff02814f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.071+0000 7ff01ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0280d0210 0x7ff02814f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60342/0 (socket says 172.21.15.19:60342) 2023-11-20T06:42:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.071+0000 7ff01ffff640 1 -- 172.21.15.19:0/1607458707 learned_addr learned my addr 172.21.15.19:0/1607458707 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.071+0000 7ff026d9d640 1 --2- 172.21.15.19:0/1607458707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0280b84e0 0x7ff028149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.071+0000 7ff02759e640 1 --2- 172.21.15.19:0/1607458707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff02815cba0 0x7ff0280c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.071+0000 7ff01ffff640 1 -- 172.21.15.19:0/1607458707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0280b84e0 msgr2=0x7ff028149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.071+0000 7ff01ffff640 1 --2- 172.21.15.19:0/1607458707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0280b84e0 0x7ff028149d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.071+0000 7ff01ffff640 1 -- 172.21.15.19:0/1607458707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff02815cba0 msgr2=0x7ff0280c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.071+0000 7ff01ffff640 1 --2- 172.21.15.19:0/1607458707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff02815cba0 0x7ff0280c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.071+0000 7ff01ffff640 1 -- 172.21.15.19:0/1607458707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff010009420 con 0x7ff0280d0210 2023-11-20T06:42:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.071+0000 7ff026d9d640 1 --2- 172.21.15.19:0/1607458707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0280b84e0 0x7ff028149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.071+0000 7ff02759e640 1 --2- 172.21.15.19:0/1607458707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff02815cba0 0x7ff0280c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.071+0000 7ff01ffff640 1 --2- 172.21.15.19:0/1607458707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0280d0210 0x7ff02814f3d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff0100ad040 tx=0x7ff01001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:05.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.071+0000 7ff01f7fe640 1 -- 172.21.15.19:0/1607458707 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0100b5810 con 0x7ff0280d0210 2023-11-20T06:42:05.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.071+0000 7ff01f7fe640 1 -- 172.21.15.19:0/1607458707 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0100b5990 con 0x7ff0280d0210 2023-11-20T06:42:05.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.071+0000 7ff01f7fe640 1 -- 172.21.15.19:0/1607458707 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0100b5d40 con 0x7ff0280d0210 2023-11-20T06:42:05.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.071+0000 7ff02d054640 1 -- 172.21.15.19:0/1607458707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff02814e5c0 con 0x7ff0280d0210 2023-11-20T06:42:05.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.071+0000 7ff02d054640 1 -- 172.21.15.19:0/1607458707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02814a240 con 0x7ff0280d0210 2023-11-20T06:42:05.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.071+0000 7ff02d054640 1 -- 172.21.15.19:0/1607458707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02804e170 con 0x7ff0280d0210 2023-11-20T06:42:05.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.071+0000 7ff01f7fe640 1 -- 172.21.15.19:0/1607458707 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff0100b4390 con 0x7ff0280d0210 2023-11-20T06:42:05.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.075+0000 7ff01f7fe640 1 --2- 172.21.15.19:0/1607458707 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff0080664a0 0x7ff008068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.075+0000 7ff01f7fe640 1 -- 172.21.15.19:0/1607458707 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff0100a8050 con 0x7ff0280d0210 2023-11-20T06:42:05.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.075+0000 7ff026d9d640 1 --2- 172.21.15.19:0/1607458707 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff0080664a0 0x7ff008068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.075+0000 7ff026d9d640 1 --2- 172.21.15.19:0/1607458707 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff0080664a0 0x7ff008068960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff018000f70 tx=0x7ff018009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:05.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.075+0000 7ff01f7fe640 1 -- 172.21.15.19:0/1607458707 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff0100ebc70 con 0x7ff0280d0210 2023-11-20T06:42:05.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.235+0000 7ff02d054640 1 -- 172.21.15.19:0/1607458707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff02814e420 con 0x7ff0280d0210 2023-11-20T06:42:05.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.235+0000 7ff01f7fe640 1 -- 172.21.15.19:0/1607458707 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff02814e420 con 0x7ff0280d0210 2023-11-20T06:42:05.240 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:05.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.235+0000 7ff02d054640 1 -- 172.21.15.19:0/1607458707 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff0080664a0 msgr2=0x7ff008068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:05.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.235+0000 7ff02d054640 1 --2- 172.21.15.19:0/1607458707 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff0080664a0 0x7ff008068960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff018000f70 tx=0x7ff018009040 comp rx=0 tx=0).stop 2023-11-20T06:42:05.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.235+0000 7ff02d054640 1 -- 172.21.15.19:0/1607458707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0280d0210 msgr2=0x7ff02814f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:05.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.235+0000 7ff02d054640 1 --2- 172.21.15.19:0/1607458707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0280d0210 0x7ff02814f3d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff0100ad040 tx=0x7ff01001ac30 comp rx=0 tx=0).stop 2023-11-20T06:42:05.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.235+0000 7ff02d054640 1 -- 172.21.15.19:0/1607458707 shutdown_connections 2023-11-20T06:42:05.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.235+0000 7ff02d054640 1 --2- 172.21.15.19:0/1607458707 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff0080664a0 0x7ff008068960 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.235+0000 7ff02d054640 1 --2- 172.21.15.19:0/1607458707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff02815cba0 0x7ff0280c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.235+0000 7ff02d054640 1 --2- 172.21.15.19:0/1607458707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0280d0210 0x7ff02814f3d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.235+0000 7ff02d054640 1 --2- 172.21.15.19:0/1607458707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0280b84e0 0x7ff028149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.235+0000 7ff02d054640 1 -- 172.21.15.19:0/1607458707 >> 172.21.15.19:0/1607458707 conn(0x7ff0280719c0 msgr2=0x7ff0280b6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:05.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.235+0000 7ff02d054640 1 -- 172.21.15.19:0/1607458707 shutdown_connections 2023-11-20T06:42:05.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.235+0000 7ff02d054640 1 -- 172.21.15.19:0/1607458707 wait complete. 2023-11-20T06:42:05.261 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.399+0000 7fd3c8da0640 1 Processor -- start 2023-11-20T06:42:05.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.399+0000 7fd3c8da0640 1 -- start start 2023-11-20T06:42:05.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.399+0000 7fd3c8da0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3c40d1490 0x7fd3c406af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.399+0000 7fd3c8da0640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd3c415cd60 0x7fd3c40b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.399+0000 7fd3c8da0640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c40d3510 con 0x7fd3c415c980 2023-11-20T06:42:05.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.399+0000 7fd3c8da0640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c40cd2b0 con 0x7fd3c415cd60 2023-11-20T06:42:05.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.399+0000 7fd3c8da0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40d2f50 con 0x7fd3c40d1490 2023-11-20T06:42:05.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c37fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd3c415c980 0x7fd3c40d0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57782/0 (socket says 172.21.15.19:57782) 2023-11-20T06:42:05.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c37fe640 1 -- 172.21.15.19:0/2917840612 learned_addr learned my addr 172.21.15.19:0/2917840612 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:05.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c2ffd640 1 --2- 172.21.15.19:0/2917840612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3c40d1490 0x7fd3c406af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c3fff640 1 --2- 172.21.15.19:0/2917840612 >> v2:172.21.15.190:3300/0 conn(0x7fd3c415cd60 0x7fd3c40b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c27fc640 1 -- 172.21.15.19:0/2917840612 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460569224 0 0) 0x7fd3b40012a0 con 0x7fd3c415c980 2023-11-20T06:42:05.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c27fc640 1 -- 172.21.15.19:0/2917840612 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3ac003530 con 0x7fd3c415c980 2023-11-20T06:42:05.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c27fc640 1 -- 172.21.15.19:0/2917840612 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3759804781 0 0) 0x7fd3ac003530 con 0x7fd3c415c980 2023-11-20T06:42:05.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c27fc640 1 -- 172.21.15.19:0/2917840612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3c40d1490 msgr2=0x7fd3c406af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:05.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c27fc640 1 --2- 172.21.15.19:0/2917840612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3c40d1490 0x7fd3c406af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c27fc640 1 -- 172.21.15.19:0/2917840612 >> v2:172.21.15.190:3300/0 conn(0x7fd3c415cd60 msgr2=0x7fd3c40b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:05.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c27fc640 1 --2- 172.21.15.19:0/2917840612 >> v2:172.21.15.190:3300/0 conn(0x7fd3c415cd60 0x7fd3c40b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c27fc640 1 -- 172.21.15.19:0/2917840612 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c40d3230 con 0x7fd3c415c980 2023-11-20T06:42:05.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c27fc640 1 -- 172.21.15.19:0/2917840612 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7fd3b4001990 con 0x7fd3c415c980 2023-11-20T06:42:05.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c3fff640 1 --2- 172.21.15.19:0/2917840612 >> v2:172.21.15.190:3300/0 conn(0x7fd3c415cd60 0x7fd3c40b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:42:05.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c27fc640 1 -- 172.21.15.19:0/2917840612 >> v1:172.21.15.19:6789/0 conn(0x7fd3c415c980 legacy=0x7fd3c40d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:05.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c27fc640 1 --2- 172.21.15.19:0/2917840612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3c40d1490 0x7fd3ac003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c27fc640 1 --2- 172.21.15.19:0/2917840612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3ac003fe0 0x7fd3ac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c27fc640 1 --2- 172.21.15.19:0/2917840612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3ac004d10 0x7fd3ac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c27fc640 1 -- 172.21.15.19:0/2917840612 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40cd2b0 con 0x7fd3ac003fe0 2023-11-20T06:42:05.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c27fc640 1 -- 172.21.15.19:0/2917840612 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40d2f50 con 0x7fd3ac004d10 2023-11-20T06:42:05.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c27fc640 1 -- 172.21.15.19:0/2917840612 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac00ba10 con 0x7fd3c40d1490 2023-11-20T06:42:05.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c2ffd640 1 --2- 172.21.15.19:0/2917840612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3ac003fe0 0x7fd3ac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c3fff640 1 --2- 172.21.15.19:0/2917840612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3ac004d10 0x7fd3ac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c37fe640 1 --2- 172.21.15.19:0/2917840612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3c40d1490 0x7fd3ac003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c2ffd640 1 -- 172.21.15.19:0/2917840612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3c40d1490 msgr2=0x7fd3ac003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:05.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c2ffd640 1 --2- 172.21.15.19:0/2917840612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3c40d1490 0x7fd3ac003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c2ffd640 1 -- 172.21.15.19:0/2917840612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3ac004d10 msgr2=0x7fd3ac005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:05.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c2ffd640 1 --2- 172.21.15.19:0/2917840612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3ac004d10 0x7fd3ac005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.403+0000 7fd3c2ffd640 1 -- 172.21.15.19:0/2917840612 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac003530 con 0x7fd3ac003fe0 2023-11-20T06:42:05.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.407+0000 7fd3c2ffd640 1 --2- 172.21.15.19:0/2917840612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3ac003fe0 0x7fd3ac0047d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8009ae0 tx=0x7fd3b801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0f9d79781a19ba server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:05.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.407+0000 7fd3c27fc640 1 -- 172.21.15.19:0/2917840612 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b80a5640 con 0x7fd3ac003fe0 2023-11-20T06:42:05.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.407+0000 7fd3c27fc640 1 -- 172.21.15.19:0/2917840612 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b80a57a0 con 0x7fd3ac003fe0 2023-11-20T06:42:05.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.407+0000 7fd3c27fc640 1 -- 172.21.15.19:0/2917840612 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b80a5b50 con 0x7fd3ac003fe0 2023-11-20T06:42:05.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.407+0000 7fd3c8da0640 1 -- 172.21.15.19:0/2917840612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3ac003fe0 msgr2=0x7fd3ac0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:05.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.407+0000 7fd3c8da0640 1 --2- 172.21.15.19:0/2917840612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3ac003fe0 0x7fd3ac0047d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8009ae0 tx=0x7fd3b801ca50 comp rx=0 tx=0).stop 2023-11-20T06:42:05.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.407+0000 7fd3c3fff640 1 -- 172.21.15.19:0/2917840612 reap_dead start 2023-11-20T06:42:05.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.407+0000 7fd3c8da0640 1 -- 172.21.15.19:0/2917840612 shutdown_connections 2023-11-20T06:42:05.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.407+0000 7fd3c8da0640 1 -- 172.21.15.19:0/2917840612 >> 172.21.15.19:0/2917840612 conn(0x7fd3c409ba80 msgr2=0x7fd3c40d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:05.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.407+0000 7fd3c8da0640 1 -- 172.21.15.19:0/2917840612 shutdown_connections 2023-11-20T06:42:05.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.407+0000 7fd3c8da0640 1 -- 172.21.15.19:0/2917840612 wait complete. 2023-11-20T06:42:05.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.407+0000 7fd3c8da0640 1 Processor -- start 2023-11-20T06:42:05.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.407+0000 7fd3c8da0640 1 -- start start 2023-11-20T06:42:05.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3c8da0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3ac003fe0 0x7fd3c4153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3c8da0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3c41f6440 0x7fd3c40ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3c8da0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3c40ca6a0 0x7fd3c40ce490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3c8da0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40cf540 con 0x7fd3ac003fe0 2023-11-20T06:42:05.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3c8da0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40cab20 con 0x7fd3c40ca6a0 2023-11-20T06:42:05.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3c8da0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40cf260 con 0x7fd3c41f6440 2023-11-20T06:42:05.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3c37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3ac003fe0 0x7fd3c4153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3c37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3ac003fe0 0x7fd3c4153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60352/0 (socket says 172.21.15.19:60352) 2023-11-20T06:42:05.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3c37fe640 1 -- 172.21.15.19:0/3124106993 learned_addr learned my addr 172.21.15.19:0/3124106993 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:05.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3c2ffd640 1 --2- 172.21.15.19:0/3124106993 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3c41f6440 0x7fd3c40ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3c3fff640 1 --2- 172.21.15.19:0/3124106993 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3c40ca6a0 0x7fd3c40ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3c37fe640 1 -- 172.21.15.19:0/3124106993 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3c41f6440 msgr2=0x7fd3c40ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:05.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3c37fe640 1 --2- 172.21.15.19:0/3124106993 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3c41f6440 0x7fd3c40ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3c37fe640 1 -- 172.21.15.19:0/3124106993 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3c40ca6a0 msgr2=0x7fd3c40ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3c37fe640 1 --2- 172.21.15.19:0/3124106993 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3c40ca6a0 0x7fd3c40ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3c37fe640 1 -- 172.21.15.19:0/3124106993 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c415e450 con 0x7fd3ac003fe0 2023-11-20T06:42:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3c37fe640 1 --2- 172.21.15.19:0/3124106993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3ac003fe0 0x7fd3c4153eb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4001440 tx=0x7fd3b40126f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3abfff640 1 -- 172.21.15.19:0/3124106993 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4014750 con 0x7fd3ac003fe0 2023-11-20T06:42:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3abfff640 1 -- 172.21.15.19:0/3124106993 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b40148b0 con 0x7fd3ac003fe0 2023-11-20T06:42:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3c8da0640 1 -- 172.21.15.19:0/3124106993 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c415e730 con 0x7fd3ac003fe0 2023-11-20T06:42:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3abfff640 1 -- 172.21.15.19:0/3124106993 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4014c60 con 0x7fd3ac003fe0 2023-11-20T06:42:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3c8da0640 1 -- 172.21.15.19:0/3124106993 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c41543f0 con 0x7fd3ac003fe0 2023-11-20T06:42:05.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3c8da0640 1 -- 172.21.15.19:0/3124106993 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c415e2b0 con 0x7fd3ac003fe0 2023-11-20T06:42:05.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.411+0000 7fd3abfff640 1 -- 172.21.15.19:0/3124106993 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd3b40153e0 con 0x7fd3ac003fe0 2023-11-20T06:42:05.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.415+0000 7fd3abfff640 1 --2- 172.21.15.19:0/3124106993 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd3b00664a0 0x7fd3b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.415+0000 7fd3abfff640 1 -- 172.21.15.19:0/3124106993 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd3b40869e0 con 0x7fd3ac003fe0 2023-11-20T06:42:05.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.415+0000 7fd3c2ffd640 1 --2- 172.21.15.19:0/3124106993 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd3b00664a0 0x7fd3b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.415+0000 7fd3c2ffd640 1 --2- 172.21.15.19:0/3124106993 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd3b00664a0 0x7fd3b0068960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd3b80af000 tx=0x7fd3b80046d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:05.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.419+0000 7fd3abfff640 1 -- 172.21.15.19:0/3124106993 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd3c415e2b0 con 0x7fd3ac003fe0 2023-11-20T06:42:05.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.579+0000 7fd3c8da0640 1 -- 172.21.15.19:0/3124106993 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3c415e2b0 con 0x7fd3ac003fe0 2023-11-20T06:42:05.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.579+0000 7fd3abfff640 1 -- 172.21.15.19:0/3124106993 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18720 (secure 0 0 0) 0x7fd3c415e2b0 con 0x7fd3ac003fe0 2023-11-20T06:42:05.585 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:05.585 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:55.472006+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:05.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.579+0000 7fd3c8da0640 1 -- 172.21.15.19:0/3124106993 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd3b00664a0 msgr2=0x7fd3b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:05.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.579+0000 7fd3c8da0640 1 --2- 172.21.15.19:0/3124106993 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd3b00664a0 0x7fd3b0068960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd3b80af000 tx=0x7fd3b80046d0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.579+0000 7fd3c8da0640 1 -- 172.21.15.19:0/3124106993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3ac003fe0 msgr2=0x7fd3c4153eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:05.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.579+0000 7fd3c8da0640 1 --2- 172.21.15.19:0/3124106993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3ac003fe0 0x7fd3c4153eb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4001440 tx=0x7fd3b40126f0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.583+0000 7fd3c8da0640 1 -- 172.21.15.19:0/3124106993 shutdown_connections 2023-11-20T06:42:05.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.583+0000 7fd3c8da0640 1 --2- 172.21.15.19:0/3124106993 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd3b00664a0 0x7fd3b0068960 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.583+0000 7fd3c8da0640 1 --2- 172.21.15.19:0/3124106993 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3c40ca6a0 0x7fd3c40ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.583+0000 7fd3c8da0640 1 --2- 172.21.15.19:0/3124106993 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd3c41f6440 0x7fd3c40ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.583+0000 7fd3c8da0640 1 --2- 172.21.15.19:0/3124106993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3ac003fe0 0x7fd3c4153eb0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.583+0000 7fd3c8da0640 1 -- 172.21.15.19:0/3124106993 >> 172.21.15.19:0/3124106993 conn(0x7fd3c409ba80 msgr2=0x7fd3c40c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:05.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.583+0000 7fd3c8da0640 1 -- 172.21.15.19:0/3124106993 shutdown_connections 2023-11-20T06:42:05.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.583+0000 7fd3c8da0640 1 -- 172.21.15.19:0/3124106993 wait complete. 2023-11-20T06:42:05.606 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T06:41:11.805111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T06:41:12.614034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T06:41:16.311206+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T06:42:05.607 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:42:05.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.747+0000 7fce96148640 1 Processor -- start 2023-11-20T06:42:05.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.747+0000 7fce96148640 1 -- start start 2023-11-20T06:42:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.747+0000 7fce96148640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce9015cdc0 0x7fce900cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.747+0000 7fce96148640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fce900b3cb0 0x7fce900cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.747+0000 7fce96148640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce900d0880 con 0x7fce900cf210 2023-11-20T06:42:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce96148640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce900b1c00 con 0x7fce900b3cb0 2023-11-20T06:42:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce96148640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce900b1ee0 con 0x7fce9015cdc0 2023-11-20T06:42:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce95146640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fce900cf210 0x7fce900cf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57790/0 (socket says 172.21.15.19:57790) 2023-11-20T06:42:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce95146640 1 -- 172.21.15.19:0/107585809 learned_addr learned my addr 172.21.15.19:0/107585809 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:05.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce87fff640 1 -- 172.21.15.19:0/107585809 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034840390 0 0) 0x7fce900d0880 con 0x7fce900cf210 2023-11-20T06:42:05.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce87fff640 1 -- 172.21.15.19:0/107585809 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce7c003530 con 0x7fce900cf210 2023-11-20T06:42:05.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce94945640 1 --2- 172.21.15.19:0/107585809 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce9015cdc0 0x7fce900cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce95947640 1 --2- 172.21.15.19:0/107585809 >> v2:172.21.15.190:3300/0 conn(0x7fce900b3cb0 0x7fce900cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce87fff640 1 -- 172.21.15.19:0/107585809 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2978301507 0 0) 0x7fce7c003530 con 0x7fce900cf210 2023-11-20T06:42:05.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce87fff640 1 -- 172.21.15.19:0/107585809 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce9015cdc0 msgr2=0x7fce900cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:05.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce87fff640 1 --2- 172.21.15.19:0/107585809 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce9015cdc0 0x7fce900cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce87fff640 1 -- 172.21.15.19:0/107585809 >> v2:172.21.15.190:3300/0 conn(0x7fce900b3cb0 msgr2=0x7fce900cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:05.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce87fff640 1 --2- 172.21.15.19:0/107585809 >> v2:172.21.15.190:3300/0 conn(0x7fce900b3cb0 0x7fce900cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce87fff640 1 -- 172.21.15.19:0/107585809 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce900b21c0 con 0x7fce900cf210 2023-11-20T06:42:05.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce87fff640 1 -- 172.21.15.19:0/107585809 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7fce8c001800 con 0x7fce900cf210 2023-11-20T06:42:05.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce87fff640 1 -- 172.21.15.19:0/107585809 >> v1:172.21.15.19:6789/0 conn(0x7fce900cf210 legacy=0x7fce900cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:05.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce87fff640 1 --2- 172.21.15.19:0/107585809 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce9015cdc0 0x7fce7c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce87fff640 1 --2- 172.21.15.19:0/107585809 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce7c003fb0 0x7fce7c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce87fff640 1 --2- 172.21.15.19:0/107585809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7c004d10 0x7fce7c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce87fff640 1 -- 172.21.15.19:0/107585809 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce900b1c00 con 0x7fce7c004d10 2023-11-20T06:42:05.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce87fff640 1 -- 172.21.15.19:0/107585809 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce900b1ee0 con 0x7fce7c003fb0 2023-11-20T06:42:05.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce87fff640 1 -- 172.21.15.19:0/107585809 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c00ba90 con 0x7fce9015cdc0 2023-11-20T06:42:05.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce95947640 1 --2- 172.21.15.19:0/107585809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7c004d10 0x7fce7c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce94945640 1 --2- 172.21.15.19:0/107585809 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce7c003fb0 0x7fce7c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce95146640 1 --2- 172.21.15.19:0/107585809 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce9015cdc0 0x7fce7c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce95947640 1 -- 172.21.15.19:0/107585809 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce9015cdc0 msgr2=0x7fce7c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:05.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce95947640 1 --2- 172.21.15.19:0/107585809 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce9015cdc0 0x7fce7c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce95947640 1 -- 172.21.15.19:0/107585809 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce7c003fb0 msgr2=0x7fce7c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:05.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce95947640 1 --2- 172.21.15.19:0/107585809 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce7c003fb0 0x7fce7c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.751+0000 7fce95947640 1 -- 172.21.15.19:0/107585809 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c003530 con 0x7fce7c004d10 2023-11-20T06:42:05.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.755+0000 7fce95947640 1 --2- 172.21.15.19:0/107585809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7c004d10 0x7fce7c005190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fce88007330 tx=0x7fce8801ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3137a674b44470f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:05.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.755+0000 7fce87fff640 1 -- 172.21.15.19:0/107585809 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce880a5d40 con 0x7fce7c004d10 2023-11-20T06:42:05.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.755+0000 7fce87fff640 1 -- 172.21.15.19:0/107585809 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce880ad440 con 0x7fce7c004d10 2023-11-20T06:42:05.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.755+0000 7fce87fff640 1 -- 172.21.15.19:0/107585809 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce880a5ea0 con 0x7fce7c004d10 2023-11-20T06:42:05.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.755+0000 7fce96148640 1 -- 172.21.15.19:0/107585809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7c004d10 msgr2=0x7fce7c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:05.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.755+0000 7fce96148640 1 --2- 172.21.15.19:0/107585809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7c004d10 0x7fce7c005190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fce88007330 tx=0x7fce8801ce40 comp rx=0 tx=0).stop 2023-11-20T06:42:05.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.755+0000 7fce95947640 1 -- 172.21.15.19:0/107585809 reap_dead start 2023-11-20T06:42:05.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.755+0000 7fce96148640 1 -- 172.21.15.19:0/107585809 shutdown_connections 2023-11-20T06:42:05.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.755+0000 7fce96148640 1 -- 172.21.15.19:0/107585809 >> 172.21.15.19:0/107585809 conn(0x7fce900d2800 msgr2=0x7fce900d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:05.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.755+0000 7fce96148640 1 -- 172.21.15.19:0/107585809 shutdown_connections 2023-11-20T06:42:05.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.755+0000 7fce96148640 1 -- 172.21.15.19:0/107585809 wait complete. 2023-11-20T06:42:05.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.755+0000 7fce96148640 1 Processor -- start 2023-11-20T06:42:05.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.755+0000 7fce96148640 1 -- start start 2023-11-20T06:42:05.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce96148640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce7c004d10 0x7fce900cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce96148640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce90150dc0 0x7fce901f5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce96148640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce900b5b30 0x7fce900b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce96148640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce90151240 con 0x7fce900b5b30 2023-11-20T06:42:05.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce96148640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce900b5420 con 0x7fce7c004d10 2023-11-20T06:42:05.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce96148640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce901f5cc0 con 0x7fce90150dc0 2023-11-20T06:42:05.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce95947640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce900b5b30 0x7fce900b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce94945640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce90150dc0 0x7fce901f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce95947640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce900b5b30 0x7fce900b5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60376/0 (socket says 172.21.15.19:60376) 2023-11-20T06:42:05.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce95146640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce7c004d10 0x7fce900cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce95947640 1 -- 172.21.15.19:0/252228368 learned_addr learned my addr 172.21.15.19:0/252228368 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:05.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce95947640 1 -- 172.21.15.19:0/252228368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce90150dc0 msgr2=0x7fce901f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:05.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce95947640 1 --2- 172.21.15.19:0/252228368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce90150dc0 0x7fce901f5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce95947640 1 -- 172.21.15.19:0/252228368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce7c004d10 msgr2=0x7fce900cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:05.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce95947640 1 --2- 172.21.15.19:0/252228368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce7c004d10 0x7fce900cc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce95947640 1 -- 172.21.15.19:0/252228368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce901f5f60 con 0x7fce900b5b30 2023-11-20T06:42:05.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce95947640 1 --2- 172.21.15.19:0/252228368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce900b5b30 0x7fce900b5fc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fce880b0040 tx=0x7fce7c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:05.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce85ffb640 1 -- 172.21.15.19:0/252228368 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce880ba070 con 0x7fce900b5b30 2023-11-20T06:42:05.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce85ffb640 1 -- 172.21.15.19:0/252228368 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce880ada70 con 0x7fce900b5b30 2023-11-20T06:42:05.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce96148640 1 -- 172.21.15.19:0/252228368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce901f6240 con 0x7fce900b5b30 2023-11-20T06:42:05.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce85ffb640 1 -- 172.21.15.19:0/252228368 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce880adc00 con 0x7fce900b5b30 2023-11-20T06:42:05.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce96148640 1 -- 172.21.15.19:0/252228368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce900b5630 con 0x7fce900b5b30 2023-11-20T06:42:05.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce96148640 1 -- 172.21.15.19:0/252228368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce901f66f0 con 0x7fce900b5b30 2023-11-20T06:42:05.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.759+0000 7fce85ffb640 1 -- 172.21.15.19:0/252228368 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fce880b4070 con 0x7fce900b5b30 2023-11-20T06:42:05.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.763+0000 7fce85ffb640 1 --2- 172.21.15.19:0/252228368 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fce740664a0 0x7fce74068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:05.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.763+0000 7fce85ffb640 1 -- 172.21.15.19:0/252228368 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fce8811dbd0 con 0x7fce900b5b30 2023-11-20T06:42:05.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.763+0000 7fce95146640 1 --2- 172.21.15.19:0/252228368 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fce740664a0 0x7fce74068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:05.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.763+0000 7fce95146640 1 --2- 172.21.15.19:0/252228368 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fce740664a0 0x7fce74068960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fce8c000c10 tx=0x7fce8c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:05.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.767+0000 7fce85ffb640 1 -- 172.21.15.19:0/252228368 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fce880eacb0 con 0x7fce900b5b30 2023-11-20T06:42:05.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.923+0000 7fce96148640 1 -- 172.21.15.19:0/252228368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fce9004e9c0 con 0x7fce900b5b30 2023-11-20T06:42:05.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.927+0000 7fce85ffb640 1 -- 172.21.15.19:0/252228368 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fce880b20a0 con 0x7fce900b5b30 2023-11-20T06:42:05.931 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:42:05.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.927+0000 7fce96148640 1 -- 172.21.15.19:0/252228368 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fce740664a0 msgr2=0x7fce74068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:05.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.927+0000 7fce96148640 1 --2- 172.21.15.19:0/252228368 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fce740664a0 0x7fce74068960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fce8c000c10 tx=0x7fce8c009040 comp rx=0 tx=0).stop 2023-11-20T06:42:05.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.927+0000 7fce96148640 1 -- 172.21.15.19:0/252228368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce900b5b30 msgr2=0x7fce900b5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:05.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.927+0000 7fce96148640 1 --2- 172.21.15.19:0/252228368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce900b5b30 0x7fce900b5fc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fce880b0040 tx=0x7fce7c005800 comp rx=0 tx=0).stop 2023-11-20T06:42:05.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.927+0000 7fce96148640 1 -- 172.21.15.19:0/252228368 shutdown_connections 2023-11-20T06:42:05.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.927+0000 7fce96148640 1 --2- 172.21.15.19:0/252228368 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fce740664a0 0x7fce74068960 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.927+0000 7fce96148640 1 --2- 172.21.15.19:0/252228368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce900b5b30 0x7fce900b5fc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.927+0000 7fce96148640 1 --2- 172.21.15.19:0/252228368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce90150dc0 0x7fce901f5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.927+0000 7fce96148640 1 --2- 172.21.15.19:0/252228368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce7c004d10 0x7fce900cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:05.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.927+0000 7fce96148640 1 -- 172.21.15.19:0/252228368 >> 172.21.15.19:0/252228368 conn(0x7fce900d2800 msgr2=0x7fce900b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:05.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.927+0000 7fce96148640 1 -- 172.21.15.19:0/252228368 shutdown_connections 2023-11-20T06:42:05.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:05.927+0000 7fce96148640 1 -- 172.21.15.19:0/252228368 wait complete. 2023-11-20T06:42:05.953 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T06:42:06.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.091+0000 7fcc44432640 1 Processor -- start 2023-11-20T06:42:06.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.095+0000 7fcc44432640 1 -- start start 2023-11-20T06:42:06.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.095+0000 7fcc44432640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcc3c159900 0x7fcc3c06e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:06.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.095+0000 7fcc44432640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc3c0b3f00 0x7fcc3c069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:06.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.095+0000 7fcc44432640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcc3c06a3d0 0x7fcc3c0cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:06.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.095+0000 7fcc44432640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3c0cd740 con 0x7fcc3c06a3d0 2023-11-20T06:42:06.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.095+0000 7fcc44432640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3c06a840 con 0x7fcc3c159900 2023-11-20T06:42:06.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.095+0000 7fcc44432640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c0b4360 con 0x7fcc3c0b3f00 2023-11-20T06:42:06.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.095+0000 7fcc429cf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcc3c06a3d0 0x7fcc3c0cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:06.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.095+0000 7fcc429cf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcc3c06a3d0 0x7fcc3c0cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60386/0 (socket says 172.21.15.19:60386) 2023-11-20T06:42:06.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.095+0000 7fcc429cf640 1 -- 172.21.15.19:0/1133106091 learned_addr learned my addr 172.21.15.19:0/1133106091 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:06.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.095+0000 7fcc419cd640 1 --2- 172.21.15.19:0/1133106091 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc3c0b3f00 0x7fcc3c069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:06.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.095+0000 7fcc421ce640 1 --2- 172.21.15.19:0/1133106091 >> v2:172.21.15.190:3300/0 conn(0x7fcc3c159900 0x7fcc3c06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:06.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.095+0000 7fcc429cf640 1 -- 172.21.15.19:0/1133106091 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc3c0b3f00 msgr2=0x7fcc3c069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:06.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.095+0000 7fcc429cf640 1 --2- 172.21.15.19:0/1133106091 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc3c0b3f00 0x7fcc3c069e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.095+0000 7fcc429cf640 1 -- 172.21.15.19:0/1133106091 >> v2:172.21.15.190:3300/0 conn(0x7fcc3c159900 msgr2=0x7fcc3c06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:06.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.095+0000 7fcc429cf640 1 --2- 172.21.15.19:0/1133106091 >> v2:172.21.15.190:3300/0 conn(0x7fcc3c159900 0x7fcc3c06e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.095+0000 7fcc429cf640 1 -- 172.21.15.19:0/1133106091 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3c0b4600 con 0x7fcc3c06a3d0 2023-11-20T06:42:06.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.099+0000 7fcc429cf640 1 --2- 172.21.15.19:0/1133106091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc3c06a3d0 0x7fcc3c0cc350 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c06ab70 tx=0x7fcc3401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510c4c9238be31ef server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:06.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.099+0000 7fcc411cc640 1 -- 172.21.15.19:0/1133106091 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc340a5560 con 0x7fcc3c06a3d0 2023-11-20T06:42:06.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.099+0000 7fcc411cc640 1 -- 172.21.15.19:0/1133106091 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc340a56c0 con 0x7fcc3c06a3d0 2023-11-20T06:42:06.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.099+0000 7fcc411cc640 1 -- 172.21.15.19:0/1133106091 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc340a5a50 con 0x7fcc3c06a3d0 2023-11-20T06:42:06.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.099+0000 7fcc44432640 1 -- 172.21.15.19:0/1133106091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc3c06a3d0 msgr2=0x7fcc3c0cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:06.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.099+0000 7fcc44432640 1 --2- 172.21.15.19:0/1133106091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc3c06a3d0 0x7fcc3c0cc350 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c06ab70 tx=0x7fcc3401c6e0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.099+0000 7fcc44432640 1 -- 172.21.15.19:0/1133106091 shutdown_connections 2023-11-20T06:42:06.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.099+0000 7fcc44432640 1 --2- 172.21.15.19:0/1133106091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc3c06a3d0 0x7fcc3c0cc350 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.099+0000 7fcc44432640 1 --2- 172.21.15.19:0/1133106091 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc3c0b3f00 0x7fcc3c069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.099+0000 7fcc44432640 1 --2- 172.21.15.19:0/1133106091 >> v2:172.21.15.190:3300/0 conn(0x7fcc3c159900 0x7fcc3c06e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.099+0000 7fcc44432640 1 -- 172.21.15.19:0/1133106091 >> 172.21.15.19:0/1133106091 conn(0x7fcc3c0b0da0 msgr2=0x7fcc3c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:06.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.099+0000 7fcc44432640 1 -- 172.21.15.19:0/1133106091 shutdown_connections 2023-11-20T06:42:06.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.099+0000 7fcc44432640 1 -- 172.21.15.19:0/1133106091 wait complete. 2023-11-20T06:42:06.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.099+0000 7fcc44432640 1 Processor -- start 2023-11-20T06:42:06.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.099+0000 7fcc44432640 1 -- start start 2023-11-20T06:42:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc44432640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc3c06a3d0 0x7fcc3c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc44432640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc3c0b3f00 0x7fcc3c14d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc44432640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc3c159900 0x7fcc3c0c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc44432640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c152b00 con 0x7fcc3c0b3f00 2023-11-20T06:42:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc44432640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c152de0 con 0x7fcc3c06a3d0 2023-11-20T06:42:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc44432640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c1530c0 con 0x7fcc3c159900 2023-11-20T06:42:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc419cd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc3c0b3f00 0x7fcc3c14d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc419cd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc3c0b3f00 0x7fcc3c14d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60398/0 (socket says 172.21.15.19:60398) 2023-11-20T06:42:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc419cd640 1 -- 172.21.15.19:0/2292656475 learned_addr learned my addr 172.21.15.19:0/2292656475 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc421ce640 1 --2- 172.21.15.19:0/2292656475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc3c06a3d0 0x7fcc3c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc429cf640 1 --2- 172.21.15.19:0/2292656475 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc3c159900 0x7fcc3c0c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc419cd640 1 -- 172.21.15.19:0/2292656475 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc3c159900 msgr2=0x7fcc3c0c4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc419cd640 1 --2- 172.21.15.19:0/2292656475 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc3c159900 0x7fcc3c0c4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc419cd640 1 -- 172.21.15.19:0/2292656475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc3c06a3d0 msgr2=0x7fcc3c155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc419cd640 1 --2- 172.21.15.19:0/2292656475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc3c06a3d0 0x7fcc3c155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc419cd640 1 -- 172.21.15.19:0/2292656475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc34009b30 con 0x7fcc3c0b3f00 2023-11-20T06:42:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc419cd640 1 --2- 172.21.15.19:0/2292656475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc3c0b3f00 0x7fcc3c14d1d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00d800 tx=0x7fcc2c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc32ffd640 1 -- 172.21.15.19:0/2292656475 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c0096a0 con 0x7fcc3c0b3f00 2023-11-20T06:42:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc32ffd640 1 -- 172.21.15.19:0/2292656475 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2c009800 con 0x7fcc3c0b3f00 2023-11-20T06:42:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc32ffd640 1 -- 172.21.15.19:0/2292656475 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c009990 con 0x7fcc3c0b3f00 2023-11-20T06:42:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc44432640 1 -- 172.21.15.19:0/2292656475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc3c1533a0 con 0x7fcc3c0b3f00 2023-11-20T06:42:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc44432640 1 -- 172.21.15.19:0/2292656475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc3c1560c0 con 0x7fcc3c0b3f00 2023-11-20T06:42:06.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.103+0000 7fcc44432640 1 -- 172.21.15.19:0/2292656475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc3c04e170 con 0x7fcc3c0b3f00 2023-11-20T06:42:06.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.107+0000 7fcc32ffd640 1 -- 172.21.15.19:0/2292656475 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcc2c009af0 con 0x7fcc3c0b3f00 2023-11-20T06:42:06.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.107+0000 7fcc32ffd640 1 --2- 172.21.15.19:0/2292656475 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fcc200664a0 0x7fcc20068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:06.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.107+0000 7fcc32ffd640 1 -- 172.21.15.19:0/2292656475 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcc2c0845f0 con 0x7fcc3c0b3f00 2023-11-20T06:42:06.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.107+0000 7fcc421ce640 1 --2- 172.21.15.19:0/2292656475 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fcc200664a0 0x7fcc20068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:06.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.107+0000 7fcc421ce640 1 --2- 172.21.15.19:0/2292656475 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fcc200664a0 0x7fcc20068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcc38007a60 tx=0x7fcc38008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:06.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.111+0000 7fcc32ffd640 1 -- 172.21.15.19:0/2292656475 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcc2c0516c0 con 0x7fcc3c0b3f00 2023-11-20T06:42:06.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.267+0000 7fcc44432640 1 -- 172.21.15.19:0/2292656475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcc3c06b380 con 0x7fcc3c0b3f00 2023-11-20T06:42:06.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.267+0000 7fcc32ffd640 1 -- 172.21.15.19:0/2292656475 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcc2c054ce0 con 0x7fcc3c0b3f00 2023-11-20T06:42:06.273 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.267+0000 7fcc44432640 1 -- 172.21.15.19:0/2292656475 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fcc200664a0 msgr2=0x7fcc20068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.267+0000 7fcc44432640 1 --2- 172.21.15.19:0/2292656475 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fcc200664a0 0x7fcc20068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcc38007a60 tx=0x7fcc38008040 comp rx=0 tx=0).stop 2023-11-20T06:42:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.267+0000 7fcc44432640 1 -- 172.21.15.19:0/2292656475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc3c0b3f00 msgr2=0x7fcc3c14d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.267+0000 7fcc44432640 1 --2- 172.21.15.19:0/2292656475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc3c0b3f00 0x7fcc3c14d1d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00d800 tx=0x7fcc2c00dcc0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.267+0000 7fcc44432640 1 -- 172.21.15.19:0/2292656475 shutdown_connections 2023-11-20T06:42:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.267+0000 7fcc44432640 1 --2- 172.21.15.19:0/2292656475 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fcc200664a0 0x7fcc20068960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.267+0000 7fcc44432640 1 --2- 172.21.15.19:0/2292656475 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc3c159900 0x7fcc3c0c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.267+0000 7fcc44432640 1 --2- 172.21.15.19:0/2292656475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc3c0b3f00 0x7fcc3c14d1d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.267+0000 7fcc44432640 1 --2- 172.21.15.19:0/2292656475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc3c06a3d0 0x7fcc3c155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.267+0000 7fcc44432640 1 -- 172.21.15.19:0/2292656475 >> 172.21.15.19:0/2292656475 conn(0x7fcc3c0b0da0 msgr2=0x7fcc3c0ca680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.267+0000 7fcc44432640 1 -- 172.21.15.19:0/2292656475 shutdown_connections 2023-11-20T06:42:06.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.267+0000 7fcc44432640 1 -- 172.21.15.19:0/2292656475 wait complete. 2023-11-20T06:42:06.294 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T06:42:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.435+0000 7f56ebf3e640 1 Processor -- start 2023-11-20T06:42:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.435+0000 7f56ebf3e640 1 -- start start 2023-11-20T06:42:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.435+0000 7f56ebf3e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f56e40b84e0 0x7f56e40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.435+0000 7f56ebf3e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e40d1670 con 0x7f56e415cba0 2023-11-20T06:42:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.435+0000 7f56ebf3e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e40d1950 con 0x7f56e40d0210 2023-11-20T06:42:06.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.435+0000 7f56ebf3e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e40d1460 con 0x7f56e40b84e0 2023-11-20T06:42:06.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.435+0000 7f56e9cda640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f56e415cba0 0x7f56e40cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57804/0 (socket says 172.21.15.19:57804) 2023-11-20T06:42:06.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.435+0000 7f56e9cda640 1 -- 172.21.15.19:0/2985880165 learned_addr learned my addr 172.21.15.19:0/2985880165 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:06.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.435+0000 7f56ea4db640 1 --2- 172.21.15.19:0/2985880165 >> v2:172.21.15.19:3300/0 conn(0x7f56e40b84e0 0x7f56e40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:06.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.435+0000 7f56e8cd8640 1 -- 172.21.15.19:0/2985880165 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760228927 0 0) 0x7f56e40d1670 con 0x7f56e415cba0 2023-11-20T06:42:06.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.435+0000 7f56e8cd8640 1 -- 172.21.15.19:0/2985880165 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56d0003530 con 0x7f56e415cba0 2023-11-20T06:42:06.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.435+0000 7f56ea4db640 1 -- 172.21.15.19:0/2985880165 >> v1:172.21.15.190:6789/0 conn(0x7f56e40d0210 legacy=0x7f56e40b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:06.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.435+0000 7f56ea4db640 1 -- 172.21.15.19:0/2985880165 >> v1:172.21.15.19:6789/0 conn(0x7f56e415cba0 legacy=0x7f56e40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:06.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.435+0000 7f56ea4db640 1 -- 172.21.15.19:0/2985880165 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e40d1c30 con 0x7f56e40b84e0 2023-11-20T06:42:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.439+0000 7f56ea4db640 1 --2- 172.21.15.19:0/2985880165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e40b84e0 0x7f56e40d0f20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009d90 tx=0x7f56dc01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b02ca613c635fc server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.439+0000 7f56e8cd8640 1 -- 172.21.15.19:0/2985880165 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc0a5980 con 0x7f56e40b84e0 2023-11-20T06:42:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.439+0000 7f56e8cd8640 1 -- 172.21.15.19:0/2985880165 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56dc0a5ae0 con 0x7f56e40b84e0 2023-11-20T06:42:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.439+0000 7f56e8cd8640 1 -- 172.21.15.19:0/2985880165 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc0a5e70 con 0x7f56e40b84e0 2023-11-20T06:42:06.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.439+0000 7f56ebf3e640 1 -- 172.21.15.19:0/2985880165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e40b84e0 msgr2=0x7f56e40d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:06.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.439+0000 7f56ebf3e640 1 --2- 172.21.15.19:0/2985880165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e40b84e0 0x7f56e40d0f20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009d90 tx=0x7f56dc01c8c0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.439+0000 7f56ebf3e640 1 -- 172.21.15.19:0/2985880165 shutdown_connections 2023-11-20T06:42:06.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.439+0000 7f56ebf3e640 1 --2- 172.21.15.19:0/2985880165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e40b84e0 0x7f56e40d0f20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.439+0000 7f56ebf3e640 1 -- 172.21.15.19:0/2985880165 >> 172.21.15.19:0/2985880165 conn(0x7f56e40719c0 msgr2=0x7f56e4071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:06.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.439+0000 7f56ebf3e640 1 -- 172.21.15.19:0/2985880165 shutdown_connections 2023-11-20T06:42:06.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.439+0000 7f56ebf3e640 1 -- 172.21.15.19:0/2985880165 wait complete. 2023-11-20T06:42:06.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56ebf3e640 1 Processor -- start 2023-11-20T06:42:06.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56ebf3e640 1 -- start start 2023-11-20T06:42:06.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56ebf3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56e40b84e0 0x7f56e4150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:06.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56ebf3e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56e40d0210 0x7f56e4148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:06.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56ebf3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e415cba0 0x7f56e40c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:06.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56ebf3e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e41491c0 con 0x7f56e415cba0 2023-11-20T06:42:06.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56ebf3e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e40b7730 con 0x7f56e40d0210 2023-11-20T06:42:06.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56ebf3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e40b7c60 con 0x7f56e40b84e0 2023-11-20T06:42:06.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56ea4db640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e415cba0 0x7f56e40c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:06.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56ea4db640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e415cba0 0x7f56e40c5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60420/0 (socket says 172.21.15.19:60420) 2023-11-20T06:42:06.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56ea4db640 1 -- 172.21.15.19:0/2756805644 learned_addr learned my addr 172.21.15.19:0/2756805644 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:06.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56e94d9640 1 --2- 172.21.15.19:0/2756805644 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56e40d0210 0x7f56e4148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:06.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56e9cda640 1 --2- 172.21.15.19:0/2756805644 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56e40b84e0 0x7f56e4150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:06.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56ea4db640 1 -- 172.21.15.19:0/2756805644 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56e40b84e0 msgr2=0x7f56e4150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:06.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56ea4db640 1 --2- 172.21.15.19:0/2756805644 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56e40b84e0 0x7f56e4150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56ea4db640 1 -- 172.21.15.19:0/2756805644 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56e40d0210 msgr2=0x7f56e4148a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:06.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56ea4db640 1 --2- 172.21.15.19:0/2756805644 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56e40d0210 0x7f56e4148a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56ea4db640 1 -- 172.21.15.19:0/2756805644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc009a70 con 0x7f56e415cba0 2023-11-20T06:42:06.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56ea4db640 1 --2- 172.21.15.19:0/2756805644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e415cba0 0x7f56e40c5690 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f56dc01a4f0 tx=0x7f56dc019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:06.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56da7fc640 1 -- 172.21.15.19:0/2756805644 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc0b9860 con 0x7f56e415cba0 2023-11-20T06:42:06.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56da7fc640 1 -- 172.21.15.19:0/2756805644 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56dc0b99c0 con 0x7f56e415cba0 2023-11-20T06:42:06.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56da7fc640 1 -- 172.21.15.19:0/2756805644 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc0b9d30 con 0x7f56e415cba0 2023-11-20T06:42:06.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56ebf3e640 1 -- 172.21.15.19:0/2756805644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e40b7980 con 0x7f56e415cba0 2023-11-20T06:42:06.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.443+0000 7f56ebf3e640 1 -- 172.21.15.19:0/2756805644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e4150030 con 0x7f56e415cba0 2023-11-20T06:42:06.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.447+0000 7f56ebf3e640 1 -- 172.21.15.19:0/2756805644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e40cd190 con 0x7f56e415cba0 2023-11-20T06:42:06.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.447+0000 7f56da7fc640 1 -- 172.21.15.19:0/2756805644 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f56dc0ad440 con 0x7f56e415cba0 2023-11-20T06:42:06.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.447+0000 7f56da7fc640 1 --2- 172.21.15.19:0/2756805644 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f56c80664a0 0x7f56c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:06.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.447+0000 7f56da7fc640 1 -- 172.21.15.19:0/2756805644 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f56dc11f540 con 0x7f56e415cba0 2023-11-20T06:42:06.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.447+0000 7f56e9cda640 1 --2- 172.21.15.19:0/2756805644 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f56c80664a0 0x7f56c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:06.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.447+0000 7f56e9cda640 1 --2- 172.21.15.19:0/2756805644 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f56c80664a0 0x7f56c8068960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f56e00011f0 tx=0x7f56e0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:06.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.451+0000 7f56da7fc640 1 -- 172.21.15.19:0/2756805644 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f56dc0ec600 con 0x7f56e415cba0 2023-11-20T06:42:06.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.607+0000 7f56ebf3e640 1 -- 172.21.15.19:0/2756805644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56e404e170 con 0x7f56e415cba0 2023-11-20T06:42:06.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.607+0000 7f56da7fc640 1 -- 172.21.15.19:0/2756805644 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56dc0efc20 con 0x7f56e415cba0 2023-11-20T06:42:06.614 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-20T06:42:06.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.611+0000 7f56ebf3e640 1 -- 172.21.15.19:0/2756805644 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f56c80664a0 msgr2=0x7f56c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:06.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.611+0000 7f56ebf3e640 1 --2- 172.21.15.19:0/2756805644 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f56c80664a0 0x7f56c8068960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f56e00011f0 tx=0x7f56e0009040 comp rx=0 tx=0).stop 2023-11-20T06:42:06.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.611+0000 7f56ebf3e640 1 -- 172.21.15.19:0/2756805644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e415cba0 msgr2=0x7f56e40c5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:06.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.611+0000 7f56ebf3e640 1 --2- 172.21.15.19:0/2756805644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e415cba0 0x7f56e40c5690 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f56dc01a4f0 tx=0x7f56dc019660 comp rx=0 tx=0).stop 2023-11-20T06:42:06.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.611+0000 7f56ebf3e640 1 -- 172.21.15.19:0/2756805644 shutdown_connections 2023-11-20T06:42:06.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.611+0000 7f56ebf3e640 1 --2- 172.21.15.19:0/2756805644 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f56c80664a0 0x7f56c8068960 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.611+0000 7f56ebf3e640 1 --2- 172.21.15.19:0/2756805644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e415cba0 0x7f56e40c5690 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.611+0000 7f56ebf3e640 1 --2- 172.21.15.19:0/2756805644 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56e40d0210 0x7f56e4148a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.611+0000 7f56ebf3e640 1 --2- 172.21.15.19:0/2756805644 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56e40b84e0 0x7f56e4150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.611+0000 7f56ebf3e640 1 -- 172.21.15.19:0/2756805644 >> 172.21.15.19:0/2756805644 conn(0x7f56e40719c0 msgr2=0x7f56e414eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:06.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.611+0000 7f56ebf3e640 1 -- 172.21.15.19:0/2756805644 shutdown_connections 2023-11-20T06:42:06.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.611+0000 7f56ebf3e640 1 -- 172.21.15.19:0/2756805644 wait complete. 2023-11-20T06:42:06.635 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T06:42:06.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.775+0000 7feafd73e640 1 Processor -- start 2023-11-20T06:42:06.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.775+0000 7feafd73e640 1 -- start start 2023-11-20T06:42:06.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.775+0000 7feafd73e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaf815cba0 0x7feaf80d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:06.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.775+0000 7feafd73e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7feaf80b84e0 0x7feaf80cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:06.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.775+0000 7feafd73e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf80d1670 con 0x7feaf80d0040 2023-11-20T06:42:06.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.775+0000 7feafd73e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf80d1460 con 0x7feaf80b84e0 2023-11-20T06:42:06.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.775+0000 7feafd73e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80d04b0 con 0x7feaf815cba0 2023-11-20T06:42:06.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.775+0000 7feaeffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7feaf80b84e0 0x7feaf80cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:06.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.775+0000 7feaeffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7feaf80b84e0 0x7feaf80cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60424/0 (socket says 172.21.15.19:60424) 2023-11-20T06:42:06.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.775+0000 7feaeffff640 1 -- 172.21.15.19:0/1968315678 learned_addr learned my addr 172.21.15.19:0/1968315678 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:06.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.779+0000 7feaf6ffd640 1 --2- 172.21.15.19:0/1968315678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaf815cba0 0x7feaf80d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:06.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.779+0000 7feaeffff640 1 -- 172.21.15.19:0/1968315678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaf815cba0 msgr2=0x7feaf80d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:06.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.779+0000 7feaeffff640 1 --2- 172.21.15.19:0/1968315678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaf815cba0 0x7feaf80d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.779+0000 7feaeffff640 1 -- 172.21.15.19:0/1968315678 >> v1:172.21.15.190:6789/0 conn(0x7feaf80d0040 legacy=0x7feaf80d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:06.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.779+0000 7feaeffff640 1 -- 172.21.15.19:0/1968315678 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf80d1950 con 0x7feaf80b84e0 2023-11-20T06:42:06.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.779+0000 7feaeffff640 1 --2- 172.21.15.19:0/1968315678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feaf80b84e0 0x7feaf80cfb00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7feae0009870 tx=0x7feae001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1d49ff91577fac server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:06.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.779+0000 7feaf67fc640 1 -- 172.21.15.19:0/1968315678 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae00ab660 con 0x7feaf80b84e0 2023-11-20T06:42:06.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.779+0000 7feaf67fc640 1 -- 172.21.15.19:0/1968315678 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae00ab7c0 con 0x7feaf80b84e0 2023-11-20T06:42:06.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.779+0000 7feaf67fc640 1 -- 172.21.15.19:0/1968315678 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae00abb50 con 0x7feaf80b84e0 2023-11-20T06:42:06.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feafd73e640 1 -- 172.21.15.19:0/1968315678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feaf80b84e0 msgr2=0x7feaf80cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:06.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feafd73e640 1 --2- 172.21.15.19:0/1968315678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feaf80b84e0 0x7feaf80cfb00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7feae0009870 tx=0x7feae001c540 comp rx=0 tx=0).stop 2023-11-20T06:42:06.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feafd73e640 1 -- 172.21.15.19:0/1968315678 shutdown_connections 2023-11-20T06:42:06.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feafd73e640 1 --2- 172.21.15.19:0/1968315678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feaf80b84e0 0x7feaf80cfb00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feafd73e640 1 --2- 172.21.15.19:0/1968315678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaf815cba0 0x7feaf80d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feafd73e640 1 -- 172.21.15.19:0/1968315678 >> 172.21.15.19:0/1968315678 conn(0x7feaf80719c0 msgr2=0x7feaf8071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:06.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feafd73e640 1 -- 172.21.15.19:0/1968315678 shutdown_connections 2023-11-20T06:42:06.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feafd73e640 1 -- 172.21.15.19:0/1968315678 wait complete. 2023-11-20T06:42:06.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feafd73e640 1 Processor -- start 2023-11-20T06:42:06.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feafd73e640 1 -- start start 2023-11-20T06:42:06.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feafd73e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaf80b84e0 0x7feaf814b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:06.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feafd73e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feaf80d0040 0x7feaf81535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:06.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feafd73e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaf815cba0 0x7feaf8153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:06.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feafd73e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8152c10 con 0x7feaf80d0040 2023-11-20T06:42:06.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feafd73e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8151cd0 con 0x7feaf815cba0 2023-11-20T06:42:06.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feafd73e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8151f90 con 0x7feaf80b84e0 2023-11-20T06:42:06.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feaeffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feaf80d0040 0x7feaf81535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:06.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feaeffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feaf80d0040 0x7feaf81535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60436/0 (socket says 172.21.15.19:60436) 2023-11-20T06:42:06.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feaeffff640 1 -- 172.21.15.19:0/1696317332 learned_addr learned my addr 172.21.15.19:0/1696317332 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:06.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feaf6ffd640 1 --2- 172.21.15.19:0/1696317332 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaf80b84e0 0x7feaf814b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:06.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feaf77fe640 1 --2- 172.21.15.19:0/1696317332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaf815cba0 0x7feaf8153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:06.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feaeffff640 1 -- 172.21.15.19:0/1696317332 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaf80b84e0 msgr2=0x7feaf814b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:06.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feaeffff640 1 --2- 172.21.15.19:0/1696317332 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaf80b84e0 0x7feaf814b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feaeffff640 1 -- 172.21.15.19:0/1696317332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaf815cba0 msgr2=0x7feaf8153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:06.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feaeffff640 1 --2- 172.21.15.19:0/1696317332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaf815cba0 0x7feaf8153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feaeffff640 1 -- 172.21.15.19:0/1696317332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae00094d0 con 0x7feaf80d0040 2023-11-20T06:42:06.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feaeffff640 1 --2- 172.21.15.19:0/1696317332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feaf80d0040 0x7feaf81535e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7feae00ad040 tx=0x7feae001ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:06.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.783+0000 7feaef7fe640 1 -- 172.21.15.19:0/1696317332 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae00b4800 con 0x7feaf80d0040 2023-11-20T06:42:06.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.787+0000 7feaef7fe640 1 -- 172.21.15.19:0/1696317332 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae00b4980 con 0x7feaf80d0040 2023-11-20T06:42:06.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.787+0000 7feaef7fe640 1 -- 172.21.15.19:0/1696317332 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae00b4d30 con 0x7feaf80d0040 2023-11-20T06:42:06.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.787+0000 7feafd73e640 1 -- 172.21.15.19:0/1696317332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf8152270 con 0x7feaf80d0040 2023-11-20T06:42:06.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.787+0000 7feafd73e640 1 -- 172.21.15.19:0/1696317332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf8152830 con 0x7feaf80d0040 2023-11-20T06:42:06.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.787+0000 7feafd73e640 1 -- 172.21.15.19:0/1696317332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf804e170 con 0x7feaf80d0040 2023-11-20T06:42:06.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.787+0000 7feaef7fe640 1 -- 172.21.15.19:0/1696317332 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7feae00a9070 con 0x7feaf80d0040 2023-11-20T06:42:06.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.787+0000 7feaef7fe640 1 --2- 172.21.15.19:0/1696317332 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fead80664a0 0x7fead8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:06.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.787+0000 7feaef7fe640 1 -- 172.21.15.19:0/1696317332 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feae011e730 con 0x7feaf80d0040 2023-11-20T06:42:06.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.787+0000 7feaf6ffd640 1 --2- 172.21.15.19:0/1696317332 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fead80664a0 0x7fead8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:06.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.787+0000 7feaf6ffd640 1 --2- 172.21.15.19:0/1696317332 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fead80664a0 0x7fead8068960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feae800b930 tx=0x7feae8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:06.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.791+0000 7feaef7fe640 1 -- 172.21.15.19:0/1696317332 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7feae00eba50 con 0x7feaf80d0040 2023-11-20T06:42:06.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.947+0000 7feafd73e640 1 -- 172.21.15.19:0/1696317332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7feaf8159800 con 0x7feaf80d0040 2023-11-20T06:42:06.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.947+0000 7feaef7fe640 1 -- 172.21.15.19:0/1696317332 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7feae00ef070 con 0x7feaf80d0040 2023-11-20T06:42:06.954 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:06.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.951+0000 7feafd73e640 1 -- 172.21.15.19:0/1696317332 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fead80664a0 msgr2=0x7fead8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:06.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.951+0000 7feafd73e640 1 --2- 172.21.15.19:0/1696317332 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fead80664a0 0x7fead8068960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feae800b930 tx=0x7feae8008040 comp rx=0 tx=0).stop 2023-11-20T06:42:06.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.951+0000 7feafd73e640 1 -- 172.21.15.19:0/1696317332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feaf80d0040 msgr2=0x7feaf81535e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:06.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.951+0000 7feafd73e640 1 --2- 172.21.15.19:0/1696317332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feaf80d0040 0x7feaf81535e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7feae00ad040 tx=0x7feae001ad80 comp rx=0 tx=0).stop 2023-11-20T06:42:06.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.951+0000 7feafd73e640 1 -- 172.21.15.19:0/1696317332 shutdown_connections 2023-11-20T06:42:06.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.951+0000 7feafd73e640 1 --2- 172.21.15.19:0/1696317332 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fead80664a0 0x7fead8068960 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.951+0000 7feafd73e640 1 --2- 172.21.15.19:0/1696317332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaf815cba0 0x7feaf8153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.951+0000 7feafd73e640 1 --2- 172.21.15.19:0/1696317332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feaf80d0040 0x7feaf81535e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.951+0000 7feafd73e640 1 --2- 172.21.15.19:0/1696317332 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaf80b84e0 0x7feaf814b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:06.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.951+0000 7feafd73e640 1 -- 172.21.15.19:0/1696317332 >> 172.21.15.19:0/1696317332 conn(0x7feaf80719c0 msgr2=0x7feaf8071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:06.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.951+0000 7feafd73e640 1 -- 172.21.15.19:0/1696317332 shutdown_connections 2023-11-20T06:42:06.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:06.951+0000 7feafd73e640 1 -- 172.21.15.19:0/1696317332 wait complete. 2023-11-20T06:42:07.025 INFO:tasks.cephfs_test_runner:Starting test: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) That when injecting a dentry into a fragmented directory, we put it in the right fragment. 2023-11-20T06:42:07.025 INFO:tasks.cephfs_test_runner:test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-11-20T06:42:07.026 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:07.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.163+0000 7f6bd70c9640 1 Processor -- start 2023-11-20T06:42:07.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.163+0000 7f6bd70c9640 1 -- start start 2023-11-20T06:42:07.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.163+0000 7f6bd70c9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6bd015cd10 0x7f6bd015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.163+0000 7f6bd70c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bd006a340 0x7f6bd0071990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.163+0000 7f6bd70c9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd015e390 con 0x7f6bd0069e90 2023-11-20T06:42:07.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.163+0000 7f6bd70c9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd0161990 con 0x7f6bd015cd10 2023-11-20T06:42:07.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.163+0000 7f6bd70c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd00ca150 con 0x7f6bd006a340 2023-11-20T06:42:07.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.163+0000 7f6bd4e65640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6bd015cd10 0x7f6bd015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.167+0000 7f6bd4e65640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6bd015cd10 0x7f6bd015de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60450/0 (socket says 172.21.15.19:60450) 2023-11-20T06:42:07.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.167+0000 7f6bd4e65640 1 -- 172.21.15.19:0/2906614049 learned_addr learned my addr 172.21.15.19:0/2906614049 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:07.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.167+0000 7f6bd5666640 1 --2- 172.21.15.19:0/2906614049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bd006a340 0x7f6bd0071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.167+0000 7f6bd4e65640 1 -- 172.21.15.19:0/2906614049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bd006a340 msgr2=0x7f6bd0071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:07.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.167+0000 7f6bd4e65640 1 --2- 172.21.15.19:0/2906614049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bd006a340 0x7f6bd0071990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.167+0000 7f6bd4e65640 1 -- 172.21.15.19:0/2906614049 >> v1:172.21.15.190:6789/0 conn(0x7f6bd0069e90 legacy=0x7f6bd0071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:07.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.167+0000 7f6bd4e65640 1 -- 172.21.15.19:0/2906614049 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd006a790 con 0x7f6bd015cd10 2023-11-20T06:42:07.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.167+0000 7f6bcf7fe640 1 -- 172.21.15.19:0/2906614049 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625477542 0 0) 0x7f6bd015e390 con 0x7f6bd0069e90 2023-11-20T06:42:07.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.167+0000 7f6bd4e65640 1 --2- 172.21.15.19:0/2906614049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bd015cd10 0x7f6bd015de50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4009870 tx=0x7f6bc401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2144c78fd039f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:07.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.167+0000 7f6bcf7fe640 1 -- 172.21.15.19:0/2906614049 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc40a9400 con 0x7f6bd015cd10 2023-11-20T06:42:07.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.167+0000 7f6bcf7fe640 1 -- 172.21.15.19:0/2906614049 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc40a9560 con 0x7f6bd015cd10 2023-11-20T06:42:07.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.167+0000 7f6bcf7fe640 1 -- 172.21.15.19:0/2906614049 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc40a98f0 con 0x7f6bd015cd10 2023-11-20T06:42:07.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd70c9640 1 -- 172.21.15.19:0/2906614049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bd015cd10 msgr2=0x7f6bd015de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:07.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd70c9640 1 --2- 172.21.15.19:0/2906614049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bd015cd10 0x7f6bd015de50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4009870 tx=0x7f6bc401c540 comp rx=0 tx=0).stop 2023-11-20T06:42:07.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd70c9640 1 -- 172.21.15.19:0/2906614049 shutdown_connections 2023-11-20T06:42:07.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd70c9640 1 --2- 172.21.15.19:0/2906614049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bd006a340 0x7f6bd0071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd70c9640 1 --2- 172.21.15.19:0/2906614049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bd015cd10 0x7f6bd015de50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd70c9640 1 -- 172.21.15.19:0/2906614049 >> 172.21.15.19:0/2906614049 conn(0x7f6bd006d310 msgr2=0x7f6bd006d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:07.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd70c9640 1 -- 172.21.15.19:0/2906614049 shutdown_connections 2023-11-20T06:42:07.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd70c9640 1 -- 172.21.15.19:0/2906614049 wait complete. 2023-11-20T06:42:07.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd70c9640 1 Processor -- start 2023-11-20T06:42:07.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd70c9640 1 -- start start 2023-11-20T06:42:07.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd70c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bd0069e90 0x7f6bd00c31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd70c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bd006a340 0x7f6bd00c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd70c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bd015cd10 0x7f6bd015a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd70c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd015bdc0 con 0x7f6bd0069e90 2023-11-20T06:42:07.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd70c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd0152040 con 0x7f6bd006a340 2023-11-20T06:42:07.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd70c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd015b520 con 0x7f6bd015cd10 2023-11-20T06:42:07.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd4e65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bd0069e90 0x7f6bd00c31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd4e65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bd0069e90 0x7f6bd00c31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60462/0 (socket says 172.21.15.19:60462) 2023-11-20T06:42:07.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd4e65640 1 -- 172.21.15.19:0/934588909 learned_addr learned my addr 172.21.15.19:0/934588909 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:07.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd5666640 1 --2- 172.21.15.19:0/934588909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bd015cd10 0x7f6bd015a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bcffff640 1 --2- 172.21.15.19:0/934588909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bd006a340 0x7f6bd00c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd4e65640 1 -- 172.21.15.19:0/934588909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bd015cd10 msgr2=0x7f6bd015a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:07.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd4e65640 1 --2- 172.21.15.19:0/934588909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bd015cd10 0x7f6bd015a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd4e65640 1 -- 172.21.15.19:0/934588909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bd006a340 msgr2=0x7f6bd00c3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:07.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd4e65640 1 --2- 172.21.15.19:0/934588909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bd006a340 0x7f6bd00c3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd4e65640 1 -- 172.21.15.19:0/934588909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc40094d0 con 0x7f6bd0069e90 2023-11-20T06:42:07.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bd5666640 1 --2- 172.21.15.19:0/934588909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bd015cd10 0x7f6bd015a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:07.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.171+0000 7f6bcffff640 1 --2- 172.21.15.19:0/934588909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bd006a340 0x7f6bd00c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:07.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.175+0000 7f6bd4e65640 1 --2- 172.21.15.19:0/934588909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bd0069e90 0x7f6bd00c31c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6bc401abf0 tx=0x7f6bc401ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:07.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.175+0000 7f6bcd7fa640 1 -- 172.21.15.19:0/934588909 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc40a9400 con 0x7f6bd0069e90 2023-11-20T06:42:07.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.175+0000 7f6bcd7fa640 1 -- 172.21.15.19:0/934588909 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc40b1820 con 0x7f6bd0069e90 2023-11-20T06:42:07.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.175+0000 7f6bcd7fa640 1 -- 172.21.15.19:0/934588909 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc40b1bd0 con 0x7f6bd0069e90 2023-11-20T06:42:07.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.175+0000 7f6bd70c9640 1 -- 172.21.15.19:0/934588909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd015b800 con 0x7f6bd0069e90 2023-11-20T06:42:07.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.175+0000 7f6bd70c9640 1 -- 172.21.15.19:0/934588909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd015a900 con 0x7f6bd0069e90 2023-11-20T06:42:07.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.175+0000 7f6bd70c9640 1 -- 172.21.15.19:0/934588909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd0151da0 con 0x7f6bd0069e90 2023-11-20T06:42:07.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.175+0000 7f6bcd7fa640 1 -- 172.21.15.19:0/934588909 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6bc40b1d30 con 0x7f6bd0069e90 2023-11-20T06:42:07.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.175+0000 7f6bcd7fa640 1 --2- 172.21.15.19:0/934588909 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6bb40664a0 0x7f6bb4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.175+0000 7f6bcd7fa640 1 -- 172.21.15.19:0/934588909 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6bc411e9d0 con 0x7f6bd0069e90 2023-11-20T06:42:07.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.175+0000 7f6bcffff640 1 --2- 172.21.15.19:0/934588909 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6bb40664a0 0x7f6bb4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.179+0000 7f6bcffff640 1 --2- 172.21.15.19:0/934588909 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6bb40664a0 0x7f6bb4068960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00ccea0 tx=0x7f6bbc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:07.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.179+0000 7f6bcd7fa640 1 -- 172.21.15.19:0/934588909 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6bc40ebb10 con 0x7f6bd0069e90 2023-11-20T06:42:07.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.343+0000 7f6bd70c9640 1 -- 172.21.15.19:0/934588909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bd00b1a60 con 0x7f6bd0069e90 2023-11-20T06:42:07.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.343+0000 7f6bcd7fa640 1 -- 172.21.15.19:0/934588909 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18720 (secure 0 0 0) 0x7f6bc40a6020 con 0x7f6bd0069e90 2023-11-20T06:42:07.349 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:07.349 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:55.472006+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:07.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.343+0000 7f6bd70c9640 1 -- 172.21.15.19:0/934588909 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6bb40664a0 msgr2=0x7f6bb4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:07.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.343+0000 7f6bd70c9640 1 --2- 172.21.15.19:0/934588909 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6bb40664a0 0x7f6bb4068960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00ccea0 tx=0x7f6bbc009040 comp rx=0 tx=0).stop 2023-11-20T06:42:07.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.343+0000 7f6bd70c9640 1 -- 172.21.15.19:0/934588909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bd0069e90 msgr2=0x7f6bd00c31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:07.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.343+0000 7f6bd70c9640 1 --2- 172.21.15.19:0/934588909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bd0069e90 0x7f6bd00c31c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6bc401abf0 tx=0x7f6bc401ad80 comp rx=0 tx=0).stop 2023-11-20T06:42:07.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.343+0000 7f6bd70c9640 1 -- 172.21.15.19:0/934588909 shutdown_connections 2023-11-20T06:42:07.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.343+0000 7f6bd70c9640 1 --2- 172.21.15.19:0/934588909 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6bb40664a0 0x7f6bb4068960 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.343+0000 7f6bd70c9640 1 --2- 172.21.15.19:0/934588909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bd015cd10 0x7f6bd015a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.343+0000 7f6bd70c9640 1 --2- 172.21.15.19:0/934588909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bd006a340 0x7f6bd00c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.343+0000 7f6bd70c9640 1 --2- 172.21.15.19:0/934588909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bd0069e90 0x7f6bd00c31c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.343+0000 7f6bd70c9640 1 -- 172.21.15.19:0/934588909 >> 172.21.15.19:0/934588909 conn(0x7f6bd006d310 msgr2=0x7f6bd0071180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:07.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.343+0000 7f6bd70c9640 1 -- 172.21.15.19:0/934588909 shutdown_connections 2023-11-20T06:42:07.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.343+0000 7f6bd70c9640 1 -- 172.21.15.19:0/934588909 wait complete. 2023-11-20T06:42:07.370 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T06:41:11.805111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T06:41:12.614034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T06:41:16.311206+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T06:42:07.370 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:42:07.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.511+0000 7fe7cdcea640 1 Processor -- start 2023-11-20T06:42:07.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.511+0000 7fe7cdcea640 1 -- start start 2023-11-20T06:42:07.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.511+0000 7fe7cdcea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7c80d0210 0x7fe7c80d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.511+0000 7fe7cdcea640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe7c80b84e0 0x7fe7c80b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.511+0000 7fe7cdcea640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c80d1670 con 0x7fe7c815cba0 2023-11-20T06:42:07.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.511+0000 7fe7cdcea640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c80d1460 con 0x7fe7c80b84e0 2023-11-20T06:42:07.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.511+0000 7fe7cdcea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80d1950 con 0x7fe7c80d0210 2023-11-20T06:42:07.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.511+0000 7fe7c77fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe7c815cba0 0x7fe7c80cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57812/0 (socket says 172.21.15.19:57812) 2023-11-20T06:42:07.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.511+0000 7fe7c77fe640 1 -- 172.21.15.19:0/4263232607 learned_addr learned my addr 172.21.15.19:0/4263232607 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:07.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.511+0000 7fe7c7fff640 1 --2- 172.21.15.19:0/4263232607 >> v2:172.21.15.190:3300/0 conn(0x7fe7c80b84e0 0x7fe7c80b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.511+0000 7fe7c6ffd640 1 --2- 172.21.15.19:0/4263232607 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7c80d0210 0x7fe7c80d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.511+0000 7fe7c67fc640 1 -- 172.21.15.19:0/4263232607 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293345508 0 0) 0x7fe7c80d1670 con 0x7fe7c815cba0 2023-11-20T06:42:07.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c67fc640 1 -- 172.21.15.19:0/4263232607 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7b0003530 con 0x7fe7c815cba0 2023-11-20T06:42:07.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c67fc640 1 -- 172.21.15.19:0/4263232607 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4209044795 0 0) 0x7fe7b0003530 con 0x7fe7c815cba0 2023-11-20T06:42:07.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c67fc640 1 -- 172.21.15.19:0/4263232607 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7c80d0210 msgr2=0x7fe7c80d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:07.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c67fc640 1 --2- 172.21.15.19:0/4263232607 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7c80d0210 0x7fe7c80d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c67fc640 1 -- 172.21.15.19:0/4263232607 >> v2:172.21.15.190:3300/0 conn(0x7fe7c80b84e0 msgr2=0x7fe7c80b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:07.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c67fc640 1 --2- 172.21.15.19:0/4263232607 >> v2:172.21.15.190:3300/0 conn(0x7fe7c80b84e0 0x7fe7c80b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c67fc640 1 -- 172.21.15.19:0/4263232607 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c80d1c30 con 0x7fe7c815cba0 2023-11-20T06:42:07.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c67fc640 1 -- 172.21.15.19:0/4263232607 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7fe7b8001680 con 0x7fe7c815cba0 2023-11-20T06:42:07.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c67fc640 1 -- 172.21.15.19:0/4263232607 >> v1:172.21.15.19:6789/0 conn(0x7fe7c815cba0 legacy=0x7fe7c80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:07.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c67fc640 1 --2- 172.21.15.19:0/4263232607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7b0003980 0x7fe7b0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c67fc640 1 --2- 172.21.15.19:0/4263232607 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7c80d0210 0x7fe7b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c67fc640 1 --2- 172.21.15.19:0/4263232607 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7b0004d10 0x7fe7b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c67fc640 1 -- 172.21.15.19:0/4263232607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80d1460 con 0x7fe7b0003980 2023-11-20T06:42:07.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c67fc640 1 -- 172.21.15.19:0/4263232607 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80d1950 con 0x7fe7b0004d10 2023-11-20T06:42:07.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c67fc640 1 -- 172.21.15.19:0/4263232607 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b000b990 con 0x7fe7c80d0210 2023-11-20T06:42:07.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c77fe640 1 --2- 172.21.15.19:0/4263232607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7b0003980 0x7fe7b0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c6ffd640 1 --2- 172.21.15.19:0/4263232607 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7c80d0210 0x7fe7b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c7fff640 1 --2- 172.21.15.19:0/4263232607 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7b0004d10 0x7fe7b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c77fe640 1 -- 172.21.15.19:0/4263232607 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7c80d0210 msgr2=0x7fe7b00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:07.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c77fe640 1 --2- 172.21.15.19:0/4263232607 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7c80d0210 0x7fe7b00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c77fe640 1 -- 172.21.15.19:0/4263232607 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7b0004d10 msgr2=0x7fe7b0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:07.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c77fe640 1 --2- 172.21.15.19:0/4263232607 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7b0004d10 0x7fe7b0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c77fe640 1 -- 172.21.15.19:0/4263232607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b0003530 con 0x7fe7b0003980 2023-11-20T06:42:07.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c6ffd640 1 --2- 172.21.15.19:0/4263232607 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7c80d0210 0x7fe7b00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:07.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.515+0000 7fe7c77fe640 1 --2- 172.21.15.19:0/4263232607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7b0003980 0x7fe7b0003da0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800c270 tx=0x7fe7b801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8dd43c489cacc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:07.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7c67fc640 1 -- 172.21.15.19:0/4263232607 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b80058e0 con 0x7fe7b0003980 2023-11-20T06:42:07.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7c67fc640 1 -- 172.21.15.19:0/4263232607 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b8005a40 con 0x7fe7b0003980 2023-11-20T06:42:07.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7c67fc640 1 -- 172.21.15.19:0/4263232607 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8005e10 con 0x7fe7b0003980 2023-11-20T06:42:07.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7cdcea640 1 -- 172.21.15.19:0/4263232607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7b0003980 msgr2=0x7fe7b0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:07.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7cdcea640 1 --2- 172.21.15.19:0/4263232607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7b0003980 0x7fe7b0003da0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800c270 tx=0x7fe7b801cc60 comp rx=0 tx=0).stop 2023-11-20T06:42:07.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7c7fff640 1 -- 172.21.15.19:0/4263232607 reap_dead start 2023-11-20T06:42:07.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7cdcea640 1 -- 172.21.15.19:0/4263232607 shutdown_connections 2023-11-20T06:42:07.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7cdcea640 1 -- 172.21.15.19:0/4263232607 >> 172.21.15.19:0/4263232607 conn(0x7fe7c80719c0 msgr2=0x7fe7c8071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:07.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7cdcea640 1 -- 172.21.15.19:0/4263232607 shutdown_connections 2023-11-20T06:42:07.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7cdcea640 1 -- 172.21.15.19:0/4263232607 wait complete. 2023-11-20T06:42:07.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7cdcea640 1 Processor -- start 2023-11-20T06:42:07.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7cdcea640 1 -- start start 2023-11-20T06:42:07.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7cdcea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7b0003980 0x7fe7c8150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7cdcea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7c80cbae0 0x7fe7c80cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7cdcea640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7c815a9f0 0x7fe7c815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7cdcea640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80d3520 con 0x7fe7c80cbae0 2023-11-20T06:42:07.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7cdcea640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c815b3b0 con 0x7fe7c815a9f0 2023-11-20T06:42:07.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7cdcea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80d3940 con 0x7fe7b0003980 2023-11-20T06:42:07.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7c6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7c80cbae0 0x7fe7c80cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7c6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7c80cbae0 0x7fe7c80cbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60482/0 (socket says 172.21.15.19:60482) 2023-11-20T06:42:07.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.519+0000 7fe7c6ffd640 1 -- 172.21.15.19:0/2824733881 learned_addr learned my addr 172.21.15.19:0/2824733881 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:07.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.523+0000 7fe7c7fff640 1 --2- 172.21.15.19:0/2824733881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7c815a9f0 0x7fe7c815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.523+0000 7fe7c77fe640 1 --2- 172.21.15.19:0/2824733881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7b0003980 0x7fe7c8150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.523+0000 7fe7c6ffd640 1 -- 172.21.15.19:0/2824733881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7b0003980 msgr2=0x7fe7c8150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:07.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.523+0000 7fe7c6ffd640 1 --2- 172.21.15.19:0/2824733881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7b0003980 0x7fe7c8150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.523+0000 7fe7c6ffd640 1 -- 172.21.15.19:0/2824733881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7c815a9f0 msgr2=0x7fe7c815ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:07.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.523+0000 7fe7c6ffd640 1 --2- 172.21.15.19:0/2824733881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7c815a9f0 0x7fe7c815ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.523+0000 7fe7c6ffd640 1 -- 172.21.15.19:0/2824733881 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c80d2b80 con 0x7fe7c80cbae0 2023-11-20T06:42:07.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.523+0000 7fe7c6ffd640 1 --2- 172.21.15.19:0/2824733881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7c80cbae0 0x7fe7c80cbf60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc011620 tx=0x7fe7bc011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:07.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.523+0000 7fe7affff640 1 -- 172.21.15.19:0/2824733881 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc004220 con 0x7fe7c80cbae0 2023-11-20T06:42:07.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.523+0000 7fe7affff640 1 -- 172.21.15.19:0/2824733881 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7bc004380 con 0x7fe7c80cbae0 2023-11-20T06:42:07.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.523+0000 7fe7affff640 1 -- 172.21.15.19:0/2824733881 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc00f920 con 0x7fe7c80cbae0 2023-11-20T06:42:07.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.523+0000 7fe7cdcea640 1 -- 172.21.15.19:0/2824733881 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c80d2e60 con 0x7fe7c80cbae0 2023-11-20T06:42:07.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.523+0000 7fe7cdcea640 1 -- 172.21.15.19:0/2824733881 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c80cb390 con 0x7fe7c80cbae0 2023-11-20T06:42:07.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.523+0000 7fe7cdcea640 1 -- 172.21.15.19:0/2824733881 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c804e170 con 0x7fe7c80cbae0 2023-11-20T06:42:07.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.523+0000 7fe7affff640 1 -- 172.21.15.19:0/2824733881 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe7bc00fa80 con 0x7fe7c80cbae0 2023-11-20T06:42:07.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.523+0000 7fe7affff640 1 --2- 172.21.15.19:0/2824733881 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe7b40664a0 0x7fe7b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.527+0000 7fe7affff640 1 -- 172.21.15.19:0/2824733881 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe7bc0843f0 con 0x7fe7c80cbae0 2023-11-20T06:42:07.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.527+0000 7fe7c77fe640 1 --2- 172.21.15.19:0/2824733881 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe7b40664a0 0x7fe7b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.527+0000 7fe7c77fe640 1 --2- 172.21.15.19:0/2824733881 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe7b40664a0 0x7fe7b4068960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe7b80aa000 tx=0x7fe7b8001a80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:07.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.527+0000 7fe7affff640 1 -- 172.21.15.19:0/2824733881 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe7bc051550 con 0x7fe7c80cbae0 2023-11-20T06:42:07.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.687+0000 7fe7cdcea640 1 -- 172.21.15.19:0/2824733881 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7c806b820 con 0x7fe7c80cbae0 2023-11-20T06:42:07.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.691+0000 7fe7affff640 1 -- 172.21.15.19:0/2824733881 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe7bc054b70 con 0x7fe7c80cbae0 2023-11-20T06:42:07.695 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:42:07.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.691+0000 7fe7cdcea640 1 -- 172.21.15.19:0/2824733881 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe7b40664a0 msgr2=0x7fe7b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:07.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.691+0000 7fe7cdcea640 1 --2- 172.21.15.19:0/2824733881 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe7b40664a0 0x7fe7b4068960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe7b80aa000 tx=0x7fe7b8001a80 comp rx=0 tx=0).stop 2023-11-20T06:42:07.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.691+0000 7fe7cdcea640 1 -- 172.21.15.19:0/2824733881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7c80cbae0 msgr2=0x7fe7c80cbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:07.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.691+0000 7fe7cdcea640 1 --2- 172.21.15.19:0/2824733881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7c80cbae0 0x7fe7c80cbf60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc011620 tx=0x7fe7bc011ae0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.691+0000 7fe7cdcea640 1 -- 172.21.15.19:0/2824733881 shutdown_connections 2023-11-20T06:42:07.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.691+0000 7fe7cdcea640 1 --2- 172.21.15.19:0/2824733881 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe7b40664a0 0x7fe7b4068960 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.691+0000 7fe7cdcea640 1 --2- 172.21.15.19:0/2824733881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7c815a9f0 0x7fe7c815ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.691+0000 7fe7cdcea640 1 --2- 172.21.15.19:0/2824733881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7c80cbae0 0x7fe7c80cbf60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.691+0000 7fe7cdcea640 1 --2- 172.21.15.19:0/2824733881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7b0003980 0x7fe7c8150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.691+0000 7fe7cdcea640 1 -- 172.21.15.19:0/2824733881 >> 172.21.15.19:0/2824733881 conn(0x7fe7c80719c0 msgr2=0x7fe7c815bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.691+0000 7fe7cdcea640 1 -- 172.21.15.19:0/2824733881 shutdown_connections 2023-11-20T06:42:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.691+0000 7fe7cdcea640 1 -- 172.21.15.19:0/2824733881 wait complete. 2023-11-20T06:42:07.716 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T06:42:07.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.859+0000 7f6ff370f640 1 Processor -- start 2023-11-20T06:42:07.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.859+0000 7f6ff370f640 1 -- start start 2023-11-20T06:42:07.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.859+0000 7f6ff370f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6fec069e90 0x7f6fec06d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.859+0000 7f6ff370f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6fec0c26b0 0x7f6fec0c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.859+0000 7f6ff370f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fec15ae30 con 0x7f6fec06a270 2023-11-20T06:42:07.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.859+0000 7f6ff370f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fec0cb090 con 0x7f6fec0c26b0 2023-11-20T06:42:07.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.859+0000 7f6ff370f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fec0ca510 con 0x7f6fec069e90 2023-11-20T06:42:07.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.859+0000 7f6ff1cac640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6fec0c26b0 0x7f6fec0c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.859+0000 7f6ff1cac640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6fec0c26b0 0x7f6fec0c2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60484/0 (socket says 172.21.15.19:60484) 2023-11-20T06:42:07.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.859+0000 7f6ff1cac640 1 -- 172.21.15.19:0/1696313906 learned_addr learned my addr 172.21.15.19:0/1696313906 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:07.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.859+0000 7f6ff0caa640 1 --1- 172.21.15.19:0/1696313906 >> v1:172.21.15.19:6789/0 conn(0x7f6fec06a270 0x7f6fec0c9ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57816/0 (socket says 172.21.15.19:57816) 2023-11-20T06:42:07.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.859+0000 7f6ff14ab640 1 --2- 172.21.15.19:0/1696313906 >> v2:172.21.15.190:3300/0 conn(0x7f6fec069e90 0x7f6fec06d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.859+0000 7f6ff1cac640 1 -- 172.21.15.19:0/1696313906 >> v2:172.21.15.190:3300/0 conn(0x7f6fec069e90 msgr2=0x7f6fec06d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:07.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.859+0000 7f6ff1cac640 1 --2- 172.21.15.19:0/1696313906 >> v2:172.21.15.190:3300/0 conn(0x7f6fec069e90 0x7f6fec06d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.859+0000 7f6ff1cac640 1 -- 172.21.15.19:0/1696313906 >> v1:172.21.15.19:6789/0 conn(0x7f6fec06a270 legacy=0x7f6fec0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:07.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.859+0000 7f6fe3fff640 1 -- 172.21.15.19:0/1696313906 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2369150020 0 0) 0x7f6fec15ae30 con 0x7f6fec06a270 2023-11-20T06:42:07.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.859+0000 7f6ff1cac640 1 -- 172.21.15.19:0/1696313906 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec0ca7f0 con 0x7f6fec0c26b0 2023-11-20T06:42:07.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.863+0000 7f6ff1cac640 1 --2- 172.21.15.19:0/1696313906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fec0c26b0 0x7f6fec0c2b00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6fec071590 tx=0x7f6fe401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99bce1cd1827957f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:07.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.863+0000 7f6fe3fff640 1 -- 172.21.15.19:0/1696313906 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40a5860 con 0x7f6fec0c26b0 2023-11-20T06:42:07.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.863+0000 7f6fe3fff640 1 -- 172.21.15.19:0/1696313906 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe40a59c0 con 0x7f6fec0c26b0 2023-11-20T06:42:07.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.863+0000 7f6fe3fff640 1 -- 172.21.15.19:0/1696313906 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40a5d50 con 0x7f6fec0c26b0 2023-11-20T06:42:07.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.863+0000 7f6ff370f640 1 -- 172.21.15.19:0/1696313906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fec0c26b0 msgr2=0x7f6fec0c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:07.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.863+0000 7f6ff370f640 1 --2- 172.21.15.19:0/1696313906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fec0c26b0 0x7f6fec0c2b00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6fec071590 tx=0x7f6fe401c9a0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.863+0000 7f6ff370f640 1 -- 172.21.15.19:0/1696313906 shutdown_connections 2023-11-20T06:42:07.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.863+0000 7f6ff370f640 1 --2- 172.21.15.19:0/1696313906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fec0c26b0 0x7f6fec0c2b00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.863+0000 7f6ff370f640 1 --2- 172.21.15.19:0/1696313906 >> v2:172.21.15.190:3300/0 conn(0x7f6fec069e90 0x7f6fec06d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.863+0000 7f6ff370f640 1 -- 172.21.15.19:0/1696313906 >> 172.21.15.19:0/1696313906 conn(0x7f6fec0b0da0 msgr2=0x7f6fec0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:07.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.863+0000 7f6ff370f640 1 -- 172.21.15.19:0/1696313906 shutdown_connections 2023-11-20T06:42:07.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.863+0000 7f6ff370f640 1 -- 172.21.15.19:0/1696313906 wait complete. 2023-11-20T06:42:07.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.863+0000 7f6ff370f640 1 Processor -- start 2023-11-20T06:42:07.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.863+0000 7f6ff370f640 1 -- start start 2023-11-20T06:42:07.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff370f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fec069e90 0x7f6fec15cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff370f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fec06a270 0x7f6fec1f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff370f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6fec0c26b0 0x7f6fec0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff370f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec15d870 con 0x7f6fec069e90 2023-11-20T06:42:07.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff370f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec15d590 con 0x7f6fec0c26b0 2023-11-20T06:42:07.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff370f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec0cc4f0 con 0x7f6fec06a270 2023-11-20T06:42:07.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff14ab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fec069e90 0x7f6fec15cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff14ab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fec069e90 0x7f6fec15cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60500/0 (socket says 172.21.15.19:60500) 2023-11-20T06:42:07.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff14ab640 1 -- 172.21.15.19:0/616032916 learned_addr learned my addr 172.21.15.19:0/616032916 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:07.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff1cac640 1 --2- 172.21.15.19:0/616032916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6fec0c26b0 0x7f6fec0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff0caa640 1 --2- 172.21.15.19:0/616032916 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fec06a270 0x7f6fec1f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff14ab640 1 -- 172.21.15.19:0/616032916 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fec06a270 msgr2=0x7f6fec1f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:07.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff14ab640 1 --2- 172.21.15.19:0/616032916 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fec06a270 0x7f6fec1f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff14ab640 1 -- 172.21.15.19:0/616032916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6fec0c26b0 msgr2=0x7f6fec0ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:07.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff14ab640 1 --2- 172.21.15.19:0/616032916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6fec0c26b0 0x7f6fec0ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:07.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff14ab640 1 -- 172.21.15.19:0/616032916 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe4009b30 con 0x7f6fec069e90 2023-11-20T06:42:07.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff0caa640 1 --2- 172.21.15.19:0/616032916 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fec06a270 0x7f6fec1f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:07.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff14ab640 1 --2- 172.21.15.19:0/616032916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fec069e90 0x7f6fec15cf20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800d800 tx=0x7f6fe800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:07.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6fe1ffb640 1 -- 172.21.15.19:0/616032916 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe800b6c0 con 0x7f6fec069e90 2023-11-20T06:42:07.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6fe1ffb640 1 -- 172.21.15.19:0/616032916 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe800b860 con 0x7f6fec069e90 2023-11-20T06:42:07.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6fe1ffb640 1 -- 172.21.15.19:0/616032916 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe800bc10 con 0x7f6fec069e90 2023-11-20T06:42:07.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff370f640 1 -- 172.21.15.19:0/616032916 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fec0cc7d0 con 0x7f6fec069e90 2023-11-20T06:42:07.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff370f640 1 -- 172.21.15.19:0/616032916 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fec1f5eb0 con 0x7f6fec069e90 2023-11-20T06:42:07.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.867+0000 7f6ff370f640 1 -- 172.21.15.19:0/616032916 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fec0cc350 con 0x7f6fec069e90 2023-11-20T06:42:07.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.871+0000 7f6fe1ffb640 1 -- 172.21.15.19:0/616032916 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6fe801e460 con 0x7f6fec069e90 2023-11-20T06:42:07.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.871+0000 7f6fe1ffb640 1 --2- 172.21.15.19:0/616032916 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6fd00664a0 0x7f6fd0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:07.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.871+0000 7f6fe1ffb640 1 -- 172.21.15.19:0/616032916 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6fe80847a0 con 0x7f6fec069e90 2023-11-20T06:42:07.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.871+0000 7f6ff0caa640 1 --2- 172.21.15.19:0/616032916 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6fd00664a0 0x7f6fd0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:07.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.871+0000 7f6ff0caa640 1 --2- 172.21.15.19:0/616032916 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6fd00664a0 0x7f6fd0068960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc007fd0 tx=0x7f6fdc007c20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:07.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:07.875+0000 7f6fe1ffb640 1 -- 172.21.15.19:0/616032916 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6fec0cc350 con 0x7f6fec069e90 2023-11-20T06:42:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.027+0000 7f6ff370f640 1 -- 172.21.15.19:0/616032916 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6fec0cccf0 con 0x7f6fec069e90 2023-11-20T06:42:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.031+0000 7f6fe1ffb640 1 -- 172.21.15.19:0/616032916 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6fec0cccf0 con 0x7f6fec069e90 2023-11-20T06:42:08.035 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.031+0000 7f6ff370f640 1 -- 172.21.15.19:0/616032916 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6fd00664a0 msgr2=0x7f6fd0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.031+0000 7f6ff370f640 1 --2- 172.21.15.19:0/616032916 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6fd00664a0 0x7f6fd0068960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc007fd0 tx=0x7f6fdc007c20 comp rx=0 tx=0).stop 2023-11-20T06:42:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.031+0000 7f6ff370f640 1 -- 172.21.15.19:0/616032916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fec069e90 msgr2=0x7f6fec15cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.031+0000 7f6ff370f640 1 --2- 172.21.15.19:0/616032916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fec069e90 0x7f6fec15cf20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800d800 tx=0x7f6fe800dcc0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.031+0000 7f6ff370f640 1 -- 172.21.15.19:0/616032916 shutdown_connections 2023-11-20T06:42:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.031+0000 7f6ff370f640 1 --2- 172.21.15.19:0/616032916 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6fd00664a0 0x7f6fd0068960 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.031+0000 7f6ff370f640 1 --2- 172.21.15.19:0/616032916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6fec0c26b0 0x7f6fec0ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.031+0000 7f6ff370f640 1 --2- 172.21.15.19:0/616032916 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fec06a270 0x7f6fec1f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.031+0000 7f6ff370f640 1 --2- 172.21.15.19:0/616032916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fec069e90 0x7f6fec15cf20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.031+0000 7f6ff370f640 1 -- 172.21.15.19:0/616032916 >> 172.21.15.19:0/616032916 conn(0x7f6fec0b0da0 msgr2=0x7f6fec0c4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:08.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.031+0000 7f6ff370f640 1 -- 172.21.15.19:0/616032916 shutdown_connections 2023-11-20T06:42:08.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.031+0000 7f6ff370f640 1 -- 172.21.15.19:0/616032916 wait complete. 2023-11-20T06:42:08.057 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T06:42:08.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.195+0000 7f8c5f49c640 1 Processor -- start 2023-11-20T06:42:08.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.199+0000 7f8c5f49c640 1 -- start start 2023-11-20T06:42:08.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.199+0000 7f8c5f49c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8c580b84e0 0x7f8c580d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:08.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.199+0000 7f8c5f49c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c580d1670 con 0x7f8c580d0210 2023-11-20T06:42:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.199+0000 7f8c5f49c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c580d1950 con 0x7f8c5815cba0 2023-11-20T06:42:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.199+0000 7f8c5f49c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c580d1460 con 0x7f8c580b84e0 2023-11-20T06:42:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.199+0000 7f8c5ca37640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8c580d0210 0x7f8c580b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57824/0 (socket says 172.21.15.19:57824) 2023-11-20T06:42:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.199+0000 7f8c5ca37640 1 -- 172.21.15.19:0/3738933269 learned_addr learned my addr 172.21.15.19:0/3738933269 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.199+0000 7f8c5da39640 1 --2- 172.21.15.19:0/3738933269 >> v2:172.21.15.190:3300/0 conn(0x7f8c580b84e0 0x7f8c580d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.199+0000 7f8c4ffff640 1 -- 172.21.15.19:0/3738933269 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2795857822 0 0) 0x7f8c580d1670 con 0x7f8c580d0210 2023-11-20T06:42:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.199+0000 7f8c4ffff640 1 -- 172.21.15.19:0/3738933269 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c44003530 con 0x7f8c580d0210 2023-11-20T06:42:08.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.199+0000 7f8c5da39640 1 -- 172.21.15.19:0/3738933269 >> v1:172.21.15.190:6789/0 conn(0x7f8c5815cba0 legacy=0x7f8c580cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:08.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.199+0000 7f8c4ffff640 1 -- 172.21.15.19:0/3738933269 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069743175 0 0) 0x7f8c580d1950 con 0x7f8c5815cba0 2023-11-20T06:42:08.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.199+0000 7f8c5da39640 1 -- 172.21.15.19:0/3738933269 >> v1:172.21.15.19:6789/0 conn(0x7f8c580d0210 legacy=0x7f8c580b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:08.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.199+0000 7f8c5da39640 1 -- 172.21.15.19:0/3738933269 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c580d1c30 con 0x7f8c580b84e0 2023-11-20T06:42:08.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.203+0000 7f8c5da39640 1 --2- 172.21.15.19:0/3738933269 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c580b84e0 0x7f8c580d0f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8c50009d90 tx=0x7f8c5001c700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5824700a9fdf6531 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:08.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.203+0000 7f8c4ffff640 1 -- 172.21.15.19:0/3738933269 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c48001680 con 0x7f8c580b84e0 2023-11-20T06:42:08.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.203+0000 7f8c4ffff640 1 -- 172.21.15.19:0/3738933269 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c500a5580 con 0x7f8c580b84e0 2023-11-20T06:42:08.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.203+0000 7f8c4ffff640 1 -- 172.21.15.19:0/3738933269 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c500a5910 con 0x7f8c580b84e0 2023-11-20T06:42:08.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.203+0000 7f8c5f49c640 1 -- 172.21.15.19:0/3738933269 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c580b84e0 msgr2=0x7f8c580d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:08.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.203+0000 7f8c5f49c640 1 --2- 172.21.15.19:0/3738933269 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c580b84e0 0x7f8c580d0f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8c50009d90 tx=0x7f8c5001c700 comp rx=0 tx=0).stop 2023-11-20T06:42:08.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.203+0000 7f8c5f49c640 1 -- 172.21.15.19:0/3738933269 shutdown_connections 2023-11-20T06:42:08.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.203+0000 7f8c5f49c640 1 --2- 172.21.15.19:0/3738933269 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c580b84e0 0x7f8c580d0f20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.203+0000 7f8c5f49c640 1 -- 172.21.15.19:0/3738933269 >> 172.21.15.19:0/3738933269 conn(0x7f8c580719c0 msgr2=0x7f8c58071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:08.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.203+0000 7f8c5f49c640 1 -- 172.21.15.19:0/3738933269 shutdown_connections 2023-11-20T06:42:08.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.203+0000 7f8c5f49c640 1 -- 172.21.15.19:0/3738933269 wait complete. 2023-11-20T06:42:08.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5f49c640 1 Processor -- start 2023-11-20T06:42:08.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5f49c640 1 -- start start 2023-11-20T06:42:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5f49c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c580b84e0 0x7f8c5814eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5f49c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c580d0210 0x7f8c5814fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5f49c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c5815cba0 0x7f8c5814df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5f49c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c580c6f00 con 0x7f8c5815cba0 2023-11-20T06:42:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5f49c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c580c6280 con 0x7f8c580d0210 2023-11-20T06:42:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5f49c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c580c6560 con 0x7f8c580b84e0 2023-11-20T06:42:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5da39640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c5815cba0 0x7f8c5814df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5da39640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c5815cba0 0x7f8c5814df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60516/0 (socket says 172.21.15.19:60516) 2023-11-20T06:42:08.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5da39640 1 -- 172.21.15.19:0/2789127468 learned_addr learned my addr 172.21.15.19:0/2789127468 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:08.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5ca37640 1 --2- 172.21.15.19:0/2789127468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c580d0210 0x7f8c5814fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:08.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5d238640 1 --2- 172.21.15.19:0/2789127468 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c580b84e0 0x7f8c5814eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:08.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5da39640 1 -- 172.21.15.19:0/2789127468 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c580b84e0 msgr2=0x7f8c5814eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:08.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5da39640 1 --2- 172.21.15.19:0/2789127468 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c580b84e0 0x7f8c5814eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5da39640 1 -- 172.21.15.19:0/2789127468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c580d0210 msgr2=0x7f8c5814fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:08.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5da39640 1 --2- 172.21.15.19:0/2789127468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c580d0210 0x7f8c5814fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5da39640 1 -- 172.21.15.19:0/2789127468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c50009a70 con 0x7f8c5815cba0 2023-11-20T06:42:08.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5da39640 1 --2- 172.21.15.19:0/2789127468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c5815cba0 0x7f8c5814df30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8c500b0040 tx=0x7f8c500194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:08.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c4dffb640 1 -- 172.21.15.19:0/2789127468 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c50003ba0 con 0x7f8c5815cba0 2023-11-20T06:42:08.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c4dffb640 1 -- 172.21.15.19:0/2789127468 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c50003d20 con 0x7f8c5815cba0 2023-11-20T06:42:08.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c4dffb640 1 -- 172.21.15.19:0/2789127468 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c500ad890 con 0x7f8c5815cba0 2023-11-20T06:42:08.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5f49c640 1 -- 172.21.15.19:0/2789127468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c580c6840 con 0x7f8c5815cba0 2023-11-20T06:42:08.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5f49c640 1 -- 172.21.15.19:0/2789127468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5814f0a0 con 0x7f8c5815cba0 2023-11-20T06:42:08.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.207+0000 7f8c5f49c640 1 -- 172.21.15.19:0/2789127468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c5804e170 con 0x7f8c5815cba0 2023-11-20T06:42:08.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.211+0000 7f8c4dffb640 1 -- 172.21.15.19:0/2789127468 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8c500b4050 con 0x7f8c5815cba0 2023-11-20T06:42:08.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.211+0000 7f8c4dffb640 1 --2- 172.21.15.19:0/2789127468 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8c3c0664a0 0x7f8c3c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:08.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.211+0000 7f8c4dffb640 1 -- 172.21.15.19:0/2789127468 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8c5011ed30 con 0x7f8c5815cba0 2023-11-20T06:42:08.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.211+0000 7f8c5d238640 1 --2- 172.21.15.19:0/2789127468 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8c3c0664a0 0x7f8c3c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:08.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.211+0000 7f8c5d238640 1 --2- 172.21.15.19:0/2789127468 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8c3c0664a0 0x7f8c3c068960 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8c54000f70 tx=0x7f8c54009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:08.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.215+0000 7f8c4dffb640 1 -- 172.21.15.19:0/2789127468 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8c500ebde0 con 0x7f8c5815cba0 2023-11-20T06:42:08.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.371+0000 7f8c5f49c640 1 -- 172.21.15.19:0/2789127468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c5815ace0 con 0x7f8c5815cba0 2023-11-20T06:42:08.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.371+0000 7f8c4dffb640 1 -- 172.21.15.19:0/2789127468 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c500c60a0 con 0x7f8c5815cba0 2023-11-20T06:42:08.378 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-20T06:42:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.375+0000 7f8c5f49c640 1 -- 172.21.15.19:0/2789127468 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8c3c0664a0 msgr2=0x7f8c3c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.375+0000 7f8c5f49c640 1 --2- 172.21.15.19:0/2789127468 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8c3c0664a0 0x7f8c3c068960 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8c54000f70 tx=0x7f8c54009040 comp rx=0 tx=0).stop 2023-11-20T06:42:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.375+0000 7f8c5f49c640 1 -- 172.21.15.19:0/2789127468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c5815cba0 msgr2=0x7f8c5814df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.375+0000 7f8c5f49c640 1 --2- 172.21.15.19:0/2789127468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c5815cba0 0x7f8c5814df30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8c500b0040 tx=0x7f8c500194a0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.375+0000 7f8c5f49c640 1 -- 172.21.15.19:0/2789127468 shutdown_connections 2023-11-20T06:42:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.375+0000 7f8c5f49c640 1 --2- 172.21.15.19:0/2789127468 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8c3c0664a0 0x7f8c3c068960 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.375+0000 7f8c5f49c640 1 --2- 172.21.15.19:0/2789127468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c5815cba0 0x7f8c5814df30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.375+0000 7f8c5f49c640 1 --2- 172.21.15.19:0/2789127468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c580d0210 0x7f8c5814fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.375+0000 7f8c5f49c640 1 --2- 172.21.15.19:0/2789127468 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c580b84e0 0x7f8c5814eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.375+0000 7f8c5f49c640 1 -- 172.21.15.19:0/2789127468 >> 172.21.15.19:0/2789127468 conn(0x7f8c580719c0 msgr2=0x7f8c580d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.375+0000 7f8c5f49c640 1 -- 172.21.15.19:0/2789127468 shutdown_connections 2023-11-20T06:42:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.375+0000 7f8c5f49c640 1 -- 172.21.15.19:0/2789127468 wait complete. 2023-11-20T06:42:08.399 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T06:42:08.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.539+0000 7f7c9bd65640 1 Processor -- start 2023-11-20T06:42:08.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.539+0000 7f7c9bd65640 1 -- start start 2023-11-20T06:42:08.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.539+0000 7f7c9bd65640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c940d0210 0x7f7c940d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:08.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.539+0000 7f7c9bd65640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7c940b84e0 0x7f7c940b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:08.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.539+0000 7f7c9bd65640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c940d1670 con 0x7f7c9415cba0 2023-11-20T06:42:08.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.539+0000 7f7c9bd65640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c940d1460 con 0x7f7c940b84e0 2023-11-20T06:42:08.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.539+0000 7f7c9bd65640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c940d1950 con 0x7f7c940d0210 2023-11-20T06:42:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.543+0000 7f7c99300640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c940d0210 0x7f7c940d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.543+0000 7f7c9a302640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7c940b84e0 0x7f7c940b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.543+0000 7f7c99300640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c940d0210 0x7f7c940d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:60460/0 (socket says 172.21.15.19:60460) 2023-11-20T06:42:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.543+0000 7f7c99300640 1 -- 172.21.15.19:0/2701305351 learned_addr learned my addr 172.21.15.19:0/2701305351 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.543+0000 7f7c99300640 1 -- 172.21.15.19:0/2701305351 >> v2:172.21.15.190:3300/0 conn(0x7f7c940b84e0 msgr2=0x7f7c940b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.543+0000 7f7c99300640 1 --2- 172.21.15.19:0/2701305351 >> v2:172.21.15.190:3300/0 conn(0x7f7c940b84e0 0x7f7c940b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.543+0000 7f7c99300640 1 -- 172.21.15.19:0/2701305351 >> v1:172.21.15.190:6789/0 conn(0x7f7c9415cba0 legacy=0x7f7c940cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.543+0000 7f7c99300640 1 -- 172.21.15.19:0/2701305351 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c940d1c30 con 0x7f7c940d0210 2023-11-20T06:42:08.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.543+0000 7f7c99300640 1 --2- 172.21.15.19:0/2701305351 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c940d0210 0x7f7c940d0f20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009870 tx=0x7f7c8401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6b4a11ebead3f28 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c98aff640 1 -- 172.21.15.19:0/2701305351 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c840a9400 con 0x7f7c940d0210 2023-11-20T06:42:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c98aff640 1 -- 172.21.15.19:0/2701305351 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c840a9560 con 0x7f7c940d0210 2023-11-20T06:42:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c98aff640 1 -- 172.21.15.19:0/2701305351 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c840a98f0 con 0x7f7c940d0210 2023-11-20T06:42:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c9bd65640 1 -- 172.21.15.19:0/2701305351 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c940d0210 msgr2=0x7f7c940d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c9bd65640 1 --2- 172.21.15.19:0/2701305351 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c940d0210 0x7f7c940d0f20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009870 tx=0x7f7c8401c540 comp rx=0 tx=0).stop 2023-11-20T06:42:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c9bd65640 1 -- 172.21.15.19:0/2701305351 shutdown_connections 2023-11-20T06:42:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c9bd65640 1 --2- 172.21.15.19:0/2701305351 >> v2:172.21.15.190:3300/0 conn(0x7f7c940b84e0 0x7f7c940b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c9bd65640 1 --2- 172.21.15.19:0/2701305351 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c940d0210 0x7f7c940d0f20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c9bd65640 1 -- 172.21.15.19:0/2701305351 >> 172.21.15.19:0/2701305351 conn(0x7f7c940719c0 msgr2=0x7f7c94071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c9bd65640 1 -- 172.21.15.19:0/2701305351 shutdown_connections 2023-11-20T06:42:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c9bd65640 1 -- 172.21.15.19:0/2701305351 wait complete. 2023-11-20T06:42:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c9bd65640 1 Processor -- start 2023-11-20T06:42:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c9bd65640 1 -- start start 2023-11-20T06:42:08.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c9bd65640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c940b84e0 0x7f7c9414a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:08.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c9bd65640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c940d0210 0x7f7c9414e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:08.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c9bd65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9415cba0 0x7f7c941588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:08.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c9bd65640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c941507e0 con 0x7f7c9415cba0 2023-11-20T06:42:08.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c9bd65640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c94155de0 con 0x7f7c940b84e0 2023-11-20T06:42:08.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c9bd65640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c941551d0 con 0x7f7c940d0210 2023-11-20T06:42:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c9a302640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9415cba0 0x7f7c941588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c9a302640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9415cba0 0x7f7c941588f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60522/0 (socket says 172.21.15.19:60522) 2023-11-20T06:42:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c9a302640 1 -- 172.21.15.19:0/1718599096 learned_addr learned my addr 172.21.15.19:0/1718599096 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c99300640 1 --2- 172.21.15.19:0/1718599096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c940d0210 0x7f7c9414e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.547+0000 7f7c99b01640 1 --2- 172.21.15.19:0/1718599096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c940b84e0 0x7f7c9414a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.551+0000 7f7c9a302640 1 -- 172.21.15.19:0/1718599096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c940d0210 msgr2=0x7f7c9414e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.551+0000 7f7c9a302640 1 --2- 172.21.15.19:0/1718599096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c940d0210 0x7f7c9414e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.551+0000 7f7c9a302640 1 -- 172.21.15.19:0/1718599096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c940b84e0 msgr2=0x7f7c9414a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.551+0000 7f7c9a302640 1 --2- 172.21.15.19:0/1718599096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c940b84e0 0x7f7c9414a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.551+0000 7f7c9a302640 1 -- 172.21.15.19:0/1718599096 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c840094d0 con 0x7f7c9415cba0 2023-11-20T06:42:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.551+0000 7f7c9a302640 1 --2- 172.21.15.19:0/1718599096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9415cba0 0x7f7c941588f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00efc0 tx=0x7f7c8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.551+0000 7f7c8a7fc640 1 -- 172.21.15.19:0/1718599096 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c014480 con 0x7f7c9415cba0 2023-11-20T06:42:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.551+0000 7f7c8a7fc640 1 -- 172.21.15.19:0/1718599096 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c00f040 con 0x7f7c9415cba0 2023-11-20T06:42:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.551+0000 7f7c8a7fc640 1 -- 172.21.15.19:0/1718599096 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c014820 con 0x7f7c9415cba0 2023-11-20T06:42:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.551+0000 7f7c9bd65640 1 -- 172.21.15.19:0/1718599096 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c941554b0 con 0x7f7c9415cba0 2023-11-20T06:42:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.551+0000 7f7c9bd65640 1 -- 172.21.15.19:0/1718599096 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c94155a70 con 0x7f7c9415cba0 2023-11-20T06:42:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.551+0000 7f7c9bd65640 1 -- 172.21.15.19:0/1718599096 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c940c9520 con 0x7f7c9415cba0 2023-11-20T06:42:08.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.551+0000 7f7c8a7fc640 1 -- 172.21.15.19:0/1718599096 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7c8c014980 con 0x7f7c9415cba0 2023-11-20T06:42:08.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.555+0000 7f7c8a7fc640 1 --2- 172.21.15.19:0/1718599096 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7c780664a0 0x7f7c78068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:08.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.555+0000 7f7c8a7fc640 1 -- 172.21.15.19:0/1718599096 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7c8c084c50 con 0x7f7c9415cba0 2023-11-20T06:42:08.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.555+0000 7f7c99b01640 1 --2- 172.21.15.19:0/1718599096 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7c780664a0 0x7f7c78068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:08.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.555+0000 7f7c99b01640 1 --2- 172.21.15.19:0/1718599096 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7c780664a0 0x7f7c78068960 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7c90007fd0 tx=0x7f7c90009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:08.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.559+0000 7f7c8a7fc640 1 -- 172.21.15.19:0/1718599096 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7c8c051db0 con 0x7f7c9415cba0 2023-11-20T06:42:08.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.715+0000 7f7c9bd65640 1 -- 172.21.15.19:0/1718599096 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7c94155f70 con 0x7f7c9415cba0 2023-11-20T06:42:08.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.715+0000 7f7c8a7fc640 1 -- 172.21.15.19:0/1718599096 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7c8c018020 con 0x7f7c9415cba0 2023-11-20T06:42:08.723 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.719+0000 7f7c9bd65640 1 -- 172.21.15.19:0/1718599096 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7c780664a0 msgr2=0x7f7c78068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.719+0000 7f7c9bd65640 1 --2- 172.21.15.19:0/1718599096 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7c780664a0 0x7f7c78068960 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7c90007fd0 tx=0x7f7c90009040 comp rx=0 tx=0).stop 2023-11-20T06:42:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.719+0000 7f7c9bd65640 1 -- 172.21.15.19:0/1718599096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9415cba0 msgr2=0x7f7c941588f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.719+0000 7f7c9bd65640 1 --2- 172.21.15.19:0/1718599096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9415cba0 0x7f7c941588f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00efc0 tx=0x7f7c8c00c490 comp rx=0 tx=0).stop 2023-11-20T06:42:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.719+0000 7f7c9bd65640 1 -- 172.21.15.19:0/1718599096 shutdown_connections 2023-11-20T06:42:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.719+0000 7f7c9bd65640 1 --2- 172.21.15.19:0/1718599096 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7c780664a0 0x7f7c78068960 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.719+0000 7f7c9bd65640 1 --2- 172.21.15.19:0/1718599096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9415cba0 0x7f7c941588f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.719+0000 7f7c9bd65640 1 --2- 172.21.15.19:0/1718599096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c940d0210 0x7f7c9414e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.719+0000 7f7c9bd65640 1 --2- 172.21.15.19:0/1718599096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c940b84e0 0x7f7c9414a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.719+0000 7f7c9bd65640 1 -- 172.21.15.19:0/1718599096 >> 172.21.15.19:0/1718599096 conn(0x7f7c940719c0 msgr2=0x7f7c941544c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.719+0000 7f7c9bd65640 1 -- 172.21.15.19:0/1718599096 shutdown_connections 2023-11-20T06:42:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.719+0000 7f7c9bd65640 1 -- 172.21.15.19:0/1718599096 wait complete. 2023-11-20T06:42:08.744 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection' 2023-11-20T06:42:08.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.883+0000 7fe855f1d640 1 Processor -- start 2023-11-20T06:42:08.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.883+0000 7fe855f1d640 1 -- start start 2023-11-20T06:42:08.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.883+0000 7fe855f1d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8500b07f0 0x7fe8500ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:08.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.883+0000 7fe855f1d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8500c96f0 con 0x7fe8500ad960 2023-11-20T06:42:08.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.883+0000 7fe855f1d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8500cb950 con 0x7fe850164520 2023-11-20T06:42:08.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.883+0000 7fe855f1d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe850164900 con 0x7fe8500b07f0 2023-11-20T06:42:08.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.883+0000 7fe84effd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe8500ad960 0x7fe8500cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57840/0 (socket says 172.21.15.19:57840) 2023-11-20T06:42:08.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.883+0000 7fe84effd640 1 -- 172.21.15.19:0/2911406178 learned_addr learned my addr 172.21.15.19:0/2911406178 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:08.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.883+0000 7fe84ffff640 1 --2- 172.21.15.19:0/2911406178 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8500b07f0 0x7fe8500ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:08.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.883+0000 7fe84e7fc640 1 -- 172.21.15.19:0/2911406178 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831023812 0 0) 0x7fe8500c96f0 con 0x7fe8500ad960 2023-11-20T06:42:08.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.883+0000 7fe84e7fc640 1 -- 172.21.15.19:0/2911406178 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe838003530 con 0x7fe8500ad960 2023-11-20T06:42:08.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.883+0000 7fe84e7fc640 1 -- 172.21.15.19:0/2911406178 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853107876 0 0) 0x7fe8500cb950 con 0x7fe850164520 2023-11-20T06:42:08.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.883+0000 7fe84e7fc640 1 -- 172.21.15.19:0/2911406178 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8500c96f0 con 0x7fe850164520 2023-11-20T06:42:08.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.883+0000 7fe84ffff640 1 -- 172.21.15.19:0/2911406178 >> v1:172.21.15.190:6789/0 conn(0x7fe850164520 legacy=0x7fe8500b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:08.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.883+0000 7fe84ffff640 1 -- 172.21.15.19:0/2911406178 >> v1:172.21.15.19:6789/0 conn(0x7fe8500ad960 legacy=0x7fe8500cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:08.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.883+0000 7fe84ffff640 1 -- 172.21.15.19:0/2911406178 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8500cbed0 con 0x7fe8500b07f0 2023-11-20T06:42:08.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.887+0000 7fe84ffff640 1 --2- 172.21.15.19:0/2911406178 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8500b07f0 0x7fe8500ce010 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe848009dc0 tx=0x7fe84801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1d9a99eaab9d686 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:08.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.887+0000 7fe84e7fc640 1 -- 172.21.15.19:0/2911406178 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8480a5a20 con 0x7fe8500b07f0 2023-11-20T06:42:08.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.887+0000 7fe84e7fc640 1 -- 172.21.15.19:0/2911406178 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8480a5b80 con 0x7fe8500b07f0 2023-11-20T06:42:08.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.887+0000 7fe84e7fc640 1 -- 172.21.15.19:0/2911406178 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8480ad440 con 0x7fe8500b07f0 2023-11-20T06:42:08.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.887+0000 7fe855f1d640 1 -- 172.21.15.19:0/2911406178 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8500b07f0 msgr2=0x7fe8500ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:08.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.887+0000 7fe855f1d640 1 --2- 172.21.15.19:0/2911406178 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8500b07f0 0x7fe8500ce010 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe848009dc0 tx=0x7fe84801c940 comp rx=0 tx=0).stop 2023-11-20T06:42:08.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.887+0000 7fe855f1d640 1 -- 172.21.15.19:0/2911406178 shutdown_connections 2023-11-20T06:42:08.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.887+0000 7fe855f1d640 1 --2- 172.21.15.19:0/2911406178 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8500b07f0 0x7fe8500ce010 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.887+0000 7fe855f1d640 1 -- 172.21.15.19:0/2911406178 >> 172.21.15.19:0/2911406178 conn(0x7fe85006c190 msgr2=0x7fe85006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:08.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.887+0000 7fe855f1d640 1 -- 172.21.15.19:0/2911406178 shutdown_connections 2023-11-20T06:42:08.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.887+0000 7fe855f1d640 1 -- 172.21.15.19:0/2911406178 wait complete. 2023-11-20T06:42:08.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe855f1d640 1 Processor -- start 2023-11-20T06:42:08.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe855f1d640 1 -- start start 2023-11-20T06:42:08.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe855f1d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8500ad960 0x7fe8500c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:08.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe855f1d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8500b07f0 0x7fe8500c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:08.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe855f1d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe850164520 0x7fe8500c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:08.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe855f1d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8500c2780 con 0x7fe850164520 2023-11-20T06:42:08.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe855f1d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8500c10d0 con 0x7fe8500ad960 2023-11-20T06:42:08.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe855f1d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8500c2130 con 0x7fe8500b07f0 2023-11-20T06:42:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe84ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe850164520 0x7fe8500c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe84ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe850164520 0x7fe8500c5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60536/0 (socket says 172.21.15.19:60536) 2023-11-20T06:42:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe84ffff640 1 -- 172.21.15.19:0/3387317428 learned_addr learned my addr 172.21.15.19:0/3387317428 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe84effd640 1 --2- 172.21.15.19:0/3387317428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8500b07f0 0x7fe8500c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe84f7fe640 1 --2- 172.21.15.19:0/3387317428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8500ad960 0x7fe8500c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe84ffff640 1 -- 172.21.15.19:0/3387317428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8500b07f0 msgr2=0x7fe8500c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe84ffff640 1 --2- 172.21.15.19:0/3387317428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8500b07f0 0x7fe8500c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe84ffff640 1 -- 172.21.15.19:0/3387317428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8500ad960 msgr2=0x7fe8500c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe84ffff640 1 --2- 172.21.15.19:0/3387317428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8500ad960 0x7fe8500c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe84ffff640 1 -- 172.21.15.19:0/3387317428 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe848009a70 con 0x7fe850164520 2023-11-20T06:42:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe84f7fe640 1 --2- 172.21.15.19:0/3387317428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8500ad960 0x7fe8500c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe84ffff640 1 --2- 172.21.15.19:0/3387317428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe850164520 0x7fe8500c5c70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe84801a570 tx=0x7fe8480196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:08.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe837fff640 1 -- 172.21.15.19:0/3387317428 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8480adca0 con 0x7fe850164520 2023-11-20T06:42:08.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe837fff640 1 -- 172.21.15.19:0/3387317428 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8480ade00 con 0x7fe850164520 2023-11-20T06:42:08.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe855f1d640 1 -- 172.21.15.19:0/3387317428 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8500c2410 con 0x7fe850164520 2023-11-20T06:42:08.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe837fff640 1 -- 172.21.15.19:0/3387317428 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8480b9690 con 0x7fe850164520 2023-11-20T06:42:08.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.891+0000 7fe855f1d640 1 -- 172.21.15.19:0/3387317428 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8500c82b0 con 0x7fe850164520 2023-11-20T06:42:08.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.895+0000 7fe855f1d640 1 -- 172.21.15.19:0/3387317428 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8500c28f0 con 0x7fe850164520 2023-11-20T06:42:08.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.895+0000 7fe837fff640 1 -- 172.21.15.19:0/3387317428 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe8480b97f0 con 0x7fe850164520 2023-11-20T06:42:08.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.895+0000 7fe837fff640 1 --2- 172.21.15.19:0/3387317428 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe83c0664a0 0x7fe83c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:08.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.895+0000 7fe837fff640 1 -- 172.21.15.19:0/3387317428 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe84811f890 con 0x7fe850164520 2023-11-20T06:42:08.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.895+0000 7fe84f7fe640 1 --2- 172.21.15.19:0/3387317428 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe83c0664a0 0x7fe83c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:08.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.895+0000 7fe84f7fe640 1 --2- 172.21.15.19:0/3387317428 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe83c0664a0 0x7fe83c068960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe8400011f0 tx=0x7fe840009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:08.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:08.899+0000 7fe837fff640 1 -- 172.21.15.19:0/3387317428 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe8480ec970 con 0x7fe850164520 2023-11-20T06:42:09.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.111+0000 7fe855f1d640 1 -- 172.21.15.19:0/3387317428 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection"]} v 0) v1 -- 0x7fe850074010 con 0x7fe850164520 2023-11-20T06:42:09.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.587+0000 7fe837fff640 1 -- 172.21.15.19:0/3387317428 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection"]}]=0 v73) v1 ==== 148+0+0 (secure 0 0 0) 0x7fe848009450 con 0x7fe850164520 2023-11-20T06:42:09.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.587+0000 7fe855f1d640 1 -- 172.21.15.19:0/3387317428 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe83c0664a0 msgr2=0x7fe83c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:09.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.591+0000 7fe855f1d640 1 --2- 172.21.15.19:0/3387317428 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe83c0664a0 0x7fe83c068960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe8400011f0 tx=0x7fe840009040 comp rx=0 tx=0).stop 2023-11-20T06:42:09.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.591+0000 7fe855f1d640 1 -- 172.21.15.19:0/3387317428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe850164520 msgr2=0x7fe8500c5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:09.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.591+0000 7fe855f1d640 1 --2- 172.21.15.19:0/3387317428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe850164520 0x7fe8500c5c70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe84801a570 tx=0x7fe8480196e0 comp rx=0 tx=0).stop 2023-11-20T06:42:09.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.591+0000 7fe855f1d640 1 -- 172.21.15.19:0/3387317428 shutdown_connections 2023-11-20T06:42:09.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.591+0000 7fe855f1d640 1 --2- 172.21.15.19:0/3387317428 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe83c0664a0 0x7fe83c068960 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:09.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.591+0000 7fe855f1d640 1 --2- 172.21.15.19:0/3387317428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe850164520 0x7fe8500c5c70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:09.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.591+0000 7fe855f1d640 1 --2- 172.21.15.19:0/3387317428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8500b07f0 0x7fe8500c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:09.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.591+0000 7fe855f1d640 1 --2- 172.21.15.19:0/3387317428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8500ad960 0x7fe8500c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:09.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.591+0000 7fe855f1d640 1 -- 172.21.15.19:0/3387317428 >> 172.21.15.19:0/3387317428 conn(0x7fe85006c190 msgr2=0x7fe8500afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:09.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.591+0000 7fe855f1d640 1 -- 172.21.15.19:0/3387317428 shutdown_connections 2023-11-20T06:42:09.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.591+0000 7fe855f1d640 1 -- 172.21.15.19:0/3387317428 wait complete. 2023-11-20T06:42:09.616 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-20T06:42:09.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.759+0000 7fd8a56ea640 1 Processor -- start 2023-11-20T06:42:09.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.759+0000 7fd8a56ea640 1 -- start start 2023-11-20T06:42:09.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.759+0000 7fd8a56ea640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd8a00d0210 0x7fd8a00d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:09.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.759+0000 7fd8a56ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8a00b84e0 0x7fd8a00b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:09.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.759+0000 7fd8a56ea640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a00d1670 con 0x7fd8a015cba0 2023-11-20T06:42:09.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.759+0000 7fd8a56ea640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a00d1460 con 0x7fd8a00d0210 2023-11-20T06:42:09.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.759+0000 7fd8a56ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a00d1950 con 0x7fd8a00b84e0 2023-11-20T06:42:09.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.759+0000 7fd897fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd8a00d0210 0x7fd8a00d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:09.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.759+0000 7fd89effd640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fd8a015cba0 0x7fd8a00cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:38270/0 (socket says 172.21.15.19:38270) 2023-11-20T06:42:09.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.759+0000 7fd89effd640 1 -- 172.21.15.19:0/2334056004 learned_addr learned my addr 172.21.15.19:0/2334056004 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:09.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.759+0000 7fd89f7fe640 1 --2- 172.21.15.19:0/2334056004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8a00b84e0 0x7fd8a00b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:09.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.759+0000 7fd89e7fc640 1 -- 172.21.15.19:0/2334056004 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748598733 0 0) 0x7fd8a00d1670 con 0x7fd8a015cba0 2023-11-20T06:42:09.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.759+0000 7fd89e7fc640 1 -- 172.21.15.19:0/2334056004 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd88c003530 con 0x7fd8a015cba0 2023-11-20T06:42:09.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.759+0000 7fd897fff640 1 -- 172.21.15.19:0/2334056004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8a00b84e0 msgr2=0x7fd8a00b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.759+0000 7fd897fff640 1 --2- 172.21.15.19:0/2334056004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8a00b84e0 0x7fd8a00b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.759+0000 7fd897fff640 1 -- 172.21.15.19:0/2334056004 >> v1:172.21.15.190:6789/0 conn(0x7fd8a015cba0 legacy=0x7fd8a00cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.759+0000 7fd897fff640 1 -- 172.21.15.19:0/2334056004 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a00d1c30 con 0x7fd8a00d0210 2023-11-20T06:42:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.759+0000 7fd89f7fe640 1 --2- 172.21.15.19:0/2334056004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8a00b84e0 0x7fd8a00b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:42:09.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.763+0000 7fd897fff640 1 --2- 172.21.15.19:0/2334056004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8a00d0210 0x7fd8a00d0f20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd8880097c0 tx=0x7fd88801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59e79bc301a9322f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:09.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.763+0000 7fd89e7fc640 1 -- 172.21.15.19:0/2334056004 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8880ab680 con 0x7fd8a00d0210 2023-11-20T06:42:09.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.763+0000 7fd89e7fc640 1 -- 172.21.15.19:0/2334056004 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8880ab7e0 con 0x7fd8a00d0210 2023-11-20T06:42:09.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.763+0000 7fd89e7fc640 1 -- 172.21.15.19:0/2334056004 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8880abb70 con 0x7fd8a00d0210 2023-11-20T06:42:09.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.763+0000 7fd8a56ea640 1 -- 172.21.15.19:0/2334056004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8a00d0210 msgr2=0x7fd8a00d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:09.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.763+0000 7fd8a56ea640 1 --2- 172.21.15.19:0/2334056004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8a00d0210 0x7fd8a00d0f20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd8880097c0 tx=0x7fd88801c480 comp rx=0 tx=0).stop 2023-11-20T06:42:09.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.763+0000 7fd8a56ea640 1 -- 172.21.15.19:0/2334056004 shutdown_connections 2023-11-20T06:42:09.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.763+0000 7fd8a56ea640 1 --2- 172.21.15.19:0/2334056004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8a00b84e0 0x7fd8a00b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:09.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.763+0000 7fd8a56ea640 1 --2- 172.21.15.19:0/2334056004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8a00d0210 0x7fd8a00d0f20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:09.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.763+0000 7fd8a56ea640 1 -- 172.21.15.19:0/2334056004 >> 172.21.15.19:0/2334056004 conn(0x7fd8a00719c0 msgr2=0x7fd8a0071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:09.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.763+0000 7fd8a56ea640 1 -- 172.21.15.19:0/2334056004 shutdown_connections 2023-11-20T06:42:09.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.763+0000 7fd8a56ea640 1 -- 172.21.15.19:0/2334056004 wait complete. 2023-11-20T06:42:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd8a56ea640 1 Processor -- start 2023-11-20T06:42:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd8a56ea640 1 -- start start 2023-11-20T06:42:09.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd8a56ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8a00b84e0 0x7fd8a014d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:09.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd8a56ea640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8a00d0210 0x7fd8a0155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:09.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd8a56ea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8a015cba0 0x7fd8a0152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:09.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd8a56ea640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a00c6ce0 con 0x7fd8a015cba0 2023-11-20T06:42:09.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd8a56ea640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a014da80 con 0x7fd8a00d0210 2023-11-20T06:42:09.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd8a56ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a0157510 con 0x7fd8a00b84e0 2023-11-20T06:42:09.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd89f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8a015cba0 0x7fd8a0152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:09.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd89f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8a015cba0 0x7fd8a0152570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60550/0 (socket says 172.21.15.19:60550) 2023-11-20T06:42:09.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd89f7fe640 1 -- 172.21.15.19:0/1362437739 learned_addr learned my addr 172.21.15.19:0/1362437739 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:09.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd897fff640 1 --2- 172.21.15.19:0/1362437739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8a00d0210 0x7fd8a0155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:09.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd89effd640 1 --2- 172.21.15.19:0/1362437739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8a00b84e0 0x7fd8a014d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:09.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd89f7fe640 1 -- 172.21.15.19:0/1362437739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8a00b84e0 msgr2=0x7fd8a014d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:09.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd89f7fe640 1 --2- 172.21.15.19:0/1362437739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8a00b84e0 0x7fd8a014d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:09.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd89f7fe640 1 -- 172.21.15.19:0/1362437739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8a00d0210 msgr2=0x7fd8a0155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:09.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd89f7fe640 1 --2- 172.21.15.19:0/1362437739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8a00d0210 0x7fd8a0155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:09.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd89f7fe640 1 -- 172.21.15.19:0/1362437739 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd898009a70 con 0x7fd8a015cba0 2023-11-20T06:42:09.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd89f7fe640 1 --2- 172.21.15.19:0/1362437739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8a015cba0 0x7fd8a0152570 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd89800efc0 tx=0x7fd898009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:09.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd8977fe640 1 -- 172.21.15.19:0/1362437739 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd898009d70 con 0x7fd8a015cba0 2023-11-20T06:42:09.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd8977fe640 1 -- 172.21.15.19:0/1362437739 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89800f040 con 0x7fd8a015cba0 2023-11-20T06:42:09.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd8a56ea640 1 -- 172.21.15.19:0/1362437739 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd888009420 con 0x7fd8a015cba0 2023-11-20T06:42:09.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd8977fe640 1 -- 172.21.15.19:0/1362437739 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8980146c0 con 0x7fd8a015cba0 2023-11-20T06:42:09.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.767+0000 7fd8a56ea640 1 -- 172.21.15.19:0/1362437739 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a0156be0 con 0x7fd8a015cba0 2023-11-20T06:42:09.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.771+0000 7fd8a56ea640 1 -- 172.21.15.19:0/1362437739 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a01576a0 con 0x7fd8a015cba0 2023-11-20T06:42:09.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.771+0000 7fd8977fe640 1 -- 172.21.15.19:0/1362437739 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd898014820 con 0x7fd8a015cba0 2023-11-20T06:42:09.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.771+0000 7fd8977fe640 1 --2- 172.21.15.19:0/1362437739 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd8800664a0 0x7fd880068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:09.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.771+0000 7fd8977fe640 1 -- 172.21.15.19:0/1362437739 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd898085160 con 0x7fd8a015cba0 2023-11-20T06:42:09.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.771+0000 7fd89effd640 1 --2- 172.21.15.19:0/1362437739 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd8800664a0 0x7fd880068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:09.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.771+0000 7fd89effd640 1 --2- 172.21.15.19:0/1362437739 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd8800664a0 0x7fd880068960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd8900011f0 tx=0x7fd890007d40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:09.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.775+0000 7fd8977fe640 1 -- 172.21.15.19:0/1362437739 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd898052230 con 0x7fd8a015cba0 2023-11-20T06:42:09.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.931+0000 7fd8a56ea640 1 -- 172.21.15.19:0/1362437739 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd8a004e170 con 0x7fd8a015cba0 2023-11-20T06:42:09.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.935+0000 7fd8977fe640 1 -- 172.21.15.19:0/1362437739 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd898055850 con 0x7fd8a015cba0 2023-11-20T06:42:09.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.939+0000 7fd8a56ea640 1 -- 172.21.15.19:0/1362437739 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd8800664a0 msgr2=0x7fd880068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:09.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.939+0000 7fd8a56ea640 1 --2- 172.21.15.19:0/1362437739 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd8800664a0 0x7fd880068960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd8900011f0 tx=0x7fd890007d40 comp rx=0 tx=0).stop 2023-11-20T06:42:09.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.939+0000 7fd8a56ea640 1 -- 172.21.15.19:0/1362437739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8a015cba0 msgr2=0x7fd8a0152570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:09.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.939+0000 7fd8a56ea640 1 --2- 172.21.15.19:0/1362437739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8a015cba0 0x7fd8a0152570 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd89800efc0 tx=0x7fd898009f90 comp rx=0 tx=0).stop 2023-11-20T06:42:09.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.939+0000 7fd8a56ea640 1 -- 172.21.15.19:0/1362437739 shutdown_connections 2023-11-20T06:42:09.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.939+0000 7fd8a56ea640 1 --2- 172.21.15.19:0/1362437739 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd8800664a0 0x7fd880068960 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:09.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.939+0000 7fd8a56ea640 1 --2- 172.21.15.19:0/1362437739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8a015cba0 0x7fd8a0152570 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:09.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.939+0000 7fd8a56ea640 1 --2- 172.21.15.19:0/1362437739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8a00d0210 0x7fd8a0155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:09.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.939+0000 7fd8a56ea640 1 --2- 172.21.15.19:0/1362437739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8a00b84e0 0x7fd8a014d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:09.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.939+0000 7fd8a56ea640 1 -- 172.21.15.19:0/1362437739 >> 172.21.15.19:0/1362437739 conn(0x7fd8a00719c0 msgr2=0x7fd8a0153d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:09.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.939+0000 7fd8a56ea640 1 -- 172.21.15.19:0/1362437739 shutdown_connections 2023-11-20T06:42:09.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:09.939+0000 7fd8a56ea640 1 -- 172.21.15.19:0/1362437739 wait complete. 2023-11-20T06:42:09.964 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-20T06:42:09.964 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-20T06:42:10.057 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-20T06:42:10.146 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-20T06:42:10.147 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:42:10.147 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:42:10.156 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:42:10.156 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:42:10.207 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:10.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.391+0000 7f418686b640 1 Processor -- start 2023-11-20T06:42:10.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.391+0000 7f418686b640 1 -- start start 2023-11-20T06:42:10.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.391+0000 7f418686b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4180070c40 0x7f418015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:10.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.391+0000 7f418686b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f41800b4020 0x7f41800b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:10.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.391+0000 7f418686b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41800b0620 0x7f418015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:10.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.391+0000 7f418686b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418015b3b0 con 0x7f4180070c40 2023-11-20T06:42:10.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.391+0000 7f418686b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41800b0a70 con 0x7f41800b4020 2023-11-20T06:42:10.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.391+0000 7f418686b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418015be60 con 0x7f41800b0620 2023-11-20T06:42:10.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.395+0000 7f417ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4180070c40 0x7f418015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:10.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.395+0000 7f417ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4180070c40 0x7f418015ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60562/0 (socket says 172.21.15.19:60562) 2023-11-20T06:42:10.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.395+0000 7f417ffff640 1 -- 172.21.15.19:0/3521042805 learned_addr learned my addr 172.21.15.19:0/3521042805 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:10.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.395+0000 7f4184e08640 1 --2- 172.21.15.19:0/3521042805 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41800b0620 0x7f418015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:10.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.395+0000 7f417f7fe640 1 --2- 172.21.15.19:0/3521042805 >> v2:172.21.15.190:3300/0 conn(0x7f41800b4020 0x7f41800b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:10.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.395+0000 7f417ffff640 1 -- 172.21.15.19:0/3521042805 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41800b0620 msgr2=0x7f418015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:10.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.395+0000 7f417ffff640 1 --2- 172.21.15.19:0/3521042805 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41800b0620 0x7f418015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:10.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.395+0000 7f417ffff640 1 -- 172.21.15.19:0/3521042805 >> v2:172.21.15.190:3300/0 conn(0x7f41800b4020 msgr2=0x7f41800b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:10.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.395+0000 7f417ffff640 1 --2- 172.21.15.19:0/3521042805 >> v2:172.21.15.190:3300/0 conn(0x7f41800b4020 0x7f41800b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:10.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.395+0000 7f417ffff640 1 -- 172.21.15.19:0/3521042805 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418015c1f0 con 0x7f4180070c40 2023-11-20T06:42:10.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.395+0000 7f4184e08640 1 --2- 172.21.15.19:0/3521042805 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41800b0620 0x7f418015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:10.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.395+0000 7f417ffff640 1 --2- 172.21.15.19:0/3521042805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4180070c40 0x7f418015ae70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f41800cc1e0 tx=0x7f417001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd7587af28a4aa8 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:10.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.395+0000 7f417effd640 1 -- 172.21.15.19:0/3521042805 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700a7070 con 0x7f4180070c40 2023-11-20T06:42:10.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.395+0000 7f417effd640 1 -- 172.21.15.19:0/3521042805 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41700ab430 con 0x7f4180070c40 2023-11-20T06:42:10.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.395+0000 7f417effd640 1 -- 172.21.15.19:0/3521042805 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700ab7c0 con 0x7f4180070c40 2023-11-20T06:42:10.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f418686b640 1 -- 172.21.15.19:0/3521042805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4180070c40 msgr2=0x7f418015ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:10.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f418686b640 1 --2- 172.21.15.19:0/3521042805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4180070c40 0x7f418015ae70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f41800cc1e0 tx=0x7f417001c470 comp rx=0 tx=0).stop 2023-11-20T06:42:10.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f418686b640 1 -- 172.21.15.19:0/3521042805 shutdown_connections 2023-11-20T06:42:10.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f418686b640 1 --2- 172.21.15.19:0/3521042805 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41800b0620 0x7f418015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:10.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f418686b640 1 --2- 172.21.15.19:0/3521042805 >> v2:172.21.15.190:3300/0 conn(0x7f41800b4020 0x7f41800b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:10.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f418686b640 1 --2- 172.21.15.19:0/3521042805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4180070c40 0x7f418015ae70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:10.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f418686b640 1 -- 172.21.15.19:0/3521042805 >> 172.21.15.19:0/3521042805 conn(0x7f418006c190 msgr2=0x7f418006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:10.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f418686b640 1 -- 172.21.15.19:0/3521042805 shutdown_connections 2023-11-20T06:42:10.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f418686b640 1 -- 172.21.15.19:0/3521042805 wait complete. 2023-11-20T06:42:10.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f418686b640 1 Processor -- start 2023-11-20T06:42:10.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f418686b640 1 -- start start 2023-11-20T06:42:10.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f418686b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4180070c40 0x7f41801f6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:10.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f418686b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41800b0620 0x7f41800b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:10.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f418686b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41800b4020 0x7f4180149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:10.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f418686b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41800b3460 con 0x7f41800b4020 2023-11-20T06:42:10.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f418686b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4180155fd0 con 0x7f41800b0620 2023-11-20T06:42:10.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f418686b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41801f6f80 con 0x7f4180070c40 2023-11-20T06:42:10.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f4184e08640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41800b4020 0x7f4180149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:10.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f4184e08640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41800b4020 0x7f4180149420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60568/0 (socket says 172.21.15.19:60568) 2023-11-20T06:42:10.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f4184e08640 1 -- 172.21.15.19:0/1194116965 learned_addr learned my addr 172.21.15.19:0/1194116965 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:10.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f417f7fe640 1 --2- 172.21.15.19:0/1194116965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41800b0620 0x7f41800b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:10.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f417ffff640 1 --2- 172.21.15.19:0/1194116965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4180070c40 0x7f41801f6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:10.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f4184e08640 1 -- 172.21.15.19:0/1194116965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4180070c40 msgr2=0x7f41801f6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:10.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f4184e08640 1 --2- 172.21.15.19:0/1194116965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4180070c40 0x7f41801f6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:10.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f4184e08640 1 -- 172.21.15.19:0/1194116965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41800b0620 msgr2=0x7f41800b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:10.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f4184e08640 1 --2- 172.21.15.19:0/1194116965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41800b0620 0x7f41800b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:10.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f4184e08640 1 -- 172.21.15.19:0/1194116965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41700094d0 con 0x7f41800b4020 2023-11-20T06:42:10.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.399+0000 7f417f7fe640 1 --2- 172.21.15.19:0/1194116965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41800b0620 0x7f41800b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:10.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.403+0000 7f4184e08640 1 --2- 172.21.15.19:0/1194116965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41800b4020 0x7f4180149420 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4178007de0 tx=0x7f417800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:10.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.403+0000 7f417cff9640 1 -- 172.21.15.19:0/1194116965 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41780039a0 con 0x7f41800b4020 2023-11-20T06:42:10.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.403+0000 7f417cff9640 1 -- 172.21.15.19:0/1194116965 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417800f040 con 0x7f41800b4020 2023-11-20T06:42:10.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.403+0000 7f417cff9640 1 -- 172.21.15.19:0/1194116965 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4178003d40 con 0x7f41800b4020 2023-11-20T06:42:10.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.403+0000 7f418686b640 1 -- 172.21.15.19:0/1194116965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41801f66e0 con 0x7f41800b4020 2023-11-20T06:42:10.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.403+0000 7f418686b640 1 -- 172.21.15.19:0/1194116965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41801f6ca0 con 0x7f41800b4020 2023-11-20T06:42:10.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.403+0000 7f418686b640 1 -- 172.21.15.19:0/1194116965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4180074010 con 0x7f41800b4020 2023-11-20T06:42:10.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.403+0000 7f417cff9640 1 -- 172.21.15.19:0/1194116965 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4178004030 con 0x7f41800b4020 2023-11-20T06:42:10.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.403+0000 7f417cff9640 1 --2- 172.21.15.19:0/1194116965 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f416c0664a0 0x7f416c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:10.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.403+0000 7f417cff9640 1 -- 172.21.15.19:0/1194116965 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4178084610 con 0x7f41800b4020 2023-11-20T06:42:10.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.403+0000 7f417ffff640 1 --2- 172.21.15.19:0/1194116965 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f416c0664a0 0x7f416c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:10.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.407+0000 7f417ffff640 1 --2- 172.21.15.19:0/1194116965 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f416c0664a0 0x7f416c068960 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f41700af000 tx=0x7f4170008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:10.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.407+0000 7f417cff9640 1 -- 172.21.15.19:0/1194116965 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f41780516c0 con 0x7f41800b4020 2023-11-20T06:42:10.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.567+0000 7f418686b640 1 -- 172.21.15.19:0/1194116965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41800ad8f0 con 0x7f41800b4020 2023-11-20T06:42:10.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.567+0000 7f417cff9640 1 -- 172.21.15.19:0/1194116965 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18720 (secure 0 0 0) 0x7f4178054ce0 con 0x7f41800b4020 2023-11-20T06:42:10.573 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:10.573 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:55.472006+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:10.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.571+0000 7f418686b640 1 -- 172.21.15.19:0/1194116965 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f416c0664a0 msgr2=0x7f416c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:10.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.571+0000 7f418686b640 1 --2- 172.21.15.19:0/1194116965 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f416c0664a0 0x7f416c068960 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f41700af000 tx=0x7f4170008040 comp rx=0 tx=0).stop 2023-11-20T06:42:10.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.571+0000 7f418686b640 1 -- 172.21.15.19:0/1194116965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41800b4020 msgr2=0x7f4180149420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:10.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.571+0000 7f418686b640 1 --2- 172.21.15.19:0/1194116965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41800b4020 0x7f4180149420 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4178007de0 tx=0x7f417800d4a0 comp rx=0 tx=0).stop 2023-11-20T06:42:10.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.571+0000 7f418686b640 1 -- 172.21.15.19:0/1194116965 shutdown_connections 2023-11-20T06:42:10.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.571+0000 7f418686b640 1 --2- 172.21.15.19:0/1194116965 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f416c0664a0 0x7f416c068960 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:10.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.571+0000 7f418686b640 1 --2- 172.21.15.19:0/1194116965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41800b4020 0x7f4180149420 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:10.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.571+0000 7f418686b640 1 --2- 172.21.15.19:0/1194116965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41800b0620 0x7f41800b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:10.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.571+0000 7f418686b640 1 --2- 172.21.15.19:0/1194116965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4180070c40 0x7f41801f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:10.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.571+0000 7f418686b640 1 -- 172.21.15.19:0/1194116965 >> 172.21.15.19:0/1194116965 conn(0x7f418006c190 msgr2=0x7f4180151c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:10.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.571+0000 7f418686b640 1 -- 172.21.15.19:0/1194116965 shutdown_connections 2023-11-20T06:42:10.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.571+0000 7f418686b640 1 -- 172.21.15.19:0/1194116965 wait complete. 2023-11-20T06:42:10.595 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T06:41:11.805111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T06:41:12.614034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T06:41:16.311206+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T06:42:10.595 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:42:10.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.735+0000 7f0a5b06b640 1 Processor -- start 2023-11-20T06:42:10.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.739+0000 7f0a5b06b640 1 -- start start 2023-11-20T06:42:10.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.739+0000 7f0a5b06b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0a5406d010 0x7f0a540c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:10.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.739+0000 7f0a5b06b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a5415ae30 con 0x7f0a54069e90 2023-11-20T06:42:10.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.739+0000 7f0a5b06b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a540ca510 con 0x7f0a540c26b0 2023-11-20T06:42:10.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.739+0000 7f0a5b06b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a540cb090 con 0x7f0a5406d010 2023-11-20T06:42:10.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.739+0000 7f0a58e07640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0a54069e90 0x7f0a5406a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57844/0 (socket says 172.21.15.19:57844) 2023-11-20T06:42:10.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.739+0000 7f0a58e07640 1 -- 172.21.15.19:0/1597757179 learned_addr learned my addr 172.21.15.19:0/1597757179 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:10.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.739+0000 7f0a53fff640 1 --2- 172.21.15.19:0/1597757179 >> v2:172.21.15.19:3300/0 conn(0x7f0a5406d010 0x7f0a540c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:10.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.739+0000 7f0a53fff640 1 -- 172.21.15.19:0/1597757179 >> v1:172.21.15.190:6789/0 conn(0x7f0a540c26b0 legacy=0x7f0a540c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:10.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.739+0000 7f0a53fff640 1 -- 172.21.15.19:0/1597757179 >> v1:172.21.15.19:6789/0 conn(0x7f0a54069e90 legacy=0x7f0a5406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:10.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.739+0000 7f0a53fff640 1 -- 172.21.15.19:0/1597757179 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a540ca7f0 con 0x7f0a5406d010 2023-11-20T06:42:10.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.739+0000 7f0a537fe640 1 -- 172.21.15.19:0/1597757179 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457149604 0 0) 0x7f0a5415ae30 con 0x7f0a54069e90 2023-11-20T06:42:10.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.743+0000 7f0a53fff640 1 --2- 172.21.15.19:0/1597757179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a5406d010 0x7f0a540c9ce0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0a400097c0 tx=0x7f0a4001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97f6631d022f29 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:10.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.743+0000 7f0a537fe640 1 -- 172.21.15.19:0/1597757179 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a400a8930 con 0x7f0a5406d010 2023-11-20T06:42:10.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.743+0000 7f0a537fe640 1 -- 172.21.15.19:0/1597757179 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a400a8a90 con 0x7f0a5406d010 2023-11-20T06:42:10.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.743+0000 7f0a537fe640 1 -- 172.21.15.19:0/1597757179 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a400a8e20 con 0x7f0a5406d010 2023-11-20T06:42:10.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.743+0000 7f0a5b06b640 1 -- 172.21.15.19:0/1597757179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a5406d010 msgr2=0x7f0a540c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:10.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.743+0000 7f0a5b06b640 1 --2- 172.21.15.19:0/1597757179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a5406d010 0x7f0a540c9ce0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0a400097c0 tx=0x7f0a4001ec30 comp rx=0 tx=0).stop 2023-11-20T06:42:10.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.743+0000 7f0a5b06b640 1 -- 172.21.15.19:0/1597757179 shutdown_connections 2023-11-20T06:42:10.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.743+0000 7f0a5b06b640 1 --2- 172.21.15.19:0/1597757179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a5406d010 0x7f0a540c9ce0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:10.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.743+0000 7f0a5b06b640 1 -- 172.21.15.19:0/1597757179 >> 172.21.15.19:0/1597757179 conn(0x7f0a540b0da0 msgr2=0x7f0a540ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:10.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.743+0000 7f0a5b06b640 1 -- 172.21.15.19:0/1597757179 shutdown_connections 2023-11-20T06:42:10.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.743+0000 7f0a5b06b640 1 -- 172.21.15.19:0/1597757179 wait complete. 2023-11-20T06:42:10.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.743+0000 7f0a5b06b640 1 Processor -- start 2023-11-20T06:42:10.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.743+0000 7f0a5b06b640 1 -- start start 2023-11-20T06:42:10.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a5b06b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0a54069e90 0x7f0a540c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:10.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a5b06b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a5406d010 0x7f0a541460b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:10.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a5b06b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a540c26b0 0x7f0a541f4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:10.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a5b06b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a540c7260 con 0x7f0a540c26b0 2023-11-20T06:42:10.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a5b06b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a541465f0 con 0x7f0a5406d010 2023-11-20T06:42:10.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a5b06b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a54156fc0 con 0x7f0a54069e90 2023-11-20T06:42:10.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a59608640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a540c26b0 0x7f0a541f4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:10.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a59608640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a540c26b0 0x7f0a541f4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60600/0 (socket says 172.21.15.19:60600) 2023-11-20T06:42:10.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a59608640 1 -- 172.21.15.19:0/964752461 learned_addr learned my addr 172.21.15.19:0/964752461 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:10.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a58e07640 1 --2- 172.21.15.19:0/964752461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0a54069e90 0x7f0a540c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:10.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a53fff640 1 --2- 172.21.15.19:0/964752461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a5406d010 0x7f0a541460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:10.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a59608640 1 -- 172.21.15.19:0/964752461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0a54069e90 msgr2=0x7f0a540c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:10.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a59608640 1 --2- 172.21.15.19:0/964752461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0a54069e90 0x7f0a540c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:10.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a59608640 1 -- 172.21.15.19:0/964752461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a5406d010 msgr2=0x7f0a541460b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:10.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a59608640 1 --2- 172.21.15.19:0/964752461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a5406d010 0x7f0a541460b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:10.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a59608640 1 -- 172.21.15.19:0/964752461 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a40009420 con 0x7f0a540c26b0 2023-11-20T06:42:10.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a59608640 1 --2- 172.21.15.19:0/964752461 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a540c26b0 0x7f0a541f4e10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00b9a0 tx=0x7f0a4c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:10.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a517fa640 1 -- 172.21.15.19:0/964752461 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c00cba0 con 0x7f0a540c26b0 2023-11-20T06:42:10.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a517fa640 1 -- 172.21.15.19:0/964752461 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4c00cd00 con 0x7f0a540c26b0 2023-11-20T06:42:10.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a517fa640 1 -- 172.21.15.19:0/964752461 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c014680 con 0x7f0a540c26b0 2023-11-20T06:42:10.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a5b06b640 1 -- 172.21.15.19:0/964752461 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a54143640 con 0x7f0a540c26b0 2023-11-20T06:42:10.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a5b06b640 1 -- 172.21.15.19:0/964752461 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a54143be0 con 0x7f0a540c26b0 2023-11-20T06:42:10.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.747+0000 7f0a5b06b640 1 -- 172.21.15.19:0/964752461 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a5404e170 con 0x7f0a540c26b0 2023-11-20T06:42:10.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.751+0000 7f0a517fa640 1 -- 172.21.15.19:0/964752461 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0a4c01d3b0 con 0x7f0a540c26b0 2023-11-20T06:42:10.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.751+0000 7f0a517fa640 1 --2- 172.21.15.19:0/964752461 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0a380664a0 0x7f0a38068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:10.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.751+0000 7f0a517fa640 1 -- 172.21.15.19:0/964752461 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0a4c083fd0 con 0x7f0a540c26b0 2023-11-20T06:42:10.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.751+0000 7f0a58e07640 1 --2- 172.21.15.19:0/964752461 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0a380664a0 0x7f0a38068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:10.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.751+0000 7f0a58e07640 1 --2- 172.21.15.19:0/964752461 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0a380664a0 0x7f0a38068960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0a48007fd0 tx=0x7f0a48007d60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:10.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.755+0000 7f0a517fa640 1 -- 172.21.15.19:0/964752461 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0a4c051140 con 0x7f0a540c26b0 2023-11-20T06:42:10.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.915+0000 7f0a5b06b640 1 -- 172.21.15.19:0/964752461 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0a540c2090 con 0x7f0a540c26b0 2023-11-20T06:42:10.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.915+0000 7f0a517fa640 1 -- 172.21.15.19:0/964752461 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0a4c054760 con 0x7f0a540c26b0 2023-11-20T06:42:10.921 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:42:10.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.919+0000 7f0a5b06b640 1 -- 172.21.15.19:0/964752461 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0a380664a0 msgr2=0x7f0a38068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:10.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.919+0000 7f0a5b06b640 1 --2- 172.21.15.19:0/964752461 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0a380664a0 0x7f0a38068960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0a48007fd0 tx=0x7f0a48007d60 comp rx=0 tx=0).stop 2023-11-20T06:42:10.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.919+0000 7f0a5b06b640 1 -- 172.21.15.19:0/964752461 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a540c26b0 msgr2=0x7f0a541f4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:10.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.919+0000 7f0a5b06b640 1 --2- 172.21.15.19:0/964752461 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a540c26b0 0x7f0a541f4e10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00b9a0 tx=0x7f0a4c00be60 comp rx=0 tx=0).stop 2023-11-20T06:42:10.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.919+0000 7f0a5b06b640 1 -- 172.21.15.19:0/964752461 shutdown_connections 2023-11-20T06:42:10.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.919+0000 7f0a5b06b640 1 --2- 172.21.15.19:0/964752461 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0a380664a0 0x7f0a38068960 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:10.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.919+0000 7f0a5b06b640 1 --2- 172.21.15.19:0/964752461 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a540c26b0 0x7f0a541f4e10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:10.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.919+0000 7f0a5b06b640 1 --2- 172.21.15.19:0/964752461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a5406d010 0x7f0a541460b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:10.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.919+0000 7f0a5b06b640 1 --2- 172.21.15.19:0/964752461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0a54069e90 0x7f0a540c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:10.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.919+0000 7f0a5b06b640 1 -- 172.21.15.19:0/964752461 >> 172.21.15.19:0/964752461 conn(0x7f0a540b0da0 msgr2=0x7f0a5406c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:10.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.919+0000 7f0a5b06b640 1 -- 172.21.15.19:0/964752461 shutdown_connections 2023-11-20T06:42:10.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:10.919+0000 7f0a5b06b640 1 -- 172.21.15.19:0/964752461 wait complete. 2023-11-20T06:42:10.943 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T06:42:11.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.083+0000 7fc79fc9e640 1 Processor -- start 2023-11-20T06:42:11.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.083+0000 7fc79fc9e640 1 -- start start 2023-11-20T06:42:11.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.083+0000 7fc79fc9e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc7980d0210 0x7fc7980d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:11.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.083+0000 7fc79fc9e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc7980b84e0 0x7fc7980b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:11.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.083+0000 7fc79fc9e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7980d1670 con 0x7fc79815cba0 2023-11-20T06:42:11.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.083+0000 7fc79fc9e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7980d1460 con 0x7fc7980b84e0 2023-11-20T06:42:11.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.083+0000 7fc79fc9e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7980d1950 con 0x7fc7980d0210 2023-11-20T06:42:11.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79da3a640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc79815cba0 0x7fc7980cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57856/0 (socket says 172.21.15.19:57856) 2023-11-20T06:42:11.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79da3a640 1 -- 172.21.15.19:0/2076605829 learned_addr learned my addr 172.21.15.19:0/2076605829 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:11.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79d239640 1 --2- 172.21.15.19:0/2076605829 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc7980d0210 0x7fc7980d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:11.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79e23b640 1 --2- 172.21.15.19:0/2076605829 >> v2:172.21.15.190:3300/0 conn(0x7fc7980b84e0 0x7fc7980b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:11.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79ca38640 1 -- 172.21.15.19:0/2076605829 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643666932 0 0) 0x7fc7980d1670 con 0x7fc79815cba0 2023-11-20T06:42:11.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79ca38640 1 -- 172.21.15.19:0/2076605829 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc784003530 con 0x7fc79815cba0 2023-11-20T06:42:11.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79ca38640 1 -- 172.21.15.19:0/2076605829 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1112860833 0 0) 0x7fc784003530 con 0x7fc79815cba0 2023-11-20T06:42:11.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79ca38640 1 -- 172.21.15.19:0/2076605829 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc7980d0210 msgr2=0x7fc7980d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:11.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79ca38640 1 --2- 172.21.15.19:0/2076605829 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc7980d0210 0x7fc7980d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79ca38640 1 -- 172.21.15.19:0/2076605829 >> v2:172.21.15.190:3300/0 conn(0x7fc7980b84e0 msgr2=0x7fc7980b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:11.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79ca38640 1 --2- 172.21.15.19:0/2076605829 >> v2:172.21.15.190:3300/0 conn(0x7fc7980b84e0 0x7fc7980b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79ca38640 1 -- 172.21.15.19:0/2076605829 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7980d1c30 con 0x7fc79815cba0 2023-11-20T06:42:11.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79ca38640 1 -- 172.21.15.19:0/2076605829 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7fc794001680 con 0x7fc79815cba0 2023-11-20T06:42:11.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79ca38640 1 -- 172.21.15.19:0/2076605829 >> v1:172.21.15.19:6789/0 conn(0x7fc79815cba0 legacy=0x7fc7980cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:11.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79ca38640 1 --2- 172.21.15.19:0/2076605829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc784003980 0x7fc784003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:11.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79ca38640 1 --2- 172.21.15.19:0/2076605829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7840047d0 0x7fc784004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:11.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79ca38640 1 --2- 172.21.15.19:0/2076605829 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc7980d0210 0x7fc784005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:11.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79ca38640 1 -- 172.21.15.19:0/2076605829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7980d1460 con 0x7fc7840047d0 2023-11-20T06:42:11.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79ca38640 1 -- 172.21.15.19:0/2076605829 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7980d1950 con 0x7fc784003980 2023-11-20T06:42:11.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79ca38640 1 -- 172.21.15.19:0/2076605829 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78400b990 con 0x7fc7980d0210 2023-11-20T06:42:11.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79d239640 1 --2- 172.21.15.19:0/2076605829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7840047d0 0x7fc784004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:11.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79da3a640 1 --2- 172.21.15.19:0/2076605829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc784003980 0x7fc784003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:11.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79e23b640 1 --2- 172.21.15.19:0/2076605829 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc7980d0210 0x7fc784005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:11.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79d239640 1 -- 172.21.15.19:0/2076605829 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc7980d0210 msgr2=0x7fc784005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:11.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79d239640 1 --2- 172.21.15.19:0/2076605829 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc7980d0210 0x7fc784005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79d239640 1 -- 172.21.15.19:0/2076605829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc784003980 msgr2=0x7fc784003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:11.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79d239640 1 --2- 172.21.15.19:0/2076605829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc784003980 0x7fc784003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.087+0000 7fc79d239640 1 -- 172.21.15.19:0/2076605829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc784003530 con 0x7fc7840047d0 2023-11-20T06:42:11.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.091+0000 7fc79d239640 1 --2- 172.21.15.19:0/2076605829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7840047d0 0x7fc784004c50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc788009ae0 tx=0x7fc78801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d465c7abfa9c2613 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:11.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.091+0000 7fc79ca38640 1 -- 172.21.15.19:0/2076605829 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7880a5560 con 0x7fc7840047d0 2023-11-20T06:42:11.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.091+0000 7fc79ca38640 1 -- 172.21.15.19:0/2076605829 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7880a56c0 con 0x7fc7840047d0 2023-11-20T06:42:11.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.091+0000 7fc79ca38640 1 -- 172.21.15.19:0/2076605829 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7880a5a70 con 0x7fc7840047d0 2023-11-20T06:42:11.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.091+0000 7fc79fc9e640 1 -- 172.21.15.19:0/2076605829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7840047d0 msgr2=0x7fc784004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:11.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.091+0000 7fc79fc9e640 1 --2- 172.21.15.19:0/2076605829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7840047d0 0x7fc784004c50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc788009ae0 tx=0x7fc78801ca50 comp rx=0 tx=0).stop 2023-11-20T06:42:11.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.091+0000 7fc79e23b640 1 -- 172.21.15.19:0/2076605829 reap_dead start 2023-11-20T06:42:11.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.091+0000 7fc79fc9e640 1 -- 172.21.15.19:0/2076605829 shutdown_connections 2023-11-20T06:42:11.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.091+0000 7fc79fc9e640 1 -- 172.21.15.19:0/2076605829 >> 172.21.15.19:0/2076605829 conn(0x7fc7980719c0 msgr2=0x7fc798071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:11.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.091+0000 7fc79fc9e640 1 -- 172.21.15.19:0/2076605829 shutdown_connections 2023-11-20T06:42:11.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.091+0000 7fc79fc9e640 1 -- 172.21.15.19:0/2076605829 wait complete. 2023-11-20T06:42:11.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.091+0000 7fc79fc9e640 1 Processor -- start 2023-11-20T06:42:11.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.091+0000 7fc79fc9e640 1 -- start start 2023-11-20T06:42:11.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc79fc9e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7840047d0 0x7fc7980cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:11.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc79fc9e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7980cb7a0 0x7fc7980cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:11.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc79fc9e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc7980cc160 0x7fc798145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:11.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc79fc9e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7980cb040 con 0x7fc7840047d0 2023-11-20T06:42:11.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc79fc9e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7980cc5c0 con 0x7fc7980cb7a0 2023-11-20T06:42:11.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc79fc9e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc798146b20 con 0x7fc7980cc160 2023-11-20T06:42:11.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc79da3a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7840047d0 0x7fc7980cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:11.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc79da3a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7840047d0 0x7fc7980cb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60614/0 (socket says 172.21.15.19:60614) 2023-11-20T06:42:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc79da3a640 1 -- 172.21.15.19:0/821767060 learned_addr learned my addr 172.21.15.19:0/821767060 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc79e23b640 1 --2- 172.21.15.19:0/821767060 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc7980cc160 0x7fc798145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc79d239640 1 --2- 172.21.15.19:0/821767060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7980cb7a0 0x7fc7980cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc79da3a640 1 -- 172.21.15.19:0/821767060 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc7980cc160 msgr2=0x7fc798145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc79da3a640 1 --2- 172.21.15.19:0/821767060 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc7980cc160 0x7fc798145480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc79da3a640 1 -- 172.21.15.19:0/821767060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7980cb7a0 msgr2=0x7fc7980cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc79da3a640 1 --2- 172.21.15.19:0/821767060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7980cb7a0 0x7fc7980cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc79da3a640 1 -- 172.21.15.19:0/821767060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc798146e00 con 0x7fc7840047d0 2023-11-20T06:42:11.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc79da3a640 1 --2- 172.21.15.19:0/821767060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7840047d0 0x7fc7980cb260 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc794012540 tx=0x7fc794012a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:11.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc78e7fc640 1 -- 172.21.15.19:0/821767060 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc794014810 con 0x7fc7840047d0 2023-11-20T06:42:11.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc78e7fc640 1 -- 172.21.15.19:0/821767060 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc794014970 con 0x7fc7840047d0 2023-11-20T06:42:11.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc78e7fc640 1 -- 172.21.15.19:0/821767060 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc794014d20 con 0x7fc7840047d0 2023-11-20T06:42:11.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc79fc9e640 1 -- 172.21.15.19:0/821767060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7981470e0 con 0x7fc7840047d0 2023-11-20T06:42:11.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc79fc9e640 1 -- 172.21.15.19:0/821767060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7981476a0 con 0x7fc7840047d0 2023-11-20T06:42:11.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc79fc9e640 1 -- 172.21.15.19:0/821767060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79804e170 con 0x7fc7840047d0 2023-11-20T06:42:11.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.095+0000 7fc78e7fc640 1 -- 172.21.15.19:0/821767060 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc794016480 con 0x7fc7840047d0 2023-11-20T06:42:11.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.099+0000 7fc78e7fc640 1 --2- 172.21.15.19:0/821767060 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc77c0664a0 0x7fc77c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:11.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.099+0000 7fc78e7fc640 1 -- 172.21.15.19:0/821767060 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc794087720 con 0x7fc7840047d0 2023-11-20T06:42:11.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.099+0000 7fc79d239640 1 --2- 172.21.15.19:0/821767060 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc77c0664a0 0x7fc77c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:11.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.099+0000 7fc79d239640 1 --2- 172.21.15.19:0/821767060 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc77c0664a0 0x7fc77c068960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc7880af000 tx=0x7fc7880046d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:11.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.103+0000 7fc78e7fc640 1 -- 172.21.15.19:0/821767060 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc794054800 con 0x7fc7840047d0 2023-11-20T06:42:11.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.259+0000 7fc79fc9e640 1 -- 172.21.15.19:0/821767060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc79815b250 con 0x7fc7840047d0 2023-11-20T06:42:11.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.259+0000 7fc78e7fc640 1 -- 172.21.15.19:0/821767060 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc794057e20 con 0x7fc7840047d0 2023-11-20T06:42:11.264 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:11.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.259+0000 7fc79fc9e640 1 -- 172.21.15.19:0/821767060 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc77c0664a0 msgr2=0x7fc77c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:11.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.259+0000 7fc79fc9e640 1 --2- 172.21.15.19:0/821767060 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc77c0664a0 0x7fc77c068960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc7880af000 tx=0x7fc7880046d0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.259+0000 7fc79fc9e640 1 -- 172.21.15.19:0/821767060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7840047d0 msgr2=0x7fc7980cb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:11.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.259+0000 7fc79fc9e640 1 --2- 172.21.15.19:0/821767060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7840047d0 0x7fc7980cb260 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc794012540 tx=0x7fc794012a00 comp rx=0 tx=0).stop 2023-11-20T06:42:11.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.259+0000 7fc79fc9e640 1 -- 172.21.15.19:0/821767060 shutdown_connections 2023-11-20T06:42:11.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.259+0000 7fc79fc9e640 1 --2- 172.21.15.19:0/821767060 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc77c0664a0 0x7fc77c068960 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.259+0000 7fc79fc9e640 1 --2- 172.21.15.19:0/821767060 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc7980cc160 0x7fc798145480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.259+0000 7fc79fc9e640 1 --2- 172.21.15.19:0/821767060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7980cb7a0 0x7fc7980cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.259+0000 7fc79fc9e640 1 --2- 172.21.15.19:0/821767060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7840047d0 0x7fc7980cb260 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.259+0000 7fc79fc9e640 1 -- 172.21.15.19:0/821767060 >> 172.21.15.19:0/821767060 conn(0x7fc7980719c0 msgr2=0x7fc7980d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:11.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.259+0000 7fc79fc9e640 1 -- 172.21.15.19:0/821767060 shutdown_connections 2023-11-20T06:42:11.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.259+0000 7fc79fc9e640 1 -- 172.21.15.19:0/821767060 wait complete. 2023-11-20T06:42:11.285 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T06:42:11.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.423+0000 7f7b31de4640 1 Processor -- start 2023-11-20T06:42:11.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.423+0000 7f7b31de4640 1 -- start start 2023-11-20T06:42:11.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.427+0000 7f7b31de4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7b2c0cf210 0x7f7b2c0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:11.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.427+0000 7f7b31de4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b2c15cdc0 0x7f7b2c0b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:11.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.427+0000 7f7b31de4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2c0cfb30 con 0x7f7b2c0d3320 2023-11-20T06:42:11.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.427+0000 7f7b31de4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2c0d0880 con 0x7f7b2c0cf210 2023-11-20T06:42:11.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.427+0000 7f7b31de4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c0b1c00 con 0x7f7b2c15cdc0 2023-11-20T06:42:11.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.427+0000 7f7b315e3640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7b2c0d3320 0x7f7b2c0b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57858/0 (socket says 172.21.15.19:57858) 2023-11-20T06:42:11.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.427+0000 7f7b315e3640 1 -- 172.21.15.19:0/4248306680 learned_addr learned my addr 172.21.15.19:0/4248306680 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:11.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.427+0000 7f7b2bfff640 1 --2- 172.21.15.19:0/4248306680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b2c15cdc0 0x7f7b2c0b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:11.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.427+0000 7f7b30de2640 1 --2- 172.21.15.19:0/4248306680 >> v2:172.21.15.190:3300/0 conn(0x7f7b2c0cf210 0x7f7b2c0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:11.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.427+0000 7f7b2b7fe640 1 -- 172.21.15.19:0/4248306680 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1531454677 0 0) 0x7f7b2c0cfb30 con 0x7f7b2c0d3320 2023-11-20T06:42:11.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.427+0000 7f7b2b7fe640 1 -- 172.21.15.19:0/4248306680 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b1c003530 con 0x7f7b2c0d3320 2023-11-20T06:42:11.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.427+0000 7f7b2bfff640 1 -- 172.21.15.19:0/4248306680 >> v2:172.21.15.190:3300/0 conn(0x7f7b2c0cf210 msgr2=0x7f7b2c0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:11.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.427+0000 7f7b2bfff640 1 --2- 172.21.15.19:0/4248306680 >> v2:172.21.15.190:3300/0 conn(0x7f7b2c0cf210 0x7f7b2c0cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.427+0000 7f7b2bfff640 1 -- 172.21.15.19:0/4248306680 >> v1:172.21.15.19:6789/0 conn(0x7f7b2c0d3320 legacy=0x7f7b2c0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:11.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.427+0000 7f7b2bfff640 1 -- 172.21.15.19:0/4248306680 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2c0b1ee0 con 0x7f7b2c15cdc0 2023-11-20T06:42:11.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.431+0000 7f7b2bfff640 1 --2- 172.21.15.19:0/4248306680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b2c15cdc0 0x7f7b2c0b2ca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7b180097c0 tx=0x7f7b2c0b4100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89831fef5940e0ae server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:11.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.431+0000 7f7b2b7fe640 1 -- 172.21.15.19:0/4248306680 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b180ab650 con 0x7f7b2c15cdc0 2023-11-20T06:42:11.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.431+0000 7f7b2b7fe640 1 -- 172.21.15.19:0/4248306680 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b180ab7b0 con 0x7f7b2c15cdc0 2023-11-20T06:42:11.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.431+0000 7f7b2b7fe640 1 -- 172.21.15.19:0/4248306680 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b180abb40 con 0x7f7b2c15cdc0 2023-11-20T06:42:11.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.431+0000 7f7b31de4640 1 -- 172.21.15.19:0/4248306680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b2c15cdc0 msgr2=0x7f7b2c0b2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:11.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.431+0000 7f7b31de4640 1 --2- 172.21.15.19:0/4248306680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b2c15cdc0 0x7f7b2c0b2ca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7b180097c0 tx=0x7f7b2c0b4100 comp rx=0 tx=0).stop 2023-11-20T06:42:11.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.431+0000 7f7b31de4640 1 -- 172.21.15.19:0/4248306680 shutdown_connections 2023-11-20T06:42:11.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.431+0000 7f7b31de4640 1 --2- 172.21.15.19:0/4248306680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b2c15cdc0 0x7f7b2c0b2ca0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.431+0000 7f7b31de4640 1 --2- 172.21.15.19:0/4248306680 >> v2:172.21.15.190:3300/0 conn(0x7f7b2c0cf210 0x7f7b2c0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.431+0000 7f7b31de4640 1 -- 172.21.15.19:0/4248306680 >> 172.21.15.19:0/4248306680 conn(0x7f7b2c0d2800 msgr2=0x7f7b2c0d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:11.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.431+0000 7f7b31de4640 1 -- 172.21.15.19:0/4248306680 shutdown_connections 2023-11-20T06:42:11.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.431+0000 7f7b31de4640 1 -- 172.21.15.19:0/4248306680 wait complete. 2023-11-20T06:42:11.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.431+0000 7f7b31de4640 1 Processor -- start 2023-11-20T06:42:11.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.431+0000 7f7b31de4640 1 -- start start 2023-11-20T06:42:11.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b31de4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b2c0cf210 0x7f7b2c06b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:11.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b31de4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b2c0d3320 0x7f7b2c154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:11.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b31de4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b2c15cdc0 0x7f7b2c154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:11.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b31de4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c15b8f0 con 0x7f7b2c0cf210 2023-11-20T06:42:11.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b31de4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c15ad40 con 0x7f7b2c15cdc0 2023-11-20T06:42:11.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b31de4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c15af50 con 0x7f7b2c0d3320 2023-11-20T06:42:11.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b30de2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b2c0cf210 0x7f7b2c06b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:11.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b30de2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b2c0cf210 0x7f7b2c06b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60622/0 (socket says 172.21.15.19:60622) 2023-11-20T06:42:11.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b30de2640 1 -- 172.21.15.19:0/1460008306 learned_addr learned my addr 172.21.15.19:0/1460008306 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:11.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b2bfff640 1 --2- 172.21.15.19:0/1460008306 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b2c0d3320 0x7f7b2c154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:11.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b315e3640 1 --2- 172.21.15.19:0/1460008306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b2c15cdc0 0x7f7b2c154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:11.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b30de2640 1 -- 172.21.15.19:0/1460008306 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b2c0d3320 msgr2=0x7f7b2c154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:11.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b30de2640 1 --2- 172.21.15.19:0/1460008306 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b2c0d3320 0x7f7b2c154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b30de2640 1 -- 172.21.15.19:0/1460008306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b2c15cdc0 msgr2=0x7f7b2c154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:11.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b30de2640 1 --2- 172.21.15.19:0/1460008306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b2c15cdc0 0x7f7b2c154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b30de2640 1 -- 172.21.15.19:0/1460008306 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b18009420 con 0x7f7b2c0cf210 2023-11-20T06:42:11.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b315e3640 1 --2- 172.21.15.19:0/1460008306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b2c15cdc0 0x7f7b2c154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:11.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b30de2640 1 --2- 172.21.15.19:0/1460008306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b2c0cf210 0x7f7b2c06b1f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000e9b0 tx=0x7f7b2000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:11.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b297fa640 1 -- 172.21.15.19:0/1460008306 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20009670 con 0x7f7b2c0cf210 2023-11-20T06:42:11.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b297fa640 1 -- 172.21.15.19:0/1460008306 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2000c9a0 con 0x7f7b2c0cf210 2023-11-20T06:42:11.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b297fa640 1 -- 172.21.15.19:0/1460008306 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2000cd10 con 0x7f7b2c0cf210 2023-11-20T06:42:11.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b31de4640 1 -- 172.21.15.19:0/1460008306 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2c15b230 con 0x7f7b2c0cf210 2023-11-20T06:42:11.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b31de4640 1 -- 172.21.15.19:0/1460008306 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2c15bd10 con 0x7f7b2c0cf210 2023-11-20T06:42:11.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.435+0000 7f7b31de4640 1 -- 172.21.15.19:0/1460008306 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b2c04e9c0 con 0x7f7b2c0cf210 2023-11-20T06:42:11.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.439+0000 7f7b297fa640 1 -- 172.21.15.19:0/1460008306 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7b20013470 con 0x7f7b2c0cf210 2023-11-20T06:42:11.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.439+0000 7f7b297fa640 1 --2- 172.21.15.19:0/1460008306 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7b100664a0 0x7f7b10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:11.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.439+0000 7f7b297fa640 1 -- 172.21.15.19:0/1460008306 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7b20084770 con 0x7f7b2c0cf210 2023-11-20T06:42:11.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.439+0000 7f7b2bfff640 1 --2- 172.21.15.19:0/1460008306 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7b100664a0 0x7f7b10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:11.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.439+0000 7f7b2bfff640 1 --2- 172.21.15.19:0/1460008306 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7b100664a0 0x7f7b10068960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7b180af000 tx=0x7f7b18004740 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:11.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.443+0000 7f7b297fa640 1 -- 172.21.15.19:0/1460008306 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7b200518d0 con 0x7f7b2c0cf210 2023-11-20T06:42:11.581 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T06:42:11.585 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T06:42:11.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.599+0000 7f7b31de4640 1 -- 172.21.15.19:0/1460008306 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7b2c0723d0 con 0x7f7b2c0cf210 2023-11-20T06:42:11.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.599+0000 7f7b297fa640 1 -- 172.21.15.19:0/1460008306 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7b20017020 con 0x7f7b2c0cf210 2023-11-20T06:42:11.606 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-20T06:42:11.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.603+0000 7f7b31de4640 1 -- 172.21.15.19:0/1460008306 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7b100664a0 msgr2=0x7f7b10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:11.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.603+0000 7f7b31de4640 1 --2- 172.21.15.19:0/1460008306 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7b100664a0 0x7f7b10068960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7b180af000 tx=0x7f7b18004740 comp rx=0 tx=0).stop 2023-11-20T06:42:11.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.603+0000 7f7b31de4640 1 -- 172.21.15.19:0/1460008306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b2c0cf210 msgr2=0x7f7b2c06b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:11.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.603+0000 7f7b31de4640 1 --2- 172.21.15.19:0/1460008306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b2c0cf210 0x7f7b2c06b1f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000e9b0 tx=0x7f7b2000ee70 comp rx=0 tx=0).stop 2023-11-20T06:42:11.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.603+0000 7f7b31de4640 1 -- 172.21.15.19:0/1460008306 shutdown_connections 2023-11-20T06:42:11.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.603+0000 7f7b31de4640 1 --2- 172.21.15.19:0/1460008306 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7b100664a0 0x7f7b10068960 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.603+0000 7f7b31de4640 1 --2- 172.21.15.19:0/1460008306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b2c15cdc0 0x7f7b2c154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.603+0000 7f7b31de4640 1 --2- 172.21.15.19:0/1460008306 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7b2c0d3320 0x7f7b2c154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.603+0000 7f7b31de4640 1 --2- 172.21.15.19:0/1460008306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b2c0cf210 0x7f7b2c06b1f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.603+0000 7f7b31de4640 1 -- 172.21.15.19:0/1460008306 >> 172.21.15.19:0/1460008306 conn(0x7f7b2c0d2800 msgr2=0x7f7b2c1589f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:11.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.603+0000 7f7b31de4640 1 -- 172.21.15.19:0/1460008306 shutdown_connections 2023-11-20T06:42:11.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.603+0000 7f7b31de4640 1 -- 172.21.15.19:0/1460008306 wait complete. 2023-11-20T06:42:11.628 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T06:42:11.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.811+0000 7fe39e246640 1 Processor -- start 2023-11-20T06:42:11.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.811+0000 7fe39e246640 1 -- start start 2023-11-20T06:42:11.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.815+0000 7fe39e246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe3980cb040 0x7fe3980ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:11.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.815+0000 7fe39e246640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3980cc330 con 0x7fe3980cebd0 2023-11-20T06:42:11.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.815+0000 7fe39e246640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3980cb4d0 con 0x7fe39815cc60 2023-11-20T06:42:11.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.815+0000 7fe39e246640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3980cefe0 con 0x7fe3980cb040 2023-11-20T06:42:11.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.815+0000 7fe397fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe3980cebd0 0x7fe3980cc990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57862/0 (socket says 172.21.15.19:57862) 2023-11-20T06:42:11.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.815+0000 7fe397fff640 1 -- 172.21.15.19:0/1932404706 learned_addr learned my addr 172.21.15.19:0/1932404706 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:11.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.815+0000 7fe396ffd640 1 --2- 172.21.15.19:0/1932404706 >> v2:172.21.15.190:3300/0 conn(0x7fe3980cb040 0x7fe3980ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:11.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.815+0000 7fe3967fc640 1 -- 172.21.15.19:0/1932404706 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731307810 0 0) 0x7fe3980cc330 con 0x7fe3980cebd0 2023-11-20T06:42:11.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.815+0000 7fe3967fc640 1 -- 172.21.15.19:0/1932404706 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe380003530 con 0x7fe3980cebd0 2023-11-20T06:42:11.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.815+0000 7fe3967fc640 1 -- 172.21.15.19:0/1932404706 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239452703 0 0) 0x7fe3980cb4d0 con 0x7fe39815cc60 2023-11-20T06:42:11.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.815+0000 7fe3967fc640 1 -- 172.21.15.19:0/1932404706 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3980cc330 con 0x7fe39815cc60 2023-11-20T06:42:11.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.815+0000 7fe396ffd640 1 -- 172.21.15.19:0/1932404706 >> v1:172.21.15.190:6789/0 conn(0x7fe39815cc60 legacy=0x7fe398161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:11.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.815+0000 7fe396ffd640 1 -- 172.21.15.19:0/1932404706 >> v1:172.21.15.19:6789/0 conn(0x7fe3980cebd0 legacy=0x7fe3980cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:11.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.815+0000 7fe3967fc640 1 -- 172.21.15.19:0/1932404706 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3211385246 0 0) 0x7fe380003530 con 0x7fe3980cebd0 2023-11-20T06:42:11.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.815+0000 7fe396ffd640 1 -- 172.21.15.19:0/1932404706 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3980cb720 con 0x7fe3980cb040 2023-11-20T06:42:11.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.819+0000 7fe396ffd640 1 --2- 172.21.15.19:0/1932404706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3980cb040 0x7fe3980ce690 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0097c0 tx=0x7fe38c01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8120040eb581fca server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:11.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.819+0000 7fe3967fc640 1 -- 172.21.15.19:0/1932404706 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390001a00 con 0x7fe3980cb040 2023-11-20T06:42:11.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.819+0000 7fe3967fc640 1 -- 172.21.15.19:0/1932404706 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c0a7050 con 0x7fe3980cb040 2023-11-20T06:42:11.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.819+0000 7fe3967fc640 1 -- 172.21.15.19:0/1932404706 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0ab620 con 0x7fe3980cb040 2023-11-20T06:42:11.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.819+0000 7fe39e246640 1 -- 172.21.15.19:0/1932404706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3980cb040 msgr2=0x7fe3980ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:11.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.819+0000 7fe39e246640 1 --2- 172.21.15.19:0/1932404706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3980cb040 0x7fe3980ce690 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0097c0 tx=0x7fe38c01c370 comp rx=0 tx=0).stop 2023-11-20T06:42:11.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.819+0000 7fe39e246640 1 -- 172.21.15.19:0/1932404706 shutdown_connections 2023-11-20T06:42:11.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.819+0000 7fe39e246640 1 --2- 172.21.15.19:0/1932404706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3980cb040 0x7fe3980ce690 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.819+0000 7fe39e246640 1 -- 172.21.15.19:0/1932404706 >> 172.21.15.19:0/1932404706 conn(0x7fe39806e570 msgr2=0x7fe39806e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:11.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.819+0000 7fe39e246640 1 -- 172.21.15.19:0/1932404706 shutdown_connections 2023-11-20T06:42:11.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.819+0000 7fe39e246640 1 -- 172.21.15.19:0/1932404706 wait complete. 2023-11-20T06:42:11.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.819+0000 7fe39e246640 1 Processor -- start 2023-11-20T06:42:11.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.819+0000 7fe39e246640 1 -- start start 2023-11-20T06:42:11.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe39e246640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3980cb040 0x7fe398151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:11.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe39e246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3980cebd0 0x7fe3980c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:11.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe39e246640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe39815cc60 0x7fe3980c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:11.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe39e246640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3980c4e00 con 0x7fe39815cc60 2023-11-20T06:42:11.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe39e246640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe398151b70 con 0x7fe3980cb040 2023-11-20T06:42:11.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe39e246640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3980c7ab0 con 0x7fe3980cebd0 2023-11-20T06:42:11.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe397fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe39815cc60 0x7fe3980c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:11.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe397fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe39815cc60 0x7fe3980c48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60632/0 (socket says 172.21.15.19:60632) 2023-11-20T06:42:11.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe397fff640 1 -- 172.21.15.19:0/1529782720 learned_addr learned my addr 172.21.15.19:0/1529782720 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:11.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe3977fe640 1 --2- 172.21.15.19:0/1529782720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3980cb040 0x7fe398151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:11.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe396ffd640 1 --2- 172.21.15.19:0/1529782720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3980cebd0 0x7fe3980c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:11.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe397fff640 1 -- 172.21.15.19:0/1529782720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3980cebd0 msgr2=0x7fe3980c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:11.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe397fff640 1 --2- 172.21.15.19:0/1529782720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3980cebd0 0x7fe3980c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe397fff640 1 -- 172.21.15.19:0/1529782720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3980cb040 msgr2=0x7fe398151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:11.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe397fff640 1 --2- 172.21.15.19:0/1529782720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3980cb040 0x7fe398151630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe397fff640 1 -- 172.21.15.19:0/1529782720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c009420 con 0x7fe39815cc60 2023-11-20T06:42:11.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe397fff640 1 --2- 172.21.15.19:0/1529782720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe39815cc60 0x7fe3980c48c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe390002010 tx=0x7fe39000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:11.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe37ffff640 1 -- 172.21.15.19:0/1529782720 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390012400 con 0x7fe39815cc60 2023-11-20T06:42:11.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe37ffff640 1 -- 172.21.15.19:0/1529782720 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe390012580 con 0x7fe39815cc60 2023-11-20T06:42:11.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe37ffff640 1 -- 172.21.15.19:0/1529782720 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390012970 con 0x7fe39815cc60 2023-11-20T06:42:11.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe39e246640 1 -- 172.21.15.19:0/1529782720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3980c7d90 con 0x7fe39815cc60 2023-11-20T06:42:11.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe39e246640 1 -- 172.21.15.19:0/1529782720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3980c8350 con 0x7fe39815cc60 2023-11-20T06:42:11.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.823+0000 7fe39e246640 1 -- 172.21.15.19:0/1529782720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39804e170 con 0x7fe39815cc60 2023-11-20T06:42:11.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.827+0000 7fe37ffff640 1 -- 172.21.15.19:0/1529782720 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe390012ad0 con 0x7fe39815cc60 2023-11-20T06:42:11.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.827+0000 7fe37ffff640 1 --2- 172.21.15.19:0/1529782720 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe3840664d0 0x7fe384068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:11.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.827+0000 7fe37ffff640 1 -- 172.21.15.19:0/1529782720 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe390084910 con 0x7fe39815cc60 2023-11-20T06:42:11.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.827+0000 7fe3977fe640 1 --2- 172.21.15.19:0/1529782720 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe3840664d0 0x7fe384068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:11.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.827+0000 7fe3977fe640 1 --2- 172.21.15.19:0/1529782720 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe3840664d0 0x7fe384068990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe3880011f0 tx=0x7fe388009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:11.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.831+0000 7fe37ffff640 1 -- 172.21.15.19:0/1529782720 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe390051a70 con 0x7fe39815cc60 2023-11-20T06:42:11.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.987+0000 7fe39e246640 1 -- 172.21.15.19:0/1529782720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe3980b6830 con 0x7fe39815cc60 2023-11-20T06:42:11.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.987+0000 7fe37ffff640 1 -- 172.21.15.19:0/1529782720 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe390055090 con 0x7fe39815cc60 2023-11-20T06:42:11.992 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:11.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.987+0000 7fe39e246640 1 -- 172.21.15.19:0/1529782720 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe3840664d0 msgr2=0x7fe384068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:11.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.987+0000 7fe39e246640 1 --2- 172.21.15.19:0/1529782720 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe3840664d0 0x7fe384068990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe3880011f0 tx=0x7fe388009040 comp rx=0 tx=0).stop 2023-11-20T06:42:11.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.987+0000 7fe39e246640 1 -- 172.21.15.19:0/1529782720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe39815cc60 msgr2=0x7fe3980c48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:11.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.987+0000 7fe39e246640 1 --2- 172.21.15.19:0/1529782720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe39815cc60 0x7fe3980c48c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe390002010 tx=0x7fe39000a430 comp rx=0 tx=0).stop 2023-11-20T06:42:11.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.987+0000 7fe39e246640 1 -- 172.21.15.19:0/1529782720 shutdown_connections 2023-11-20T06:42:11.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.987+0000 7fe39e246640 1 --2- 172.21.15.19:0/1529782720 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe3840664d0 0x7fe384068990 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.987+0000 7fe39e246640 1 --2- 172.21.15.19:0/1529782720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe39815cc60 0x7fe3980c48c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.987+0000 7fe39e246640 1 --2- 172.21.15.19:0/1529782720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3980cebd0 0x7fe3980c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.987+0000 7fe39e246640 1 --2- 172.21.15.19:0/1529782720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3980cb040 0x7fe398151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:11.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.987+0000 7fe39e246640 1 -- 172.21.15.19:0/1529782720 >> 172.21.15.19:0/1529782720 conn(0x7fe39806e570 msgr2=0x7fe39806bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:11.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.987+0000 7fe39e246640 1 -- 172.21.15.19:0/1529782720 shutdown_connections 2023-11-20T06:42:11.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:11.987+0000 7fe39e246640 1 -- 172.21.15.19:0/1529782720 wait complete. 2023-11-20T06:42:12.013 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T06:42:12.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.151+0000 7fa898f65640 1 Processor -- start 2023-11-20T06:42:12.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.151+0000 7fa898f65640 1 -- start start 2023-11-20T06:42:12.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.151+0000 7fa898f65640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa8941597c0 0x7fa8940ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:12.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.151+0000 7fa898f65640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa8940adc10 0x7fa8940cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:12.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.151+0000 7fa898f65640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8940723d0 con 0x7fa894159ba0 2023-11-20T06:42:12.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.151+0000 7fa898f65640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8940717c0 con 0x7fa8940adc10 2023-11-20T06:42:12.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.151+0000 7fa898f65640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa894071aa0 con 0x7fa8941597c0 2023-11-20T06:42:12.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.155+0000 7fa88bfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa894159ba0 0x7fa8940cae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54314/0 (socket says 172.21.15.19:54314) 2023-11-20T06:42:12.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.155+0000 7fa88bfff640 1 -- 172.21.15.19:0/2463931889 learned_addr learned my addr 172.21.15.19:0/2463931889 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:12.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.155+0000 7fa892d9d640 1 --2- 172.21.15.19:0/2463931889 >> v2:172.21.15.19:3300/0 conn(0x7fa8940adc10 0x7fa8940cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:12.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.155+0000 7fa89259c640 1 --2- 172.21.15.19:0/2463931889 >> v2:172.21.15.190:3300/0 conn(0x7fa8941597c0 0x7fa8940ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:12.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.155+0000 7fa892d9d640 1 -- 172.21.15.19:0/2463931889 >> v2:172.21.15.190:3300/0 conn(0x7fa8941597c0 msgr2=0x7fa8940ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:12.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.155+0000 7fa892d9d640 1 --2- 172.21.15.19:0/2463931889 >> v2:172.21.15.190:3300/0 conn(0x7fa8941597c0 0x7fa8940ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.155+0000 7fa892d9d640 1 -- 172.21.15.19:0/2463931889 >> v1:172.21.15.19:6789/0 conn(0x7fa894159ba0 legacy=0x7fa8940cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:12.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.155+0000 7fa892d9d640 1 -- 172.21.15.19:0/2463931889 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa894071d80 con 0x7fa8940adc10 2023-11-20T06:42:12.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.155+0000 7fa891d9b640 1 -- 172.21.15.19:0/2463931889 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 837146591 0 0) 0x7fa8940723d0 con 0x7fa894159ba0 2023-11-20T06:42:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.155+0000 7fa892d9d640 1 --2- 172.21.15.19:0/2463931889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8940adc10 0x7fa8940cb520 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa8940cdaf0 tx=0x7fa88c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149a71ec7cf14aa6 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.155+0000 7fa891d9b640 1 -- 172.21.15.19:0/2463931889 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c0a5970 con 0x7fa8940adc10 2023-11-20T06:42:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.155+0000 7fa891d9b640 1 -- 172.21.15.19:0/2463931889 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c0a5ad0 con 0x7fa8940adc10 2023-11-20T06:42:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.155+0000 7fa891d9b640 1 -- 172.21.15.19:0/2463931889 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c0a5e60 con 0x7fa8940adc10 2023-11-20T06:42:12.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa898f65640 1 -- 172.21.15.19:0/2463931889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8940adc10 msgr2=0x7fa8940cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:12.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa898f65640 1 --2- 172.21.15.19:0/2463931889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8940adc10 0x7fa8940cb520 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa8940cdaf0 tx=0x7fa88c01c910 comp rx=0 tx=0).stop 2023-11-20T06:42:12.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa898f65640 1 -- 172.21.15.19:0/2463931889 shutdown_connections 2023-11-20T06:42:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa898f65640 1 --2- 172.21.15.19:0/2463931889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8940adc10 0x7fa8940cb520 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa898f65640 1 --2- 172.21.15.19:0/2463931889 >> v2:172.21.15.190:3300/0 conn(0x7fa8941597c0 0x7fa8940ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa898f65640 1 -- 172.21.15.19:0/2463931889 >> 172.21.15.19:0/2463931889 conn(0x7fa89406c190 msgr2=0x7fa89406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa898f65640 1 -- 172.21.15.19:0/2463931889 shutdown_connections 2023-11-20T06:42:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa898f65640 1 -- 172.21.15.19:0/2463931889 wait complete. 2023-11-20T06:42:12.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa898f65640 1 Processor -- start 2023-11-20T06:42:12.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa898f65640 1 -- start start 2023-11-20T06:42:12.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa898f65640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8940adc10 0x7fa894155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:12.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa898f65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8941597c0 0x7fa894159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:12.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa898f65640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa894159ba0 0x7fa8940af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:12.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa898f65640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8940c4ab0 con 0x7fa8941597c0 2023-11-20T06:42:12.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa898f65640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89415ccb0 con 0x7fa8940adc10 2023-11-20T06:42:12.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa898f65640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89415c0a0 con 0x7fa894159ba0 2023-11-20T06:42:12.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa88bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8941597c0 0x7fa894159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:12.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa88bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8941597c0 0x7fa894159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50828/0 (socket says 172.21.15.19:50828) 2023-11-20T06:42:12.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa88bfff640 1 -- 172.21.15.19:0/3409443567 learned_addr learned my addr 172.21.15.19:0/3409443567 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:12.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa89259c640 1 --2- 172.21.15.19:0/3409443567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8940adc10 0x7fa894155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:12.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa892d9d640 1 --2- 172.21.15.19:0/3409443567 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa894159ba0 0x7fa8940af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:12.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa88bfff640 1 -- 172.21.15.19:0/3409443567 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa894159ba0 msgr2=0x7fa8940af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:12.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa88bfff640 1 --2- 172.21.15.19:0/3409443567 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa894159ba0 0x7fa8940af340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa88bfff640 1 -- 172.21.15.19:0/3409443567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8940adc10 msgr2=0x7fa894155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:12.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa88bfff640 1 --2- 172.21.15.19:0/3409443567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8940adc10 0x7fa894155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa88bfff640 1 -- 172.21.15.19:0/3409443567 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c009a70 con 0x7fa8941597c0 2023-11-20T06:42:12.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.159+0000 7fa89259c640 1 --2- 172.21.15.19:0/3409443567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8940adc10 0x7fa894155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:12.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.163+0000 7fa88bfff640 1 --2- 172.21.15.19:0/3409443567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8941597c0 0x7fa894159fe0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00c3e0 tx=0x7fa87c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:12.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.163+0000 7fa88affd640 1 -- 172.21.15.19:0/3409443567 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c0074e0 con 0x7fa8941597c0 2023-11-20T06:42:12.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.163+0000 7fa88affd640 1 -- 172.21.15.19:0/3409443567 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c007660 con 0x7fa8941597c0 2023-11-20T06:42:12.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.163+0000 7fa898f65640 1 -- 172.21.15.19:0/3409443567 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89415c380 con 0x7fa8941597c0 2023-11-20T06:42:12.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.163+0000 7fa88affd640 1 -- 172.21.15.19:0/3409443567 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c004a30 con 0x7fa8941597c0 2023-11-20T06:42:12.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.163+0000 7fa898f65640 1 -- 172.21.15.19:0/3409443567 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89415c940 con 0x7fa8941597c0 2023-11-20T06:42:12.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.163+0000 7fa898f65640 1 -- 172.21.15.19:0/3409443567 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa894074010 con 0x7fa8941597c0 2023-11-20T06:42:12.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.163+0000 7fa88affd640 1 -- 172.21.15.19:0/3409443567 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa87c004b90 con 0x7fa8941597c0 2023-11-20T06:42:12.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.163+0000 7fa88affd640 1 --2- 172.21.15.19:0/3409443567 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa8740664a0 0x7fa874068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:12.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.163+0000 7fa88affd640 1 -- 172.21.15.19:0/3409443567 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa87c083ff0 con 0x7fa8941597c0 2023-11-20T06:42:12.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.163+0000 7fa89259c640 1 --2- 172.21.15.19:0/3409443567 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa8740664a0 0x7fa874068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:12.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.167+0000 7fa89259c640 1 --2- 172.21.15.19:0/3409443567 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa8740664a0 0x7fa874068960 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa884007a70 tx=0x7fa884008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:12.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.167+0000 7fa88affd640 1 -- 172.21.15.19:0/3409443567 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa87c0b5090 con 0x7fa8941597c0 2023-11-20T06:42:12.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.335+0000 7fa898f65640 1 -- 172.21.15.19:0/3409443567 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa8940b4320 con 0x7fa8941597c0 2023-11-20T06:42:12.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.339+0000 7fa88affd640 1 -- 172.21.15.19:0/3409443567 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa87c054b70 con 0x7fa8941597c0 2023-11-20T06:42:12.343 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2023-11-20T06:42:12.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.339+0000 7fa898f65640 1 -- 172.21.15.19:0/3409443567 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa8740664a0 msgr2=0x7fa874068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:12.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.339+0000 7fa898f65640 1 --2- 172.21.15.19:0/3409443567 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa8740664a0 0x7fa874068960 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa884007a70 tx=0x7fa884008040 comp rx=0 tx=0).stop 2023-11-20T06:42:12.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.339+0000 7fa898f65640 1 -- 172.21.15.19:0/3409443567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8941597c0 msgr2=0x7fa894159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:12.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.339+0000 7fa898f65640 1 --2- 172.21.15.19:0/3409443567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8941597c0 0x7fa894159fe0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00c3e0 tx=0x7fa87c00c8a0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.339+0000 7fa898f65640 1 -- 172.21.15.19:0/3409443567 shutdown_connections 2023-11-20T06:42:12.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.339+0000 7fa898f65640 1 --2- 172.21.15.19:0/3409443567 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa8740664a0 0x7fa874068960 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.339+0000 7fa898f65640 1 --2- 172.21.15.19:0/3409443567 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa894159ba0 0x7fa8940af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.339+0000 7fa898f65640 1 --2- 172.21.15.19:0/3409443567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8941597c0 0x7fa894159fe0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.339+0000 7fa898f65640 1 --2- 172.21.15.19:0/3409443567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8940adc10 0x7fa894155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.339+0000 7fa898f65640 1 -- 172.21.15.19:0/3409443567 >> 172.21.15.19:0/3409443567 conn(0x7fa89406c190 msgr2=0x7fa89406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:12.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.339+0000 7fa898f65640 1 -- 172.21.15.19:0/3409443567 shutdown_connections 2023-11-20T06:42:12.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.339+0000 7fa898f65640 1 -- 172.21.15.19:0/3409443567 wait complete. 2023-11-20T06:42:12.364 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:42:12.364 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:42:12.374 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:12.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.555+0000 7fea963aa640 1 Processor -- start 2023-11-20T06:42:12.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.555+0000 7fea963aa640 1 -- start start 2023-11-20T06:42:12.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.555+0000 7fea963aa640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fea90065a80 0x7fea90161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:12.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.555+0000 7fea963aa640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fea9015cf10 0x7fea9006cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:12.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.555+0000 7fea963aa640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea900ccbd0 con 0x7fea9015cb30 2023-11-20T06:42:12.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.555+0000 7fea963aa640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea9006b180 con 0x7fea90065a80 2023-11-20T06:42:12.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.555+0000 7fea963aa640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea9006b460 con 0x7fea9015cf10 2023-11-20T06:42:12.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.555+0000 7fea8f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fea90065a80 0x7fea90161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:12.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.555+0000 7fea8f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fea90065a80 0x7fea90161000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50842/0 (socket says 172.21.15.19:50842) 2023-11-20T06:42:12.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.555+0000 7fea8f7fe640 1 -- 172.21.15.19:0/265320894 learned_addr learned my addr 172.21.15.19:0/265320894 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:12.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.559+0000 7fea94947640 1 --2- 172.21.15.19:0/265320894 >> v2:172.21.15.190:3300/0 conn(0x7fea9015cf10 0x7fea9006cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:12.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.559+0000 7fea8f7fe640 1 -- 172.21.15.19:0/265320894 >> v2:172.21.15.190:3300/0 conn(0x7fea9015cf10 msgr2=0x7fea9006cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:12.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.559+0000 7fea8f7fe640 1 --2- 172.21.15.19:0/265320894 >> v2:172.21.15.190:3300/0 conn(0x7fea9015cf10 0x7fea9006cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.559+0000 7fea8f7fe640 1 -- 172.21.15.19:0/265320894 >> v1:172.21.15.190:6789/0 conn(0x7fea9015cb30 legacy=0x7fea901608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:12.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.559+0000 7fea8f7fe640 1 -- 172.21.15.19:0/265320894 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9006c6e0 con 0x7fea90065a80 2023-11-20T06:42:12.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.559+0000 7fea8effd640 1 -- 172.21.15.19:0/265320894 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910873404 0 0) 0x7fea900ccbd0 con 0x7fea9015cb30 2023-11-20T06:42:12.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.559+0000 7fea8f7fe640 1 --2- 172.21.15.19:0/265320894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea90065a80 0x7fea90161000 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fea900ccdb0 tx=0x7fea8401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b609ad4012769c6a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:12.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.559+0000 7fea8effd640 1 -- 172.21.15.19:0/265320894 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea840aa430 con 0x7fea90065a80 2023-11-20T06:42:12.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.559+0000 7fea8effd640 1 -- 172.21.15.19:0/265320894 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea840aa590 con 0x7fea90065a80 2023-11-20T06:42:12.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.559+0000 7fea8effd640 1 -- 172.21.15.19:0/265320894 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea840aa920 con 0x7fea90065a80 2023-11-20T06:42:12.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.559+0000 7fea963aa640 1 -- 172.21.15.19:0/265320894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea90065a80 msgr2=0x7fea90161000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:12.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.559+0000 7fea963aa640 1 --2- 172.21.15.19:0/265320894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea90065a80 0x7fea90161000 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fea900ccdb0 tx=0x7fea8401c4d0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea963aa640 1 -- 172.21.15.19:0/265320894 shutdown_connections 2023-11-20T06:42:12.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea963aa640 1 --2- 172.21.15.19:0/265320894 >> v2:172.21.15.190:3300/0 conn(0x7fea9015cf10 0x7fea9006cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea963aa640 1 --2- 172.21.15.19:0/265320894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea90065a80 0x7fea90161000 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea963aa640 1 -- 172.21.15.19:0/265320894 >> 172.21.15.19:0/265320894 conn(0x7fea900b0880 msgr2=0x7fea900b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:12.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea963aa640 1 -- 172.21.15.19:0/265320894 shutdown_connections 2023-11-20T06:42:12.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea963aa640 1 -- 172.21.15.19:0/265320894 wait complete. 2023-11-20T06:42:12.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea963aa640 1 Processor -- start 2023-11-20T06:42:12.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea963aa640 1 -- start start 2023-11-20T06:42:12.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea963aa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea90065a80 0x7fea90154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:12.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea963aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea9015cb30 0x7fea9015b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:12.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea963aa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea9015cf10 0x7fea9015bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:12.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea963aa640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea900c9a60 con 0x7fea9015cf10 2023-11-20T06:42:12.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea963aa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea900b2440 con 0x7fea90065a80 2023-11-20T06:42:12.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea963aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea900b2720 con 0x7fea9015cb30 2023-11-20T06:42:12.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea94947640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea9015cf10 0x7fea9015bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:12.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea94947640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea9015cf10 0x7fea9015bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50856/0 (socket says 172.21.15.19:50856) 2023-11-20T06:42:12.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea94947640 1 -- 172.21.15.19:0/2854281286 learned_addr learned my addr 172.21.15.19:0/2854281286 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:12.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea8f7fe640 1 --2- 172.21.15.19:0/2854281286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea9015cb30 0x7fea9015b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:12.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea8ffff640 1 --2- 172.21.15.19:0/2854281286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea90065a80 0x7fea90154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:12.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea94947640 1 -- 172.21.15.19:0/2854281286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea9015cb30 msgr2=0x7fea9015b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:12.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea94947640 1 --2- 172.21.15.19:0/2854281286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea9015cb30 0x7fea9015b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea94947640 1 -- 172.21.15.19:0/2854281286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea90065a80 msgr2=0x7fea90154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:12.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea94947640 1 --2- 172.21.15.19:0/2854281286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea90065a80 0x7fea90154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea94947640 1 -- 172.21.15.19:0/2854281286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea840094d0 con 0x7fea9015cf10 2023-11-20T06:42:12.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.563+0000 7fea8ffff640 1 --2- 172.21.15.19:0/2854281286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea90065a80 0x7fea90154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:12.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.567+0000 7fea94947640 1 --2- 172.21.15.19:0/2854281286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea9015cf10 0x7fea9015bb00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fea8800efc0 tx=0x7fea8800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:12.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.567+0000 7fea8cff9640 1 -- 172.21.15.19:0/2854281286 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea88009ba0 con 0x7fea9015cf10 2023-11-20T06:42:12.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.567+0000 7fea8cff9640 1 -- 172.21.15.19:0/2854281286 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8800f040 con 0x7fea9015cf10 2023-11-20T06:42:12.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.567+0000 7fea963aa640 1 -- 172.21.15.19:0/2854281286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea900b2a00 con 0x7fea9015cf10 2023-11-20T06:42:12.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.567+0000 7fea8cff9640 1 -- 172.21.15.19:0/2854281286 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea880146c0 con 0x7fea9015cf10 2023-11-20T06:42:12.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.567+0000 7fea963aa640 1 -- 172.21.15.19:0/2854281286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9009dd10 con 0x7fea9015cf10 2023-11-20T06:42:12.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.567+0000 7fea963aa640 1 -- 172.21.15.19:0/2854281286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9009df60 con 0x7fea9015cf10 2023-11-20T06:42:12.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.567+0000 7fea8cff9640 1 -- 172.21.15.19:0/2854281286 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fea88014820 con 0x7fea9015cf10 2023-11-20T06:42:12.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.567+0000 7fea8cff9640 1 --2- 172.21.15.19:0/2854281286 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fea7c0664a0 0x7fea7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:12.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.567+0000 7fea8cff9640 1 -- 172.21.15.19:0/2854281286 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fea88084cd0 con 0x7fea9015cf10 2023-11-20T06:42:12.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.567+0000 7fea8ffff640 1 --2- 172.21.15.19:0/2854281286 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fea7c0664a0 0x7fea7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:12.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.571+0000 7fea8ffff640 1 --2- 172.21.15.19:0/2854281286 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fea7c0664a0 0x7fea7c068960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fea80000f70 tx=0x7fea80009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:12.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.571+0000 7fea8cff9640 1 -- 172.21.15.19:0/2854281286 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fea88051cf0 con 0x7fea9015cf10 2023-11-20T06:42:12.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.731+0000 7fea963aa640 1 -- 172.21.15.19:0/2854281286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea90074010 con 0x7fea9015cf10 2023-11-20T06:42:12.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.731+0000 7fea8cff9640 1 -- 172.21.15.19:0/2854281286 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18720 (secure 0 0 0) 0x7fea88018020 con 0x7fea9015cf10 2023-11-20T06:42:12.738 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:12.738 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:55.472006+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:12.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.735+0000 7fea963aa640 1 -- 172.21.15.19:0/2854281286 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fea7c0664a0 msgr2=0x7fea7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:12.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.735+0000 7fea963aa640 1 --2- 172.21.15.19:0/2854281286 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fea7c0664a0 0x7fea7c068960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fea80000f70 tx=0x7fea80009040 comp rx=0 tx=0).stop 2023-11-20T06:42:12.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.735+0000 7fea963aa640 1 -- 172.21.15.19:0/2854281286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea9015cf10 msgr2=0x7fea9015bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:12.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.735+0000 7fea963aa640 1 --2- 172.21.15.19:0/2854281286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea9015cf10 0x7fea9015bb00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fea8800efc0 tx=0x7fea8800c490 comp rx=0 tx=0).stop 2023-11-20T06:42:12.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.735+0000 7fea963aa640 1 -- 172.21.15.19:0/2854281286 shutdown_connections 2023-11-20T06:42:12.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.735+0000 7fea963aa640 1 --2- 172.21.15.19:0/2854281286 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fea7c0664a0 0x7fea7c068960 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.735+0000 7fea963aa640 1 --2- 172.21.15.19:0/2854281286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea9015cf10 0x7fea9015bb00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.735+0000 7fea963aa640 1 --2- 172.21.15.19:0/2854281286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea9015cb30 0x7fea9015b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.735+0000 7fea963aa640 1 --2- 172.21.15.19:0/2854281286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea90065a80 0x7fea90154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.735+0000 7fea963aa640 1 -- 172.21.15.19:0/2854281286 >> 172.21.15.19:0/2854281286 conn(0x7fea900b0880 msgr2=0x7fea900aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:12.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.735+0000 7fea963aa640 1 -- 172.21.15.19:0/2854281286 shutdown_connections 2023-11-20T06:42:12.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.735+0000 7fea963aa640 1 -- 172.21.15.19:0/2854281286 wait complete. 2023-11-20T06:42:12.759 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T06:41:11.805111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T06:41:12.614034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T06:41:16.311206+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T06:42:12.760 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:42:12.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.899+0000 7fc697994640 1 Processor -- start 2023-11-20T06:42:12.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.899+0000 7fc697994640 1 -- start start 2023-11-20T06:42:12.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.899+0000 7fc697994640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6900d0210 0x7fc6900d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:12.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.899+0000 7fc697994640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6900d1670 con 0x7fc69015cba0 2023-11-20T06:42:12.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.899+0000 7fc697994640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6900d1950 con 0x7fc6900b84e0 2023-11-20T06:42:12.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.899+0000 7fc697994640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900d1460 con 0x7fc6900d0210 2023-11-20T06:42:12.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.903+0000 7fc695730640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc69015cba0 0x7fc6900cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54328/0 (socket says 172.21.15.19:54328) 2023-11-20T06:42:12.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.903+0000 7fc695730640 1 -- 172.21.15.19:0/1213830095 learned_addr learned my addr 172.21.15.19:0/1213830095 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:12.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.903+0000 7fc694f2f640 1 --2- 172.21.15.19:0/1213830095 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6900d0210 0x7fc6900d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:12.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.903+0000 7fc687fff640 1 -- 172.21.15.19:0/1213830095 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 303058734 0 0) 0x7fc6900d1670 con 0x7fc69015cba0 2023-11-20T06:42:12.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.903+0000 7fc687fff640 1 -- 172.21.15.19:0/1213830095 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc67c003530 con 0x7fc69015cba0 2023-11-20T06:42:12.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.903+0000 7fc687fff640 1 -- 172.21.15.19:0/1213830095 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022825604 0 0) 0x7fc6900d1950 con 0x7fc6900b84e0 2023-11-20T06:42:12.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.903+0000 7fc687fff640 1 -- 172.21.15.19:0/1213830095 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6900d1670 con 0x7fc6900b84e0 2023-11-20T06:42:12.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.903+0000 7fc687fff640 1 -- 172.21.15.19:0/1213830095 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1409821483 0 0) 0x7fc67c003530 con 0x7fc69015cba0 2023-11-20T06:42:12.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.903+0000 7fc694f2f640 1 -- 172.21.15.19:0/1213830095 >> v1:172.21.15.190:6789/0 conn(0x7fc6900b84e0 legacy=0x7fc6900b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:12.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.903+0000 7fc694f2f640 1 -- 172.21.15.19:0/1213830095 >> v1:172.21.15.19:6789/0 conn(0x7fc69015cba0 legacy=0x7fc6900cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:12.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.903+0000 7fc694f2f640 1 -- 172.21.15.19:0/1213830095 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6900d1c30 con 0x7fc6900d0210 2023-11-20T06:42:12.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.903+0000 7fc694f2f640 1 --2- 172.21.15.19:0/1213830095 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6900d0210 0x7fc6900d0f20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc6800097f0 tx=0x7fc68001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edac5865651143c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:12.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.907+0000 7fc687fff640 1 -- 172.21.15.19:0/1213830095 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c001680 con 0x7fc6900d0210 2023-11-20T06:42:12.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.907+0000 7fc687fff640 1 -- 172.21.15.19:0/1213830095 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6800ad460 con 0x7fc6900d0210 2023-11-20T06:42:12.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.907+0000 7fc687fff640 1 -- 172.21.15.19:0/1213830095 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6800ad7f0 con 0x7fc6900d0210 2023-11-20T06:42:12.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.907+0000 7fc697994640 1 -- 172.21.15.19:0/1213830095 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6900d0210 msgr2=0x7fc6900d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:12.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.907+0000 7fc697994640 1 --2- 172.21.15.19:0/1213830095 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6900d0210 0x7fc6900d0f20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc6800097f0 tx=0x7fc68001c3e0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.907+0000 7fc697994640 1 -- 172.21.15.19:0/1213830095 shutdown_connections 2023-11-20T06:42:12.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.907+0000 7fc697994640 1 --2- 172.21.15.19:0/1213830095 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6900d0210 0x7fc6900d0f20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.907+0000 7fc697994640 1 -- 172.21.15.19:0/1213830095 >> 172.21.15.19:0/1213830095 conn(0x7fc6900719c0 msgr2=0x7fc690071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:12.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.907+0000 7fc697994640 1 -- 172.21.15.19:0/1213830095 shutdown_connections 2023-11-20T06:42:12.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.907+0000 7fc697994640 1 -- 172.21.15.19:0/1213830095 wait complete. 2023-11-20T06:42:12.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.907+0000 7fc697994640 1 Processor -- start 2023-11-20T06:42:12.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.907+0000 7fc697994640 1 -- start start 2023-11-20T06:42:12.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc697994640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6900b84e0 0x7fc6900cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:12.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc697994640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6900d0210 0x7fc69014f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:12.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc697994640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69015cba0 0x7fc6900c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:12.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc697994640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900c7140 con 0x7fc69015cba0 2023-11-20T06:42:12.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc697994640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900c7420 con 0x7fc6900b84e0 2023-11-20T06:42:12.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc697994640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900cb290 con 0x7fc6900d0210 2023-11-20T06:42:12.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc695f31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69015cba0 0x7fc6900c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:12.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc695730640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6900b84e0 0x7fc6900cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:12.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc695f31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69015cba0 0x7fc6900c6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50870/0 (socket says 172.21.15.19:50870) 2023-11-20T06:42:12.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc695f31640 1 -- 172.21.15.19:0/3197325831 learned_addr learned my addr 172.21.15.19:0/3197325831 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:12.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc694f2f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6900d0210 0x7fc69014f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:12.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc695f31640 1 -- 172.21.15.19:0/3197325831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6900d0210 msgr2=0x7fc69014f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:12.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc695f31640 1 --2- 172.21.15.19:0/3197325831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6900d0210 0x7fc69014f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc695f31640 1 -- 172.21.15.19:0/3197325831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6900b84e0 msgr2=0x7fc6900cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:12.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc695f31640 1 --2- 172.21.15.19:0/3197325831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6900b84e0 0x7fc6900cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:12.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc695f31640 1 -- 172.21.15.19:0/3197325831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc680009420 con 0x7fc69015cba0 2023-11-20T06:42:12.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc695f31640 1 --2- 172.21.15.19:0/3197325831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69015cba0 0x7fc6900c6680 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc68800c790 tx=0x7fc68800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:12.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc685ffb640 1 -- 172.21.15.19:0/3197325831 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68800cea0 con 0x7fc69015cba0 2023-11-20T06:42:12.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc685ffb640 1 -- 172.21.15.19:0/3197325831 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc688003b80 con 0x7fc69015cba0 2023-11-20T06:42:12.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc697994640 1 -- 172.21.15.19:0/3197325831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6900cb570 con 0x7fc69015cba0 2023-11-20T06:42:12.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc685ffb640 1 -- 172.21.15.19:0/3197325831 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68800a850 con 0x7fc69015cba0 2023-11-20T06:42:12.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc697994640 1 -- 172.21.15.19:0/3197325831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69014cff0 con 0x7fc69015cba0 2023-11-20T06:42:12.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc697994640 1 -- 172.21.15.19:0/3197325831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc69004e170 con 0x7fc69015cba0 2023-11-20T06:42:12.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.911+0000 7fc685ffb640 1 -- 172.21.15.19:0/3197325831 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc68800a9b0 con 0x7fc69015cba0 2023-11-20T06:42:12.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.915+0000 7fc685ffb640 1 --2- 172.21.15.19:0/3197325831 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc6740664a0 0x7fc674068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:12.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.915+0000 7fc685ffb640 1 -- 172.21.15.19:0/3197325831 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc688084050 con 0x7fc69015cba0 2023-11-20T06:42:12.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.915+0000 7fc695730640 1 --2- 172.21.15.19:0/3197325831 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc6740664a0 0x7fc674068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:12.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.915+0000 7fc695730640 1 --2- 172.21.15.19:0/3197325831 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc6740664a0 0x7fc674068960 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc68c001ec0 tx=0x7fc68c0019c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:12.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:12.919+0000 7fc685ffb640 1 -- 172.21.15.19:0/3197325831 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc6880b5090 con 0x7fc69015cba0 2023-11-20T06:42:13.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.075+0000 7fc697994640 1 -- 172.21.15.19:0/3197325831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc6900cba20 con 0x7fc69015cba0 2023-11-20T06:42:13.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.075+0000 7fc685ffb640 1 -- 172.21.15.19:0/3197325831 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc688054bb0 con 0x7fc69015cba0 2023-11-20T06:42:13.081 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:42:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.079+0000 7fc697994640 1 -- 172.21.15.19:0/3197325831 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc6740664a0 msgr2=0x7fc674068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.079+0000 7fc697994640 1 --2- 172.21.15.19:0/3197325831 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc6740664a0 0x7fc674068960 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc68c001ec0 tx=0x7fc68c0019c0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.079+0000 7fc697994640 1 -- 172.21.15.19:0/3197325831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69015cba0 msgr2=0x7fc6900c6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.079+0000 7fc697994640 1 --2- 172.21.15.19:0/3197325831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69015cba0 0x7fc6900c6680 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc68800c790 tx=0x7fc68800cc50 comp rx=0 tx=0).stop 2023-11-20T06:42:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.079+0000 7fc697994640 1 -- 172.21.15.19:0/3197325831 shutdown_connections 2023-11-20T06:42:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.079+0000 7fc697994640 1 --2- 172.21.15.19:0/3197325831 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc6740664a0 0x7fc674068960 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.079+0000 7fc697994640 1 --2- 172.21.15.19:0/3197325831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69015cba0 0x7fc6900c6680 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.079+0000 7fc697994640 1 --2- 172.21.15.19:0/3197325831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6900d0210 0x7fc69014f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.079+0000 7fc697994640 1 --2- 172.21.15.19:0/3197325831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6900b84e0 0x7fc6900cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.079+0000 7fc697994640 1 -- 172.21.15.19:0/3197325831 >> 172.21.15.19:0/3197325831 conn(0x7fc6900719c0 msgr2=0x7fc6900d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.079+0000 7fc697994640 1 -- 172.21.15.19:0/3197325831 shutdown_connections 2023-11-20T06:42:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.079+0000 7fc697994640 1 -- 172.21.15.19:0/3197325831 wait complete. 2023-11-20T06:42:13.102 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T06:42:13.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.243+0000 7f108e165640 1 Processor -- start 2023-11-20T06:42:13.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.243+0000 7f108e165640 1 -- start start 2023-11-20T06:42:13.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.243+0000 7f108e165640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10880b84e0 0x7f10880d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.243+0000 7f108e165640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10880d1670 con 0x7f10880d0210 2023-11-20T06:42:13.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.243+0000 7f108e165640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10880d1950 con 0x7f108815cba0 2023-11-20T06:42:13.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.243+0000 7f108e165640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10880d1460 con 0x7f10880b84e0 2023-11-20T06:42:13.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.243+0000 7f1086ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f10880d0210 0x7f10880b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54344/0 (socket says 172.21.15.19:54344) 2023-11-20T06:42:13.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.243+0000 7f1086ffd640 1 -- 172.21.15.19:0/3450383507 learned_addr learned my addr 172.21.15.19:0/3450383507 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:13.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.243+0000 7f10867fc640 1 -- 172.21.15.19:0/3450383507 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321853567 0 0) 0x7f10880d1670 con 0x7f10880d0210 2023-11-20T06:42:13.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.243+0000 7f1087fff640 1 --2- 172.21.15.19:0/3450383507 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10880b84e0 0x7f10880d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:13.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f10867fc640 1 -- 172.21.15.19:0/3450383507 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1070003530 con 0x7f10880d0210 2023-11-20T06:42:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f10867fc640 1 -- 172.21.15.19:0/3450383507 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3485934215 0 0) 0x7f1070003530 con 0x7f10880d0210 2023-11-20T06:42:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f10867fc640 1 -- 172.21.15.19:0/3450383507 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10880b84e0 msgr2=0x7f10880d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f10867fc640 1 --2- 172.21.15.19:0/3450383507 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10880b84e0 0x7f10880d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f10867fc640 1 -- 172.21.15.19:0/3450383507 >> v1:172.21.15.190:6789/0 conn(0x7f108815cba0 legacy=0x7f10880cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f10867fc640 1 -- 172.21.15.19:0/3450383507 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10880d1c30 con 0x7f10880d0210 2023-11-20T06:42:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f10867fc640 1 -- 172.21.15.19:0/3450383507 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7f107c001680 con 0x7f10880d0210 2023-11-20T06:42:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f10867fc640 1 -- 172.21.15.19:0/3450383507 >> v1:172.21.15.19:6789/0 conn(0x7f10880d0210 legacy=0x7f10880b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f10867fc640 1 --2- 172.21.15.19:0/3450383507 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10880b84e0 0x7f10700039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f10867fc640 1 --2- 172.21.15.19:0/3450383507 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1070003f30 0x7f10700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f10867fc640 1 --2- 172.21.15.19:0/3450383507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1070004d10 0x7f1070005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f10867fc640 1 -- 172.21.15.19:0/3450383507 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10880d1460 con 0x7f1070004d10 2023-11-20T06:42:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f10867fc640 1 -- 172.21.15.19:0/3450383507 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107000ba70 con 0x7f1070003f30 2023-11-20T06:42:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f10867fc640 1 -- 172.21.15.19:0/3450383507 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107000bc30 con 0x7f10880b84e0 2023-11-20T06:42:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f1087fff640 1 --2- 172.21.15.19:0/3450383507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1070004d10 0x7f1070005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f10877fe640 1 --2- 172.21.15.19:0/3450383507 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10880b84e0 0x7f10700039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f1086ffd640 1 --2- 172.21.15.19:0/3450383507 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1070003f30 0x7f10700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f1087fff640 1 -- 172.21.15.19:0/3450383507 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10880b84e0 msgr2=0x7f10700039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f1087fff640 1 --2- 172.21.15.19:0/3450383507 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10880b84e0 0x7f10700039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f1087fff640 1 -- 172.21.15.19:0/3450383507 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1070003f30 msgr2=0x7f10700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f1087fff640 1 --2- 172.21.15.19:0/3450383507 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1070003f30 0x7f10700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f1087fff640 1 -- 172.21.15.19:0/3450383507 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1070003530 con 0x7f1070004d10 2023-11-20T06:42:13.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.247+0000 7f1087fff640 1 --2- 172.21.15.19:0/3450383507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1070004d10 0x7f1070005190 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1080009f90 tx=0x7f108001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f486b917a160ca server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:13.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.251+0000 7f10867fc640 1 -- 172.21.15.19:0/3450383507 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10800a5c30 con 0x7f1070004d10 2023-11-20T06:42:13.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.251+0000 7f10867fc640 1 -- 172.21.15.19:0/3450383507 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108000f040 con 0x7f1070004d10 2023-11-20T06:42:13.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.251+0000 7f10867fc640 1 -- 172.21.15.19:0/3450383507 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10800ad440 con 0x7f1070004d10 2023-11-20T06:42:13.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.251+0000 7f108e165640 1 -- 172.21.15.19:0/3450383507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1070004d10 msgr2=0x7f1070005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:13.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.251+0000 7f108e165640 1 --2- 172.21.15.19:0/3450383507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1070004d10 0x7f1070005190 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1080009f90 tx=0x7f108001cc20 comp rx=0 tx=0).stop 2023-11-20T06:42:13.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.251+0000 7f1087fff640 1 -- 172.21.15.19:0/3450383507 reap_dead start 2023-11-20T06:42:13.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.251+0000 7f108e165640 1 -- 172.21.15.19:0/3450383507 shutdown_connections 2023-11-20T06:42:13.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.251+0000 7f108e165640 1 -- 172.21.15.19:0/3450383507 >> 172.21.15.19:0/3450383507 conn(0x7f10880719c0 msgr2=0x7f1088071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:13.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.251+0000 7f108e165640 1 -- 172.21.15.19:0/3450383507 shutdown_connections 2023-11-20T06:42:13.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.251+0000 7f108e165640 1 -- 172.21.15.19:0/3450383507 wait complete. 2023-11-20T06:42:13.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.251+0000 7f108e165640 1 Processor -- start 2023-11-20T06:42:13.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.251+0000 7f108e165640 1 -- start start 2023-11-20T06:42:13.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.251+0000 7f108e165640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1070004d10 0x7f108814eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.251+0000 7f108e165640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f108815cf80 0x7f108815d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.251+0000 7f108e165640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f108815f400 0x7f108815f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.251+0000 7f108e165640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108815fdf0 con 0x7f108815cf80 2023-11-20T06:42:13.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.251+0000 7f108e165640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10881f3370 con 0x7f1070004d10 2023-11-20T06:42:13.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.251+0000 7f108e165640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10881f68b0 con 0x7f108815f400 2023-11-20T06:42:13.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f1086ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f108815cf80 0x7f108815d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:13.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f1086ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f108815cf80 0x7f108815d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50886/0 (socket says 172.21.15.19:50886) 2023-11-20T06:42:13.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f1086ffd640 1 -- 172.21.15.19:0/411254167 learned_addr learned my addr 172.21.15.19:0/411254167 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:13.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f10877fe640 1 --2- 172.21.15.19:0/411254167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1070004d10 0x7f108814eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:13.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f1087fff640 1 --2- 172.21.15.19:0/411254167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f108815f400 0x7f108815f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:13.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f1086ffd640 1 -- 172.21.15.19:0/411254167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f108815f400 msgr2=0x7f108815f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:13.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f1086ffd640 1 --2- 172.21.15.19:0/411254167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f108815f400 0x7f108815f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f1086ffd640 1 -- 172.21.15.19:0/411254167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1070004d10 msgr2=0x7f108814eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:13.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f1086ffd640 1 --2- 172.21.15.19:0/411254167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1070004d10 0x7f108814eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f1086ffd640 1 -- 172.21.15.19:0/411254167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10881f3090 con 0x7f108815cf80 2023-11-20T06:42:13.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f1087fff640 1 --2- 172.21.15.19:0/411254167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f108815f400 0x7f108815f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:13.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f10877fe640 1 --2- 172.21.15.19:0/411254167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1070004d10 0x7f108814eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:13.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f1086ffd640 1 --2- 172.21.15.19:0/411254167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f108815cf80 0x7f108815d400 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f107c0072f0 tx=0x7f107c0076f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:13.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f106ffff640 1 -- 172.21.15.19:0/411254167 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c001510 con 0x7f108815cf80 2023-11-20T06:42:13.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f106ffff640 1 -- 172.21.15.19:0/411254167 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107c00fa20 con 0x7f108815cf80 2023-11-20T06:42:13.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f108e165640 1 -- 172.21.15.19:0/411254167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10880c7630 con 0x7f108815cf80 2023-11-20T06:42:13.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f106ffff640 1 -- 172.21.15.19:0/411254167 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c00fdd0 con 0x7f108815cf80 2023-11-20T06:42:13.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f108e165640 1 -- 172.21.15.19:0/411254167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10880c7bf0 con 0x7f108815cf80 2023-11-20T06:42:13.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f108e165640 1 -- 172.21.15.19:0/411254167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10880c7490 con 0x7f108815cf80 2023-11-20T06:42:13.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f106ffff640 1 -- 172.21.15.19:0/411254167 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f107c01e3b0 con 0x7f108815cf80 2023-11-20T06:42:13.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f106ffff640 1 --2- 172.21.15.19:0/411254167 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f10740664a0 0x7f1074068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.255+0000 7f106ffff640 1 -- 172.21.15.19:0/411254167 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f107c083ff0 con 0x7f108815cf80 2023-11-20T06:42:13.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.259+0000 7f10877fe640 1 --2- 172.21.15.19:0/411254167 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f10740664a0 0x7f1074068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:13.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.259+0000 7f10877fe640 1 --2- 172.21.15.19:0/411254167 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f10740664a0 0x7f1074068960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f108815f390 tx=0x7f1078009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:13.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.259+0000 7f106ffff640 1 -- 172.21.15.19:0/411254167 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f10880c7490 con 0x7f108815cf80 2023-11-20T06:42:13.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.415+0000 7f108e165640 1 -- 172.21.15.19:0/411254167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10880c7490 con 0x7f108815cf80 2023-11-20T06:42:13.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.419+0000 7f106ffff640 1 -- 172.21.15.19:0/411254167 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f10880c7490 con 0x7f108815cf80 2023-11-20T06:42:13.423 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.419+0000 7f108e165640 1 -- 172.21.15.19:0/411254167 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f10740664a0 msgr2=0x7f1074068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.419+0000 7f108e165640 1 --2- 172.21.15.19:0/411254167 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f10740664a0 0x7f1074068960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f108815f390 tx=0x7f1078009040 comp rx=0 tx=0).stop 2023-11-20T06:42:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.419+0000 7f108e165640 1 -- 172.21.15.19:0/411254167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f108815cf80 msgr2=0x7f108815d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.419+0000 7f108e165640 1 --2- 172.21.15.19:0/411254167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f108815cf80 0x7f108815d400 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f107c0072f0 tx=0x7f107c0076f0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.419+0000 7f108e165640 1 -- 172.21.15.19:0/411254167 shutdown_connections 2023-11-20T06:42:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.419+0000 7f108e165640 1 --2- 172.21.15.19:0/411254167 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f10740664a0 0x7f1074068960 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.419+0000 7f108e165640 1 --2- 172.21.15.19:0/411254167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f108815f400 0x7f108815f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.419+0000 7f108e165640 1 --2- 172.21.15.19:0/411254167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f108815cf80 0x7f108815d400 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.419+0000 7f108e165640 1 --2- 172.21.15.19:0/411254167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1070004d10 0x7f108814eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.419+0000 7f108e165640 1 -- 172.21.15.19:0/411254167 >> 172.21.15.19:0/411254167 conn(0x7f10880719c0 msgr2=0x7f1088071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:13.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.419+0000 7f108e165640 1 -- 172.21.15.19:0/411254167 shutdown_connections 2023-11-20T06:42:13.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.419+0000 7f108e165640 1 -- 172.21.15.19:0/411254167 wait complete. 2023-11-20T06:42:13.444 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T06:42:13.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.583+0000 7f9c72a9e640 1 Processor -- start 2023-11-20T06:42:13.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.583+0000 7f9c72a9e640 1 -- start start 2023-11-20T06:42:13.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c72a9e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9c6c0ceda0 0x7f9c6c167be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c72a9e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c0cc330 con 0x7f9c6c15cc60 2023-11-20T06:42:13.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c72a9e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c0cb4d0 con 0x7f9c6c0cb040 2023-11-20T06:42:13.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c72a9e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6c0cb720 con 0x7f9c6c0ceda0 2023-11-20T06:42:13.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c7083a640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9c6c15cc60 0x7f9c6c161260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54350/0 (socket says 172.21.15.19:54350) 2023-11-20T06:42:13.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c7083a640 1 -- 172.21.15.19:0/1258944013 learned_addr learned my addr 172.21.15.19:0/1258944013 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:13.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c7103b640 1 --2- 172.21.15.19:0/1258944013 >> v2:172.21.15.190:3300/0 conn(0x7f9c6c0ceda0 0x7f9c6c167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:13.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c6b7fe640 1 -- 172.21.15.19:0/1258944013 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889774323 0 0) 0x7f9c6c0cc330 con 0x7f9c6c15cc60 2023-11-20T06:42:13.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c6b7fe640 1 -- 172.21.15.19:0/1258944013 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c5c003530 con 0x7f9c6c15cc60 2023-11-20T06:42:13.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c6b7fe640 1 -- 172.21.15.19:0/1258944013 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1522934790 0 0) 0x7f9c5c003530 con 0x7f9c6c15cc60 2023-11-20T06:42:13.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c6b7fe640 1 -- 172.21.15.19:0/1258944013 >> v2:172.21.15.190:3300/0 conn(0x7f9c6c0ceda0 msgr2=0x7f9c6c167be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:13.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c6b7fe640 1 --2- 172.21.15.19:0/1258944013 >> v2:172.21.15.190:3300/0 conn(0x7f9c6c0ceda0 0x7f9c6c167be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c6b7fe640 1 -- 172.21.15.19:0/1258944013 >> v1:172.21.15.190:6789/0 conn(0x7f9c6c0cb040 legacy=0x7f9c6c0ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:13.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c6b7fe640 1 -- 172.21.15.19:0/1258944013 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c0cba00 con 0x7f9c6c15cc60 2023-11-20T06:42:13.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c6b7fe640 1 -- 172.21.15.19:0/1258944013 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7f9c60001680 con 0x7f9c6c15cc60 2023-11-20T06:42:13.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c6b7fe640 1 -- 172.21.15.19:0/1258944013 >> v1:172.21.15.19:6789/0 conn(0x7f9c6c15cc60 legacy=0x7f9c6c161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:13.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c6b7fe640 1 --2- 172.21.15.19:0/1258944013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c5c003980 0x7f9c5c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c6b7fe640 1 --2- 172.21.15.19:0/1258944013 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c5c0047d0 0x7f9c5c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c6b7fe640 1 --2- 172.21.15.19:0/1258944013 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c5c005190 0x7f9c5c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c6b7fe640 1 -- 172.21.15.19:0/1258944013 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c0cb720 con 0x7f9c5c003980 2023-11-20T06:42:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c6b7fe640 1 -- 172.21.15.19:0/1258944013 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c00c030 con 0x7f9c5c005190 2023-11-20T06:42:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c6b7fe640 1 -- 172.21.15.19:0/1258944013 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c00c1f0 con 0x7f9c5c0047d0 2023-11-20T06:42:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c7083a640 1 --2- 172.21.15.19:0/1258944013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c5c003980 0x7f9c5c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c7103b640 1 --2- 172.21.15.19:0/1258944013 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c5c005190 0x7f9c5c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c6bfff640 1 --2- 172.21.15.19:0/1258944013 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c5c0047d0 0x7f9c5c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c7083a640 1 -- 172.21.15.19:0/1258944013 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c5c0047d0 msgr2=0x7f9c5c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c7083a640 1 --2- 172.21.15.19:0/1258944013 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c5c0047d0 0x7f9c5c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c7083a640 1 -- 172.21.15.19:0/1258944013 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c5c005190 msgr2=0x7f9c5c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c7083a640 1 --2- 172.21.15.19:0/1258944013 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c5c005190 0x7f9c5c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c7083a640 1 -- 172.21.15.19:0/1258944013 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c003530 con 0x7f9c5c003980 2023-11-20T06:42:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c6bfff640 1 --2- 172.21.15.19:0/1258944013 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c5c0047d0 0x7f9c5c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c7103b640 1 --2- 172.21.15.19:0/1258944013 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c5c005190 0x7f9c5c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.587+0000 7f9c7103b640 1 -- 172.21.15.19:0/1258944013 reap_dead start 2023-11-20T06:42:13.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.591+0000 7f9c7083a640 1 --2- 172.21.15.19:0/1258944013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c5c003980 0x7f9c5c003da0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000c240 tx=0x7f9c6001cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0ad8fabc2c909e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:13.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.591+0000 7f9c6b7fe640 1 -- 172.21.15.19:0/1258944013 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c60005ae0 con 0x7f9c5c003980 2023-11-20T06:42:13.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.591+0000 7f9c6b7fe640 1 -- 172.21.15.19:0/1258944013 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c60005c40 con 0x7f9c5c003980 2023-11-20T06:42:13.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.591+0000 7f9c6b7fe640 1 -- 172.21.15.19:0/1258944013 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c600a5ab0 con 0x7f9c5c003980 2023-11-20T06:42:13.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.591+0000 7f9c72a9e640 1 -- 172.21.15.19:0/1258944013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c5c003980 msgr2=0x7f9c5c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:13.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.591+0000 7f9c72a9e640 1 --2- 172.21.15.19:0/1258944013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c5c003980 0x7f9c5c003da0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000c240 tx=0x7f9c6001cbd0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.591+0000 7f9c72a9e640 1 -- 172.21.15.19:0/1258944013 shutdown_connections 2023-11-20T06:42:13.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.591+0000 7f9c72a9e640 1 --2- 172.21.15.19:0/1258944013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c5c003980 0x7f9c5c003da0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.591+0000 7f9c72a9e640 1 -- 172.21.15.19:0/1258944013 >> 172.21.15.19:0/1258944013 conn(0x7f9c6c06e570 msgr2=0x7f9c6c06e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:13.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.591+0000 7f9c72a9e640 1 -- 172.21.15.19:0/1258944013 shutdown_connections 2023-11-20T06:42:13.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.591+0000 7f9c72a9e640 1 -- 172.21.15.19:0/1258944013 wait complete. 2023-11-20T06:42:13.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.591+0000 7f9c72a9e640 1 Processor -- start 2023-11-20T06:42:13.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c72a9e640 1 -- start start 2023-11-20T06:42:13.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c72a9e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c5c003980 0x7f9c6c159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c72a9e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c6c0c9ca0 0x7f9c6c15dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c72a9e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c6c15f5f0 0x7f9c6c15fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c72a9e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c15ffb0 con 0x7f9c5c003980 2023-11-20T06:42:13.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c72a9e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c1f6bc0 con 0x7f9c6c0c9ca0 2023-11-20T06:42:13.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c72a9e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c15eca0 con 0x7f9c6c15f5f0 2023-11-20T06:42:13.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c7083a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c5c003980 0x7f9c6c159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:13.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c7083a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c5c003980 0x7f9c6c159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50906/0 (socket says 172.21.15.19:50906) 2023-11-20T06:42:13.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c7083a640 1 -- 172.21.15.19:0/599439674 learned_addr learned my addr 172.21.15.19:0/599439674 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:13.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c7083a640 1 -- 172.21.15.19:0/599439674 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c6c15f5f0 msgr2=0x7f9c6c15fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:13.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c7083a640 1 --2- 172.21.15.19:0/599439674 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c6c15f5f0 0x7f9c6c15fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c7083a640 1 -- 172.21.15.19:0/599439674 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c6c0c9ca0 msgr2=0x7f9c6c15dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:13.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c7083a640 1 --2- 172.21.15.19:0/599439674 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c6c0c9ca0 0x7f9c6c15dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c7083a640 1 -- 172.21.15.19:0/599439674 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c15e400 con 0x7f9c5c003980 2023-11-20T06:42:13.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c7083a640 1 --2- 172.21.15.19:0/599439674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c5c003980 0x7f9c6c159630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000c240 tx=0x7f9c5c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:13.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c697fa640 1 -- 172.21.15.19:0/599439674 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c600b4070 con 0x7f9c5c003980 2023-11-20T06:42:13.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c697fa640 1 -- 172.21.15.19:0/599439674 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c60005db0 con 0x7f9c5c003980 2023-11-20T06:42:13.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c72a9e640 1 -- 172.21.15.19:0/599439674 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6c15e6e0 con 0x7f9c5c003980 2023-11-20T06:42:13.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c697fa640 1 -- 172.21.15.19:0/599439674 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c600a5870 con 0x7f9c5c003980 2023-11-20T06:42:13.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c72a9e640 1 -- 172.21.15.19:0/599439674 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6c15e0e0 con 0x7f9c5c003980 2023-11-20T06:42:13.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.595+0000 7f9c72a9e640 1 -- 172.21.15.19:0/599439674 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6c04e170 con 0x7f9c5c003980 2023-11-20T06:42:13.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.599+0000 7f9c697fa640 1 -- 172.21.15.19:0/599439674 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9c600a59d0 con 0x7f9c5c003980 2023-11-20T06:42:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.599+0000 7f9c697fa640 1 --2- 172.21.15.19:0/599439674 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c500664d0 0x7f9c50068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.599+0000 7f9c697fa640 1 -- 172.21.15.19:0/599439674 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9c6011d950 con 0x7f9c5c003980 2023-11-20T06:42:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.599+0000 7f9c6bfff640 1 --2- 172.21.15.19:0/599439674 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c500664d0 0x7f9c50068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.599+0000 7f9c6bfff640 1 --2- 172.21.15.19:0/599439674 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c500664d0 0x7f9c50068990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c0af9d0 tx=0x7f9c58009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:13.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.603+0000 7f9c697fa640 1 -- 172.21.15.19:0/599439674 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9c600ea970 con 0x7f9c5c003980 2023-11-20T06:42:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.759+0000 7f9c72a9e640 1 -- 172.21.15.19:0/599439674 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c6c0b6830 con 0x7f9c5c003980 2023-11-20T06:42:13.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.759+0000 7f9c697fa640 1 -- 172.21.15.19:0/599439674 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c600edf90 con 0x7f9c5c003980 2023-11-20T06:42:13.765 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-20T06:42:13.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.763+0000 7f9c72a9e640 1 -- 172.21.15.19:0/599439674 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c500664d0 msgr2=0x7f9c50068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:13.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.763+0000 7f9c72a9e640 1 --2- 172.21.15.19:0/599439674 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c500664d0 0x7f9c50068990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c0af9d0 tx=0x7f9c58009040 comp rx=0 tx=0).stop 2023-11-20T06:42:13.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.763+0000 7f9c72a9e640 1 -- 172.21.15.19:0/599439674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c5c003980 msgr2=0x7f9c6c159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:13.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.763+0000 7f9c72a9e640 1 --2- 172.21.15.19:0/599439674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c5c003980 0x7f9c6c159630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000c240 tx=0x7f9c5c005800 comp rx=0 tx=0).stop 2023-11-20T06:42:13.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.763+0000 7f9c72a9e640 1 -- 172.21.15.19:0/599439674 shutdown_connections 2023-11-20T06:42:13.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.763+0000 7f9c72a9e640 1 --2- 172.21.15.19:0/599439674 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c500664d0 0x7f9c50068990 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.763+0000 7f9c72a9e640 1 --2- 172.21.15.19:0/599439674 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c6c15f5f0 0x7f9c6c15fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.763+0000 7f9c72a9e640 1 --2- 172.21.15.19:0/599439674 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c6c0c9ca0 0x7f9c6c15dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.763+0000 7f9c72a9e640 1 --2- 172.21.15.19:0/599439674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c5c003980 0x7f9c6c159630 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.763+0000 7f9c72a9e640 1 -- 172.21.15.19:0/599439674 >> 172.21.15.19:0/599439674 conn(0x7f9c6c06e570 msgr2=0x7f9c6c072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:13.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.763+0000 7f9c72a9e640 1 -- 172.21.15.19:0/599439674 shutdown_connections 2023-11-20T06:42:13.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.763+0000 7f9c72a9e640 1 -- 172.21.15.19:0/599439674 wait complete. 2023-11-20T06:42:13.787 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T06:42:13.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.927+0000 7fa85f291640 1 Processor -- start 2023-11-20T06:42:13.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.927+0000 7fa85f291640 1 -- start start 2023-11-20T06:42:13.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.927+0000 7fa85f291640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa85815cc60 0x7fa8580cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.927+0000 7fa85f291640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa858161260 0x7fa8580ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.927+0000 7fa85f291640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8580cc330 con 0x7fa8580cebd0 2023-11-20T06:42:13.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.927+0000 7fa85f291640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8580cefe0 con 0x7fa858161260 2023-11-20T06:42:13.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.927+0000 7fa85f291640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8580cb720 con 0x7fa85815cc60 2023-11-20T06:42:13.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.927+0000 7fa85c82c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa858161260 0x7fa8580ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:13.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.931+0000 7fa85d02d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa85815cc60 0x7fa8580cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:13.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.931+0000 7fa85d82e640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fa8580cebd0 0x7fa8580b2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:54286/0 (socket says 172.21.15.19:54286) 2023-11-20T06:42:13.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.931+0000 7fa85d82e640 1 -- 172.21.15.19:0/165851973 learned_addr learned my addr 172.21.15.19:0/165851973 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:13.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.931+0000 7fa85c82c640 1 -- 172.21.15.19:0/165851973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa85815cc60 msgr2=0x7fa8580cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:13.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.931+0000 7fa85c82c640 1 --2- 172.21.15.19:0/165851973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa85815cc60 0x7fa8580cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.931+0000 7fa85c82c640 1 -- 172.21.15.19:0/165851973 >> v1:172.21.15.190:6789/0 conn(0x7fa8580cebd0 legacy=0x7fa8580b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:13.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.931+0000 7fa85c82c640 1 -- 172.21.15.19:0/165851973 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8580cba00 con 0x7fa858161260 2023-11-20T06:42:13.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.931+0000 7fa85c82c640 1 --2- 172.21.15.19:0/165851973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa858161260 0x7fa8580ce690 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa8480097c0 tx=0x7fa84801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6df42581b8004cd server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:13.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.931+0000 7fa84ffff640 1 -- 172.21.15.19:0/165851973 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8480ab650 con 0x7fa858161260 2023-11-20T06:42:13.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.931+0000 7fa84ffff640 1 -- 172.21.15.19:0/165851973 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8480ab7b0 con 0x7fa858161260 2023-11-20T06:42:13.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.931+0000 7fa84ffff640 1 -- 172.21.15.19:0/165851973 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8480abb40 con 0x7fa858161260 2023-11-20T06:42:13.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85f291640 1 -- 172.21.15.19:0/165851973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa858161260 msgr2=0x7fa8580ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:13.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85f291640 1 --2- 172.21.15.19:0/165851973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa858161260 0x7fa8580ce690 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa8480097c0 tx=0x7fa84801c450 comp rx=0 tx=0).stop 2023-11-20T06:42:13.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85f291640 1 -- 172.21.15.19:0/165851973 shutdown_connections 2023-11-20T06:42:13.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85f291640 1 --2- 172.21.15.19:0/165851973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa858161260 0x7fa8580ce690 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85f291640 1 --2- 172.21.15.19:0/165851973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa85815cc60 0x7fa8580cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85f291640 1 -- 172.21.15.19:0/165851973 >> 172.21.15.19:0/165851973 conn(0x7fa85806e570 msgr2=0x7fa85806e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:13.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85f291640 1 -- 172.21.15.19:0/165851973 shutdown_connections 2023-11-20T06:42:13.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85f291640 1 -- 172.21.15.19:0/165851973 wait complete. 2023-11-20T06:42:13.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85f291640 1 Processor -- start 2023-11-20T06:42:13.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85f291640 1 -- start start 2023-11-20T06:42:13.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85f291640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8580cebd0 0x7fa8580b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85f291640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa85815cc60 0x7fa858152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85f291640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa858161260 0x7fa8581545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85f291640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa858153ab0 con 0x7fa85815cc60 2023-11-20T06:42:13.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85f291640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8580b5920 con 0x7fa858161260 2023-11-20T06:42:13.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85f291640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8581595b0 con 0x7fa8580cebd0 2023-11-20T06:42:13.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85c82c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa85815cc60 0x7fa858152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85c82c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa85815cc60 0x7fa858152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50912/0 (socket says 172.21.15.19:50912) 2023-11-20T06:42:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85c82c640 1 -- 172.21.15.19:0/2113416641 learned_addr learned my addr 172.21.15.19:0/2113416641 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85d02d640 1 --2- 172.21.15.19:0/2113416641 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8580cebd0 0x7fa8580b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85d82e640 1 --2- 172.21.15.19:0/2113416641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa858161260 0x7fa8581545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85c82c640 1 -- 172.21.15.19:0/2113416641 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8580cebd0 msgr2=0x7fa8580b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85c82c640 1 --2- 172.21.15.19:0/2113416641 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8580cebd0 0x7fa8580b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85c82c640 1 -- 172.21.15.19:0/2113416641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa858161260 msgr2=0x7fa8581545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.935+0000 7fa85c82c640 1 --2- 172.21.15.19:0/2113416641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa858161260 0x7fa8581545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:13.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.939+0000 7fa85c82c640 1 -- 172.21.15.19:0/2113416641 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa848009420 con 0x7fa85815cc60 2023-11-20T06:42:13.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.939+0000 7fa85c82c640 1 --2- 172.21.15.19:0/2113416641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa85815cc60 0x7fa858152ff0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa8480ad040 tx=0x7fa84801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:13.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.939+0000 7fa84dffb640 1 -- 172.21.15.19:0/2113416641 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8480b5810 con 0x7fa85815cc60 2023-11-20T06:42:13.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.939+0000 7fa84dffb640 1 -- 172.21.15.19:0/2113416641 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8480b5990 con 0x7fa85815cc60 2023-11-20T06:42:13.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.939+0000 7fa85f291640 1 -- 172.21.15.19:0/2113416641 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa858159890 con 0x7fa85815cc60 2023-11-20T06:42:13.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.939+0000 7fa84dffb640 1 -- 172.21.15.19:0/2113416641 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8480b5d40 con 0x7fa85815cc60 2023-11-20T06:42:13.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.939+0000 7fa85f291640 1 -- 172.21.15.19:0/2113416641 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8580b5be0 con 0x7fa85815cc60 2023-11-20T06:42:13.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.939+0000 7fa85f291640 1 -- 172.21.15.19:0/2113416641 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8580b5dd0 con 0x7fa85815cc60 2023-11-20T06:42:13.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.939+0000 7fa84dffb640 1 -- 172.21.15.19:0/2113416641 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa8480b4390 con 0x7fa85815cc60 2023-11-20T06:42:13.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.943+0000 7fa84dffb640 1 --2- 172.21.15.19:0/2113416641 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa83c0664a0 0x7fa83c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:13.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.943+0000 7fa84dffb640 1 -- 172.21.15.19:0/2113416641 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa84811ed10 con 0x7fa85815cc60 2023-11-20T06:42:13.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.943+0000 7fa85d02d640 1 --2- 172.21.15.19:0/2113416641 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa83c0664a0 0x7fa83c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:13.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.943+0000 7fa85d02d640 1 --2- 172.21.15.19:0/2113416641 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa83c0664a0 0x7fa83c068960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa854009b60 tx=0x7fa854009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:13.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:13.947+0000 7fa84dffb640 1 -- 172.21.15.19:0/2113416641 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa8480ebd60 con 0x7fa85815cc60 2023-11-20T06:42:14.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.103+0000 7fa85f291640 1 -- 172.21.15.19:0/2113416641 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa85804e170 con 0x7fa85815cc60 2023-11-20T06:42:14.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.103+0000 7fa84dffb640 1 -- 172.21.15.19:0/2113416641 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa8480ab610 con 0x7fa85815cc60 2023-11-20T06:42:14.110 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:14.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.107+0000 7fa85f291640 1 -- 172.21.15.19:0/2113416641 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa83c0664a0 msgr2=0x7fa83c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:14.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.107+0000 7fa85f291640 1 --2- 172.21.15.19:0/2113416641 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa83c0664a0 0x7fa83c068960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa854009b60 tx=0x7fa854009190 comp rx=0 tx=0).stop 2023-11-20T06:42:14.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.107+0000 7fa85f291640 1 -- 172.21.15.19:0/2113416641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa85815cc60 msgr2=0x7fa858152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:14.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.107+0000 7fa85f291640 1 --2- 172.21.15.19:0/2113416641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa85815cc60 0x7fa858152ff0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa8480ad040 tx=0x7fa84801ac90 comp rx=0 tx=0).stop 2023-11-20T06:42:14.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.107+0000 7fa85f291640 1 -- 172.21.15.19:0/2113416641 shutdown_connections 2023-11-20T06:42:14.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.107+0000 7fa85f291640 1 --2- 172.21.15.19:0/2113416641 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa83c0664a0 0x7fa83c068960 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.107+0000 7fa85f291640 1 --2- 172.21.15.19:0/2113416641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa858161260 0x7fa8581545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.107+0000 7fa85f291640 1 --2- 172.21.15.19:0/2113416641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa85815cc60 0x7fa858152ff0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.107+0000 7fa85f291640 1 --2- 172.21.15.19:0/2113416641 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8580cebd0 0x7fa8580b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.107+0000 7fa85f291640 1 -- 172.21.15.19:0/2113416641 >> 172.21.15.19:0/2113416641 conn(0x7fa85806e570 msgr2=0x7fa85815fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:14.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.107+0000 7fa85f291640 1 -- 172.21.15.19:0/2113416641 shutdown_connections 2023-11-20T06:42:14.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.107+0000 7fa85f291640 1 -- 172.21.15.19:0/2113416641 wait complete. 2023-11-20T06:42:14.131 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T06:42:14.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.271+0000 7f2b961aa640 1 Processor -- start 2023-11-20T06:42:14.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.271+0000 7f2b961aa640 1 -- start start 2023-11-20T06:42:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.271+0000 7f2b961aa640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b900cf090 0x7f2b900cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.271+0000 7f2b961aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b900c6ad0 0x7f2b900c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.271+0000 7f2b961aa640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b900c65f0 con 0x7f2b9015ca70 2023-11-20T06:42:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.271+0000 7f2b961aa640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b900cfa60 con 0x7f2b900cf090 2023-11-20T06:42:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.271+0000 7f2b961aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900ce820 con 0x7f2b900c6ad0 2023-11-20T06:42:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.271+0000 7f2b8f7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2b9015ca70 0x7f2b900d3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54352/0 (socket says 172.21.15.19:54352) 2023-11-20T06:42:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.271+0000 7f2b8effd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b900cf090 0x7f2b900cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.271+0000 7f2b8f7fe640 1 -- 172.21.15.19:0/1958053080 learned_addr learned my addr 172.21.15.19:0/1958053080 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.271+0000 7f2b8ffff640 1 --2- 172.21.15.19:0/1958053080 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b900c6ad0 0x7f2b900c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.271+0000 7f2b8effd640 1 -- 172.21.15.19:0/1958053080 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b900c6ad0 msgr2=0x7f2b900c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.271+0000 7f2b8effd640 1 --2- 172.21.15.19:0/1958053080 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b900c6ad0 0x7f2b900c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.271+0000 7f2b8effd640 1 -- 172.21.15.19:0/1958053080 >> v1:172.21.15.19:6789/0 conn(0x7f2b9015ca70 legacy=0x7f2b900d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:14.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.271+0000 7f2b8effd640 1 -- 172.21.15.19:0/1958053080 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b900cdf80 con 0x7f2b900cf090 2023-11-20T06:42:14.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.271+0000 7f2b8e7fc640 1 -- 172.21.15.19:0/1958053080 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 510374602 0 0) 0x7f2b900c65f0 con 0x7f2b9015ca70 2023-11-20T06:42:14.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.275+0000 7f2b8effd640 1 --2- 172.21.15.19:0/1958053080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b900cf090 0x7f2b900cf520 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2b840097c0 tx=0x7f2b8401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62602580a2fd45cc server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:14.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.275+0000 7f2b8e7fc640 1 -- 172.21.15.19:0/1958053080 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b840ab650 con 0x7f2b900cf090 2023-11-20T06:42:14.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.275+0000 7f2b8e7fc640 1 -- 172.21.15.19:0/1958053080 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b840ab7b0 con 0x7f2b900cf090 2023-11-20T06:42:14.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.275+0000 7f2b8e7fc640 1 -- 172.21.15.19:0/1958053080 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b840abb40 con 0x7f2b900cf090 2023-11-20T06:42:14.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.275+0000 7f2b961aa640 1 -- 172.21.15.19:0/1958053080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b900cf090 msgr2=0x7f2b900cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:14.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.275+0000 7f2b961aa640 1 --2- 172.21.15.19:0/1958053080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b900cf090 0x7f2b900cf520 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2b840097c0 tx=0x7f2b8401c450 comp rx=0 tx=0).stop 2023-11-20T06:42:14.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.275+0000 7f2b961aa640 1 -- 172.21.15.19:0/1958053080 shutdown_connections 2023-11-20T06:42:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.275+0000 7f2b961aa640 1 --2- 172.21.15.19:0/1958053080 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b900c6ad0 0x7f2b900c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.275+0000 7f2b961aa640 1 --2- 172.21.15.19:0/1958053080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b900cf090 0x7f2b900cf520 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.275+0000 7f2b961aa640 1 -- 172.21.15.19:0/1958053080 >> 172.21.15.19:0/1958053080 conn(0x7f2b9009bc50 msgr2=0x7f2b900d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.275+0000 7f2b961aa640 1 -- 172.21.15.19:0/1958053080 shutdown_connections 2023-11-20T06:42:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.275+0000 7f2b961aa640 1 -- 172.21.15.19:0/1958053080 wait complete. 2023-11-20T06:42:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b961aa640 1 Processor -- start 2023-11-20T06:42:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b961aa640 1 -- start start 2023-11-20T06:42:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b961aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b900c6ad0 0x7f2b9014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b961aa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b900cf090 0x7f2b9015aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b961aa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b9015ca70 0x7f2b9015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b961aa640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9014eb70 con 0x7f2b9015ca70 2023-11-20T06:42:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b961aa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9014ee50 con 0x7f2b900cf090 2023-11-20T06:42:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b961aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9014f130 con 0x7f2b900c6ad0 2023-11-20T06:42:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b8ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b9015ca70 0x7f2b9015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b8ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b9015ca70 0x7f2b9015b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50930/0 (socket says 172.21.15.19:50930) 2023-11-20T06:42:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b8ffff640 1 -- 172.21.15.19:0/2360384998 learned_addr learned my addr 172.21.15.19:0/2360384998 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b8effd640 1 --2- 172.21.15.19:0/2360384998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b900cf090 0x7f2b9015aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b8f7fe640 1 --2- 172.21.15.19:0/2360384998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b900c6ad0 0x7f2b9014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b8ffff640 1 -- 172.21.15.19:0/2360384998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b900c6ad0 msgr2=0x7f2b9014df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b8ffff640 1 --2- 172.21.15.19:0/2360384998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b900c6ad0 0x7f2b9014df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b8ffff640 1 -- 172.21.15.19:0/2360384998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b900cf090 msgr2=0x7f2b9015aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:14.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b8ffff640 1 --2- 172.21.15.19:0/2360384998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b900cf090 0x7f2b9015aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b8ffff640 1 -- 172.21.15.19:0/2360384998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b84009420 con 0x7f2b9015ca70 2023-11-20T06:42:14.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b8ffff640 1 --2- 172.21.15.19:0/2360384998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b9015ca70 0x7f2b9015b3f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800efc0 tx=0x7f2b8800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:14.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b77fff640 1 -- 172.21.15.19:0/2360384998 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88014480 con 0x7f2b9015ca70 2023-11-20T06:42:14.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b77fff640 1 -- 172.21.15.19:0/2360384998 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8800f040 con 0x7f2b9015ca70 2023-11-20T06:42:14.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b77fff640 1 -- 172.21.15.19:0/2360384998 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88014820 con 0x7f2b9015ca70 2023-11-20T06:42:14.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b961aa640 1 -- 172.21.15.19:0/2360384998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b900d38a0 con 0x7f2b9015ca70 2023-11-20T06:42:14.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b961aa640 1 -- 172.21.15.19:0/2360384998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9014f6f0 con 0x7f2b9015ca70 2023-11-20T06:42:14.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.279+0000 7f2b961aa640 1 -- 172.21.15.19:0/2360384998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b9014f8e0 con 0x7f2b9015ca70 2023-11-20T06:42:14.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.283+0000 7f2b77fff640 1 -- 172.21.15.19:0/2360384998 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2b88014980 con 0x7f2b9015ca70 2023-11-20T06:42:14.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.283+0000 7f2b77fff640 1 --2- 172.21.15.19:0/2360384998 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2b7c0664a0 0x7f2b7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:14.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.283+0000 7f2b77fff640 1 -- 172.21.15.19:0/2360384998 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2b88084d70 con 0x7f2b9015ca70 2023-11-20T06:42:14.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.283+0000 7f2b8f7fe640 1 --2- 172.21.15.19:0/2360384998 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2b7c0664a0 0x7f2b7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:14.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.283+0000 7f2b8f7fe640 1 --2- 172.21.15.19:0/2360384998 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2b7c0664a0 0x7f2b7c068960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2b800016e0 tx=0x7f2b80009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:14.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.287+0000 7f2b77fff640 1 -- 172.21.15.19:0/2360384998 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2b88051ec0 con 0x7f2b9015ca70 2023-11-20T06:42:14.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.459+0000 7f2b961aa640 1 -- 172.21.15.19:0/2360384998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2b900cfdb0 con 0x7f2b9015ca70 2023-11-20T06:42:14.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.459+0000 7f2b77fff640 1 -- 172.21.15.19:0/2360384998 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2b88018020 con 0x7f2b9015ca70 2023-11-20T06:42:14.464 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2023-11-20T06:42:14.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.459+0000 7f2b961aa640 1 -- 172.21.15.19:0/2360384998 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2b7c0664a0 msgr2=0x7f2b7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:14.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.459+0000 7f2b961aa640 1 --2- 172.21.15.19:0/2360384998 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2b7c0664a0 0x7f2b7c068960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2b800016e0 tx=0x7f2b80009040 comp rx=0 tx=0).stop 2023-11-20T06:42:14.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.459+0000 7f2b961aa640 1 -- 172.21.15.19:0/2360384998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b9015ca70 msgr2=0x7f2b9015b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:14.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.459+0000 7f2b961aa640 1 --2- 172.21.15.19:0/2360384998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b9015ca70 0x7f2b9015b3f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800efc0 tx=0x7f2b8800c490 comp rx=0 tx=0).stop 2023-11-20T06:42:14.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.459+0000 7f2b961aa640 1 -- 172.21.15.19:0/2360384998 shutdown_connections 2023-11-20T06:42:14.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.459+0000 7f2b961aa640 1 --2- 172.21.15.19:0/2360384998 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2b7c0664a0 0x7f2b7c068960 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.459+0000 7f2b961aa640 1 --2- 172.21.15.19:0/2360384998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b9015ca70 0x7f2b9015b3f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.459+0000 7f2b961aa640 1 --2- 172.21.15.19:0/2360384998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b900cf090 0x7f2b9015aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.459+0000 7f2b961aa640 1 --2- 172.21.15.19:0/2360384998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b900c6ad0 0x7f2b9014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.459+0000 7f2b961aa640 1 -- 172.21.15.19:0/2360384998 >> 172.21.15.19:0/2360384998 conn(0x7f2b9009bc50 msgr2=0x7f2b900b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:14.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.459+0000 7f2b961aa640 1 -- 172.21.15.19:0/2360384998 shutdown_connections 2023-11-20T06:42:14.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.459+0000 7f2b961aa640 1 -- 172.21.15.19:0/2360384998 wait complete. 2023-11-20T06:42:14.485 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi019.front.sepia.ceph.com... 2023-11-20T06:42:14.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:14.485 DEBUG:teuthology.orchestra.run.smithi019:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-20T06:42:14.506 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:42:14.506 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2023-11-20T06:42:14.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:14.506 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-20T06:42:14.556 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:42:14.556 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:42:14.566 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:42:14.566 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:42:14.619 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:14.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.755+0000 7fc5619b8640 1 Processor -- start 2023-11-20T06:42:14.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.755+0000 7fc5619b8640 1 -- start start 2023-11-20T06:42:14.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc5619b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc55c070c40 0x7fc55c15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:14.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc5619b8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55c15be60 con 0x7fc55c0b4020 2023-11-20T06:42:14.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc5619b8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55c15c1f0 con 0x7fc55c0b07f0 2023-11-20T06:42:14.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc5619b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c15b3b0 con 0x7fc55c070c40 2023-11-20T06:42:14.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc553fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc55c0b4020 0x7fc55c0b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54358/0 (socket says 172.21.15.19:54358) 2023-11-20T06:42:14.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc553fff640 1 -- 172.21.15.19:0/787817552 learned_addr learned my addr 172.21.15.19:0/787817552 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:14.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55affd640 1 --2- 172.21.15.19:0/787817552 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc55c070c40 0x7fc55c15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:14.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55a7fc640 1 -- 172.21.15.19:0/787817552 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285141820 0 0) 0x7fc55c15be60 con 0x7fc55c0b4020 2023-11-20T06:42:14.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55a7fc640 1 -- 172.21.15.19:0/787817552 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc548003530 con 0x7fc55c0b4020 2023-11-20T06:42:14.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55a7fc640 1 -- 172.21.15.19:0/787817552 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504333648 0 0) 0x7fc55c15c1f0 con 0x7fc55c0b07f0 2023-11-20T06:42:14.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55a7fc640 1 -- 172.21.15.19:0/787817552 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc55c15be60 con 0x7fc55c0b07f0 2023-11-20T06:42:14.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55a7fc640 1 -- 172.21.15.19:0/787817552 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3898568721 0 0) 0x7fc548003530 con 0x7fc55c0b4020 2023-11-20T06:42:14.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55a7fc640 1 -- 172.21.15.19:0/787817552 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc55c070c40 msgr2=0x7fc55c15ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:14.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55a7fc640 1 --2- 172.21.15.19:0/787817552 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc55c070c40 0x7fc55c15ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55a7fc640 1 -- 172.21.15.19:0/787817552 >> v1:172.21.15.190:6789/0 conn(0x7fc55c0b07f0 legacy=0x7fc55c164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:14.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55a7fc640 1 -- 172.21.15.19:0/787817552 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c071020 con 0x7fc55c0b4020 2023-11-20T06:42:14.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55a7fc640 1 -- 172.21.15.19:0/787817552 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7fc544001680 con 0x7fc55c0b4020 2023-11-20T06:42:14.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55a7fc640 1 -- 172.21.15.19:0/787817552 >> v1:172.21.15.19:6789/0 conn(0x7fc55c0b4020 legacy=0x7fc55c0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:14.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55a7fc640 1 --2- 172.21.15.19:0/787817552 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc55c070c40 0x7fc548003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:14.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55a7fc640 1 --2- 172.21.15.19:0/787817552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5480040a0 0x7fc5480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:14.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55a7fc640 1 --2- 172.21.15.19:0/787817552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc548004d10 0x7fc548005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:14.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55a7fc640 1 -- 172.21.15.19:0/787817552 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c15b3b0 con 0x7fc548004d10 2023-11-20T06:42:14.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55a7fc640 1 -- 172.21.15.19:0/787817552 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54800bb20 con 0x7fc5480040a0 2023-11-20T06:42:14.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55a7fc640 1 -- 172.21.15.19:0/787817552 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54800bcb0 con 0x7fc55c070c40 2023-11-20T06:42:14.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55affd640 1 --2- 172.21.15.19:0/787817552 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc55c070c40 0x7fc548003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:14.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc553fff640 1 --2- 172.21.15.19:0/787817552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5480040a0 0x7fc5480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:14.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55b7fe640 1 --2- 172.21.15.19:0/787817552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc548004d10 0x7fc548005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:14.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55b7fe640 1 -- 172.21.15.19:0/787817552 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc55c070c40 msgr2=0x7fc548003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:14.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55b7fe640 1 --2- 172.21.15.19:0/787817552 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc55c070c40 0x7fc548003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55b7fe640 1 -- 172.21.15.19:0/787817552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5480040a0 msgr2=0x7fc5480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:14.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55b7fe640 1 --2- 172.21.15.19:0/787817552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5480040a0 0x7fc5480047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.759+0000 7fc55b7fe640 1 -- 172.21.15.19:0/787817552 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc548003530 con 0x7fc548004d10 2023-11-20T06:42:14.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.763+0000 7fc55b7fe640 1 --2- 172.21.15.19:0/787817552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc548004d10 0x7fc548005190 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc55c070120 tx=0x7fc55401eff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9249ca060bf4a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:14.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.763+0000 7fc55a7fc640 1 -- 172.21.15.19:0/787817552 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5540a8c10 con 0x7fc548004d10 2023-11-20T06:42:14.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.763+0000 7fc55a7fc640 1 -- 172.21.15.19:0/787817552 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5540a8d90 con 0x7fc548004d10 2023-11-20T06:42:14.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.763+0000 7fc55a7fc640 1 -- 172.21.15.19:0/787817552 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc554003bc0 con 0x7fc548004d10 2023-11-20T06:42:14.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.763+0000 7fc5619b8640 1 -- 172.21.15.19:0/787817552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc548004d10 msgr2=0x7fc548005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:14.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.763+0000 7fc5619b8640 1 --2- 172.21.15.19:0/787817552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc548004d10 0x7fc548005190 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc55c070120 tx=0x7fc55401eff0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.763+0000 7fc55b7fe640 1 -- 172.21.15.19:0/787817552 reap_dead start 2023-11-20T06:42:14.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.763+0000 7fc5619b8640 1 -- 172.21.15.19:0/787817552 shutdown_connections 2023-11-20T06:42:14.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.763+0000 7fc5619b8640 1 -- 172.21.15.19:0/787817552 >> 172.21.15.19:0/787817552 conn(0x7fc55c06c190 msgr2=0x7fc55c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:14.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.763+0000 7fc5619b8640 1 -- 172.21.15.19:0/787817552 shutdown_connections 2023-11-20T06:42:14.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.763+0000 7fc5619b8640 1 -- 172.21.15.19:0/787817552 wait complete. 2023-11-20T06:42:14.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc5619b8640 1 Processor -- start 2023-11-20T06:42:14.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc5619b8640 1 -- start start 2023-11-20T06:42:14.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc5619b8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc548004d10 0x7fc55c1f4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:14.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc5619b8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc55c14b1c0 0x7fc55c14b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:14.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc5619b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc55c0af4b0 0x7fc55c0af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:14.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc5619b8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c14bb80 con 0x7fc55c14b1c0 2023-11-20T06:42:14.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc5619b8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c0afe70 con 0x7fc548004d10 2023-11-20T06:42:14.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc5619b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c14e020 con 0x7fc55c0af4b0 2023-11-20T06:42:14.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc553fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc55c14b1c0 0x7fc55c14b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:14.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc553fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc55c14b1c0 0x7fc55c14b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50940/0 (socket says 172.21.15.19:50940) 2023-11-20T06:42:14.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc553fff640 1 -- 172.21.15.19:0/4028212270 learned_addr learned my addr 172.21.15.19:0/4028212270 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:14.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc55b7fe640 1 --2- 172.21.15.19:0/4028212270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc55c0af4b0 0x7fc55c0af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:14.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc55affd640 1 --2- 172.21.15.19:0/4028212270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc548004d10 0x7fc55c1f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:14.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc553fff640 1 -- 172.21.15.19:0/4028212270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc55c0af4b0 msgr2=0x7fc55c0af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:14.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc553fff640 1 --2- 172.21.15.19:0/4028212270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc55c0af4b0 0x7fc55c0af930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc553fff640 1 -- 172.21.15.19:0/4028212270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc548004d10 msgr2=0x7fc55c1f4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:14.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc553fff640 1 --2- 172.21.15.19:0/4028212270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc548004d10 0x7fc55c1f4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc553fff640 1 -- 172.21.15.19:0/4028212270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c1f5240 con 0x7fc55c14b1c0 2023-11-20T06:42:14.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc55b7fe640 1 --2- 172.21.15.19:0/4028212270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc55c0af4b0 0x7fc55c0af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:14.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc55affd640 1 --2- 172.21.15.19:0/4028212270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc548004d10 0x7fc55c1f4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:14.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc553fff640 1 --2- 172.21.15.19:0/4028212270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc55c14b1c0 0x7fc55c14b640 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc544007340 tx=0x7fc544007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:14.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc558ff9640 1 -- 172.21.15.19:0/4028212270 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54400f9c0 con 0x7fc55c14b1c0 2023-11-20T06:42:14.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc558ff9640 1 -- 172.21.15.19:0/4028212270 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54400fb40 con 0x7fc55c14b1c0 2023-11-20T06:42:14.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc558ff9640 1 -- 172.21.15.19:0/4028212270 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5440133f0 con 0x7fc55c14b1c0 2023-11-20T06:42:14.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc5619b8640 1 -- 172.21.15.19:0/4028212270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc55c0b1240 con 0x7fc55c14b1c0 2023-11-20T06:42:14.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc5619b8640 1 -- 172.21.15.19:0/4028212270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55c0b1800 con 0x7fc55c14b1c0 2023-11-20T06:42:14.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.767+0000 7fc5619b8640 1 -- 172.21.15.19:0/4028212270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc55c074010 con 0x7fc55c14b1c0 2023-11-20T06:42:14.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.771+0000 7fc558ff9640 1 -- 172.21.15.19:0/4028212270 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc544013550 con 0x7fc55c14b1c0 2023-11-20T06:42:14.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.771+0000 7fc558ff9640 1 --2- 172.21.15.19:0/4028212270 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc53c0664a0 0x7fc53c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:14.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.771+0000 7fc558ff9640 1 -- 172.21.15.19:0/4028212270 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc544084480 con 0x7fc55c14b1c0 2023-11-20T06:42:14.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.771+0000 7fc55affd640 1 --2- 172.21.15.19:0/4028212270 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc53c0664a0 0x7fc53c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:14.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.771+0000 7fc55affd640 1 --2- 172.21.15.19:0/4028212270 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc53c0664a0 0x7fc53c068960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009ad0 tx=0x7fc54c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:14.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.775+0000 7fc558ff9640 1 -- 172.21.15.19:0/4028212270 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc544051560 con 0x7fc55c14b1c0 2023-11-20T06:42:14.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.935+0000 7fc5619b8640 1 -- 172.21.15.19:0/4028212270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc55c154a40 con 0x7fc55c14b1c0 2023-11-20T06:42:14.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.939+0000 7fc558ff9640 1 -- 172.21.15.19:0/4028212270 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18720 (secure 0 0 0) 0x7fc544054b80 con 0x7fc55c14b1c0 2023-11-20T06:42:14.944 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:14.944 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:55.472006+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:14.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.939+0000 7fc5619b8640 1 -- 172.21.15.19:0/4028212270 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc53c0664a0 msgr2=0x7fc53c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:14.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.939+0000 7fc5619b8640 1 --2- 172.21.15.19:0/4028212270 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc53c0664a0 0x7fc53c068960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009ad0 tx=0x7fc54c008040 comp rx=0 tx=0).stop 2023-11-20T06:42:14.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.939+0000 7fc5619b8640 1 -- 172.21.15.19:0/4028212270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc55c14b1c0 msgr2=0x7fc55c14b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:14.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.939+0000 7fc5619b8640 1 --2- 172.21.15.19:0/4028212270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc55c14b1c0 0x7fc55c14b640 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc544007340 tx=0x7fc544007800 comp rx=0 tx=0).stop 2023-11-20T06:42:14.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.939+0000 7fc5619b8640 1 -- 172.21.15.19:0/4028212270 shutdown_connections 2023-11-20T06:42:14.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.939+0000 7fc5619b8640 1 --2- 172.21.15.19:0/4028212270 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc53c0664a0 0x7fc53c068960 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.939+0000 7fc5619b8640 1 --2- 172.21.15.19:0/4028212270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc55c0af4b0 0x7fc55c0af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.939+0000 7fc5619b8640 1 --2- 172.21.15.19:0/4028212270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc55c14b1c0 0x7fc55c14b640 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.939+0000 7fc5619b8640 1 --2- 172.21.15.19:0/4028212270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc548004d10 0x7fc55c1f4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:14.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.939+0000 7fc5619b8640 1 -- 172.21.15.19:0/4028212270 >> 172.21.15.19:0/4028212270 conn(0x7fc55c06c190 msgr2=0x7fc55c0c4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:14.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.939+0000 7fc5619b8640 1 -- 172.21.15.19:0/4028212270 shutdown_connections 2023-11-20T06:42:14.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:14.939+0000 7fc5619b8640 1 -- 172.21.15.19:0/4028212270 wait complete. 2023-11-20T06:42:14.967 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T06:41:11.805111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T06:41:12.614034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T06:41:16.311206+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T06:42:14.968 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:42:15.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.111+0000 7fdb56f3e640 1 Processor -- start 2023-11-20T06:42:15.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.111+0000 7fdb56f3e640 1 -- start start 2023-11-20T06:42:15.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.115+0000 7fdb56f3e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdb500b84e0 0x7fdb500d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:15.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.115+0000 7fdb56f3e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb500d1670 con 0x7fdb5015cba0 2023-11-20T06:42:15.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.115+0000 7fdb56f3e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb500d1950 con 0x7fdb500d0210 2023-11-20T06:42:15.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.115+0000 7fdb56f3e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb500d1460 con 0x7fdb500b84e0 2023-11-20T06:42:15.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.115+0000 7fdb54cda640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdb5015cba0 0x7fdb500cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54366/0 (socket says 172.21.15.19:54366) 2023-11-20T06:42:15.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.115+0000 7fdb54cda640 1 -- 172.21.15.19:0/4266745956 learned_addr learned my addr 172.21.15.19:0/4266745956 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:15.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.115+0000 7fdb554db640 1 --2- 172.21.15.19:0/4266745956 >> v2:172.21.15.190:3300/0 conn(0x7fdb500b84e0 0x7fdb500d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:15.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.115+0000 7fdb4f7fe640 1 -- 172.21.15.19:0/4266745956 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525129957 0 0) 0x7fdb500d1670 con 0x7fdb5015cba0 2023-11-20T06:42:15.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.115+0000 7fdb4f7fe640 1 -- 172.21.15.19:0/4266745956 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb40003530 con 0x7fdb5015cba0 2023-11-20T06:42:15.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.115+0000 7fdb4f7fe640 1 -- 172.21.15.19:0/4266745956 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004221758 0 0) 0x7fdb500d1950 con 0x7fdb500d0210 2023-11-20T06:42:15.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.115+0000 7fdb4f7fe640 1 -- 172.21.15.19:0/4266745956 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb500d1670 con 0x7fdb500d0210 2023-11-20T06:42:15.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.115+0000 7fdb554db640 1 -- 172.21.15.19:0/4266745956 >> v1:172.21.15.190:6789/0 conn(0x7fdb500d0210 legacy=0x7fdb500b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:15.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.115+0000 7fdb554db640 1 -- 172.21.15.19:0/4266745956 >> v1:172.21.15.19:6789/0 conn(0x7fdb5015cba0 legacy=0x7fdb500cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:15.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.115+0000 7fdb554db640 1 -- 172.21.15.19:0/4266745956 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb500d1c30 con 0x7fdb500b84e0 2023-11-20T06:42:15.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.119+0000 7fdb554db640 1 --2- 172.21.15.19:0/4266745956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb500b84e0 0x7fdb500d0f20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009d90 tx=0x7fdb4801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a75987273025e0b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:15.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.119+0000 7fdb4f7fe640 1 -- 172.21.15.19:0/4266745956 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb480a5980 con 0x7fdb500b84e0 2023-11-20T06:42:15.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.119+0000 7fdb4f7fe640 1 -- 172.21.15.19:0/4266745956 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb480a5ae0 con 0x7fdb500b84e0 2023-11-20T06:42:15.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.119+0000 7fdb4f7fe640 1 -- 172.21.15.19:0/4266745956 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb480a5e70 con 0x7fdb500b84e0 2023-11-20T06:42:15.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.119+0000 7fdb56f3e640 1 -- 172.21.15.19:0/4266745956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb500b84e0 msgr2=0x7fdb500d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:15.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.119+0000 7fdb56f3e640 1 --2- 172.21.15.19:0/4266745956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb500b84e0 0x7fdb500d0f20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009d90 tx=0x7fdb4801c8c0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.119+0000 7fdb56f3e640 1 -- 172.21.15.19:0/4266745956 shutdown_connections 2023-11-20T06:42:15.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.119+0000 7fdb56f3e640 1 --2- 172.21.15.19:0/4266745956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb500b84e0 0x7fdb500d0f20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.119+0000 7fdb56f3e640 1 -- 172.21.15.19:0/4266745956 >> 172.21.15.19:0/4266745956 conn(0x7fdb500719c0 msgr2=0x7fdb50071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:15.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.119+0000 7fdb56f3e640 1 -- 172.21.15.19:0/4266745956 shutdown_connections 2023-11-20T06:42:15.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.119+0000 7fdb56f3e640 1 -- 172.21.15.19:0/4266745956 wait complete. 2023-11-20T06:42:15.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.119+0000 7fdb56f3e640 1 Processor -- start 2023-11-20T06:42:15.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.119+0000 7fdb56f3e640 1 -- start start 2023-11-20T06:42:15.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.119+0000 7fdb56f3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb500b84e0 0x7fdb5014c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:15.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.119+0000 7fdb56f3e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb500d0210 0x7fdb5015fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:15.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.119+0000 7fdb56f3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb5015cba0 0x7fdb5015d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:15.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.119+0000 7fdb56f3e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb500ca8a0 con 0x7fdb500b84e0 2023-11-20T06:42:15.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.119+0000 7fdb56f3e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5014cdf0 con 0x7fdb500d0210 2023-11-20T06:42:15.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.119+0000 7fdb56f3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb500c9c20 con 0x7fdb5015cba0 2023-11-20T06:42:15.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.123+0000 7fdb54cda640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb500b84e0 0x7fdb5014c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:15.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.123+0000 7fdb54cda640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb500b84e0 0x7fdb5014c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50954/0 (socket says 172.21.15.19:50954) 2023-11-20T06:42:15.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.123+0000 7fdb54cda640 1 -- 172.21.15.19:0/1638299157 learned_addr learned my addr 172.21.15.19:0/1638299157 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:15.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.123+0000 7fdb554db640 1 --2- 172.21.15.19:0/1638299157 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb5015cba0 0x7fdb5015d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:15.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.123+0000 7fdb4ffff640 1 --2- 172.21.15.19:0/1638299157 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb500d0210 0x7fdb5015fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:15.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.123+0000 7fdb54cda640 1 -- 172.21.15.19:0/1638299157 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb5015cba0 msgr2=0x7fdb5015d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:15.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.123+0000 7fdb54cda640 1 --2- 172.21.15.19:0/1638299157 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb5015cba0 0x7fdb5015d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.123+0000 7fdb54cda640 1 -- 172.21.15.19:0/1638299157 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb500d0210 msgr2=0x7fdb5015fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:15.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.123+0000 7fdb54cda640 1 --2- 172.21.15.19:0/1638299157 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb500d0210 0x7fdb5015fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.123+0000 7fdb54cda640 1 -- 172.21.15.19:0/1638299157 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb48009a70 con 0x7fdb500b84e0 2023-11-20T06:42:15.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.123+0000 7fdb54cda640 1 --2- 172.21.15.19:0/1638299157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb500b84e0 0x7fdb5014c8b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400c420 tx=0x7fdb4400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:15.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.123+0000 7fdb4d7fa640 1 -- 172.21.15.19:0/1638299157 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44005cf0 con 0x7fdb500b84e0 2023-11-20T06:42:15.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.123+0000 7fdb4d7fa640 1 -- 172.21.15.19:0/1638299157 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb44005e50 con 0x7fdb500b84e0 2023-11-20T06:42:15.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.123+0000 7fdb4d7fa640 1 -- 172.21.15.19:0/1638299157 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44007310 con 0x7fdb500b84e0 2023-11-20T06:42:15.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.123+0000 7fdb56f3e640 1 -- 172.21.15.19:0/1638299157 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb500c9f00 con 0x7fdb500b84e0 2023-11-20T06:42:15.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.123+0000 7fdb56f3e640 1 -- 172.21.15.19:0/1638299157 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb500ca4c0 con 0x7fdb500b84e0 2023-11-20T06:42:15.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.123+0000 7fdb56f3e640 1 -- 172.21.15.19:0/1638299157 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5004e170 con 0x7fdb500b84e0 2023-11-20T06:42:15.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.123+0000 7fdb4d7fa640 1 -- 172.21.15.19:0/1638299157 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdb44007470 con 0x7fdb500b84e0 2023-11-20T06:42:15.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.123+0000 7fdb4d7fa640 1 --2- 172.21.15.19:0/1638299157 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdb340664a0 0x7fdb34068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:15.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.123+0000 7fdb4d7fa640 1 -- 172.21.15.19:0/1638299157 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdb440837d0 con 0x7fdb500b84e0 2023-11-20T06:42:15.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.127+0000 7fdb4ffff640 1 --2- 172.21.15.19:0/1638299157 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdb340664a0 0x7fdb34068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:15.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.127+0000 7fdb4ffff640 1 --2- 172.21.15.19:0/1638299157 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdb340664a0 0x7fdb34068960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdb50157a70 tx=0x7fdb3c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:15.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.127+0000 7fdb4d7fa640 1 -- 172.21.15.19:0/1638299157 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdb44050930 con 0x7fdb500b84e0 2023-11-20T06:42:15.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.287+0000 7fdb56f3e640 1 -- 172.21.15.19:0/1638299157 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdb5014d500 con 0x7fdb500b84e0 2023-11-20T06:42:15.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.287+0000 7fdb4d7fa640 1 -- 172.21.15.19:0/1638299157 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdb44053f50 con 0x7fdb500b84e0 2023-11-20T06:42:15.293 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:42:15.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.287+0000 7fdb56f3e640 1 -- 172.21.15.19:0/1638299157 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdb340664a0 msgr2=0x7fdb34068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:15.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.287+0000 7fdb56f3e640 1 --2- 172.21.15.19:0/1638299157 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdb340664a0 0x7fdb34068960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdb50157a70 tx=0x7fdb3c009040 comp rx=0 tx=0).stop 2023-11-20T06:42:15.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.287+0000 7fdb56f3e640 1 -- 172.21.15.19:0/1638299157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb500b84e0 msgr2=0x7fdb5014c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:15.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.287+0000 7fdb56f3e640 1 --2- 172.21.15.19:0/1638299157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb500b84e0 0x7fdb5014c8b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400c420 tx=0x7fdb4400c8e0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.291+0000 7fdb56f3e640 1 -- 172.21.15.19:0/1638299157 shutdown_connections 2023-11-20T06:42:15.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.291+0000 7fdb56f3e640 1 --2- 172.21.15.19:0/1638299157 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdb340664a0 0x7fdb34068960 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.291+0000 7fdb56f3e640 1 --2- 172.21.15.19:0/1638299157 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb5015cba0 0x7fdb5015d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.291+0000 7fdb56f3e640 1 --2- 172.21.15.19:0/1638299157 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb500d0210 0x7fdb5015fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.291+0000 7fdb56f3e640 1 --2- 172.21.15.19:0/1638299157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb500b84e0 0x7fdb5014c8b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.291+0000 7fdb56f3e640 1 -- 172.21.15.19:0/1638299157 >> 172.21.15.19:0/1638299157 conn(0x7fdb500719c0 msgr2=0x7fdb50153740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:15.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.291+0000 7fdb56f3e640 1 -- 172.21.15.19:0/1638299157 shutdown_connections 2023-11-20T06:42:15.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.291+0000 7fdb56f3e640 1 -- 172.21.15.19:0/1638299157 wait complete. 2023-11-20T06:42:15.314 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T06:42:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.455+0000 7fda9173f640 1 Processor -- start 2023-11-20T06:42:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.455+0000 7fda9173f640 1 -- start start 2023-11-20T06:42:15.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.455+0000 7fda9173f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda8c0cf210 0x7fda8c0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:15.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.455+0000 7fda9173f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fda8c0d3320 0x7fda8c0ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:15.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.455+0000 7fda9173f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda8c0cfb30 con 0x7fda8c15cdc0 2023-11-20T06:42:15.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.455+0000 7fda9173f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda8c0cea10 con 0x7fda8c0d3320 2023-11-20T06:42:15.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.455+0000 7fda9173f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c0d0880 con 0x7fda8c0cf210 2023-11-20T06:42:15.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.455+0000 7fda90f3e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fda8c0d3320 0x7fda8c0ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:15.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.455+0000 7fda8b7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fda8c15cdc0 0x7fda8c0b2ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54374/0 (socket says 172.21.15.19:54374) 2023-11-20T06:42:15.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.455+0000 7fda8b7fe640 1 -- 172.21.15.19:0/3530952335 learned_addr learned my addr 172.21.15.19:0/3530952335 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:15.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.455+0000 7fda8bfff640 1 --2- 172.21.15.19:0/3530952335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda8c0cf210 0x7fda8c0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.455+0000 7fda90f3e640 1 -- 172.21.15.19:0/3530952335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda8c0cf210 msgr2=0x7fda8c0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.455+0000 7fda90f3e640 1 --2- 172.21.15.19:0/3530952335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda8c0cf210 0x7fda8c0cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.455+0000 7fda90f3e640 1 -- 172.21.15.19:0/3530952335 >> v1:172.21.15.19:6789/0 conn(0x7fda8c15cdc0 legacy=0x7fda8c0b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.455+0000 7fda90f3e640 1 -- 172.21.15.19:0/3530952335 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c0b1c00 con 0x7fda8c0d3320 2023-11-20T06:42:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.455+0000 7fda8bfff640 1 --2- 172.21.15.19:0/3530952335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda8c0cf210 0x7fda8c0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.455+0000 7fda8affd640 1 -- 172.21.15.19:0/3530952335 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943578244 0 0) 0x7fda8c0cfb30 con 0x7fda8c15cdc0 2023-11-20T06:42:15.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.459+0000 7fda90f3e640 1 --2- 172.21.15.19:0/3530952335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda8c0d3320 0x7fda8c0ce4d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fda84009d90 tx=0x7fda8401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5742dc6ef021e531 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:15.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.459+0000 7fda8affd640 1 -- 172.21.15.19:0/3530952335 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda840a59e0 con 0x7fda8c0d3320 2023-11-20T06:42:15.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.459+0000 7fda8affd640 1 -- 172.21.15.19:0/3530952335 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda840a5b40 con 0x7fda8c0d3320 2023-11-20T06:42:15.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.459+0000 7fda8affd640 1 -- 172.21.15.19:0/3530952335 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda840ad440 con 0x7fda8c0d3320 2023-11-20T06:42:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.459+0000 7fda9173f640 1 -- 172.21.15.19:0/3530952335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda8c0d3320 msgr2=0x7fda8c0ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.459+0000 7fda9173f640 1 --2- 172.21.15.19:0/3530952335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda8c0d3320 0x7fda8c0ce4d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fda84009d90 tx=0x7fda8401c920 comp rx=0 tx=0).stop 2023-11-20T06:42:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.459+0000 7fda9173f640 1 -- 172.21.15.19:0/3530952335 shutdown_connections 2023-11-20T06:42:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.459+0000 7fda9173f640 1 --2- 172.21.15.19:0/3530952335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda8c0d3320 0x7fda8c0ce4d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.459+0000 7fda9173f640 1 --2- 172.21.15.19:0/3530952335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda8c0cf210 0x7fda8c0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.459+0000 7fda9173f640 1 -- 172.21.15.19:0/3530952335 >> 172.21.15.19:0/3530952335 conn(0x7fda8c0d2800 msgr2=0x7fda8c0d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.459+0000 7fda9173f640 1 -- 172.21.15.19:0/3530952335 shutdown_connections 2023-11-20T06:42:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.459+0000 7fda9173f640 1 -- 172.21.15.19:0/3530952335 wait complete. 2023-11-20T06:42:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda9173f640 1 Processor -- start 2023-11-20T06:42:15.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda9173f640 1 -- start start 2023-11-20T06:42:15.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda9173f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda8c0cf210 0x7fda8c15d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:15.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda9173f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda8c0d3320 0x7fda8c0afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:15.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda9173f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda8c15cdc0 0x7fda8c06b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:15.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda9173f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c15d6e0 con 0x7fda8c15cdc0 2023-11-20T06:42:15.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda9173f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c0cc8c0 con 0x7fda8c0cf210 2023-11-20T06:42:15.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda9173f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c0c9a50 con 0x7fda8c0d3320 2023-11-20T06:42:15.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda90f3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda8c15cdc0 0x7fda8c06b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:15.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda90f3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda8c15cdc0 0x7fda8c06b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50976/0 (socket says 172.21.15.19:50976) 2023-11-20T06:42:15.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda90f3e640 1 -- 172.21.15.19:0/449571335 learned_addr learned my addr 172.21.15.19:0/449571335 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:15.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda8b7fe640 1 --2- 172.21.15.19:0/449571335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda8c0d3320 0x7fda8c0afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:15.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda8bfff640 1 --2- 172.21.15.19:0/449571335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda8c0cf210 0x7fda8c15d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda90f3e640 1 -- 172.21.15.19:0/449571335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda8c0d3320 msgr2=0x7fda8c0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda90f3e640 1 --2- 172.21.15.19:0/449571335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda8c0d3320 0x7fda8c0afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda90f3e640 1 -- 172.21.15.19:0/449571335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda8c0cf210 msgr2=0x7fda8c15d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda90f3e640 1 --2- 172.21.15.19:0/449571335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda8c0cf210 0x7fda8c15d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda90f3e640 1 -- 172.21.15.19:0/449571335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda84009a70 con 0x7fda8c15cdc0 2023-11-20T06:42:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda90f3e640 1 --2- 172.21.15.19:0/449571335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda8c15cdc0 0x7fda8c06b670 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fda840b0040 tx=0x7fda840196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda88ff9640 1 -- 172.21.15.19:0/449571335 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda840ade40 con 0x7fda8c15cdc0 2023-11-20T06:42:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda88ff9640 1 -- 172.21.15.19:0/449571335 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda84009450 con 0x7fda8c15cdc0 2023-11-20T06:42:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda9173f640 1 -- 172.21.15.19:0/449571335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda8c0c9d30 con 0x7fda8c15cdc0 2023-11-20T06:42:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda88ff9640 1 -- 172.21.15.19:0/449571335 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda840b7630 con 0x7fda8c15cdc0 2023-11-20T06:42:15.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.463+0000 7fda9173f640 1 -- 172.21.15.19:0/449571335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8c0ca2f0 con 0x7fda8c15cdc0 2023-11-20T06:42:15.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.467+0000 7fda9173f640 1 -- 172.21.15.19:0/449571335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8c1f7e20 con 0x7fda8c15cdc0 2023-11-20T06:42:15.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.467+0000 7fda88ff9640 1 -- 172.21.15.19:0/449571335 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fda840b4050 con 0x7fda8c15cdc0 2023-11-20T06:42:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.467+0000 7fda88ff9640 1 --2- 172.21.15.19:0/449571335 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fda780664d0 0x7fda78068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.467+0000 7fda88ff9640 1 -- 172.21.15.19:0/449571335 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fda8411f980 con 0x7fda8c15cdc0 2023-11-20T06:42:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.467+0000 7fda8bfff640 1 --2- 172.21.15.19:0/449571335 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fda780664d0 0x7fda78068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.467+0000 7fda8bfff640 1 --2- 172.21.15.19:0/449571335 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fda780664d0 0x7fda78068990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fda7c006fd0 tx=0x7fda7c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:15.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.471+0000 7fda88ff9640 1 -- 172.21.15.19:0/449571335 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fda8c1f7e20 con 0x7fda8c15cdc0 2023-11-20T06:42:15.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.631+0000 7fda9173f640 1 -- 172.21.15.19:0/449571335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda8c1f7e20 con 0x7fda8c15cdc0 2023-11-20T06:42:15.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.631+0000 7fda88ff9640 1 -- 172.21.15.19:0/449571335 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fda8c1f7e20 con 0x7fda8c15cdc0 2023-11-20T06:42:15.638 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:15.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.635+0000 7fda9173f640 1 -- 172.21.15.19:0/449571335 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fda780664d0 msgr2=0x7fda78068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:15.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.635+0000 7fda9173f640 1 --2- 172.21.15.19:0/449571335 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fda780664d0 0x7fda78068990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fda7c006fd0 tx=0x7fda7c008040 comp rx=0 tx=0).stop 2023-11-20T06:42:15.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.635+0000 7fda9173f640 1 -- 172.21.15.19:0/449571335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda8c15cdc0 msgr2=0x7fda8c06b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:15.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.635+0000 7fda9173f640 1 --2- 172.21.15.19:0/449571335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda8c15cdc0 0x7fda8c06b670 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fda840b0040 tx=0x7fda840196c0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.635+0000 7fda9173f640 1 -- 172.21.15.19:0/449571335 shutdown_connections 2023-11-20T06:42:15.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.635+0000 7fda9173f640 1 --2- 172.21.15.19:0/449571335 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fda780664d0 0x7fda78068990 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.635+0000 7fda9173f640 1 --2- 172.21.15.19:0/449571335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda8c15cdc0 0x7fda8c06b670 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.635+0000 7fda9173f640 1 --2- 172.21.15.19:0/449571335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda8c0d3320 0x7fda8c0afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.635+0000 7fda9173f640 1 --2- 172.21.15.19:0/449571335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda8c0cf210 0x7fda8c15d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.635+0000 7fda9173f640 1 -- 172.21.15.19:0/449571335 >> 172.21.15.19:0/449571335 conn(0x7fda8c0d2800 msgr2=0x7fda8c0cdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:15.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.635+0000 7fda9173f640 1 -- 172.21.15.19:0/449571335 shutdown_connections 2023-11-20T06:42:15.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.635+0000 7fda9173f640 1 -- 172.21.15.19:0/449571335 wait complete. 2023-11-20T06:42:15.659 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T06:42:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.803+0000 7fc734b3e640 1 Processor -- start 2023-11-20T06:42:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.807+0000 7fc734b3e640 1 -- start start 2023-11-20T06:42:15.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.807+0000 7fc734b3e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc730069e90 0x7fc73006d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:15.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.807+0000 7fc734b3e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc7300c26b0 0x7fc7300c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:15.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.807+0000 7fc734b3e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc73015ae30 con 0x7fc73006a270 2023-11-20T06:42:15.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.807+0000 7fc734b3e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7300cb090 con 0x7fc7300c26b0 2023-11-20T06:42:15.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.807+0000 7fc734b3e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7300ca510 con 0x7fc730069e90 2023-11-20T06:42:15.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.807+0000 7fc727fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc73006a270 0x7fc7300c9ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54382/0 (socket says 172.21.15.19:54382) 2023-11-20T06:42:15.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.807+0000 7fc727fff640 1 -- 172.21.15.19:0/2082487840 learned_addr learned my addr 172.21.15.19:0/2082487840 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:15.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.807+0000 7fc72ed9d640 1 --2- 172.21.15.19:0/2082487840 >> v2:172.21.15.19:3300/0 conn(0x7fc7300c26b0 0x7fc7300c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.807+0000 7fc72e59c640 1 --2- 172.21.15.19:0/2082487840 >> v2:172.21.15.190:3300/0 conn(0x7fc730069e90 0x7fc73006d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.807+0000 7fc72ed9d640 1 -- 172.21.15.19:0/2082487840 >> v2:172.21.15.190:3300/0 conn(0x7fc730069e90 msgr2=0x7fc73006d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.807+0000 7fc72ed9d640 1 --2- 172.21.15.19:0/2082487840 >> v2:172.21.15.190:3300/0 conn(0x7fc730069e90 0x7fc73006d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.807+0000 7fc72ed9d640 1 -- 172.21.15.19:0/2082487840 >> v1:172.21.15.19:6789/0 conn(0x7fc73006a270 legacy=0x7fc7300c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.807+0000 7fc72dd9b640 1 -- 172.21.15.19:0/2082487840 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088690505 0 0) 0x7fc73015ae30 con 0x7fc73006a270 2023-11-20T06:42:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.807+0000 7fc72ed9d640 1 -- 172.21.15.19:0/2082487840 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7300ca7f0 con 0x7fc7300c26b0 2023-11-20T06:42:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.807+0000 7fc72e59c640 1 --2- 172.21.15.19:0/2082487840 >> v2:172.21.15.190:3300/0 conn(0x7fc730069e90 0x7fc73006d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:15.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.811+0000 7fc72ed9d640 1 --2- 172.21.15.19:0/2082487840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7300c26b0 0x7fc7300c2b00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc730071590 tx=0x7fc72801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837417e467cae649 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.811+0000 7fc72dd9b640 1 -- 172.21.15.19:0/2082487840 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7280a59a0 con 0x7fc7300c26b0 2023-11-20T06:42:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.811+0000 7fc72dd9b640 1 -- 172.21.15.19:0/2082487840 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7280a5b00 con 0x7fc7300c26b0 2023-11-20T06:42:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.811+0000 7fc72dd9b640 1 -- 172.21.15.19:0/2082487840 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7280a5e90 con 0x7fc7300c26b0 2023-11-20T06:42:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.811+0000 7fc734b3e640 1 -- 172.21.15.19:0/2082487840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7300c26b0 msgr2=0x7fc7300c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:15.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.811+0000 7fc734b3e640 1 --2- 172.21.15.19:0/2082487840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7300c26b0 0x7fc7300c2b00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc730071590 tx=0x7fc72801c8e0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.811+0000 7fc734b3e640 1 -- 172.21.15.19:0/2082487840 shutdown_connections 2023-11-20T06:42:15.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.811+0000 7fc734b3e640 1 --2- 172.21.15.19:0/2082487840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7300c26b0 0x7fc7300c2b00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.811+0000 7fc734b3e640 1 --2- 172.21.15.19:0/2082487840 >> v2:172.21.15.190:3300/0 conn(0x7fc730069e90 0x7fc73006d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.811+0000 7fc734b3e640 1 -- 172.21.15.19:0/2082487840 >> 172.21.15.19:0/2082487840 conn(0x7fc7300b0da0 msgr2=0x7fc7300ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:15.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.811+0000 7fc734b3e640 1 -- 172.21.15.19:0/2082487840 shutdown_connections 2023-11-20T06:42:15.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.811+0000 7fc734b3e640 1 -- 172.21.15.19:0/2082487840 wait complete. 2023-11-20T06:42:15.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.811+0000 7fc734b3e640 1 Processor -- start 2023-11-20T06:42:15.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.811+0000 7fc734b3e640 1 -- start start 2023-11-20T06:42:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc734b3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc730069e90 0x7fc7300c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc734b3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc73006a270 0x7fc73013f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc734b3e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7300c26b0 0x7fc730153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc734b3e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7300c1810 con 0x7fc730069e90 2023-11-20T06:42:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc734b3e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7301417c0 con 0x7fc7300c26b0 2023-11-20T06:42:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc734b3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc730157f90 con 0x7fc73006a270 2023-11-20T06:42:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc72e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc730069e90 0x7fc7300c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc72e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc730069e90 0x7fc7300c12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50990/0 (socket says 172.21.15.19:50990) 2023-11-20T06:42:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc72e59c640 1 -- 172.21.15.19:0/1571881365 learned_addr learned my addr 172.21.15.19:0/1571881365 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc72e59c640 1 -- 172.21.15.19:0/1571881365 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc73006a270 msgr2=0x7fc73013f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc72e59c640 1 --2- 172.21.15.19:0/1571881365 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc73006a270 0x7fc73013f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc72e59c640 1 -- 172.21.15.19:0/1571881365 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7300c26b0 msgr2=0x7fc730153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc72e59c640 1 --2- 172.21.15.19:0/1571881365 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7300c26b0 0x7fc730153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc72e59c640 1 -- 172.21.15.19:0/1571881365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc728009a70 con 0x7fc730069e90 2023-11-20T06:42:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc72e59c640 1 --2- 172.21.15.19:0/1571881365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc730069e90 0x7fc7300c12d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc72000e810 tx=0x7fc72000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc726ffd640 1 -- 172.21.15.19:0/1571881365 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72000c8d0 con 0x7fc730069e90 2023-11-20T06:42:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc726ffd640 1 -- 172.21.15.19:0/1571881365 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72000ca30 con 0x7fc730069e90 2023-11-20T06:42:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc726ffd640 1 -- 172.21.15.19:0/1571881365 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72000cdc0 con 0x7fc730069e90 2023-11-20T06:42:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc734b3e640 1 -- 172.21.15.19:0/1571881365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc730158270 con 0x7fc730069e90 2023-11-20T06:42:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc734b3e640 1 -- 172.21.15.19:0/1571881365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc730152e00 con 0x7fc730069e90 2023-11-20T06:42:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc734b3e640 1 -- 172.21.15.19:0/1571881365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc73004e170 con 0x7fc730069e90 2023-11-20T06:42:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.815+0000 7fc726ffd640 1 -- 172.21.15.19:0/1571881365 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc720013410 con 0x7fc730069e90 2023-11-20T06:42:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.819+0000 7fc726ffd640 1 --2- 172.21.15.19:0/1571881365 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc7100664a0 0x7fc710068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.819+0000 7fc726ffd640 1 -- 172.21.15.19:0/1571881365 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc720084140 con 0x7fc730069e90 2023-11-20T06:42:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.819+0000 7fc727fff640 1 --2- 172.21.15.19:0/1571881365 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc7100664a0 0x7fc710068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.819+0000 7fc727fff640 1 --2- 172.21.15.19:0/1571881365 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc7100664a0 0x7fc710068960 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc7180011f0 tx=0x7fc718007930 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:15.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.823+0000 7fc726ffd640 1 -- 172.21.15.19:0/1571881365 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc720051160 con 0x7fc730069e90 2023-11-20T06:42:15.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.979+0000 7fc734b3e640 1 -- 172.21.15.19:0/1571881365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc7300c2090 con 0x7fc730069e90 2023-11-20T06:42:15.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.979+0000 7fc726ffd640 1 -- 172.21.15.19:0/1571881365 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc720054780 con 0x7fc730069e90 2023-11-20T06:42:15.986 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-20T06:42:15.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.983+0000 7fc734b3e640 1 -- 172.21.15.19:0/1571881365 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc7100664a0 msgr2=0x7fc710068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:15.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.983+0000 7fc734b3e640 1 --2- 172.21.15.19:0/1571881365 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc7100664a0 0x7fc710068960 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc7180011f0 tx=0x7fc718007930 comp rx=0 tx=0).stop 2023-11-20T06:42:15.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.983+0000 7fc734b3e640 1 -- 172.21.15.19:0/1571881365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc730069e90 msgr2=0x7fc7300c12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:15.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.983+0000 7fc734b3e640 1 --2- 172.21.15.19:0/1571881365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc730069e90 0x7fc7300c12d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc72000e810 tx=0x7fc72000ecd0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.983+0000 7fc734b3e640 1 -- 172.21.15.19:0/1571881365 shutdown_connections 2023-11-20T06:42:15.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.983+0000 7fc734b3e640 1 --2- 172.21.15.19:0/1571881365 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fc7100664a0 0x7fc710068960 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.983+0000 7fc734b3e640 1 --2- 172.21.15.19:0/1571881365 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7300c26b0 0x7fc730153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.983+0000 7fc734b3e640 1 --2- 172.21.15.19:0/1571881365 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc73006a270 0x7fc73013f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.983+0000 7fc734b3e640 1 --2- 172.21.15.19:0/1571881365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc730069e90 0x7fc7300c12d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:15.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.983+0000 7fc734b3e640 1 -- 172.21.15.19:0/1571881365 >> 172.21.15.19:0/1571881365 conn(0x7fc7300b0da0 msgr2=0x7fc7300701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.983+0000 7fc734b3e640 1 -- 172.21.15.19:0/1571881365 shutdown_connections 2023-11-20T06:42:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:15.983+0000 7fc734b3e640 1 -- 172.21.15.19:0/1571881365 wait complete. 2023-11-20T06:42:16.009 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T06:42:16.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.151+0000 7fa07fc6b640 1 Processor -- start 2023-11-20T06:42:16.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.151+0000 7fa07fc6b640 1 -- start start 2023-11-20T06:42:16.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.151+0000 7fa07fc6b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa07815cbc0 0x7fa0780ab870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:16.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.151+0000 7fa07fc6b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa078160860 0x7fa078160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:16.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.151+0000 7fa07fc6b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa078161390 con 0x7fa078069e90 2023-11-20T06:42:16.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.151+0000 7fa07fc6b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0780ccda0 con 0x7fa078160860 2023-11-20T06:42:16.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.151+0000 7fa07fc6b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0780cd080 con 0x7fa07815cbc0 2023-11-20T06:42:16.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.151+0000 7fa07d206640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa078160860 0x7fa078160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:16.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.151+0000 7fa07e208640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa078069e90 0x7fa0780cd880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54398/0 (socket says 172.21.15.19:54398) 2023-11-20T06:42:16.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.151+0000 7fa07e208640 1 -- 172.21.15.19:0/3362588868 learned_addr learned my addr 172.21.15.19:0/3362588868 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:16.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.151+0000 7fa07da07640 1 --2- 172.21.15.19:0/3362588868 >> v2:172.21.15.190:3300/0 conn(0x7fa07815cbc0 0x7fa0780ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:16.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.151+0000 7fa07ca05640 1 -- 172.21.15.19:0/3362588868 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437135448 0 0) 0x7fa078161390 con 0x7fa078069e90 2023-11-20T06:42:16.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.151+0000 7fa07d206640 1 -- 172.21.15.19:0/3362588868 >> v2:172.21.15.190:3300/0 conn(0x7fa07815cbc0 msgr2=0x7fa0780ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:16.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.151+0000 7fa07d206640 1 --2- 172.21.15.19:0/3362588868 >> v2:172.21.15.190:3300/0 conn(0x7fa07815cbc0 0x7fa0780ab870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.151+0000 7fa07d206640 1 -- 172.21.15.19:0/3362588868 >> v1:172.21.15.19:6789/0 conn(0x7fa078069e90 legacy=0x7fa0780cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:16.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.151+0000 7fa07d206640 1 -- 172.21.15.19:0/3362588868 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0780cd360 con 0x7fa078160860 2023-11-20T06:42:16.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.155+0000 7fa07d206640 1 --2- 172.21.15.19:0/3362588868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa078160860 0x7fa078160cf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa0780713e0 tx=0x7fa06801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dbdf3b12c9d5a81 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:16.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.155+0000 7fa07ca05640 1 -- 172.21.15.19:0/3362588868 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680ab600 con 0x7fa078160860 2023-11-20T06:42:16.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.155+0000 7fa07ca05640 1 -- 172.21.15.19:0/3362588868 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0680a7050 con 0x7fa078160860 2023-11-20T06:42:16.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.155+0000 7fa07ca05640 1 -- 172.21.15.19:0/3362588868 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680ab980 con 0x7fa078160860 2023-11-20T06:42:16.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.155+0000 7fa07fc6b640 1 -- 172.21.15.19:0/3362588868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa078160860 msgr2=0x7fa078160cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:16.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.155+0000 7fa07fc6b640 1 --2- 172.21.15.19:0/3362588868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa078160860 0x7fa078160cf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa0780713e0 tx=0x7fa06801c3d0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.155+0000 7fa07fc6b640 1 -- 172.21.15.19:0/3362588868 shutdown_connections 2023-11-20T06:42:16.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.155+0000 7fa07fc6b640 1 --2- 172.21.15.19:0/3362588868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa078160860 0x7fa078160cf0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.155+0000 7fa07fc6b640 1 --2- 172.21.15.19:0/3362588868 >> v2:172.21.15.190:3300/0 conn(0x7fa07815cbc0 0x7fa0780ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.155+0000 7fa07fc6b640 1 -- 172.21.15.19:0/3362588868 >> 172.21.15.19:0/3362588868 conn(0x7fa0780b0da0 msgr2=0x7fa0780ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:16.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.155+0000 7fa07fc6b640 1 -- 172.21.15.19:0/3362588868 shutdown_connections 2023-11-20T06:42:16.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.155+0000 7fa07fc6b640 1 -- 172.21.15.19:0/3362588868 wait complete. 2023-11-20T06:42:16.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07fc6b640 1 Processor -- start 2023-11-20T06:42:16.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07fc6b640 1 -- start start 2023-11-20T06:42:16.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07fc6b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa078069e90 0x7fa0780b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:16.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07fc6b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa07815cbc0 0x7fa078155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:16.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07fc6b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa078160860 0x7fa0780c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:16.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07fc6b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa078156650 con 0x7fa07815cbc0 2023-11-20T06:42:16.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07fc6b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa078156930 con 0x7fa078160860 2023-11-20T06:42:16.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07fc6b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa078156c10 con 0x7fa078069e90 2023-11-20T06:42:16.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07d206640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa07815cbc0 0x7fa078155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:16.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07d206640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa07815cbc0 0x7fa078155cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51000/0 (socket says 172.21.15.19:51000) 2023-11-20T06:42:16.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07d206640 1 -- 172.21.15.19:0/984661706 learned_addr learned my addr 172.21.15.19:0/984661706 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:16.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07da07640 1 --2- 172.21.15.19:0/984661706 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa078069e90 0x7fa0780b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:16.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07e208640 1 --2- 172.21.15.19:0/984661706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa078160860 0x7fa0780c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:16.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07d206640 1 -- 172.21.15.19:0/984661706 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa078069e90 msgr2=0x7fa0780b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:16.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07d206640 1 --2- 172.21.15.19:0/984661706 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa078069e90 0x7fa0780b3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07d206640 1 -- 172.21.15.19:0/984661706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa078160860 msgr2=0x7fa0780c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:16.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07d206640 1 --2- 172.21.15.19:0/984661706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa078160860 0x7fa0780c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07d206640 1 -- 172.21.15.19:0/984661706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa068009420 con 0x7fa07815cbc0 2023-11-20T06:42:16.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07da07640 1 --2- 172.21.15.19:0/984661706 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa078069e90 0x7fa0780b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:16.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07d206640 1 --2- 172.21.15.19:0/984661706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa07815cbc0 0x7fa078155cf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa0680ae040 tx=0x7fa068019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:16.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa06e7fc640 1 -- 172.21.15.19:0/984661706 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680b4610 con 0x7fa07815cbc0 2023-11-20T06:42:16.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa06e7fc640 1 -- 172.21.15.19:0/984661706 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0680b4770 con 0x7fa07815cbc0 2023-11-20T06:42:16.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa06e7fc640 1 -- 172.21.15.19:0/984661706 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680b4b20 con 0x7fa07815cbc0 2023-11-20T06:42:16.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07fc6b640 1 -- 172.21.15.19:0/984661706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07806a830 con 0x7fa07815cbc0 2023-11-20T06:42:16.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.159+0000 7fa07fc6b640 1 -- 172.21.15.19:0/984661706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0781571d0 con 0x7fa07815cbc0 2023-11-20T06:42:16.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.163+0000 7fa07fc6b640 1 -- 172.21.15.19:0/984661706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0781573c0 con 0x7fa07815cbc0 2023-11-20T06:42:16.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.163+0000 7fa06e7fc640 1 -- 172.21.15.19:0/984661706 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa0680b2040 con 0x7fa07815cbc0 2023-11-20T06:42:16.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.163+0000 7fa06e7fc640 1 --2- 172.21.15.19:0/984661706 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa05c0664a0 0x7fa05c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:16.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.163+0000 7fa06e7fc640 1 -- 172.21.15.19:0/984661706 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa06811e220 con 0x7fa07815cbc0 2023-11-20T06:42:16.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.163+0000 7fa07da07640 1 --2- 172.21.15.19:0/984661706 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa05c0664a0 0x7fa05c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:16.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.163+0000 7fa07da07640 1 --2- 172.21.15.19:0/984661706 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa05c0664a0 0x7fa05c068960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa074007a70 tx=0x7fa074008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:16.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.167+0000 7fa06e7fc640 1 -- 172.21.15.19:0/984661706 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa0680eb2d0 con 0x7fa07815cbc0 2023-11-20T06:42:16.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.323+0000 7fa07fc6b640 1 -- 172.21.15.19:0/984661706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa07804e170 con 0x7fa07815cbc0 2023-11-20T06:42:16.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.323+0000 7fa06e7fc640 1 -- 172.21.15.19:0/984661706 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa0680ee8f0 con 0x7fa07815cbc0 2023-11-20T06:42:16.331 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.327+0000 7fa07fc6b640 1 -- 172.21.15.19:0/984661706 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa05c0664a0 msgr2=0x7fa05c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.327+0000 7fa07fc6b640 1 --2- 172.21.15.19:0/984661706 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa05c0664a0 0x7fa05c068960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa074007a70 tx=0x7fa074008040 comp rx=0 tx=0).stop 2023-11-20T06:42:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.327+0000 7fa07fc6b640 1 -- 172.21.15.19:0/984661706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa07815cbc0 msgr2=0x7fa078155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.327+0000 7fa07fc6b640 1 --2- 172.21.15.19:0/984661706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa07815cbc0 0x7fa078155cf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa0680ae040 tx=0x7fa068019170 comp rx=0 tx=0).stop 2023-11-20T06:42:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.327+0000 7fa07fc6b640 1 -- 172.21.15.19:0/984661706 shutdown_connections 2023-11-20T06:42:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.327+0000 7fa07fc6b640 1 --2- 172.21.15.19:0/984661706 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa05c0664a0 0x7fa05c068960 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.327+0000 7fa07fc6b640 1 --2- 172.21.15.19:0/984661706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa078160860 0x7fa0780c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.327+0000 7fa07fc6b640 1 --2- 172.21.15.19:0/984661706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa07815cbc0 0x7fa078155cf0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.327+0000 7fa07fc6b640 1 --2- 172.21.15.19:0/984661706 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa078069e90 0x7fa0780b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.327+0000 7fa07fc6b640 1 -- 172.21.15.19:0/984661706 >> 172.21.15.19:0/984661706 conn(0x7fa0780b0da0 msgr2=0x7fa0780cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.327+0000 7fa07fc6b640 1 -- 172.21.15.19:0/984661706 shutdown_connections 2023-11-20T06:42:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.327+0000 7fa07fc6b640 1 -- 172.21.15.19:0/984661706 wait complete. 2023-11-20T06:42:16.352 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T06:42:16.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.491+0000 7f2634e91640 1 Processor -- start 2023-11-20T06:42:16.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.491+0000 7f2634e91640 1 -- start start 2023-11-20T06:42:16.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.491+0000 7f2634e91640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26300b07f0 0x7f263015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:16.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.491+0000 7f2634e91640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f263015d690 0x7f2630164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.491+0000 7f2634e91640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263015be60 con 0x7f2630070c40 2023-11-20T06:42:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.491+0000 7f2634e91640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263015b3b0 con 0x7f263015d690 2023-11-20T06:42:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.491+0000 7f2634e91640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263015c1f0 con 0x7f26300b07f0 2023-11-20T06:42:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.491+0000 7f262ed9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f263015d690 0x7f2630164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.491+0000 7f262e59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2630070c40 0x7f26300b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54410/0 (socket says 172.21.15.19:54410) 2023-11-20T06:42:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.491+0000 7f262e59c640 1 -- 172.21.15.19:0/1798434027 learned_addr learned my addr 172.21.15.19:0/1798434027 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.491+0000 7f2627fff640 1 --2- 172.21.15.19:0/1798434027 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26300b07f0 0x7f263015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:16.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.495+0000 7f262ed9d640 1 -- 172.21.15.19:0/1798434027 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26300b07f0 msgr2=0x7f263015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:16.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.495+0000 7f262ed9d640 1 --2- 172.21.15.19:0/1798434027 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26300b07f0 0x7f263015ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.495+0000 7f262ed9d640 1 -- 172.21.15.19:0/1798434027 >> v1:172.21.15.19:6789/0 conn(0x7f2630070c40 legacy=0x7f26300b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:16.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.495+0000 7f262ed9d640 1 -- 172.21.15.19:0/1798434027 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2630071020 con 0x7f263015d690 2023-11-20T06:42:16.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.495+0000 7f262dd9b640 1 -- 172.21.15.19:0/1798434027 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314682066 0 0) 0x7f263015be60 con 0x7f2630070c40 2023-11-20T06:42:16.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.495+0000 7f262ed9d640 1 --2- 172.21.15.19:0/1798434027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f263015d690 0x7f2630164490 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2628009d90 tx=0x7f262801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22634418bcc69f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:16.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.495+0000 7f262dd9b640 1 -- 172.21.15.19:0/1798434027 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26280a5980 con 0x7f263015d690 2023-11-20T06:42:16.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.495+0000 7f262dd9b640 1 -- 172.21.15.19:0/1798434027 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26280a5ae0 con 0x7f263015d690 2023-11-20T06:42:16.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.495+0000 7f262dd9b640 1 -- 172.21.15.19:0/1798434027 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26280a5e70 con 0x7f263015d690 2023-11-20T06:42:16.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.495+0000 7f2634e91640 1 -- 172.21.15.19:0/1798434027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f263015d690 msgr2=0x7f2630164490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:16.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.495+0000 7f2634e91640 1 --2- 172.21.15.19:0/1798434027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f263015d690 0x7f2630164490 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2628009d90 tx=0x7f262801c8c0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.495+0000 7f2634e91640 1 -- 172.21.15.19:0/1798434027 shutdown_connections 2023-11-20T06:42:16.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.495+0000 7f2634e91640 1 --2- 172.21.15.19:0/1798434027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f263015d690 0x7f2630164490 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.495+0000 7f2634e91640 1 --2- 172.21.15.19:0/1798434027 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26300b07f0 0x7f263015ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.495+0000 7f2634e91640 1 -- 172.21.15.19:0/1798434027 >> 172.21.15.19:0/1798434027 conn(0x7f263006c190 msgr2=0x7f263006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:16.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f2634e91640 1 -- 172.21.15.19:0/1798434027 shutdown_connections 2023-11-20T06:42:16.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f2634e91640 1 -- 172.21.15.19:0/1798434027 wait complete. 2023-11-20T06:42:16.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f2634e91640 1 Processor -- start 2023-11-20T06:42:16.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f2634e91640 1 -- start start 2023-11-20T06:42:16.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f2634e91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2630070c40 0x7f2630159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:16.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f2634e91640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26300b07f0 0x7f263015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:16.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f2634e91640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f263015d690 0x7f2630155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:16.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f2634e91640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2630157ad0 con 0x7f2630070c40 2023-11-20T06:42:16.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f2634e91640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2630156e50 con 0x7f26300b07f0 2023-11-20T06:42:16.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f2634e91640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2630157130 con 0x7f263015d690 2023-11-20T06:42:16.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f262e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2630070c40 0x7f2630159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:16.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f262e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2630070c40 0x7f2630159c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51012/0 (socket says 172.21.15.19:51012) 2023-11-20T06:42:16.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f262e59c640 1 -- 172.21.15.19:0/359269882 learned_addr learned my addr 172.21.15.19:0/359269882 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:16.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f2627fff640 1 --2- 172.21.15.19:0/359269882 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26300b07f0 0x7f263015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:16.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f262ed9d640 1 --2- 172.21.15.19:0/359269882 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f263015d690 0x7f2630155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f262e59c640 1 -- 172.21.15.19:0/359269882 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f263015d690 msgr2=0x7f2630155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f262e59c640 1 --2- 172.21.15.19:0/359269882 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f263015d690 0x7f2630155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f262e59c640 1 -- 172.21.15.19:0/359269882 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26300b07f0 msgr2=0x7f263015a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f262e59c640 1 --2- 172.21.15.19:0/359269882 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26300b07f0 0x7f263015a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f262e59c640 1 -- 172.21.15.19:0/359269882 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2628009a70 con 0x7f2630070c40 2023-11-20T06:42:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.499+0000 7f262e59c640 1 --2- 172.21.15.19:0/359269882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2630070c40 0x7f2630159c60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f26200011f0 tx=0x7f262000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.503+0000 7f2626ffd640 1 -- 172.21.15.19:0/359269882 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26200074e0 con 0x7f2630070c40 2023-11-20T06:42:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.503+0000 7f2626ffd640 1 -- 172.21.15.19:0/359269882 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2620007640 con 0x7f2630070c40 2023-11-20T06:42:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.503+0000 7f2626ffd640 1 -- 172.21.15.19:0/359269882 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620004a10 con 0x7f2630070c40 2023-11-20T06:42:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.503+0000 7f2634e91640 1 -- 172.21.15.19:0/359269882 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2630157410 con 0x7f2630070c40 2023-11-20T06:42:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.503+0000 7f2634e91640 1 -- 172.21.15.19:0/359269882 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2630157ef0 con 0x7f2630070c40 2023-11-20T06:42:16.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.503+0000 7f2634e91640 1 -- 172.21.15.19:0/359269882 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2630074010 con 0x7f2630070c40 2023-11-20T06:42:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.503+0000 7f2626ffd640 1 -- 172.21.15.19:0/359269882 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2620004b70 con 0x7f2630070c40 2023-11-20T06:42:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.503+0000 7f2626ffd640 1 --2- 172.21.15.19:0/359269882 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f26100664a0 0x7f2610068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.503+0000 7f2626ffd640 1 -- 172.21.15.19:0/359269882 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f26200834a0 con 0x7f2630070c40 2023-11-20T06:42:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.503+0000 7f2627fff640 1 --2- 172.21.15.19:0/359269882 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f26100664a0 0x7f2610068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.503+0000 7f2627fff640 1 --2- 172.21.15.19:0/359269882 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f26100664a0 0x7f2610068960 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f26300cef80 tx=0x7f2618009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:16.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.507+0000 7f2626ffd640 1 -- 172.21.15.19:0/359269882 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2620050600 con 0x7f2630070c40 2023-11-20T06:42:16.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.679+0000 7f2634e91640 1 -- 172.21.15.19:0/359269882 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f26300b0390 con 0x7f2630070c40 2023-11-20T06:42:16.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.679+0000 7f2626ffd640 1 -- 172.21.15.19:0/359269882 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2620018080 con 0x7f2630070c40 2023-11-20T06:42:16.684 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2023-11-20T06:42:16.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.679+0000 7f2634e91640 1 -- 172.21.15.19:0/359269882 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f26100664a0 msgr2=0x7f2610068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:16.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.679+0000 7f2634e91640 1 --2- 172.21.15.19:0/359269882 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f26100664a0 0x7f2610068960 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f26300cef80 tx=0x7f2618009190 comp rx=0 tx=0).stop 2023-11-20T06:42:16.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.679+0000 7f2634e91640 1 -- 172.21.15.19:0/359269882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2630070c40 msgr2=0x7f2630159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:16.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.679+0000 7f2634e91640 1 --2- 172.21.15.19:0/359269882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2630070c40 0x7f2630159c60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f26200011f0 tx=0x7f262000c9b0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.679+0000 7f2634e91640 1 -- 172.21.15.19:0/359269882 shutdown_connections 2023-11-20T06:42:16.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.679+0000 7f2634e91640 1 --2- 172.21.15.19:0/359269882 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f26100664a0 0x7f2610068960 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.679+0000 7f2634e91640 1 --2- 172.21.15.19:0/359269882 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f263015d690 0x7f2630155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.679+0000 7f2634e91640 1 --2- 172.21.15.19:0/359269882 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26300b07f0 0x7f263015a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.679+0000 7f2634e91640 1 --2- 172.21.15.19:0/359269882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2630070c40 0x7f2630159c60 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.679+0000 7f2634e91640 1 -- 172.21.15.19:0/359269882 >> 172.21.15.19:0/359269882 conn(0x7f263006c190 msgr2=0x7f26300ce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:16.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.679+0000 7f2634e91640 1 -- 172.21.15.19:0/359269882 shutdown_connections 2023-11-20T06:42:16.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.679+0000 7f2634e91640 1 -- 172.21.15.19:0/359269882 wait complete. 2023-11-20T06:42:16.705 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:42:16.705 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:42:16.716 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:16.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.855+0000 7f19d7f0f640 1 Processor -- start 2023-11-20T06:42:16.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.855+0000 7f19d7f0f640 1 -- start start 2023-11-20T06:42:16.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.855+0000 7f19d7f0f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f19d015ca50 0x7f19d006c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:16.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.855+0000 7f19d7f0f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19d015ce30 0x7f19d00cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:16.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.855+0000 7f19d7f0f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f19d00b21c0 0x7f19d00b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:16.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.855+0000 7f19d7f0f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d00b2b50 con 0x7f19d015ca50 2023-11-20T06:42:16.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.855+0000 7f19d7f0f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d01607e0 con 0x7f19d00b21c0 2023-11-20T06:42:16.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.855+0000 7f19d7f0f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00cf060 con 0x7f19d015ce30 2023-11-20T06:42:16.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.855+0000 7f19d5cab640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f19d015ca50 0x7f19d006c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:16.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.855+0000 7f19d5cab640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f19d015ca50 0x7f19d006c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51028/0 (socket says 172.21.15.19:51028) 2023-11-20T06:42:16.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.855+0000 7f19d5cab640 1 -- 172.21.15.19:0/355194046 learned_addr learned my addr 172.21.15.19:0/355194046 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:16.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.855+0000 7f19d54aa640 1 --2- 172.21.15.19:0/355194046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19d015ce30 0x7f19d00cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:16.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.855+0000 7f19d64ac640 1 --2- 172.21.15.19:0/355194046 >> v2:172.21.15.190:3300/0 conn(0x7f19d00b21c0 0x7f19d00b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:16.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.855+0000 7f19d5cab640 1 -- 172.21.15.19:0/355194046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19d015ce30 msgr2=0x7f19d00cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:16.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.855+0000 7f19d5cab640 1 --2- 172.21.15.19:0/355194046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19d015ce30 0x7f19d00cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.855+0000 7f19d5cab640 1 -- 172.21.15.19:0/355194046 >> v2:172.21.15.190:3300/0 conn(0x7f19d00b21c0 msgr2=0x7f19d00b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:16.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.855+0000 7f19d5cab640 1 --2- 172.21.15.19:0/355194046 >> v2:172.21.15.190:3300/0 conn(0x7f19d00b21c0 0x7f19d00b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.855+0000 7f19d5cab640 1 -- 172.21.15.19:0/355194046 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d0070210 con 0x7f19d015ca50 2023-11-20T06:42:16.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.855+0000 7f19d64ac640 1 --2- 172.21.15.19:0/355194046 >> v2:172.21.15.190:3300/0 conn(0x7f19d00b21c0 0x7f19d00b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:16.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.855+0000 7f19d54aa640 1 --2- 172.21.15.19:0/355194046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19d015ce30 0x7f19d00cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:16.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.859+0000 7f19d5cab640 1 --2- 172.21.15.19:0/355194046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d015ca50 0x7f19d006c980 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f19d00723a0 tx=0x7f19cc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30d47848d73453f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:16.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.859+0000 7f19d4ca9640 1 -- 172.21.15.19:0/355194046 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc0aa5f0 con 0x7f19d015ca50 2023-11-20T06:42:16.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.859+0000 7f19d4ca9640 1 -- 172.21.15.19:0/355194046 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19cc0aa750 con 0x7f19d015ca50 2023-11-20T06:42:16.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.859+0000 7f19d4ca9640 1 -- 172.21.15.19:0/355194046 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc0aaae0 con 0x7f19d015ca50 2023-11-20T06:42:16.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.859+0000 7f19d7f0f640 1 -- 172.21.15.19:0/355194046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d015ca50 msgr2=0x7f19d006c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:16.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.859+0000 7f19d7f0f640 1 --2- 172.21.15.19:0/355194046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d015ca50 0x7f19d006c980 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f19d00723a0 tx=0x7f19cc01c4d0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.859+0000 7f19d7f0f640 1 -- 172.21.15.19:0/355194046 shutdown_connections 2023-11-20T06:42:16.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.859+0000 7f19d7f0f640 1 --2- 172.21.15.19:0/355194046 >> v2:172.21.15.190:3300/0 conn(0x7f19d00b21c0 0x7f19d00b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.859+0000 7f19d7f0f640 1 --2- 172.21.15.19:0/355194046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19d015ce30 0x7f19d00cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.859+0000 7f19d7f0f640 1 --2- 172.21.15.19:0/355194046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d015ca50 0x7f19d006c980 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.859+0000 7f19d7f0f640 1 -- 172.21.15.19:0/355194046 >> 172.21.15.19:0/355194046 conn(0x7f19d00cd1c0 msgr2=0x7f19d00cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:16.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.859+0000 7f19d7f0f640 1 -- 172.21.15.19:0/355194046 shutdown_connections 2023-11-20T06:42:16.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.859+0000 7f19d7f0f640 1 -- 172.21.15.19:0/355194046 wait complete. 2023-11-20T06:42:16.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.859+0000 7f19d7f0f640 1 Processor -- start 2023-11-20T06:42:16.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d7f0f640 1 -- start start 2023-11-20T06:42:16.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d7f0f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19d00b21c0 0x7f19d00c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:16.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d7f0f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d015ca50 0x7f19d0153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:16.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d54aa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d015ca50 0x7f19d0153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:16.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d54aa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d015ca50 0x7f19d0153760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51040/0 (socket says 172.21.15.19:51040) 2023-11-20T06:42:16.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d5cab640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19d00b21c0 0x7f19d00c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:16.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d7f0f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19d015ce30 0x7f19d00c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:16.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d5cab640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19d00b21c0 0x7f19d00c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:42514/0 (socket says 172.21.15.19:42514) 2023-11-20T06:42:16.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d7f0f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00c8e70 con 0x7f19d015ca50 2023-11-20T06:42:16.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d7f0f640 1 -- 172.21.15.19:0/1651714627 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00c81f0 con 0x7f19d00b21c0 2023-11-20T06:42:16.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d7f0f640 1 -- 172.21.15.19:0/1651714627 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00c84d0 con 0x7f19d015ce30 2023-11-20T06:42:16.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d54aa640 1 -- 172.21.15.19:0/1651714627 learned_addr learned my addr 172.21.15.19:0/1651714627 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:16.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d64ac640 1 --2- 172.21.15.19:0/1651714627 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19d015ce30 0x7f19d00c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:16.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d54aa640 1 -- 172.21.15.19:0/1651714627 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19d015ce30 msgr2=0x7f19d00c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:16.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d54aa640 1 --2- 172.21.15.19:0/1651714627 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19d015ce30 0x7f19d00c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d54aa640 1 -- 172.21.15.19:0/1651714627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19d00b21c0 msgr2=0x7f19d00c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:16.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d54aa640 1 --2- 172.21.15.19:0/1651714627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19d00b21c0 0x7f19d00c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:16.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d54aa640 1 -- 172.21.15.19:0/1651714627 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19cc0094d0 con 0x7f19d015ca50 2023-11-20T06:42:16.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d64ac640 1 --2- 172.21.15.19:0/1651714627 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19d015ce30 0x7f19d00c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:16.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d54aa640 1 --2- 172.21.15.19:0/1651714627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d015ca50 0x7f19d0153760 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f19c000c7c0 tx=0x7f19c000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:16.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19c67fc640 1 -- 172.21.15.19:0/1651714627 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c0007a30 con 0x7f19d015ca50 2023-11-20T06:42:16.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19c67fc640 1 -- 172.21.15.19:0/1651714627 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c0007b90 con 0x7f19d015ca50 2023-11-20T06:42:16.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19c67fc640 1 -- 172.21.15.19:0/1651714627 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c000ce70 con 0x7f19d015ca50 2023-11-20T06:42:16.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d7f0f640 1 -- 172.21.15.19:0/1651714627 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d00c87b0 con 0x7f19d015ca50 2023-11-20T06:42:16.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d7f0f640 1 -- 172.21.15.19:0/1651714627 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d00c97d0 con 0x7f19d015ca50 2023-11-20T06:42:16.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.863+0000 7f19d7f0f640 1 -- 172.21.15.19:0/1651714627 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d00c8fb0 con 0x7f19d015ca50 2023-11-20T06:42:16.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.867+0000 7f19c67fc640 1 -- 172.21.15.19:0/1651714627 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f19c00113f0 con 0x7f19d015ca50 2023-11-20T06:42:16.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.867+0000 7f19c67fc640 1 --2- 172.21.15.19:0/1651714627 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f19b40664a0 0x7f19b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:16.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.867+0000 7f19c67fc640 1 -- 172.21.15.19:0/1651714627 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f19c0084670 con 0x7f19d015ca50 2023-11-20T06:42:16.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.867+0000 7f19d5cab640 1 --2- 172.21.15.19:0/1651714627 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f19b40664a0 0x7f19b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:16.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.867+0000 7f19d5cab640 1 --2- 172.21.15.19:0/1651714627 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f19b40664a0 0x7f19b4068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0ae000 tx=0x7f19cc0b5040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:16.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:16.871+0000 7f19c67fc640 1 -- 172.21.15.19:0/1651714627 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f19d00c8fb0 con 0x7f19d015ca50 2023-11-20T06:42:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.027+0000 7f19d7f0f640 1 -- 172.21.15.19:0/1651714627 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19d00c8fb0 con 0x7f19d015ca50 2023-11-20T06:42:17.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.027+0000 7f19c67fc640 1 -- 172.21.15.19:0/1651714627 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18720 (secure 0 0 0) 0x7f19d00c8fb0 con 0x7f19d015ca50 2023-11-20T06:42:17.034 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:17.034 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:55.472006+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:17.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.031+0000 7f19d7f0f640 1 -- 172.21.15.19:0/1651714627 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f19b40664a0 msgr2=0x7f19b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:17.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.031+0000 7f19d7f0f640 1 --2- 172.21.15.19:0/1651714627 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f19b40664a0 0x7f19b4068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0ae000 tx=0x7f19cc0b5040 comp rx=0 tx=0).stop 2023-11-20T06:42:17.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.031+0000 7f19d7f0f640 1 -- 172.21.15.19:0/1651714627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d015ca50 msgr2=0x7f19d0153760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:17.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.031+0000 7f19d7f0f640 1 --2- 172.21.15.19:0/1651714627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d015ca50 0x7f19d0153760 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f19c000c7c0 tx=0x7f19c000cc80 comp rx=0 tx=0).stop 2023-11-20T06:42:17.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.031+0000 7f19d7f0f640 1 -- 172.21.15.19:0/1651714627 shutdown_connections 2023-11-20T06:42:17.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.031+0000 7f19d7f0f640 1 --2- 172.21.15.19:0/1651714627 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f19b40664a0 0x7f19b4068960 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.031+0000 7f19d7f0f640 1 --2- 172.21.15.19:0/1651714627 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19d015ce30 0x7f19d00c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.031+0000 7f19d7f0f640 1 --2- 172.21.15.19:0/1651714627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d015ca50 0x7f19d0153760 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.031+0000 7f19d7f0f640 1 --2- 172.21.15.19:0/1651714627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19d00b21c0 0x7f19d00c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.031+0000 7f19d7f0f640 1 -- 172.21.15.19:0/1651714627 >> 172.21.15.19:0/1651714627 conn(0x7f19d00cd1c0 msgr2=0x7f19d00b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:17.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.031+0000 7f19d7f0f640 1 -- 172.21.15.19:0/1651714627 shutdown_connections 2023-11-20T06:42:17.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.031+0000 7f19d7f0f640 1 -- 172.21.15.19:0/1651714627 wait complete. 2023-11-20T06:42:17.056 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T06:41:11.805111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T06:41:12.614034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T06:41:16.311206+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T06:42:17.056 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:42:17.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.199+0000 7fd1d5ff2640 1 Processor -- start 2023-11-20T06:42:17.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.199+0000 7fd1d5ff2640 1 -- start start 2023-11-20T06:42:17.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.199+0000 7fd1d5ff2640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd1d00cd910 0x7fd1d00d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:17.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.199+0000 7fd1d5ff2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd1d00d2b80 0x7fd1d006ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:17.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.199+0000 7fd1d5ff2640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d015ce60 con 0x7fd1d015ca80 2023-11-20T06:42:17.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.199+0000 7fd1d5ff2640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d006b310 con 0x7fd1d00d2b80 2023-11-20T06:42:17.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.199+0000 7fd1d5ff2640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d006b5f0 con 0x7fd1d00cd910 2023-11-20T06:42:17.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.199+0000 7fd1d57f1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd1d00d2b80 0x7fd1d006ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:17.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.199+0000 7fd1d57f1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd1d00d2b80 0x7fd1d006ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51044/0 (socket says 172.21.15.19:51044) 2023-11-20T06:42:17.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.199+0000 7fd1d57f1640 1 -- 172.21.15.19:0/1876846996 learned_addr learned my addr 172.21.15.19:0/1876846996 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:17.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.199+0000 7fd1cffff640 1 --2- 172.21.15.19:0/1876846996 >> v2:172.21.15.190:3300/0 conn(0x7fd1d00cd910 0x7fd1d00d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:17.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.199+0000 7fd1d57f1640 1 -- 172.21.15.19:0/1876846996 >> v2:172.21.15.190:3300/0 conn(0x7fd1d00cd910 msgr2=0x7fd1d00d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:17.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.199+0000 7fd1d57f1640 1 --2- 172.21.15.19:0/1876846996 >> v2:172.21.15.190:3300/0 conn(0x7fd1d00cd910 0x7fd1d00d2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.199+0000 7fd1d57f1640 1 -- 172.21.15.19:0/1876846996 >> v1:172.21.15.190:6789/0 conn(0x7fd1d015ca80 legacy=0x7fd1d00cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:17.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.199+0000 7fd1d57f1640 1 -- 172.21.15.19:0/1876846996 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d00cf160 con 0x7fd1d00d2b80 2023-11-20T06:42:17.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.203+0000 7fd1d57f1640 1 --2- 172.21.15.19:0/1876846996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d00d2b80 0x7fd1d006ba80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00d02b0 tx=0x7fd1c801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89310c41c19ef2c server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:17.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.203+0000 7fd1cf7fe640 1 -- 172.21.15.19:0/1876846996 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80a5800 con 0x7fd1d00d2b80 2023-11-20T06:42:17.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.203+0000 7fd1cf7fe640 1 -- 172.21.15.19:0/1876846996 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c80a5960 con 0x7fd1d00d2b80 2023-11-20T06:42:17.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.203+0000 7fd1cf7fe640 1 -- 172.21.15.19:0/1876846996 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80a5cf0 con 0x7fd1d00d2b80 2023-11-20T06:42:17.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.203+0000 7fd1d5ff2640 1 -- 172.21.15.19:0/1876846996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d00d2b80 msgr2=0x7fd1d006ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:17.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.203+0000 7fd1d5ff2640 1 --2- 172.21.15.19:0/1876846996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d00d2b80 0x7fd1d006ba80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00d02b0 tx=0x7fd1c801c940 comp rx=0 tx=0).stop 2023-11-20T06:42:17.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.203+0000 7fd1d5ff2640 1 -- 172.21.15.19:0/1876846996 shutdown_connections 2023-11-20T06:42:17.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.203+0000 7fd1d5ff2640 1 --2- 172.21.15.19:0/1876846996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d00d2b80 0x7fd1d006ba80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.203+0000 7fd1d5ff2640 1 --2- 172.21.15.19:0/1876846996 >> v2:172.21.15.190:3300/0 conn(0x7fd1d00cd910 0x7fd1d00d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.203+0000 7fd1d5ff2640 1 -- 172.21.15.19:0/1876846996 >> 172.21.15.19:0/1876846996 conn(0x7fd1d008c230 msgr2=0x7fd1d009bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:17.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.203+0000 7fd1d5ff2640 1 -- 172.21.15.19:0/1876846996 shutdown_connections 2023-11-20T06:42:17.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.203+0000 7fd1d5ff2640 1 -- 172.21.15.19:0/1876846996 wait complete. 2023-11-20T06:42:17.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.203+0000 7fd1d5ff2640 1 Processor -- start 2023-11-20T06:42:17.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.203+0000 7fd1d5ff2640 1 -- start start 2023-11-20T06:42:17.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1d5ff2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1d00cd910 0x7fd1d015ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:17.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1d5ff2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d00d2b80 0x7fd1d0154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:17.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1d5ff2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d015ca80 0x7fd1d00c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:17.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1d5ff2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d0156190 con 0x7fd1d015ca80 2023-11-20T06:42:17.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1d5ff2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d0155580 con 0x7fd1d00cd910 2023-11-20T06:42:17.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1d5ff2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d0155860 con 0x7fd1d00d2b80 2023-11-20T06:42:17.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1d57f1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d015ca80 0x7fd1d00c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:17.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1d57f1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d015ca80 0x7fd1d00c6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51056/0 (socket says 172.21.15.19:51056) 2023-11-20T06:42:17.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1d57f1640 1 -- 172.21.15.19:0/1218282548 learned_addr learned my addr 172.21.15.19:0/1218282548 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:17.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1cffff640 1 --2- 172.21.15.19:0/1218282548 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d00d2b80 0x7fd1d0154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:17.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1d4ff0640 1 --2- 172.21.15.19:0/1218282548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1d00cd910 0x7fd1d015ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:17.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1d57f1640 1 -- 172.21.15.19:0/1218282548 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d00d2b80 msgr2=0x7fd1d0154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:17.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1d57f1640 1 --2- 172.21.15.19:0/1218282548 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d00d2b80 0x7fd1d0154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1d57f1640 1 -- 172.21.15.19:0/1218282548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1d00cd910 msgr2=0x7fd1d015ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:17.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1d57f1640 1 --2- 172.21.15.19:0/1218282548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1d00cd910 0x7fd1d015ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1d57f1640 1 -- 172.21.15.19:0/1218282548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c8009b30 con 0x7fd1d015ca80 2023-11-20T06:42:17.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1d57f1640 1 --2- 172.21.15.19:0/1218282548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d015ca80 0x7fd1d00c6ed0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd1c80af040 tx=0x7fd1c80196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:17.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1cd7fa640 1 -- 172.21.15.19:0/1218282548 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80b8670 con 0x7fd1d015ca80 2023-11-20T06:42:17.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1cd7fa640 1 -- 172.21.15.19:0/1218282548 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c80b87f0 con 0x7fd1d015ca80 2023-11-20T06:42:17.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1d5ff2640 1 -- 172.21.15.19:0/1218282548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d0155b40 con 0x7fd1d015ca80 2023-11-20T06:42:17.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1cd7fa640 1 -- 172.21.15.19:0/1218282548 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80b8ba0 con 0x7fd1d015ca80 2023-11-20T06:42:17.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1d5ff2640 1 -- 172.21.15.19:0/1218282548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d015f120 con 0x7fd1d015ca80 2023-11-20T06:42:17.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.207+0000 7fd1d5ff2640 1 -- 172.21.15.19:0/1218282548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d0156340 con 0x7fd1d015ca80 2023-11-20T06:42:17.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.211+0000 7fd1cd7fa640 1 -- 172.21.15.19:0/1218282548 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd1c80b8d00 con 0x7fd1d015ca80 2023-11-20T06:42:17.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.211+0000 7fd1cd7fa640 1 --2- 172.21.15.19:0/1218282548 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd1b40664d0 0x7fd1b4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:17.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.211+0000 7fd1cd7fa640 1 -- 172.21.15.19:0/1218282548 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd1c811f680 con 0x7fd1d015ca80 2023-11-20T06:42:17.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.211+0000 7fd1d4ff0640 1 --2- 172.21.15.19:0/1218282548 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd1b40664d0 0x7fd1b4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:17.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.211+0000 7fd1d4ff0640 1 --2- 172.21.15.19:0/1218282548 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd1b40664d0 0x7fd1b4068990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4000fc0 tx=0x7fd1c4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:17.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.215+0000 7fd1cd7fa640 1 -- 172.21.15.19:0/1218282548 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd1d0156340 con 0x7fd1d015ca80 2023-11-20T06:42:17.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.375+0000 7fd1d5ff2640 1 -- 172.21.15.19:0/1218282548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd1d0155ff0 con 0x7fd1d015ca80 2023-11-20T06:42:17.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.375+0000 7fd1cd7fa640 1 -- 172.21.15.19:0/1218282548 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd1d0155ff0 con 0x7fd1d015ca80 2023-11-20T06:42:17.380 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:42:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.375+0000 7fd1d5ff2640 1 -- 172.21.15.19:0/1218282548 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd1b40664d0 msgr2=0x7fd1b4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.375+0000 7fd1d5ff2640 1 --2- 172.21.15.19:0/1218282548 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd1b40664d0 0x7fd1b4068990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4000fc0 tx=0x7fd1c4009040 comp rx=0 tx=0).stop 2023-11-20T06:42:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.375+0000 7fd1d5ff2640 1 -- 172.21.15.19:0/1218282548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d015ca80 msgr2=0x7fd1d00c6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.375+0000 7fd1d5ff2640 1 --2- 172.21.15.19:0/1218282548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d015ca80 0x7fd1d00c6ed0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd1c80af040 tx=0x7fd1c80196e0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.375+0000 7fd1d5ff2640 1 -- 172.21.15.19:0/1218282548 shutdown_connections 2023-11-20T06:42:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.375+0000 7fd1d5ff2640 1 --2- 172.21.15.19:0/1218282548 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd1b40664d0 0x7fd1b4068990 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.375+0000 7fd1d5ff2640 1 --2- 172.21.15.19:0/1218282548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d015ca80 0x7fd1d00c6ed0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.375+0000 7fd1d5ff2640 1 --2- 172.21.15.19:0/1218282548 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d00d2b80 0x7fd1d0154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.375+0000 7fd1d5ff2640 1 --2- 172.21.15.19:0/1218282548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1d00cd910 0x7fd1d015ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.375+0000 7fd1d5ff2640 1 -- 172.21.15.19:0/1218282548 >> 172.21.15.19:0/1218282548 conn(0x7fd1d008c230 msgr2=0x7fd1d015f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:17.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.375+0000 7fd1d5ff2640 1 -- 172.21.15.19:0/1218282548 shutdown_connections 2023-11-20T06:42:17.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.375+0000 7fd1d5ff2640 1 -- 172.21.15.19:0/1218282548 wait complete. 2023-11-20T06:42:17.402 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T06:42:17.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.543+0000 7f61aeb1d640 1 Processor -- start 2023-11-20T06:42:17.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.543+0000 7f61aeb1d640 1 -- start start 2023-11-20T06:42:17.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.547+0000 7f61aeb1d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61a8159900 0x7f61a806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:17.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.547+0000 7f61aeb1d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f61a806a5a0 0x7f61a80c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:17.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.547+0000 7f61aeb1d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a80b4360 con 0x7f61a80b3f00 2023-11-20T06:42:17.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.547+0000 7f61aeb1d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a80cd740 con 0x7f61a806a5a0 2023-11-20T06:42:17.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.547+0000 7f61aeb1d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a80b4600 con 0x7f61a8159900 2023-11-20T06:42:17.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.547+0000 7f61ac8b9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61a8159900 0x7f61a806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:17.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.547+0000 7f61ac8b9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61a8159900 0x7f61a806e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:49710/0 (socket says 172.21.15.19:49710) 2023-11-20T06:42:17.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.547+0000 7f61ac8b9640 1 -- 172.21.15.19:0/3510998259 learned_addr learned my addr 172.21.15.19:0/3510998259 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:17.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.547+0000 7f61ad0ba640 1 --2- 172.21.15.19:0/3510998259 >> v2:172.21.15.190:3300/0 conn(0x7f61a806a5a0 0x7f61a80c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:17.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.547+0000 7f61ac8b9640 1 -- 172.21.15.19:0/3510998259 >> v2:172.21.15.190:3300/0 conn(0x7f61a806a5a0 msgr2=0x7f61a80c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:17.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.547+0000 7f61ac8b9640 1 --2- 172.21.15.19:0/3510998259 >> v2:172.21.15.190:3300/0 conn(0x7f61a806a5a0 0x7f61a80c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.547+0000 7f61ac8b9640 1 -- 172.21.15.19:0/3510998259 >> v1:172.21.15.190:6789/0 conn(0x7f61a80b3f00 legacy=0x7f61a8069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:17.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.547+0000 7f61ac8b9640 1 -- 172.21.15.19:0/3510998259 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a80c8dd0 con 0x7f61a8159900 2023-11-20T06:42:17.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.547+0000 7f61a77fe640 1 -- 172.21.15.19:0/3510998259 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416795755 0 0) 0x7f61a80b4360 con 0x7f61a80b3f00 2023-11-20T06:42:17.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.547+0000 7f61ad0ba640 1 --2- 172.21.15.19:0/3510998259 >> v2:172.21.15.190:3300/0 conn(0x7f61a806a5a0 0x7f61a80c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:42:17.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.551+0000 7f61ac8b9640 1 --2- 172.21.15.19:0/3510998259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61a8159900 0x7f61a806e260 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f619c00bb10 tx=0x7f619c01ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f82be4ae32dc16e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:17.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.551+0000 7f61a77fe640 1 -- 172.21.15.19:0/3510998259 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c0a7cb0 con 0x7f61a8159900 2023-11-20T06:42:17.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.551+0000 7f61a77fe640 1 -- 172.21.15.19:0/3510998259 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619c0a7e10 con 0x7f61a8159900 2023-11-20T06:42:17.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.551+0000 7f61a77fe640 1 -- 172.21.15.19:0/3510998259 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c0af660 con 0x7f61a8159900 2023-11-20T06:42:17.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.551+0000 7f61aeb1d640 1 -- 172.21.15.19:0/3510998259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61a8159900 msgr2=0x7f61a806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:17.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.551+0000 7f61aeb1d640 1 --2- 172.21.15.19:0/3510998259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61a8159900 0x7f61a806e260 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f619c00bb10 tx=0x7f619c01ebe0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.551+0000 7f61aeb1d640 1 -- 172.21.15.19:0/3510998259 shutdown_connections 2023-11-20T06:42:17.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.551+0000 7f61aeb1d640 1 --2- 172.21.15.19:0/3510998259 >> v2:172.21.15.190:3300/0 conn(0x7f61a806a5a0 0x7f61a80c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.551+0000 7f61aeb1d640 1 --2- 172.21.15.19:0/3510998259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61a8159900 0x7f61a806e260 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.551+0000 7f61aeb1d640 1 -- 172.21.15.19:0/3510998259 >> 172.21.15.19:0/3510998259 conn(0x7f61a80b0da0 msgr2=0x7f61a80ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:17.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.551+0000 7f61aeb1d640 1 -- 172.21.15.19:0/3510998259 shutdown_connections 2023-11-20T06:42:17.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.551+0000 7f61aeb1d640 1 -- 172.21.15.19:0/3510998259 wait complete. 2023-11-20T06:42:17.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.551+0000 7f61aeb1d640 1 Processor -- start 2023-11-20T06:42:17.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.551+0000 7f61aeb1d640 1 -- start start 2023-11-20T06:42:17.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61aeb1d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61a806a5a0 0x7f61a8156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:17.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61aeb1d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a80b3f00 0x7f61a8151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:17.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61aeb1d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61a8159900 0x7f61a81514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:17.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61aeb1d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a8149490 con 0x7f61a80b3f00 2023-11-20T06:42:17.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61aeb1d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a80accc0 con 0x7f61a8159900 2023-11-20T06:42:17.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61aeb1d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a80aced0 con 0x7f61a806a5a0 2023-11-20T06:42:17.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61a7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a80b3f00 0x7f61a8151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:17.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61a7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a80b3f00 0x7f61a8151d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51064/0 (socket says 172.21.15.19:51064) 2023-11-20T06:42:17.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61a7fff640 1 -- 172.21.15.19:0/3116170053 learned_addr learned my addr 172.21.15.19:0/3116170053 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:17.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61ac8b9640 1 --2- 172.21.15.19:0/3116170053 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61a806a5a0 0x7f61a8156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:17.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61ad0ba640 1 --2- 172.21.15.19:0/3116170053 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61a8159900 0x7f61a81514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:17.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61ac8b9640 1 -- 172.21.15.19:0/3116170053 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61a8159900 msgr2=0x7f61a81514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:17.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61ac8b9640 1 --2- 172.21.15.19:0/3116170053 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61a8159900 0x7f61a81514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61ac8b9640 1 -- 172.21.15.19:0/3116170053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a80b3f00 msgr2=0x7f61a8151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:17.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61ac8b9640 1 --2- 172.21.15.19:0/3116170053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a80b3f00 0x7f61a8151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61ac8b9640 1 -- 172.21.15.19:0/3116170053 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a0009a70 con 0x7f61a806a5a0 2023-11-20T06:42:17.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61a7fff640 1 --2- 172.21.15.19:0/3116170053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a80b3f00 0x7f61a8151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:42:17.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61ac8b9640 1 --2- 172.21.15.19:0/3116170053 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61a806a5a0 0x7f61a8156c00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f619c0ae000 tx=0x7f619c01d420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:17.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61a57fa640 1 -- 172.21.15.19:0/3116170053 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c0be070 con 0x7f61a806a5a0 2023-11-20T06:42:17.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61a57fa640 1 -- 172.21.15.19:0/3116170053 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619c0afbf0 con 0x7f61a806a5a0 2023-11-20T06:42:17.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61a57fa640 1 -- 172.21.15.19:0/3116170053 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c0ba480 con 0x7f61a806a5a0 2023-11-20T06:42:17.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61aeb1d640 1 -- 172.21.15.19:0/3116170053 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619c00b770 con 0x7f61a806a5a0 2023-11-20T06:42:17.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61aeb1d640 1 -- 172.21.15.19:0/3116170053 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a81f8190 con 0x7f61a806a5a0 2023-11-20T06:42:17.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.555+0000 7f61aeb1d640 1 -- 172.21.15.19:0/3116170053 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a804e170 con 0x7f61a806a5a0 2023-11-20T06:42:17.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.559+0000 7f61a57fa640 1 -- 172.21.15.19:0/3116170053 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f619c0c3410 con 0x7f61a806a5a0 2023-11-20T06:42:17.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.559+0000 7f61a57fa640 1 --2- 172.21.15.19:0/3116170053 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f618c0664a0 0x7f618c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:17.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.559+0000 7f61a57fa640 1 -- 172.21.15.19:0/3116170053 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f619c11f4b0 con 0x7f61a806a5a0 2023-11-20T06:42:17.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.559+0000 7f61a7fff640 1 --2- 172.21.15.19:0/3116170053 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f618c0664a0 0x7f618c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:17.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.559+0000 7f61a7fff640 1 --2- 172.21.15.19:0/3116170053 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f618c0664a0 0x7f618c068960 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f61a81f80f0 tx=0x7f6194009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:17.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.563+0000 7f61a57fa640 1 -- 172.21.15.19:0/3116170053 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f619c0ec5e0 con 0x7f61a806a5a0 2023-11-20T06:42:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.723+0000 7f61aeb1d640 1 -- 172.21.15.19:0/3116170053 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61a80ad010 con 0x7f61a806a5a0 2023-11-20T06:42:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.723+0000 7f61a57fa640 1 -- 172.21.15.19:0/3116170053 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f61a80ad010 con 0x7f61a806a5a0 2023-11-20T06:42:17.728 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:17.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.723+0000 7f61aeb1d640 1 -- 172.21.15.19:0/3116170053 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f618c0664a0 msgr2=0x7f618c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:17.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.723+0000 7f61aeb1d640 1 --2- 172.21.15.19:0/3116170053 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f618c0664a0 0x7f618c068960 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f61a81f80f0 tx=0x7f6194009040 comp rx=0 tx=0).stop 2023-11-20T06:42:17.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.723+0000 7f61aeb1d640 1 -- 172.21.15.19:0/3116170053 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61a806a5a0 msgr2=0x7f61a8156c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:17.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.723+0000 7f61aeb1d640 1 --2- 172.21.15.19:0/3116170053 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61a806a5a0 0x7f61a8156c00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f619c0ae000 tx=0x7f619c01d420 comp rx=0 tx=0).stop 2023-11-20T06:42:17.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.723+0000 7f61aeb1d640 1 -- 172.21.15.19:0/3116170053 shutdown_connections 2023-11-20T06:42:17.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.723+0000 7f61aeb1d640 1 --2- 172.21.15.19:0/3116170053 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f618c0664a0 0x7f618c068960 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.723+0000 7f61aeb1d640 1 --2- 172.21.15.19:0/3116170053 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61a8159900 0x7f61a81514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.723+0000 7f61aeb1d640 1 --2- 172.21.15.19:0/3116170053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a80b3f00 0x7f61a8151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.723+0000 7f61aeb1d640 1 --2- 172.21.15.19:0/3116170053 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61a806a5a0 0x7f61a8156c00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.723+0000 7f61aeb1d640 1 -- 172.21.15.19:0/3116170053 >> 172.21.15.19:0/3116170053 conn(0x7f61a80b0da0 msgr2=0x7f61a8070a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:17.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.723+0000 7f61aeb1d640 1 -- 172.21.15.19:0/3116170053 shutdown_connections 2023-11-20T06:42:17.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.723+0000 7f61aeb1d640 1 -- 172.21.15.19:0/3116170053 wait complete. 2023-11-20T06:42:17.750 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T06:42:17.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.891+0000 7f2a73b1d640 1 Processor -- start 2023-11-20T06:42:17.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.891+0000 7f2a73b1d640 1 -- start start 2023-11-20T06:42:17.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.891+0000 7f2a73b1d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2a6c06a5a0 0x7f2a6c06e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:17.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.891+0000 7f2a73b1d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a6c0b3f00 0x7f2a6c0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:17.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.891+0000 7f2a73b1d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a6c0b4370 con 0x7f2a6c159900 2023-11-20T06:42:17.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.891+0000 7f2a73b1d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6c0cd740 con 0x7f2a6c06a5a0 2023-11-20T06:42:17.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.891+0000 7f2a73b1d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c0b4600 con 0x7f2a6c0b3f00 2023-11-20T06:42:17.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.891+0000 7f2a710b8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2a6c06a5a0 0x7f2a6c06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:17.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.891+0000 7f2a710b8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2a6c06a5a0 0x7f2a6c06e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51078/0 (socket says 172.21.15.19:51078) 2023-11-20T06:42:17.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.891+0000 7f2a710b8640 1 -- 172.21.15.19:0/3689128896 learned_addr learned my addr 172.21.15.19:0/3689128896 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:17.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.891+0000 7f2a720ba640 1 --2- 172.21.15.19:0/3689128896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a6c0b3f00 0x7f2a6c0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:17.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.891+0000 7f2a710b8640 1 -- 172.21.15.19:0/3689128896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a6c0b3f00 msgr2=0x7f2a6c0c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:17.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.891+0000 7f2a710b8640 1 --2- 172.21.15.19:0/3689128896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a6c0b3f00 0x7f2a6c0c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.891+0000 7f2a710b8640 1 -- 172.21.15.19:0/3689128896 >> v1:172.21.15.190:6789/0 conn(0x7f2a6c159900 legacy=0x7f2a6c069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:17.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.891+0000 7f2a710b8640 1 -- 172.21.15.19:0/3689128896 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6c0c8dd0 con 0x7f2a6c06a5a0 2023-11-20T06:42:17.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.895+0000 7f2a710b8640 1 --2- 172.21.15.19:0/3689128896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a6c06a5a0 0x7f2a6c06e260 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009870 tx=0x7f2a5c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70083f519acabd38 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:17.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.895+0000 7f2a708b7640 1 -- 172.21.15.19:0/3689128896 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c0aa670 con 0x7f2a6c06a5a0 2023-11-20T06:42:17.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.895+0000 7f2a708b7640 1 -- 172.21.15.19:0/3689128896 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c0aa7d0 con 0x7f2a6c06a5a0 2023-11-20T06:42:17.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.895+0000 7f2a708b7640 1 -- 172.21.15.19:0/3689128896 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c0aab60 con 0x7f2a6c06a5a0 2023-11-20T06:42:17.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.895+0000 7f2a73b1d640 1 -- 172.21.15.19:0/3689128896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a6c06a5a0 msgr2=0x7f2a6c06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:17.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.895+0000 7f2a73b1d640 1 --2- 172.21.15.19:0/3689128896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a6c06a5a0 0x7f2a6c06e260 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009870 tx=0x7f2a5c01c510 comp rx=0 tx=0).stop 2023-11-20T06:42:17.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.895+0000 7f2a73b1d640 1 -- 172.21.15.19:0/3689128896 shutdown_connections 2023-11-20T06:42:17.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.895+0000 7f2a73b1d640 1 --2- 172.21.15.19:0/3689128896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a6c0b3f00 0x7f2a6c0c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.895+0000 7f2a73b1d640 1 --2- 172.21.15.19:0/3689128896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a6c06a5a0 0x7f2a6c06e260 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.895+0000 7f2a73b1d640 1 -- 172.21.15.19:0/3689128896 >> 172.21.15.19:0/3689128896 conn(0x7f2a6c0b0da0 msgr2=0x7f2a6c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:17.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.895+0000 7f2a73b1d640 1 -- 172.21.15.19:0/3689128896 shutdown_connections 2023-11-20T06:42:17.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.895+0000 7f2a73b1d640 1 -- 172.21.15.19:0/3689128896 wait complete. 2023-11-20T06:42:17.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.895+0000 7f2a73b1d640 1 Processor -- start 2023-11-20T06:42:17.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a73b1d640 1 -- start start 2023-11-20T06:42:17.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a73b1d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a6c06a5a0 0x7f2a6c14bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:17.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a73b1d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a6c0b3f00 0x7f2a6c14eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:17.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a73b1d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a6c159900 0x7f2a6c15a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:17.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a73b1d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c14e690 con 0x7f2a6c06a5a0 2023-11-20T06:42:17.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a73b1d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c14da80 con 0x7f2a6c159900 2023-11-20T06:42:17.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a73b1d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c14dd60 con 0x7f2a6c0b3f00 2023-11-20T06:42:17.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a718b9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a6c06a5a0 0x7f2a6c14bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:17.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a718b9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a6c06a5a0 0x7f2a6c14bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51088/0 (socket says 172.21.15.19:51088) 2023-11-20T06:42:17.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a718b9640 1 -- 172.21.15.19:0/29685449 learned_addr learned my addr 172.21.15.19:0/29685449 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:17.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a710b8640 1 --2- 172.21.15.19:0/29685449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a6c0b3f00 0x7f2a6c14eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:17.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a720ba640 1 --2- 172.21.15.19:0/29685449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a6c159900 0x7f2a6c15a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:17.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a718b9640 1 -- 172.21.15.19:0/29685449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a6c0b3f00 msgr2=0x7f2a6c14eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:17.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a718b9640 1 --2- 172.21.15.19:0/29685449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a6c0b3f00 0x7f2a6c14eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a718b9640 1 -- 172.21.15.19:0/29685449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a6c159900 msgr2=0x7f2a6c15a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:17.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a718b9640 1 --2- 172.21.15.19:0/29685449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a6c159900 0x7f2a6c15a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:17.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a718b9640 1 -- 172.21.15.19:0/29685449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c0094d0 con 0x7f2a6c06a5a0 2023-11-20T06:42:17.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a718b9640 1 --2- 172.21.15.19:0/29685449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a6c06a5a0 0x7f2a6c14bce0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800c3c0 tx=0x7f2a6800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:17.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a627fc640 1 -- 172.21.15.19:0/29685449 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a680052d0 con 0x7f2a6c06a5a0 2023-11-20T06:42:17.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a627fc640 1 -- 172.21.15.19:0/29685449 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a68005430 con 0x7f2a6c06a5a0 2023-11-20T06:42:17.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a627fc640 1 -- 172.21.15.19:0/29685449 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a68003840 con 0x7f2a6c06a5a0 2023-11-20T06:42:17.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a73b1d640 1 -- 172.21.15.19:0/29685449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6c14e040 con 0x7f2a6c06a5a0 2023-11-20T06:42:17.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a73b1d640 1 -- 172.21.15.19:0/29685449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6c14c220 con 0x7f2a6c06a5a0 2023-11-20T06:42:17.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.899+0000 7f2a73b1d640 1 -- 172.21.15.19:0/29685449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a6c04e170 con 0x7f2a6c06a5a0 2023-11-20T06:42:17.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.903+0000 7f2a627fc640 1 -- 172.21.15.19:0/29685449 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2a680039a0 con 0x7f2a6c06a5a0 2023-11-20T06:42:17.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.903+0000 7f2a627fc640 1 --2- 172.21.15.19:0/29685449 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2a500664a0 0x7f2a50068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:17.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.903+0000 7f2a627fc640 1 -- 172.21.15.19:0/29685449 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2a68083750 con 0x7f2a6c06a5a0 2023-11-20T06:42:17.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.903+0000 7f2a710b8640 1 --2- 172.21.15.19:0/29685449 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2a500664a0 0x7f2a50068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:17.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.903+0000 7f2a710b8640 1 --2- 172.21.15.19:0/29685449 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2a500664a0 0x7f2a50068960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0ae000 tx=0x7f2a5c0b5040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:17.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:17.907+0000 7f2a627fc640 1 -- 172.21.15.19:0/29685449 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2a68050820 con 0x7f2a6c06a5a0 2023-11-20T06:42:18.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.063+0000 7f2a73b1d640 1 -- 172.21.15.19:0/29685449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2a6c0cec50 con 0x7f2a6c06a5a0 2023-11-20T06:42:18.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.063+0000 7f2a627fc640 1 -- 172.21.15.19:0/29685449 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2a68053e40 con 0x7f2a6c06a5a0 2023-11-20T06:42:18.070 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-20T06:42:18.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.067+0000 7f2a73b1d640 1 -- 172.21.15.19:0/29685449 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2a500664a0 msgr2=0x7f2a50068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:18.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.067+0000 7f2a73b1d640 1 --2- 172.21.15.19:0/29685449 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2a500664a0 0x7f2a50068960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0ae000 tx=0x7f2a5c0b5040 comp rx=0 tx=0).stop 2023-11-20T06:42:18.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.067+0000 7f2a73b1d640 1 -- 172.21.15.19:0/29685449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a6c06a5a0 msgr2=0x7f2a6c14bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:18.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.067+0000 7f2a73b1d640 1 --2- 172.21.15.19:0/29685449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a6c06a5a0 0x7f2a6c14bce0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800c3c0 tx=0x7f2a6800c880 comp rx=0 tx=0).stop 2023-11-20T06:42:18.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.067+0000 7f2a73b1d640 1 -- 172.21.15.19:0/29685449 shutdown_connections 2023-11-20T06:42:18.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.067+0000 7f2a73b1d640 1 --2- 172.21.15.19:0/29685449 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2a500664a0 0x7f2a50068960 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.067+0000 7f2a73b1d640 1 --2- 172.21.15.19:0/29685449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a6c159900 0x7f2a6c15a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.067+0000 7f2a73b1d640 1 --2- 172.21.15.19:0/29685449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a6c0b3f00 0x7f2a6c14eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.067+0000 7f2a73b1d640 1 --2- 172.21.15.19:0/29685449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a6c06a5a0 0x7f2a6c14bce0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.067+0000 7f2a73b1d640 1 -- 172.21.15.19:0/29685449 >> 172.21.15.19:0/29685449 conn(0x7f2a6c0b0da0 msgr2=0x7f2a6c072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:18.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.067+0000 7f2a73b1d640 1 -- 172.21.15.19:0/29685449 shutdown_connections 2023-11-20T06:42:18.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.067+0000 7f2a73b1d640 1 -- 172.21.15.19:0/29685449 wait complete. 2023-11-20T06:42:18.091 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T06:42:18.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.231+0000 7f60f1d3e640 1 Processor -- start 2023-11-20T06:42:18.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.231+0000 7f60f1d3e640 1 -- start start 2023-11-20T06:42:18.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.231+0000 7f60f1d3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60ec159900 0x7f60ec06e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:18.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.231+0000 7f60f1d3e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f60ec06a5a0 0x7f60ec0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:18.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.231+0000 7f60f1d3e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60ec0b4360 con 0x7f60ec0b3f00 2023-11-20T06:42:18.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.231+0000 7f60f1d3e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ec0cd740 con 0x7f60ec06a5a0 2023-11-20T06:42:18.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.231+0000 7f60f1d3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec0b4600 con 0x7f60ec159900 2023-11-20T06:42:18.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.231+0000 7f60ebfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f60ec06a5a0 0x7f60ec0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:18.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.231+0000 7f60ebfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f60ec06a5a0 0x7f60ec0c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51090/0 (socket says 172.21.15.19:51090) 2023-11-20T06:42:18.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.231+0000 7f60ebfff640 1 -- 172.21.15.19:0/3890184308 learned_addr learned my addr 172.21.15.19:0/3890184308 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:18.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.231+0000 7f60eb7fe640 1 --2- 172.21.15.19:0/3890184308 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60ec159900 0x7f60ec06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:18.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.231+0000 7f60ebfff640 1 -- 172.21.15.19:0/3890184308 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60ec159900 msgr2=0x7f60ec06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:18.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.231+0000 7f60ebfff640 1 --2- 172.21.15.19:0/3890184308 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60ec159900 0x7f60ec06e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.231+0000 7f60ebfff640 1 -- 172.21.15.19:0/3890184308 >> v1:172.21.15.190:6789/0 conn(0x7f60ec0b3f00 legacy=0x7f60ec069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:18.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.231+0000 7f60ea7fc640 1 -- 172.21.15.19:0/3890184308 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430908042 0 0) 0x7f60ec0b4360 con 0x7f60ec0b3f00 2023-11-20T06:42:18.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.231+0000 7f60ebfff640 1 -- 172.21.15.19:0/3890184308 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec0c8dd0 con 0x7f60ec06a5a0 2023-11-20T06:42:18.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.235+0000 7f60ebfff640 1 --2- 172.21.15.19:0/3890184308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ec06a5a0 0x7f60ec0c9b90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009e50 tx=0x7f60e401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b24c6236a3fa20 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:18.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.235+0000 7f60ea7fc640 1 -- 172.21.15.19:0/3890184308 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e40a58a0 con 0x7f60ec06a5a0 2023-11-20T06:42:18.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.235+0000 7f60ea7fc640 1 -- 172.21.15.19:0/3890184308 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e40a5a00 con 0x7f60ec06a5a0 2023-11-20T06:42:18.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.235+0000 7f60ea7fc640 1 -- 172.21.15.19:0/3890184308 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e40a5d90 con 0x7f60ec06a5a0 2023-11-20T06:42:18.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.235+0000 7f60f1d3e640 1 -- 172.21.15.19:0/3890184308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ec06a5a0 msgr2=0x7f60ec0c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:18.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.235+0000 7f60f1d3e640 1 --2- 172.21.15.19:0/3890184308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ec06a5a0 0x7f60ec0c9b90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009e50 tx=0x7f60e401c9e0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.235+0000 7f60f1d3e640 1 -- 172.21.15.19:0/3890184308 shutdown_connections 2023-11-20T06:42:18.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.235+0000 7f60f1d3e640 1 --2- 172.21.15.19:0/3890184308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ec06a5a0 0x7f60ec0c9b90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.235+0000 7f60f1d3e640 1 --2- 172.21.15.19:0/3890184308 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60ec159900 0x7f60ec06e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.235+0000 7f60f1d3e640 1 -- 172.21.15.19:0/3890184308 >> 172.21.15.19:0/3890184308 conn(0x7f60ec0b0da0 msgr2=0x7f60ec0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:18.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.235+0000 7f60f1d3e640 1 -- 172.21.15.19:0/3890184308 shutdown_connections 2023-11-20T06:42:18.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.235+0000 7f60f1d3e640 1 -- 172.21.15.19:0/3890184308 wait complete. 2023-11-20T06:42:18.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60f1d3e640 1 Processor -- start 2023-11-20T06:42:18.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60f1d3e640 1 -- start start 2023-11-20T06:42:18.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60f1d3e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60ec06a5a0 0x7f60ec1511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:18.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60f1d3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ec0b3f00 0x7f60ec149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:18.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60f1d3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60ec159900 0x7f60ec0701f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:18.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60f1d3e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec154bf0 con 0x7f60ec0b3f00 2023-11-20T06:42:18.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60f1d3e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec154ed0 con 0x7f60ec06a5a0 2023-11-20T06:42:18.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60f1d3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec1516f0 con 0x7f60ec159900 2023-11-20T06:42:18.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60eaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ec0b3f00 0x7f60ec149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:18.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60eaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ec0b3f00 0x7f60ec149e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51106/0 (socket says 172.21.15.19:51106) 2023-11-20T06:42:18.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60eaffd640 1 -- 172.21.15.19:0/285065209 learned_addr learned my addr 172.21.15.19:0/285065209 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:18.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60eb7fe640 1 --2- 172.21.15.19:0/285065209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60ec06a5a0 0x7f60ec1511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:18.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60ebfff640 1 --2- 172.21.15.19:0/285065209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60ec159900 0x7f60ec0701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:18.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60eaffd640 1 -- 172.21.15.19:0/285065209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60ec159900 msgr2=0x7f60ec0701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:18.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60eaffd640 1 --2- 172.21.15.19:0/285065209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60ec159900 0x7f60ec0701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60eaffd640 1 -- 172.21.15.19:0/285065209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60ec06a5a0 msgr2=0x7f60ec1511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:18.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60eaffd640 1 --2- 172.21.15.19:0/285065209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60ec06a5a0 0x7f60ec1511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60eaffd640 1 -- 172.21.15.19:0/285065209 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e4009b30 con 0x7f60ec0b3f00 2023-11-20T06:42:18.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60eaffd640 1 --2- 172.21.15.19:0/285065209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ec0b3f00 0x7f60ec149e70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f60e000c4d0 tx=0x7f60e000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:18.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60d3fff640 1 -- 172.21.15.19:0/285065209 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e0005480 con 0x7f60ec0b3f00 2023-11-20T06:42:18.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60d3fff640 1 -- 172.21.15.19:0/285065209 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e0003600 con 0x7f60ec0b3f00 2023-11-20T06:42:18.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60d3fff640 1 -- 172.21.15.19:0/285065209 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e00039b0 con 0x7f60ec0b3f00 2023-11-20T06:42:18.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60f1d3e640 1 -- 172.21.15.19:0/285065209 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60ec1551b0 con 0x7f60ec0b3f00 2023-11-20T06:42:18.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.239+0000 7f60f1d3e640 1 -- 172.21.15.19:0/285065209 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ec14a3b0 con 0x7f60ec0b3f00 2023-11-20T06:42:18.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.243+0000 7f60f1d3e640 1 -- 172.21.15.19:0/285065209 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60ec15b930 con 0x7f60ec0b3f00 2023-11-20T06:42:18.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.243+0000 7f60d3fff640 1 -- 172.21.15.19:0/285065209 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f60e0003b10 con 0x7f60ec0b3f00 2023-11-20T06:42:18.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.243+0000 7f60d3fff640 1 --2- 172.21.15.19:0/285065209 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f60d80664a0 0x7f60d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:18.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.243+0000 7f60d3fff640 1 -- 172.21.15.19:0/285065209 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f60e00837c0 con 0x7f60ec0b3f00 2023-11-20T06:42:18.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.243+0000 7f60eb7fe640 1 --2- 172.21.15.19:0/285065209 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f60d80664a0 0x7f60d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:18.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.247+0000 7f60eb7fe640 1 --2- 172.21.15.19:0/285065209 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f60d80664a0 0x7f60d8068960 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009ac0 tx=0x7f60dc009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:18.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.247+0000 7f60d3fff640 1 -- 172.21.15.19:0/285065209 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f60ec15b930 con 0x7f60ec0b3f00 2023-11-20T06:42:18.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.407+0000 7f60f1d3e640 1 -- 172.21.15.19:0/285065209 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f60ec15b930 con 0x7f60ec0b3f00 2023-11-20T06:42:18.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.407+0000 7f60d3fff640 1 -- 172.21.15.19:0/285065209 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f60ec15b930 con 0x7f60ec0b3f00 2023-11-20T06:42:18.412 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:18.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.407+0000 7f60f1d3e640 1 -- 172.21.15.19:0/285065209 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f60d80664a0 msgr2=0x7f60d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:18.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.407+0000 7f60f1d3e640 1 --2- 172.21.15.19:0/285065209 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f60d80664a0 0x7f60d8068960 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009ac0 tx=0x7f60dc009190 comp rx=0 tx=0).stop 2023-11-20T06:42:18.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.407+0000 7f60f1d3e640 1 -- 172.21.15.19:0/285065209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ec0b3f00 msgr2=0x7f60ec149e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:18.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.407+0000 7f60f1d3e640 1 --2- 172.21.15.19:0/285065209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ec0b3f00 0x7f60ec149e70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f60e000c4d0 tx=0x7f60e000c990 comp rx=0 tx=0).stop 2023-11-20T06:42:18.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.407+0000 7f60f1d3e640 1 -- 172.21.15.19:0/285065209 shutdown_connections 2023-11-20T06:42:18.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.407+0000 7f60f1d3e640 1 --2- 172.21.15.19:0/285065209 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f60d80664a0 0x7f60d8068960 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.407+0000 7f60f1d3e640 1 --2- 172.21.15.19:0/285065209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60ec159900 0x7f60ec0701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.407+0000 7f60f1d3e640 1 --2- 172.21.15.19:0/285065209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ec0b3f00 0x7f60ec149e70 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.407+0000 7f60f1d3e640 1 --2- 172.21.15.19:0/285065209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60ec06a5a0 0x7f60ec1511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.407+0000 7f60f1d3e640 1 -- 172.21.15.19:0/285065209 >> 172.21.15.19:0/285065209 conn(0x7f60ec0b0da0 msgr2=0x7f60ec0afba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:18.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.407+0000 7f60f1d3e640 1 -- 172.21.15.19:0/285065209 shutdown_connections 2023-11-20T06:42:18.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.407+0000 7f60f1d3e640 1 -- 172.21.15.19:0/285065209 wait complete. 2023-11-20T06:42:18.433 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T06:42:18.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.571+0000 7f3d4759e640 1 Processor -- start 2023-11-20T06:42:18.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.571+0000 7f3d4759e640 1 -- start start 2023-11-20T06:42:18.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d4759e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3d4815cd60 0x7f3d4806af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:18.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d4759e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d480d3510 con 0x7f3d480d1490 2023-11-20T06:42:18.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d4759e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d480d2f50 con 0x7f3d4815c980 2023-11-20T06:42:18.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d4759e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d480cd2b0 con 0x7f3d4815cd60 2023-11-20T06:42:18.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d3ffff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3d480d1490 0x7f3d480cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54412/0 (socket says 172.21.15.19:54412) 2023-11-20T06:42:18.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d3ffff640 1 -- 172.21.15.19:0/2427752410 learned_addr learned my addr 172.21.15.19:0/2427752410 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:18.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d46d9d640 1 --2- 172.21.15.19:0/2427752410 >> v2:172.21.15.190:3300/0 conn(0x7f3d4815cd60 0x7f3d4806af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:18.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d45d9b640 1 -- 172.21.15.19:0/2427752410 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296168485 0 0) 0x7f3d30001120 con 0x7f3d480d1490 2023-11-20T06:42:18.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d45d9b640 1 -- 172.21.15.19:0/2427752410 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d34003530 con 0x7f3d480d1490 2023-11-20T06:42:18.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d45d9b640 1 -- 172.21.15.19:0/2427752410 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738883307 0 0) 0x7f3d480d2f50 con 0x7f3d4815c980 2023-11-20T06:42:18.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d45d9b640 1 -- 172.21.15.19:0/2427752410 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d30001120 con 0x7f3d4815c980 2023-11-20T06:42:18.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d45d9b640 1 -- 172.21.15.19:0/2427752410 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2930029193 0 0) 0x7f3d34003530 con 0x7f3d480d1490 2023-11-20T06:42:18.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d45d9b640 1 -- 172.21.15.19:0/2427752410 >> v2:172.21.15.190:3300/0 conn(0x7f3d4815cd60 msgr2=0x7f3d4806af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:18.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d45d9b640 1 --2- 172.21.15.19:0/2427752410 >> v2:172.21.15.190:3300/0 conn(0x7f3d4815cd60 0x7f3d4806af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d45d9b640 1 -- 172.21.15.19:0/2427752410 >> v1:172.21.15.190:6789/0 conn(0x7f3d4815c980 legacy=0x7f3d480d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:18.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d45d9b640 1 -- 172.21.15.19:0/2427752410 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d480d3230 con 0x7f3d480d1490 2023-11-20T06:42:18.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d45d9b640 1 -- 172.21.15.19:0/2427752410 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7f3d30001810 con 0x7f3d480d1490 2023-11-20T06:42:18.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d45d9b640 1 -- 172.21.15.19:0/2427752410 >> v1:172.21.15.19:6789/0 conn(0x7f3d480d1490 legacy=0x7f3d480cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:18.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d45d9b640 1 --2- 172.21.15.19:0/2427752410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d34003bf0 0x7f3d34003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:18.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d45d9b640 1 --2- 172.21.15.19:0/2427752410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d340047d0 0x7f3d34004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:18.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d45d9b640 1 --2- 172.21.15.19:0/2427752410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d34005250 0x7f3d3400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:18.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d45d9b640 1 -- 172.21.15.19:0/2427752410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d480cd2b0 con 0x7f3d34005250 2023-11-20T06:42:18.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d45d9b640 1 -- 172.21.15.19:0/2427752410 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3400c190 con 0x7f3d34003bf0 2023-11-20T06:42:18.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d45d9b640 1 -- 172.21.15.19:0/2427752410 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3400c350 con 0x7f3d340047d0 2023-11-20T06:42:18.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d46d9d640 1 --2- 172.21.15.19:0/2427752410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d34005250 0x7f3d3400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:18.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d3ffff640 1 --2- 172.21.15.19:0/2427752410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d340047d0 0x7f3d34004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:18.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d4659c640 1 --2- 172.21.15.19:0/2427752410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d34003bf0 0x7f3d34003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:18.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d46d9d640 1 -- 172.21.15.19:0/2427752410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d340047d0 msgr2=0x7f3d34004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:18.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d46d9d640 1 --2- 172.21.15.19:0/2427752410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d340047d0 0x7f3d34004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d46d9d640 1 -- 172.21.15.19:0/2427752410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d34003bf0 msgr2=0x7f3d34003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:18.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d46d9d640 1 --2- 172.21.15.19:0/2427752410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d34003bf0 0x7f3d34003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.575+0000 7f3d46d9d640 1 -- 172.21.15.19:0/2427752410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d34003530 con 0x7f3d34005250 2023-11-20T06:42:18.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.579+0000 7f3d46d9d640 1 -- 172.21.15.19:0/2427752410 reap_dead start 2023-11-20T06:42:18.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.579+0000 7f3d46d9d640 1 --2- 172.21.15.19:0/2427752410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d34005250 0x7f3d3400b990 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3d40009fc0 tx=0x7f3d4001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f12a475858d543b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:18.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.579+0000 7f3d45d9b640 1 -- 172.21.15.19:0/2427752410 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d400a5ab0 con 0x7f3d34005250 2023-11-20T06:42:18.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.579+0000 7f3d45d9b640 1 -- 172.21.15.19:0/2427752410 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4000f040 con 0x7f3d34005250 2023-11-20T06:42:18.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.579+0000 7f3d45d9b640 1 -- 172.21.15.19:0/2427752410 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d400a5e50 con 0x7f3d34005250 2023-11-20T06:42:18.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.579+0000 7f3d4759e640 1 -- 172.21.15.19:0/2427752410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d34005250 msgr2=0x7f3d3400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:18.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.579+0000 7f3d4759e640 1 --2- 172.21.15.19:0/2427752410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d34005250 0x7f3d3400b990 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3d40009fc0 tx=0x7f3d4001cca0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.579+0000 7f3d4759e640 1 -- 172.21.15.19:0/2427752410 shutdown_connections 2023-11-20T06:42:18.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.579+0000 7f3d4759e640 1 --2- 172.21.15.19:0/2427752410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d34005250 0x7f3d3400b990 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.579+0000 7f3d4759e640 1 -- 172.21.15.19:0/2427752410 >> 172.21.15.19:0/2427752410 conn(0x7f3d4809ba80 msgr2=0x7f3d480d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:18.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.579+0000 7f3d4759e640 1 -- 172.21.15.19:0/2427752410 shutdown_connections 2023-11-20T06:42:18.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.579+0000 7f3d4759e640 1 -- 172.21.15.19:0/2427752410 wait complete. 2023-11-20T06:42:18.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.579+0000 7f3d4759e640 1 Processor -- start 2023-11-20T06:42:18.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.579+0000 7f3d4759e640 1 -- start start 2023-11-20T06:42:18.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d4759e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d34005250 0x7f3d480ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:18.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d4759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d4815f010 0x7f3d4815f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:18.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d4759e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d4815d140 0x7f3d4815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:18.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d4759e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d480b5660 con 0x7f3d4815f010 2023-11-20T06:42:18.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d4759e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4815f9d0 con 0x7f3d34005250 2023-11-20T06:42:18.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d4759e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d48160450 con 0x7f3d4815d140 2023-11-20T06:42:18.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d3ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d4815f010 0x7f3d4815f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:18.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d3ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d4815f010 0x7f3d4815f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51114/0 (socket says 172.21.15.19:51114) 2023-11-20T06:42:18.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d3ffff640 1 -- 172.21.15.19:0/3508426879 learned_addr learned my addr 172.21.15.19:0/3508426879 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:18.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d46d9d640 1 --2- 172.21.15.19:0/3508426879 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d4815d140 0x7f3d4815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:18.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d4659c640 1 --2- 172.21.15.19:0/3508426879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d34005250 0x7f3d480ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:18.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d3ffff640 1 -- 172.21.15.19:0/3508426879 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d4815d140 msgr2=0x7f3d4815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:18.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d3ffff640 1 --2- 172.21.15.19:0/3508426879 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d4815d140 0x7f3d4815d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d3ffff640 1 -- 172.21.15.19:0/3508426879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d34005250 msgr2=0x7f3d480ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:18.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d3ffff640 1 --2- 172.21.15.19:0/3508426879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d34005250 0x7f3d480ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d3ffff640 1 -- 172.21.15.19:0/3508426879 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4815fbb0 con 0x7f3d4815f010 2023-11-20T06:42:18.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d46d9d640 1 --2- 172.21.15.19:0/3508426879 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d4815d140 0x7f3d4815d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:18.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d3ffff640 1 --2- 172.21.15.19:0/3508426879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d4815f010 0x7f3d4815f490 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000e780 tx=0x7f3d3000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:18.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d3effd640 1 -- 172.21.15.19:0/3508426879 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3000ee30 con 0x7f3d4815f010 2023-11-20T06:42:18.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d3effd640 1 -- 172.21.15.19:0/3508426879 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3000c8d0 con 0x7f3d4815f010 2023-11-20T06:42:18.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d4759e640 1 -- 172.21.15.19:0/3508426879 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4815fe90 con 0x7f3d4815f010 2023-11-20T06:42:18.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d3effd640 1 -- 172.21.15.19:0/3508426879 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3000cc80 con 0x7f3d4815f010 2023-11-20T06:42:18.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d4759e640 1 -- 172.21.15.19:0/3508426879 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d480ce560 con 0x7f3d4815f010 2023-11-20T06:42:18.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d4759e640 1 -- 172.21.15.19:0/3508426879 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d480b53c0 con 0x7f3d4815f010 2023-11-20T06:42:18.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.583+0000 7f3d3effd640 1 -- 172.21.15.19:0/3508426879 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3d3001d460 con 0x7f3d4815f010 2023-11-20T06:42:18.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.587+0000 7f3d3effd640 1 --2- 172.21.15.19:0/3508426879 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f3d280664a0 0x7f3d28068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:18.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.587+0000 7f3d3effd640 1 -- 172.21.15.19:0/3508426879 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3d30083fb0 con 0x7f3d4815f010 2023-11-20T06:42:18.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.587+0000 7f3d4659c640 1 --2- 172.21.15.19:0/3508426879 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f3d280664a0 0x7f3d28068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:18.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.587+0000 7f3d4659c640 1 --2- 172.21.15.19:0/3508426879 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f3d280664a0 0x7f3d28068960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3d38005680 tx=0x7f3d38009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:18.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.591+0000 7f3d3effd640 1 -- 172.21.15.19:0/3508426879 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3d480b53c0 con 0x7f3d4815f010 2023-11-20T06:42:18.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.763+0000 7f3d4759e640 1 -- 172.21.15.19:0/3508426879 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3d480b57a0 con 0x7f3d4815f010 2023-11-20T06:42:18.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.763+0000 7f3d3effd640 1 -- 172.21.15.19:0/3508426879 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3d480b57a0 con 0x7f3d4815f010 2023-11-20T06:42:18.768 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2023-11-20T06:42:18.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.763+0000 7f3d4759e640 1 -- 172.21.15.19:0/3508426879 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f3d280664a0 msgr2=0x7f3d28068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:18.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.763+0000 7f3d4759e640 1 --2- 172.21.15.19:0/3508426879 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f3d280664a0 0x7f3d28068960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3d38005680 tx=0x7f3d38009040 comp rx=0 tx=0).stop 2023-11-20T06:42:18.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.763+0000 7f3d4759e640 1 -- 172.21.15.19:0/3508426879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d4815f010 msgr2=0x7f3d4815f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:18.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.763+0000 7f3d4759e640 1 --2- 172.21.15.19:0/3508426879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d4815f010 0x7f3d4815f490 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000e780 tx=0x7f3d3000ec40 comp rx=0 tx=0).stop 2023-11-20T06:42:18.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.763+0000 7f3d4759e640 1 -- 172.21.15.19:0/3508426879 shutdown_connections 2023-11-20T06:42:18.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.763+0000 7f3d4759e640 1 --2- 172.21.15.19:0/3508426879 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f3d280664a0 0x7f3d28068960 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.763+0000 7f3d4759e640 1 --2- 172.21.15.19:0/3508426879 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d4815d140 0x7f3d4815d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.763+0000 7f3d4759e640 1 --2- 172.21.15.19:0/3508426879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d4815f010 0x7f3d4815f490 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.763+0000 7f3d4759e640 1 --2- 172.21.15.19:0/3508426879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d34005250 0x7f3d480ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:18.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.763+0000 7f3d4759e640 1 -- 172.21.15.19:0/3508426879 >> 172.21.15.19:0/3508426879 conn(0x7f3d4809ba80 msgr2=0x7f3d480c6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:18.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.763+0000 7f3d4759e640 1 -- 172.21.15.19:0/3508426879 shutdown_connections 2023-11-20T06:42:18.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:18.763+0000 7f3d4759e640 1 -- 172.21.15.19:0/3508426879 wait complete. 2023-11-20T06:42:18.789 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi190.front.sepia.ceph.com... 2023-11-20T06:42:18.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:18.790 DEBUG:teuthology.orchestra.run.smithi190:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-20T06:42:18.827 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:42:18.827 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-11-20T06:42:18.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:18.828 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-20T06:42:18.885 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:42:18.885 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:42:18.894 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:42:18.895 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:42:18.948 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:19.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.131+0000 7ff671b72640 1 Processor -- start 2023-11-20T06:42:19.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.131+0000 7ff671b72640 1 -- start start 2023-11-20T06:42:19.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.131+0000 7ff671b72640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff66c1591e0 0x7ff66c0c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:19.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.131+0000 7ff671b72640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff66c0ca430 0x7ff66c071c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:19.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.131+0000 7ff671b72640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff66c0721b0 0x7ff66c0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:19.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.131+0000 7ff671b72640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66c071020 con 0x7ff66c0ca430 2023-11-20T06:42:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.131+0000 7ff671b72640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66c0c8e50 con 0x7ff66c1591e0 2023-11-20T06:42:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.131+0000 7ff671b72640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c0c9130 con 0x7ff66c0721b0 2023-11-20T06:42:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.135+0000 7ff66affd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff66c0ca430 0x7ff66c071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.135+0000 7ff66affd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff66c0ca430 0x7ff66c071c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51128/0 (socket says 172.21.15.19:51128) 2023-11-20T06:42:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.135+0000 7ff66affd640 1 -- 172.21.15.19:0/4234023400 learned_addr learned my addr 172.21.15.19:0/4234023400 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.135+0000 7ff66bfff640 1 --2- 172.21.15.19:0/4234023400 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff66c0721b0 0x7ff66c0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.135+0000 7ff66b7fe640 1 --2- 172.21.15.19:0/4234023400 >> v2:172.21.15.190:3300/0 conn(0x7ff66c1591e0 0x7ff66c0c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.135+0000 7ff66affd640 1 -- 172.21.15.19:0/4234023400 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff66c0721b0 msgr2=0x7ff66c0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.135+0000 7ff66affd640 1 --2- 172.21.15.19:0/4234023400 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff66c0721b0 0x7ff66c0b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.135+0000 7ff66affd640 1 -- 172.21.15.19:0/4234023400 >> v2:172.21.15.190:3300/0 conn(0x7ff66c1591e0 msgr2=0x7ff66c0c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.135+0000 7ff66affd640 1 --2- 172.21.15.19:0/4234023400 >> v2:172.21.15.190:3300/0 conn(0x7ff66c1591e0 0x7ff66c0c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.135+0000 7ff66affd640 1 -- 172.21.15.19:0/4234023400 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c0c9410 con 0x7ff66c0ca430 2023-11-20T06:42:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.135+0000 7ff66b7fe640 1 --2- 172.21.15.19:0/4234023400 >> v2:172.21.15.190:3300/0 conn(0x7ff66c1591e0 0x7ff66c0c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:19.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.135+0000 7ff66affd640 1 --2- 172.21.15.19:0/4234023400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff66c0ca430 0x7ff66c071c70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff66c06d140 tx=0x7ff66001e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc04a0fff7bf8cb server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:19.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.135+0000 7ff66a7fc640 1 -- 172.21.15.19:0/4234023400 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff660004230 con 0x7ff66c0ca430 2023-11-20T06:42:19.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.135+0000 7ff66a7fc640 1 -- 172.21.15.19:0/4234023400 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6600ab070 con 0x7ff66c0ca430 2023-11-20T06:42:19.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.135+0000 7ff66a7fc640 1 -- 172.21.15.19:0/4234023400 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff660003620 con 0x7ff66c0ca430 2023-11-20T06:42:19.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff671b72640 1 -- 172.21.15.19:0/4234023400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff66c0ca430 msgr2=0x7ff66c071c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:19.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff671b72640 1 --2- 172.21.15.19:0/4234023400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff66c0ca430 0x7ff66c071c70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff66c06d140 tx=0x7ff66001e9b0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff671b72640 1 -- 172.21.15.19:0/4234023400 shutdown_connections 2023-11-20T06:42:19.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff671b72640 1 --2- 172.21.15.19:0/4234023400 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff66c0721b0 0x7ff66c0b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff671b72640 1 --2- 172.21.15.19:0/4234023400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff66c0ca430 0x7ff66c071c70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff671b72640 1 --2- 172.21.15.19:0/4234023400 >> v2:172.21.15.190:3300/0 conn(0x7ff66c1591e0 0x7ff66c0c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff671b72640 1 -- 172.21.15.19:0/4234023400 >> 172.21.15.19:0/4234023400 conn(0x7ff66c06c190 msgr2=0x7ff66c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:19.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff671b72640 1 -- 172.21.15.19:0/4234023400 shutdown_connections 2023-11-20T06:42:19.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff671b72640 1 -- 172.21.15.19:0/4234023400 wait complete. 2023-11-20T06:42:19.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff671b72640 1 Processor -- start 2023-11-20T06:42:19.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff671b72640 1 -- start start 2023-11-20T06:42:19.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff671b72640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff66c0721b0 0x7ff66c15b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:19.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff671b72640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff66c0ca430 0x7ff66c1596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:19.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff671b72640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff66c1591e0 0x7ff66c159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:19.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff671b72640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c15b820 con 0x7ff66c0721b0 2023-11-20T06:42:19.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff671b72640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c15a240 con 0x7ff66c1591e0 2023-11-20T06:42:19.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff671b72640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c15a520 con 0x7ff66c0ca430 2023-11-20T06:42:19.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff66b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff66c0721b0 0x7ff66c15b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:19.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff66b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff66c0721b0 0x7ff66c15b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51138/0 (socket says 172.21.15.19:51138) 2023-11-20T06:42:19.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff66b7fe640 1 -- 172.21.15.19:0/533917892 learned_addr learned my addr 172.21.15.19:0/533917892 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:19.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff66bfff640 1 --2- 172.21.15.19:0/533917892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff66c1591e0 0x7ff66c159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:19.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.139+0000 7ff66affd640 1 --2- 172.21.15.19:0/533917892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff66c0ca430 0x7ff66c1596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:19.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.143+0000 7ff66b7fe640 1 -- 172.21.15.19:0/533917892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff66c0ca430 msgr2=0x7ff66c1596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:19.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.143+0000 7ff66b7fe640 1 --2- 172.21.15.19:0/533917892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff66c0ca430 0x7ff66c1596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.143+0000 7ff66b7fe640 1 -- 172.21.15.19:0/533917892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff66c1591e0 msgr2=0x7ff66c159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:19.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.143+0000 7ff66b7fe640 1 --2- 172.21.15.19:0/533917892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff66c1591e0 0x7ff66c159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.143+0000 7ff66b7fe640 1 -- 172.21.15.19:0/533917892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66000b780 con 0x7ff66c0721b0 2023-11-20T06:42:19.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.143+0000 7ff66bfff640 1 --2- 172.21.15.19:0/533917892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff66c1591e0 0x7ff66c159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:19.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.143+0000 7ff66b7fe640 1 --2- 172.21.15.19:0/533917892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff66c0721b0 0x7ff66c15b2e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00d800 tx=0x7ff65c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:19.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.143+0000 7ff653fff640 1 -- 172.21.15.19:0/533917892 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c0096c0 con 0x7ff66c0721b0 2023-11-20T06:42:19.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.143+0000 7ff653fff640 1 -- 172.21.15.19:0/533917892 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65c009820 con 0x7ff66c0721b0 2023-11-20T06:42:19.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.143+0000 7ff653fff640 1 -- 172.21.15.19:0/533917892 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c009bd0 con 0x7ff66c0721b0 2023-11-20T06:42:19.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.143+0000 7ff671b72640 1 -- 172.21.15.19:0/533917892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66c15a800 con 0x7ff66c0721b0 2023-11-20T06:42:19.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.143+0000 7ff671b72640 1 -- 172.21.15.19:0/533917892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66c15adc0 con 0x7ff66c0721b0 2023-11-20T06:42:19.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.143+0000 7ff671b72640 1 -- 172.21.15.19:0/533917892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66c074010 con 0x7ff66c0721b0 2023-11-20T06:42:19.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.143+0000 7ff653fff640 1 -- 172.21.15.19:0/533917892 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff65c009d30 con 0x7ff66c0721b0 2023-11-20T06:42:19.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.143+0000 7ff653fff640 1 --2- 172.21.15.19:0/533917892 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6580664a0 0x7ff658068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:19.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.143+0000 7ff653fff640 1 -- 172.21.15.19:0/533917892 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff65c084940 con 0x7ff66c0721b0 2023-11-20T06:42:19.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.143+0000 7ff66affd640 1 --2- 172.21.15.19:0/533917892 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6580664a0 0x7ff658068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:19.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.147+0000 7ff66affd640 1 --2- 172.21.15.19:0/533917892 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6580664a0 0x7ff658068960 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff6600b1000 tx=0x7ff6600a9070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:19.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.147+0000 7ff653fff640 1 -- 172.21.15.19:0/533917892 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff65c051a00 con 0x7ff66c0721b0 2023-11-20T06:42:19.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.307+0000 7ff671b72640 1 -- 172.21.15.19:0/533917892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff66c071f90 con 0x7ff66c0721b0 2023-11-20T06:42:19.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.311+0000 7ff653fff640 1 -- 172.21.15.19:0/533917892 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18720 (secure 0 0 0) 0x7ff65c055020 con 0x7ff66c0721b0 2023-11-20T06:42:19.316 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:19.316 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:55.472006+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:19.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.311+0000 7ff671b72640 1 -- 172.21.15.19:0/533917892 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6580664a0 msgr2=0x7ff658068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:19.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.311+0000 7ff671b72640 1 --2- 172.21.15.19:0/533917892 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6580664a0 0x7ff658068960 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff6600b1000 tx=0x7ff6600a9070 comp rx=0 tx=0).stop 2023-11-20T06:42:19.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.311+0000 7ff671b72640 1 -- 172.21.15.19:0/533917892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff66c0721b0 msgr2=0x7ff66c15b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:19.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.311+0000 7ff671b72640 1 --2- 172.21.15.19:0/533917892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff66c0721b0 0x7ff66c15b2e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00d800 tx=0x7ff65c00dcc0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.311+0000 7ff671b72640 1 -- 172.21.15.19:0/533917892 shutdown_connections 2023-11-20T06:42:19.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.311+0000 7ff671b72640 1 --2- 172.21.15.19:0/533917892 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff6580664a0 0x7ff658068960 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.311+0000 7ff671b72640 1 --2- 172.21.15.19:0/533917892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff66c1591e0 0x7ff66c159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.311+0000 7ff671b72640 1 --2- 172.21.15.19:0/533917892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff66c0ca430 0x7ff66c1596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.311+0000 7ff671b72640 1 --2- 172.21.15.19:0/533917892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff66c0721b0 0x7ff66c15b2e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.311+0000 7ff671b72640 1 -- 172.21.15.19:0/533917892 >> 172.21.15.19:0/533917892 conn(0x7ff66c06c190 msgr2=0x7ff66c154f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:19.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.311+0000 7ff671b72640 1 -- 172.21.15.19:0/533917892 shutdown_connections 2023-11-20T06:42:19.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.311+0000 7ff671b72640 1 -- 172.21.15.19:0/533917892 wait complete. 2023-11-20T06:42:19.337 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T06:41:11.805111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T06:41:12.614034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T06:41:16.311206+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T06:42:19.338 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:42:19.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.479+0000 7fe309cd6640 1 Processor -- start 2023-11-20T06:42:19.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.479+0000 7fe309cd6640 1 -- start start 2023-11-20T06:42:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.479+0000 7fe309cd6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe30415cba0 0x7fe3040d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.479+0000 7fe309cd6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe3040b84e0 0x7fe3040cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.479+0000 7fe309cd6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3040d1670 con 0x7fe3040d0040 2023-11-20T06:42:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.479+0000 7fe309cd6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3040d1460 con 0x7fe30415cba0 2023-11-20T06:42:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.479+0000 7fe309cd6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3040d04b0 con 0x7fe3040b84e0 2023-11-20T06:42:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.479+0000 7fe303fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe3040d0040 0x7fe3040d2ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54420/0 (socket says 172.21.15.19:54420) 2023-11-20T06:42:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.479+0000 7fe3037fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe30415cba0 0x7fe3040d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.479+0000 7fe303fff640 1 -- 172.21.15.19:0/3331816879 learned_addr learned my addr 172.21.15.19:0/3331816879 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.479+0000 7fe302ffd640 1 --2- 172.21.15.19:0/3331816879 >> v2:172.21.15.190:3300/0 conn(0x7fe3040b84e0 0x7fe3040cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.479+0000 7fe3037fe640 1 -- 172.21.15.19:0/3331816879 >> v2:172.21.15.190:3300/0 conn(0x7fe3040b84e0 msgr2=0x7fe3040cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.479+0000 7fe3037fe640 1 --2- 172.21.15.19:0/3331816879 >> v2:172.21.15.190:3300/0 conn(0x7fe3040b84e0 0x7fe3040cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.479+0000 7fe3037fe640 1 -- 172.21.15.19:0/3331816879 >> v1:172.21.15.19:6789/0 conn(0x7fe3040d0040 legacy=0x7fe3040d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.479+0000 7fe3037fe640 1 -- 172.21.15.19:0/3331816879 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3040d1950 con 0x7fe30415cba0 2023-11-20T06:42:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.479+0000 7fe3027fc640 1 -- 172.21.15.19:0/3331816879 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247671914 0 0) 0x7fe3040d1670 con 0x7fe3040d0040 2023-11-20T06:42:19.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.483+0000 7fe3037fe640 1 --2- 172.21.15.19:0/3331816879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe30415cba0 0x7fe3040d0f20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe3040cf2f0 tx=0x7fe2f401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1672e760499d9c13 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:19.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.483+0000 7fe3027fc640 1 -- 172.21.15.19:0/3331816879 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f40ab600 con 0x7fe30415cba0 2023-11-20T06:42:19.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.483+0000 7fe3027fc640 1 -- 172.21.15.19:0/3331816879 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f40a7050 con 0x7fe30415cba0 2023-11-20T06:42:19.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.483+0000 7fe3027fc640 1 -- 172.21.15.19:0/3331816879 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f40ab980 con 0x7fe30415cba0 2023-11-20T06:42:19.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.483+0000 7fe309cd6640 1 -- 172.21.15.19:0/3331816879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe30415cba0 msgr2=0x7fe3040d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:19.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.483+0000 7fe309cd6640 1 --2- 172.21.15.19:0/3331816879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe30415cba0 0x7fe3040d0f20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe3040cf2f0 tx=0x7fe2f401c3d0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.483+0000 7fe309cd6640 1 -- 172.21.15.19:0/3331816879 shutdown_connections 2023-11-20T06:42:19.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.483+0000 7fe309cd6640 1 --2- 172.21.15.19:0/3331816879 >> v2:172.21.15.190:3300/0 conn(0x7fe3040b84e0 0x7fe3040cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.483+0000 7fe309cd6640 1 --2- 172.21.15.19:0/3331816879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe30415cba0 0x7fe3040d0f20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.483+0000 7fe309cd6640 1 -- 172.21.15.19:0/3331816879 >> 172.21.15.19:0/3331816879 conn(0x7fe3040719c0 msgr2=0x7fe304071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:19.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.483+0000 7fe309cd6640 1 -- 172.21.15.19:0/3331816879 shutdown_connections 2023-11-20T06:42:19.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.483+0000 7fe309cd6640 1 -- 172.21.15.19:0/3331816879 wait complete. 2023-11-20T06:42:19.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe309cd6640 1 Processor -- start 2023-11-20T06:42:19.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe309cd6640 1 -- start start 2023-11-20T06:42:19.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe309cd6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3040b84e0 0x7fe30414fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:19.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe309cd6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3040d0040 0x7fe304156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:19.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe309cd6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe30415cba0 0x7fe304151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:19.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe309cd6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3041596b0 con 0x7fe30415cba0 2023-11-20T06:42:19.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe309cd6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe304157bf0 con 0x7fe3040d0040 2023-11-20T06:42:19.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe309cd6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe304159110 con 0x7fe3040b84e0 2023-11-20T06:42:19.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe303fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe30415cba0 0x7fe304151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:19.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe303fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe30415cba0 0x7fe304151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51158/0 (socket says 172.21.15.19:51158) 2023-11-20T06:42:19.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe303fff640 1 -- 172.21.15.19:0/2233353995 learned_addr learned my addr 172.21.15.19:0/2233353995 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:19.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe3037fe640 1 --2- 172.21.15.19:0/2233353995 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3040b84e0 0x7fe30414fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:19.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe302ffd640 1 --2- 172.21.15.19:0/2233353995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3040d0040 0x7fe304156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:19.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe303fff640 1 -- 172.21.15.19:0/2233353995 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3040b84e0 msgr2=0x7fe30414fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:19.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe303fff640 1 --2- 172.21.15.19:0/2233353995 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3040b84e0 0x7fe30414fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe303fff640 1 -- 172.21.15.19:0/2233353995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3040d0040 msgr2=0x7fe304156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:19.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe303fff640 1 --2- 172.21.15.19:0/2233353995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3040d0040 0x7fe304156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe303fff640 1 -- 172.21.15.19:0/2233353995 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f4009420 con 0x7fe30415cba0 2023-11-20T06:42:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe303fff640 1 --2- 172.21.15.19:0/2233353995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe30415cba0 0x7fe304151ce0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc001570 tx=0x7fe2fc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe2ebfff640 1 -- 172.21.15.19:0/2233353995 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc00a640 con 0x7fe30415cba0 2023-11-20T06:42:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe2ebfff640 1 -- 172.21.15.19:0/2233353995 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2fc00a7c0 con 0x7fe30415cba0 2023-11-20T06:42:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe309cd6640 1 -- 172.21.15.19:0/2233353995 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3041593d0 con 0x7fe30415cba0 2023-11-20T06:42:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe2ebfff640 1 -- 172.21.15.19:0/2233353995 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc00ab70 con 0x7fe30415cba0 2023-11-20T06:42:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe309cd6640 1 -- 172.21.15.19:0/2233353995 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe304157880 con 0x7fe30415cba0 2023-11-20T06:42:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.487+0000 7fe309cd6640 1 -- 172.21.15.19:0/2233353995 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30404e170 con 0x7fe30415cba0 2023-11-20T06:42:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.491+0000 7fe2ebfff640 1 -- 172.21.15.19:0/2233353995 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe2fc00acd0 con 0x7fe30415cba0 2023-11-20T06:42:19.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.491+0000 7fe2ebfff640 1 --2- 172.21.15.19:0/2233353995 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe2f00664a0 0x7fe2f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:19.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.491+0000 7fe2ebfff640 1 -- 172.21.15.19:0/2233353995 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe2fc083820 con 0x7fe30415cba0 2023-11-20T06:42:19.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.491+0000 7fe3037fe640 1 --2- 172.21.15.19:0/2233353995 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe2f00664a0 0x7fe2f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:19.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.491+0000 7fe3037fe640 1 --2- 172.21.15.19:0/2233353995 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe2f00664a0 0x7fe2f0068960 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40ad000 tx=0x7fe2f40a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:19.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.495+0000 7fe2ebfff640 1 -- 172.21.15.19:0/2233353995 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe2fc0508f0 con 0x7fe30415cba0 2023-11-20T06:42:19.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.651+0000 7fe309cd6640 1 -- 172.21.15.19:0/2233353995 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe304157d30 con 0x7fe30415cba0 2023-11-20T06:42:19.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.651+0000 7fe2ebfff640 1 -- 172.21.15.19:0/2233353995 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2fc0180a0 con 0x7fe30415cba0 2023-11-20T06:42:19.659 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:42:19.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.655+0000 7fe309cd6640 1 -- 172.21.15.19:0/2233353995 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe2f00664a0 msgr2=0x7fe2f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:19.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.655+0000 7fe309cd6640 1 --2- 172.21.15.19:0/2233353995 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe2f00664a0 0x7fe2f0068960 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40ad000 tx=0x7fe2f40a6000 comp rx=0 tx=0).stop 2023-11-20T06:42:19.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.655+0000 7fe309cd6640 1 -- 172.21.15.19:0/2233353995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe30415cba0 msgr2=0x7fe304151ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:19.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.655+0000 7fe309cd6640 1 --2- 172.21.15.19:0/2233353995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe30415cba0 0x7fe304151ce0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc001570 tx=0x7fe2fc00cca0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.655+0000 7fe309cd6640 1 -- 172.21.15.19:0/2233353995 shutdown_connections 2023-11-20T06:42:19.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.655+0000 7fe309cd6640 1 --2- 172.21.15.19:0/2233353995 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe2f00664a0 0x7fe2f0068960 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.655+0000 7fe309cd6640 1 --2- 172.21.15.19:0/2233353995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe30415cba0 0x7fe304151ce0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.655+0000 7fe309cd6640 1 --2- 172.21.15.19:0/2233353995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3040d0040 0x7fe304156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.655+0000 7fe309cd6640 1 --2- 172.21.15.19:0/2233353995 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3040b84e0 0x7fe30414fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.655+0000 7fe309cd6640 1 -- 172.21.15.19:0/2233353995 >> 172.21.15.19:0/2233353995 conn(0x7fe3040719c0 msgr2=0x7fe304159ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:19.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.655+0000 7fe309cd6640 1 -- 172.21.15.19:0/2233353995 shutdown_connections 2023-11-20T06:42:19.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.655+0000 7fe309cd6640 1 -- 172.21.15.19:0/2233353995 wait complete. 2023-11-20T06:42:19.680 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T06:42:19.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.819+0000 7fd755380640 1 Processor -- start 2023-11-20T06:42:19.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.819+0000 7fd755380640 1 -- start start 2023-11-20T06:42:19.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.823+0000 7fd755380640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd75015cba0 0x7fd7500d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:19.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.823+0000 7fd755380640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd7500b84e0 0x7fd7500cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:19.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.823+0000 7fd755380640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7500d0040 0x7fd7500d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:19.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.823+0000 7fd755380640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7500d1460 con 0x7fd7500b84e0 2023-11-20T06:42:19.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.823+0000 7fd755380640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7500d04b0 con 0x7fd75015cba0 2023-11-20T06:42:19.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.823+0000 7fd755380640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7500d1670 con 0x7fd7500d0040 2023-11-20T06:42:19.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.823+0000 7fd747fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd7500b84e0 0x7fd7500cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:19.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.823+0000 7fd747fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd7500b84e0 0x7fd7500cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51164/0 (socket says 172.21.15.19:51164) 2023-11-20T06:42:19.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.823+0000 7fd747fff640 1 -- 172.21.15.19:0/1261271343 learned_addr learned my addr 172.21.15.19:0/1261271343 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:19.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.823+0000 7fd74f7fe640 1 --2- 172.21.15.19:0/1261271343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7500d0040 0x7fd7500d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:19.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.823+0000 7fd74effd640 1 --2- 172.21.15.19:0/1261271343 >> v2:172.21.15.190:3300/0 conn(0x7fd75015cba0 0x7fd7500d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:19.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.823+0000 7fd747fff640 1 -- 172.21.15.19:0/1261271343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7500d0040 msgr2=0x7fd7500d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:19.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.823+0000 7fd747fff640 1 --2- 172.21.15.19:0/1261271343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7500d0040 0x7fd7500d2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.823+0000 7fd747fff640 1 -- 172.21.15.19:0/1261271343 >> v2:172.21.15.190:3300/0 conn(0x7fd75015cba0 msgr2=0x7fd7500d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:19.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.823+0000 7fd747fff640 1 --2- 172.21.15.19:0/1261271343 >> v2:172.21.15.190:3300/0 conn(0x7fd75015cba0 0x7fd7500d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.823+0000 7fd747fff640 1 -- 172.21.15.19:0/1261271343 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7500d1950 con 0x7fd7500b84e0 2023-11-20T06:42:19.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.823+0000 7fd747fff640 1 --2- 172.21.15.19:0/1261271343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7500b84e0 0x7fd7500cfb00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd7500b4890 tx=0x7fd73801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb16a158891fb70 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:19.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.823+0000 7fd74e7fc640 1 -- 172.21.15.19:0/1261271343 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7380ab600 con 0x7fd7500b84e0 2023-11-20T06:42:19.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd74e7fc640 1 -- 172.21.15.19:0/1261271343 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7380a7050 con 0x7fd7500b84e0 2023-11-20T06:42:19.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd74e7fc640 1 -- 172.21.15.19:0/1261271343 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7380ab980 con 0x7fd7500b84e0 2023-11-20T06:42:19.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd755380640 1 -- 172.21.15.19:0/1261271343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7500b84e0 msgr2=0x7fd7500cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:19.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd755380640 1 --2- 172.21.15.19:0/1261271343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7500b84e0 0x7fd7500cfb00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd7500b4890 tx=0x7fd73801c240 comp rx=0 tx=0).stop 2023-11-20T06:42:19.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd755380640 1 -- 172.21.15.19:0/1261271343 shutdown_connections 2023-11-20T06:42:19.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd755380640 1 --2- 172.21.15.19:0/1261271343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd7500d0040 0x7fd7500d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd755380640 1 --2- 172.21.15.19:0/1261271343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7500b84e0 0x7fd7500cfb00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd755380640 1 --2- 172.21.15.19:0/1261271343 >> v2:172.21.15.190:3300/0 conn(0x7fd75015cba0 0x7fd7500d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd755380640 1 -- 172.21.15.19:0/1261271343 >> 172.21.15.19:0/1261271343 conn(0x7fd7500719c0 msgr2=0x7fd750071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:19.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd755380640 1 -- 172.21.15.19:0/1261271343 shutdown_connections 2023-11-20T06:42:19.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd755380640 1 -- 172.21.15.19:0/1261271343 wait complete. 2023-11-20T06:42:19.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd755380640 1 Processor -- start 2023-11-20T06:42:19.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd755380640 1 -- start start 2023-11-20T06:42:19.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd755380640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7500b84e0 0x7fd75014bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:19.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd755380640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7500d0040 0x7fd75015a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:19.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd755380640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd75015cba0 0x7fd750157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:19.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd755380640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75014c060 con 0x7fd7500d0040 2023-11-20T06:42:19.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd755380640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd750159f70 con 0x7fd7500b84e0 2023-11-20T06:42:19.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd755380640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75015e740 con 0x7fd75015cba0 2023-11-20T06:42:19.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd747fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7500d0040 0x7fd75015a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:19.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd747fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7500d0040 0x7fd75015a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51176/0 (socket says 172.21.15.19:51176) 2023-11-20T06:42:19.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd747fff640 1 -- 172.21.15.19:0/2558122733 learned_addr learned my addr 172.21.15.19:0/2558122733 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:19.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd74f7fe640 1 --2- 172.21.15.19:0/2558122733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd75015cba0 0x7fd750157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:19.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd74effd640 1 --2- 172.21.15.19:0/2558122733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7500b84e0 0x7fd75014bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:19.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd747fff640 1 -- 172.21.15.19:0/2558122733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd75015cba0 msgr2=0x7fd750157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:19.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd747fff640 1 --2- 172.21.15.19:0/2558122733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd75015cba0 0x7fd750157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd747fff640 1 -- 172.21.15.19:0/2558122733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7500b84e0 msgr2=0x7fd75014bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:19.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd747fff640 1 --2- 172.21.15.19:0/2558122733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7500b84e0 0x7fd75014bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:19.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.827+0000 7fd747fff640 1 -- 172.21.15.19:0/2558122733 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380094d0 con 0x7fd7500d0040 2023-11-20T06:42:19.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.831+0000 7fd747fff640 1 --2- 172.21.15.19:0/2558122733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7500d0040 0x7fd75015a320 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd73801a8f0 tx=0x7fd738018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:19.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.831+0000 7fd7477fe640 1 -- 172.21.15.19:0/2558122733 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7380b37d0 con 0x7fd7500d0040 2023-11-20T06:42:19.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.831+0000 7fd7477fe640 1 -- 172.21.15.19:0/2558122733 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7380a4e90 con 0x7fd7500d0040 2023-11-20T06:42:19.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.831+0000 7fd755380640 1 -- 172.21.15.19:0/2558122733 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7500c87b0 con 0x7fd7500d0040 2023-11-20T06:42:19.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.831+0000 7fd7477fe640 1 -- 172.21.15.19:0/2558122733 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7380b3b30 con 0x7fd7500d0040 2023-11-20T06:42:19.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.831+0000 7fd755380640 1 -- 172.21.15.19:0/2558122733 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75015ea00 con 0x7fd7500d0040 2023-11-20T06:42:19.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.831+0000 7fd755380640 1 -- 172.21.15.19:0/2558122733 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75004e170 con 0x7fd7500d0040 2023-11-20T06:42:19.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.831+0000 7fd7477fe640 1 -- 172.21.15.19:0/2558122733 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd7380b2070 con 0x7fd7500d0040 2023-11-20T06:42:19.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.831+0000 7fd7477fe640 1 --2- 172.21.15.19:0/2558122733 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd7300664a0 0x7fd730068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:19.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.831+0000 7fd7477fe640 1 -- 172.21.15.19:0/2558122733 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd73811e3d0 con 0x7fd7500d0040 2023-11-20T06:42:19.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.835+0000 7fd74effd640 1 --2- 172.21.15.19:0/2558122733 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd7300664a0 0x7fd730068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:19.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.835+0000 7fd74effd640 1 --2- 172.21.15.19:0/2558122733 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd7300664a0 0x7fd730068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd74000b930 tx=0x7fd740008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:19.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.835+0000 7fd7477fe640 1 -- 172.21.15.19:0/2558122733 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd7380eb5a0 con 0x7fd7500d0040 2023-11-20T06:42:19.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.991+0000 7fd755380640 1 -- 172.21.15.19:0/2558122733 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd750071ed0 con 0x7fd7500d0040 2023-11-20T06:42:19.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.995+0000 7fd7477fe640 1 -- 172.21.15.19:0/2558122733 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd7380eebc0 con 0x7fd7500d0040 2023-11-20T06:42:19.999 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:20.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.995+0000 7fd755380640 1 -- 172.21.15.19:0/2558122733 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd7300664a0 msgr2=0x7fd730068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:20.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.995+0000 7fd755380640 1 --2- 172.21.15.19:0/2558122733 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd7300664a0 0x7fd730068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd74000b930 tx=0x7fd740008040 comp rx=0 tx=0).stop 2023-11-20T06:42:20.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.995+0000 7fd755380640 1 -- 172.21.15.19:0/2558122733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7500d0040 msgr2=0x7fd75015a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:20.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.995+0000 7fd755380640 1 --2- 172.21.15.19:0/2558122733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7500d0040 0x7fd75015a320 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd73801a8f0 tx=0x7fd738018fe0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.995+0000 7fd755380640 1 -- 172.21.15.19:0/2558122733 shutdown_connections 2023-11-20T06:42:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.995+0000 7fd755380640 1 --2- 172.21.15.19:0/2558122733 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd7300664a0 0x7fd730068960 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.995+0000 7fd755380640 1 --2- 172.21.15.19:0/2558122733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd75015cba0 0x7fd750157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.995+0000 7fd755380640 1 --2- 172.21.15.19:0/2558122733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7500d0040 0x7fd75015a320 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.995+0000 7fd755380640 1 --2- 172.21.15.19:0/2558122733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7500b84e0 0x7fd75014bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.995+0000 7fd755380640 1 -- 172.21.15.19:0/2558122733 >> 172.21.15.19:0/2558122733 conn(0x7fd7500719c0 msgr2=0x7fd750072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.995+0000 7fd755380640 1 -- 172.21.15.19:0/2558122733 shutdown_connections 2023-11-20T06:42:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:19.995+0000 7fd755380640 1 -- 172.21.15.19:0/2558122733 wait complete. 2023-11-20T06:42:20.021 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T06:42:20.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.159+0000 7fbdaa879640 1 Processor -- start 2023-11-20T06:42:20.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.159+0000 7fbdaa879640 1 -- start start 2023-11-20T06:42:20.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.163+0000 7fbdaa879640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbda415cba0 0x7fbda40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:20.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.163+0000 7fbdaa879640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda40b84e0 0x7fbda40cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:20.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.163+0000 7fbdaa879640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbda40d0040 0x7fbda40d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:20.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.163+0000 7fbdaa879640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda40d1460 con 0x7fbda40d0040 2023-11-20T06:42:20.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.163+0000 7fbdaa879640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda40d04b0 con 0x7fbda415cba0 2023-11-20T06:42:20.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.163+0000 7fbdaa879640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40d1670 con 0x7fbda40b84e0 2023-11-20T06:42:20.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.163+0000 7fbda8e16640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbda40d0040 0x7fbda40d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:20.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.163+0000 7fbda8e16640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbda40d0040 0x7fbda40d2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51192/0 (socket says 172.21.15.19:51192) 2023-11-20T06:42:20.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.163+0000 7fbda8e16640 1 -- 172.21.15.19:0/3850347877 learned_addr learned my addr 172.21.15.19:0/3850347877 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:20.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.163+0000 7fbda3fff640 1 --2- 172.21.15.19:0/3850347877 >> v2:172.21.15.190:3300/0 conn(0x7fbda415cba0 0x7fbda40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:20.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.163+0000 7fbda37fe640 1 --2- 172.21.15.19:0/3850347877 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda40b84e0 0x7fbda40cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:20.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.163+0000 7fbda8e16640 1 -- 172.21.15.19:0/3850347877 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda40b84e0 msgr2=0x7fbda40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:20.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.163+0000 7fbda8e16640 1 --2- 172.21.15.19:0/3850347877 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda40b84e0 0x7fbda40cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.163+0000 7fbda8e16640 1 -- 172.21.15.19:0/3850347877 >> v2:172.21.15.190:3300/0 conn(0x7fbda415cba0 msgr2=0x7fbda40d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:20.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.163+0000 7fbda8e16640 1 --2- 172.21.15.19:0/3850347877 >> v2:172.21.15.190:3300/0 conn(0x7fbda415cba0 0x7fbda40d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.163+0000 7fbda8e16640 1 -- 172.21.15.19:0/3850347877 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda40d1950 con 0x7fbda40d0040 2023-11-20T06:42:20.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.163+0000 7fbda3fff640 1 --2- 172.21.15.19:0/3850347877 >> v2:172.21.15.190:3300/0 conn(0x7fbda415cba0 0x7fbda40d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:20.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.163+0000 7fbda37fe640 1 --2- 172.21.15.19:0/3850347877 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda40b84e0 0x7fbda40cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:20.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.167+0000 7fbda8e16640 1 --2- 172.21.15.19:0/3850347877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbda40d0040 0x7fbda40d2ae0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbda40b4890 tx=0x7fbd9c01c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1006bac593855fae server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:20.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.167+0000 7fbda2ffd640 1 -- 172.21.15.19:0/3850347877 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c0a5590 con 0x7fbda40d0040 2023-11-20T06:42:20.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.167+0000 7fbda2ffd640 1 -- 172.21.15.19:0/3850347877 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c0a56f0 con 0x7fbda40d0040 2023-11-20T06:42:20.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.167+0000 7fbda2ffd640 1 -- 172.21.15.19:0/3850347877 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c0a5a80 con 0x7fbda40d0040 2023-11-20T06:42:20.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.167+0000 7fbdaa879640 1 -- 172.21.15.19:0/3850347877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbda40d0040 msgr2=0x7fbda40d2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:20.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.167+0000 7fbdaa879640 1 --2- 172.21.15.19:0/3850347877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbda40d0040 0x7fbda40d2ae0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbda40b4890 tx=0x7fbd9c01c710 comp rx=0 tx=0).stop 2023-11-20T06:42:20.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.167+0000 7fbdaa879640 1 -- 172.21.15.19:0/3850347877 shutdown_connections 2023-11-20T06:42:20.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.167+0000 7fbdaa879640 1 --2- 172.21.15.19:0/3850347877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbda40d0040 0x7fbda40d2ae0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.167+0000 7fbdaa879640 1 --2- 172.21.15.19:0/3850347877 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda40b84e0 0x7fbda40cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.167+0000 7fbdaa879640 1 --2- 172.21.15.19:0/3850347877 >> v2:172.21.15.190:3300/0 conn(0x7fbda415cba0 0x7fbda40d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.167+0000 7fbdaa879640 1 -- 172.21.15.19:0/3850347877 >> 172.21.15.19:0/3850347877 conn(0x7fbda40719c0 msgr2=0x7fbda4071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:20.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.167+0000 7fbdaa879640 1 -- 172.21.15.19:0/3850347877 shutdown_connections 2023-11-20T06:42:20.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.167+0000 7fbdaa879640 1 -- 172.21.15.19:0/3850347877 wait complete. 2023-11-20T06:42:20.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.167+0000 7fbdaa879640 1 Processor -- start 2023-11-20T06:42:20.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.167+0000 7fbdaa879640 1 -- start start 2023-11-20T06:42:20.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbdaa879640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbda40b84e0 0x7fbda4150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbdaa879640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbda40d0040 0x7fbda41567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbdaa879640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda415cba0 0x7fbda415d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbdaa879640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda415dea0 con 0x7fbda40b84e0 2023-11-20T06:42:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbdaa879640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda415eca0 con 0x7fbda40d0040 2023-11-20T06:42:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbdaa879640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda415e090 con 0x7fbda415cba0 2023-11-20T06:42:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbda3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbda40b84e0 0x7fbda4150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbda3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbda40b84e0 0x7fbda4150430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51202/0 (socket says 172.21.15.19:51202) 2023-11-20T06:42:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbda3fff640 1 -- 172.21.15.19:0/158617470 learned_addr learned my addr 172.21.15.19:0/158617470 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbda8e16640 1 --2- 172.21.15.19:0/158617470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda415cba0 0x7fbda415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbda3fff640 1 -- 172.21.15.19:0/158617470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda415cba0 msgr2=0x7fbda415d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbda37fe640 1 --2- 172.21.15.19:0/158617470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbda40d0040 0x7fbda41567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:20.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbda3fff640 1 --2- 172.21.15.19:0/158617470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda415cba0 0x7fbda415d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbda3fff640 1 -- 172.21.15.19:0/158617470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbda40d0040 msgr2=0x7fbda41567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:20.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbda3fff640 1 --2- 172.21.15.19:0/158617470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbda40d0040 0x7fbda41567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbda3fff640 1 -- 172.21.15.19:0/158617470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c009b30 con 0x7fbda40b84e0 2023-11-20T06:42:20.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbda8e16640 1 --2- 172.21.15.19:0/158617470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda415cba0 0x7fbda415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:20.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbda37fe640 1 --2- 172.21.15.19:0/158617470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbda40d0040 0x7fbda41567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:20.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbda3fff640 1 --2- 172.21.15.19:0/158617470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbda40b84e0 0x7fbda4150430 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400c7f0 tx=0x7fbd9400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:20.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbda0ff9640 1 -- 172.21.15.19:0/158617470 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd94007820 con 0x7fbda40b84e0 2023-11-20T06:42:20.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbda0ff9640 1 -- 172.21.15.19:0/158617470 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd94007980 con 0x7fbda40b84e0 2023-11-20T06:42:20.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbdaa879640 1 -- 172.21.15.19:0/158617470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda415e370 con 0x7fbda40b84e0 2023-11-20T06:42:20.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbda0ff9640 1 -- 172.21.15.19:0/158617470 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd94007d30 con 0x7fbda40b84e0 2023-11-20T06:42:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbdaa879640 1 -- 172.21.15.19:0/158617470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda415e930 con 0x7fbda40b84e0 2023-11-20T06:42:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbdaa879640 1 -- 172.21.15.19:0/158617470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda404e170 con 0x7fbda40b84e0 2023-11-20T06:42:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.171+0000 7fbda0ff9640 1 -- 172.21.15.19:0/158617470 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbd940113f0 con 0x7fbda40b84e0 2023-11-20T06:42:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.175+0000 7fbda0ff9640 1 --2- 172.21.15.19:0/158617470 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbd900664a0 0x7fbd90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.175+0000 7fbda0ff9640 1 -- 172.21.15.19:0/158617470 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbd940844d0 con 0x7fbda40b84e0 2023-11-20T06:42:20.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.175+0000 7fbda37fe640 1 --2- 172.21.15.19:0/158617470 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbd900664a0 0x7fbd90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:20.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.175+0000 7fbda37fe640 1 --2- 172.21.15.19:0/158617470 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbd900664a0 0x7fbd90068960 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbd98006fd0 tx=0x7fbd98008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:20.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.179+0000 7fbda0ff9640 1 -- 172.21.15.19:0/158617470 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbd94051620 con 0x7fbda40b84e0 2023-11-20T06:42:20.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.335+0000 7fbdaa879640 1 -- 172.21.15.19:0/158617470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbda4071da0 con 0x7fbda40b84e0 2023-11-20T06:42:20.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.335+0000 7fbda0ff9640 1 -- 172.21.15.19:0/158617470 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd9405b030 con 0x7fbda40b84e0 2023-11-20T06:42:20.341 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-20T06:42:20.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.335+0000 7fbdaa879640 1 -- 172.21.15.19:0/158617470 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbd900664a0 msgr2=0x7fbd90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:20.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.335+0000 7fbdaa879640 1 --2- 172.21.15.19:0/158617470 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbd900664a0 0x7fbd90068960 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbd98006fd0 tx=0x7fbd98008040 comp rx=0 tx=0).stop 2023-11-20T06:42:20.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.335+0000 7fbdaa879640 1 -- 172.21.15.19:0/158617470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbda40b84e0 msgr2=0x7fbda4150430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:20.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.335+0000 7fbdaa879640 1 --2- 172.21.15.19:0/158617470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbda40b84e0 0x7fbda4150430 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400c7f0 tx=0x7fbd9400ccb0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.335+0000 7fbdaa879640 1 -- 172.21.15.19:0/158617470 shutdown_connections 2023-11-20T06:42:20.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.335+0000 7fbdaa879640 1 --2- 172.21.15.19:0/158617470 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbd900664a0 0x7fbd90068960 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.335+0000 7fbdaa879640 1 --2- 172.21.15.19:0/158617470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbda415cba0 0x7fbda415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.335+0000 7fbdaa879640 1 --2- 172.21.15.19:0/158617470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbda40d0040 0x7fbda41567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.335+0000 7fbdaa879640 1 --2- 172.21.15.19:0/158617470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbda40b84e0 0x7fbda4150430 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.335+0000 7fbdaa879640 1 -- 172.21.15.19:0/158617470 >> 172.21.15.19:0/158617470 conn(0x7fbda40719c0 msgr2=0x7fbda40b6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:20.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.335+0000 7fbdaa879640 1 -- 172.21.15.19:0/158617470 shutdown_connections 2023-11-20T06:42:20.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.335+0000 7fbdaa879640 1 -- 172.21.15.19:0/158617470 wait complete. 2023-11-20T06:42:20.362 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T06:42:20.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.503+0000 7f7a47f3e640 1 Processor -- start 2023-11-20T06:42:20.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.503+0000 7f7a47f3e640 1 -- start start 2023-11-20T06:42:20.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.503+0000 7f7a47f3e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7a4006a0f0 0x7f7a400c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:20.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.503+0000 7f7a47f3e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7a4006a4d0 0x7f7a400ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.503+0000 7f7a47f3e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4006c6d0 con 0x7f7a40164dc0 2023-11-20T06:42:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.503+0000 7f7a47f3e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4006c950 con 0x7f7a4006a0f0 2023-11-20T06:42:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.503+0000 7f7a47f3e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a401654f0 con 0x7f7a4006a4d0 2023-11-20T06:42:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.503+0000 7f7a464db640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7a40164dc0 0x7f7a400ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54428/0 (socket says 172.21.15.19:54428) 2023-11-20T06:42:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.503+0000 7f7a464db640 1 -- 172.21.15.19:0/3191991625 learned_addr learned my addr 172.21.15.19:0/3191991625 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.503+0000 7f7a45cda640 1 --2- 172.21.15.19:0/3191991625 >> v2:172.21.15.19:3300/0 conn(0x7f7a4006a0f0 0x7f7a400c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.503+0000 7f7a454d9640 1 --2- 172.21.15.19:0/3191991625 >> v2:172.21.15.190:3300/0 conn(0x7f7a4006a4d0 0x7f7a400ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.503+0000 7f7a45cda640 1 -- 172.21.15.19:0/3191991625 >> v2:172.21.15.190:3300/0 conn(0x7f7a4006a4d0 msgr2=0x7f7a400ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.503+0000 7f7a45cda640 1 --2- 172.21.15.19:0/3191991625 >> v2:172.21.15.190:3300/0 conn(0x7f7a4006a4d0 0x7f7a400ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.503+0000 7f7a45cda640 1 -- 172.21.15.19:0/3191991625 >> v1:172.21.15.19:6789/0 conn(0x7f7a40164dc0 legacy=0x7f7a400ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.503+0000 7f7a45cda640 1 -- 172.21.15.19:0/3191991625 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a401657d0 con 0x7f7a4006a0f0 2023-11-20T06:42:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.503+0000 7f7a44cd8640 1 -- 172.21.15.19:0/3191991625 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865414840 0 0) 0x7f7a4006c6d0 con 0x7f7a40164dc0 2023-11-20T06:42:20.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.503+0000 7f7a454d9640 1 --2- 172.21.15.19:0/3191991625 >> v2:172.21.15.190:3300/0 conn(0x7f7a4006a4d0 0x7f7a400ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:20.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.507+0000 7f7a45cda640 1 --2- 172.21.15.19:0/3191991625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a4006a0f0 0x7f7a400c8dd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7a40071390 tx=0x7f7a3c01cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e39c029ea08c373 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:20.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.507+0000 7f7a44cd8640 1 -- 172.21.15.19:0/3191991625 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c0ab680 con 0x7f7a4006a0f0 2023-11-20T06:42:20.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.507+0000 7f7a44cd8640 1 -- 172.21.15.19:0/3191991625 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c0ab7e0 con 0x7f7a4006a0f0 2023-11-20T06:42:20.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.507+0000 7f7a44cd8640 1 -- 172.21.15.19:0/3191991625 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c0abb70 con 0x7f7a4006a0f0 2023-11-20T06:42:20.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.507+0000 7f7a47f3e640 1 -- 172.21.15.19:0/3191991625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a4006a0f0 msgr2=0x7f7a400c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:20.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.507+0000 7f7a47f3e640 1 --2- 172.21.15.19:0/3191991625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a4006a0f0 0x7f7a400c8dd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7a40071390 tx=0x7f7a3c01cec0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.507+0000 7f7a47f3e640 1 -- 172.21.15.19:0/3191991625 shutdown_connections 2023-11-20T06:42:20.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.507+0000 7f7a47f3e640 1 --2- 172.21.15.19:0/3191991625 >> v2:172.21.15.190:3300/0 conn(0x7f7a4006a4d0 0x7f7a400ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.507+0000 7f7a47f3e640 1 --2- 172.21.15.19:0/3191991625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a4006a0f0 0x7f7a400c8dd0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.507+0000 7f7a47f3e640 1 -- 172.21.15.19:0/3191991625 >> 172.21.15.19:0/3191991625 conn(0x7f7a400b0da0 msgr2=0x7f7a400ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:20.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.507+0000 7f7a47f3e640 1 -- 172.21.15.19:0/3191991625 shutdown_connections 2023-11-20T06:42:20.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.507+0000 7f7a47f3e640 1 -- 172.21.15.19:0/3191991625 wait complete. 2023-11-20T06:42:20.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a47f3e640 1 Processor -- start 2023-11-20T06:42:20.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a47f3e640 1 -- start start 2023-11-20T06:42:20.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a47f3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a4006a0f0 0x7f7a400b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:20.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a47f3e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a4006a4d0 0x7f7a4015aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:20.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a47f3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a40164dc0 0x7f7a40163080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:20.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a47f3e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400b44a0 con 0x7f7a4006a0f0 2023-11-20T06:42:20.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a47f3e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400c5850 con 0x7f7a4006a4d0 2023-11-20T06:42:20.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a47f3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4015be20 con 0x7f7a40164dc0 2023-11-20T06:42:20.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a45cda640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a4006a0f0 0x7f7a400b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:20.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a45cda640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a4006a0f0 0x7f7a400b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51222/0 (socket says 172.21.15.19:51222) 2023-11-20T06:42:20.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a45cda640 1 -- 172.21.15.19:0/4118643532 learned_addr learned my addr 172.21.15.19:0/4118643532 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:20.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a464db640 1 --2- 172.21.15.19:0/4118643532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a40164dc0 0x7f7a40163080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:20.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a454d9640 1 --2- 172.21.15.19:0/4118643532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a4006a4d0 0x7f7a4015aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:20.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a45cda640 1 -- 172.21.15.19:0/4118643532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a40164dc0 msgr2=0x7f7a40163080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:20.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a45cda640 1 --2- 172.21.15.19:0/4118643532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a40164dc0 0x7f7a40163080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a45cda640 1 -- 172.21.15.19:0/4118643532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a4006a4d0 msgr2=0x7f7a4015aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:20.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a45cda640 1 --2- 172.21.15.19:0/4118643532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a4006a4d0 0x7f7a4015aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a45cda640 1 -- 172.21.15.19:0/4118643532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c009420 con 0x7f7a4006a0f0 2023-11-20T06:42:20.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a464db640 1 --2- 172.21.15.19:0/4118643532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a40164dc0 0x7f7a40163080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:20.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a45cda640 1 --2- 172.21.15.19:0/4118643532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a4006a0f0 0x7f7a400b3c30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c0ad040 tx=0x7f7a3c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:20.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a367fc640 1 -- 172.21.15.19:0/4118643532 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c0b5810 con 0x7f7a4006a0f0 2023-11-20T06:42:20.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a367fc640 1 -- 172.21.15.19:0/4118643532 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c0b5990 con 0x7f7a4006a0f0 2023-11-20T06:42:20.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a47f3e640 1 -- 172.21.15.19:0/4118643532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4015c100 con 0x7f7a4006a0f0 2023-11-20T06:42:20.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a367fc640 1 -- 172.21.15.19:0/4118643532 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c0b5d40 con 0x7f7a4006a0f0 2023-11-20T06:42:20.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.511+0000 7f7a47f3e640 1 -- 172.21.15.19:0/4118643532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a400b4170 con 0x7f7a4006a0f0 2023-11-20T06:42:20.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.515+0000 7f7a47f3e640 1 -- 172.21.15.19:0/4118643532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4015c620 con 0x7f7a4006a0f0 2023-11-20T06:42:20.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.515+0000 7f7a367fc640 1 -- 172.21.15.19:0/4118643532 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7a3c0bf410 con 0x7f7a4006a0f0 2023-11-20T06:42:20.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.515+0000 7f7a367fc640 1 --2- 172.21.15.19:0/4118643532 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7a240664a0 0x7f7a24068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:20.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.515+0000 7f7a367fc640 1 -- 172.21.15.19:0/4118643532 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7a3c11ed20 con 0x7f7a4006a0f0 2023-11-20T06:42:20.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.515+0000 7f7a454d9640 1 --2- 172.21.15.19:0/4118643532 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7a240664a0 0x7f7a24068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:20.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.515+0000 7f7a454d9640 1 --2- 172.21.15.19:0/4118643532 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7a240664a0 0x7f7a24068960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7a400b48a0 tx=0x7f7a30008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:20.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.519+0000 7f7a367fc640 1 -- 172.21.15.19:0/4118643532 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7a3c0ebdf0 con 0x7f7a4006a0f0 2023-11-20T06:42:20.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.675+0000 7f7a47f3e640 1 -- 172.21.15.19:0/4118643532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7a4015bf60 con 0x7f7a4006a0f0 2023-11-20T06:42:20.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.675+0000 7f7a367fc640 1 -- 172.21.15.19:0/4118643532 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7a4015bf60 con 0x7f7a4006a0f0 2023-11-20T06:42:20.681 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:20.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.679+0000 7f7a47f3e640 1 -- 172.21.15.19:0/4118643532 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7a240664a0 msgr2=0x7f7a24068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:20.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.679+0000 7f7a47f3e640 1 --2- 172.21.15.19:0/4118643532 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7a240664a0 0x7f7a24068960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7a400b48a0 tx=0x7f7a30008040 comp rx=0 tx=0).stop 2023-11-20T06:42:20.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.679+0000 7f7a47f3e640 1 -- 172.21.15.19:0/4118643532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a4006a0f0 msgr2=0x7f7a400b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:20.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.679+0000 7f7a47f3e640 1 --2- 172.21.15.19:0/4118643532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a4006a0f0 0x7f7a400b3c30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c0ad040 tx=0x7f7a3c01aca0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.679+0000 7f7a47f3e640 1 -- 172.21.15.19:0/4118643532 shutdown_connections 2023-11-20T06:42:20.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.679+0000 7f7a47f3e640 1 --2- 172.21.15.19:0/4118643532 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7a240664a0 0x7f7a24068960 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.679+0000 7f7a47f3e640 1 --2- 172.21.15.19:0/4118643532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a40164dc0 0x7f7a40163080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.679+0000 7f7a47f3e640 1 --2- 172.21.15.19:0/4118643532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a4006a4d0 0x7f7a4015aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.679+0000 7f7a47f3e640 1 --2- 172.21.15.19:0/4118643532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a4006a0f0 0x7f7a400b3c30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.679+0000 7f7a47f3e640 1 -- 172.21.15.19:0/4118643532 >> 172.21.15.19:0/4118643532 conn(0x7f7a400b0da0 msgr2=0x7f7a400af730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:20.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.679+0000 7f7a47f3e640 1 -- 172.21.15.19:0/4118643532 shutdown_connections 2023-11-20T06:42:20.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.679+0000 7f7a47f3e640 1 -- 172.21.15.19:0/4118643532 wait complete. 2023-11-20T06:42:20.702 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T06:42:20.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.839+0000 7fd07992a640 1 Processor -- start 2023-11-20T06:42:20.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.839+0000 7fd07992a640 1 -- start start 2023-11-20T06:42:20.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.843+0000 7fd07992a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd07415ca70 0x7fd0740d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:20.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.843+0000 7fd07992a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0740d3550 0x7fd0740cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:20.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.843+0000 7fd07992a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0740cf5d0 0x7fd0740d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:20.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.843+0000 7fd07992a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0740ce820 con 0x7fd0740cf5d0 2023-11-20T06:42:20.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.843+0000 7fd07992a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0740cfa40 con 0x7fd07415ca70 2023-11-20T06:42:20.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.843+0000 7fd07992a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0740c65f0 con 0x7fd0740d3550 2023-11-20T06:42:20.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.843+0000 7fd0737fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0740cf5d0 0x7fd0740d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:20.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.843+0000 7fd0737fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0740cf5d0 0x7fd0740d0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51224/0 (socket says 172.21.15.19:51224) 2023-11-20T06:42:20.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.843+0000 7fd0737fe640 1 -- 172.21.15.19:0/2813015275 learned_addr learned my addr 172.21.15.19:0/2813015275 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:20.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.843+0000 7fd072ffd640 1 --2- 172.21.15.19:0/2813015275 >> v2:172.21.15.190:3300/0 conn(0x7fd07415ca70 0x7fd0740d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:20.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.843+0000 7fd06bfff640 1 --2- 172.21.15.19:0/2813015275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0740d3550 0x7fd0740cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:20.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.843+0000 7fd0737fe640 1 -- 172.21.15.19:0/2813015275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0740d3550 msgr2=0x7fd0740cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:20.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.843+0000 7fd0737fe640 1 --2- 172.21.15.19:0/2813015275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0740d3550 0x7fd0740cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.843+0000 7fd0737fe640 1 -- 172.21.15.19:0/2813015275 >> v2:172.21.15.190:3300/0 conn(0x7fd07415ca70 msgr2=0x7fd0740d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:20.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.843+0000 7fd0737fe640 1 --2- 172.21.15.19:0/2813015275 >> v2:172.21.15.190:3300/0 conn(0x7fd07415ca70 0x7fd0740d3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.843+0000 7fd0737fe640 1 -- 172.21.15.19:0/2813015275 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0740cdf80 con 0x7fd0740cf5d0 2023-11-20T06:42:20.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.843+0000 7fd06bfff640 1 --2- 172.21.15.19:0/2813015275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0740d3550 0x7fd0740cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:20.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.843+0000 7fd072ffd640 1 --2- 172.21.15.19:0/2813015275 >> v2:172.21.15.190:3300/0 conn(0x7fd07415ca70 0x7fd0740d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:20.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd0737fe640 1 --2- 172.21.15.19:0/2813015275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0740cf5d0 0x7fd0740d0980 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd07408a880 tx=0x7fd06c01c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1510a22399f16e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:20.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd0727fc640 1 -- 172.21.15.19:0/2813015275 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06c0a5560 con 0x7fd0740cf5d0 2023-11-20T06:42:20.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd0727fc640 1 -- 172.21.15.19:0/2813015275 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06c0a56c0 con 0x7fd0740cf5d0 2023-11-20T06:42:20.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd0727fc640 1 -- 172.21.15.19:0/2813015275 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06c0a5a50 con 0x7fd0740cf5d0 2023-11-20T06:42:20.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd07992a640 1 -- 172.21.15.19:0/2813015275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0740cf5d0 msgr2=0x7fd0740d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:20.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd07992a640 1 --2- 172.21.15.19:0/2813015275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0740cf5d0 0x7fd0740d0980 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd07408a880 tx=0x7fd06c01c6e0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd07992a640 1 -- 172.21.15.19:0/2813015275 shutdown_connections 2023-11-20T06:42:20.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd07992a640 1 --2- 172.21.15.19:0/2813015275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0740cf5d0 0x7fd0740d0980 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd07992a640 1 --2- 172.21.15.19:0/2813015275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0740d3550 0x7fd0740cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd07992a640 1 --2- 172.21.15.19:0/2813015275 >> v2:172.21.15.190:3300/0 conn(0x7fd07415ca70 0x7fd0740d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd07992a640 1 -- 172.21.15.19:0/2813015275 >> 172.21.15.19:0/2813015275 conn(0x7fd07409bc50 msgr2=0x7fd0740d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:20.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd07992a640 1 -- 172.21.15.19:0/2813015275 shutdown_connections 2023-11-20T06:42:20.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd07992a640 1 -- 172.21.15.19:0/2813015275 wait complete. 2023-11-20T06:42:20.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd07992a640 1 Processor -- start 2023-11-20T06:42:20.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd07992a640 1 -- start start 2023-11-20T06:42:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd07992a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0740cf5d0 0x7fd07415fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd07992a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0740d3550 0x7fd07415e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd07992a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd07415ca70 0x7fd07406c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd07992a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd074160450 con 0x7fd0740cf5d0 2023-11-20T06:42:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd07992a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07415ef30 con 0x7fd07415ca70 2023-11-20T06:42:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.847+0000 7fd07992a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd074160170 con 0x7fd0740d3550 2023-11-20T06:42:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd072ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0740cf5d0 0x7fd07415fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd072ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0740cf5d0 0x7fd07415fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51236/0 (socket says 172.21.15.19:51236) 2023-11-20T06:42:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd072ffd640 1 -- 172.21.15.19:0/4164204936 learned_addr learned my addr 172.21.15.19:0/4164204936 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd06bfff640 1 --2- 172.21.15.19:0/4164204936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0740d3550 0x7fd07415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd0737fe640 1 --2- 172.21.15.19:0/4164204936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd07415ca70 0x7fd07406c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd072ffd640 1 -- 172.21.15.19:0/4164204936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0740d3550 msgr2=0x7fd07415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd072ffd640 1 --2- 172.21.15.19:0/4164204936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0740d3550 0x7fd07415e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd072ffd640 1 -- 172.21.15.19:0/4164204936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd07415ca70 msgr2=0x7fd07406c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd072ffd640 1 --2- 172.21.15.19:0/4164204936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd07415ca70 0x7fd07406c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd072ffd640 1 -- 172.21.15.19:0/4164204936 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c009b30 con 0x7fd0740cf5d0 2023-11-20T06:42:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd06bfff640 1 --2- 172.21.15.19:0/4164204936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0740d3550 0x7fd07415e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd0737fe640 1 --2- 172.21.15.19:0/4164204936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd07415ca70 0x7fd07406c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd072ffd640 1 --2- 172.21.15.19:0/4164204936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0740cf5d0 0x7fd07415fb40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd06400d800 tx=0x7fd06400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd070ff9640 1 -- 172.21.15.19:0/4164204936 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0640059a0 con 0x7fd0740cf5d0 2023-11-20T06:42:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd070ff9640 1 -- 172.21.15.19:0/4164204936 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd064005b00 con 0x7fd0740cf5d0 2023-11-20T06:42:20.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd070ff9640 1 -- 172.21.15.19:0/4164204936 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd064005e90 con 0x7fd0740cf5d0 2023-11-20T06:42:20.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd07992a640 1 -- 172.21.15.19:0/4164204936 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0740b58a0 con 0x7fd0740cf5d0 2023-11-20T06:42:20.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd07992a640 1 -- 172.21.15.19:0/4164204936 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0740b5e60 con 0x7fd0740cf5d0 2023-11-20T06:42:20.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd07992a640 1 -- 172.21.15.19:0/4164204936 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0740b5700 con 0x7fd0740cf5d0 2023-11-20T06:42:20.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd070ff9640 1 -- 172.21.15.19:0/4164204936 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd064004030 con 0x7fd0740cf5d0 2023-11-20T06:42:20.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.851+0000 7fd070ff9640 1 --2- 172.21.15.19:0/4164204936 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd0540664a0 0x7fd054068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:20.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.855+0000 7fd070ff9640 1 -- 172.21.15.19:0/4164204936 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd0640840b0 con 0x7fd0740cf5d0 2023-11-20T06:42:20.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.855+0000 7fd06bfff640 1 --2- 172.21.15.19:0/4164204936 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd0540664a0 0x7fd054068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:20.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.855+0000 7fd06bfff640 1 --2- 172.21.15.19:0/4164204936 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd0540664a0 0x7fd054068960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd0740c5d50 tx=0x7fd05c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:20.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:20.855+0000 7fd070ff9640 1 -- 172.21.15.19:0/4164204936 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd0740b5700 con 0x7fd0740cf5d0 2023-11-20T06:42:21.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.027+0000 7fd07992a640 1 -- 172.21.15.19:0/4164204936 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd0740b5700 con 0x7fd0740cf5d0 2023-11-20T06:42:21.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.027+0000 7fd070ff9640 1 -- 172.21.15.19:0/4164204936 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd0740b5700 con 0x7fd0740cf5d0 2023-11-20T06:42:21.033 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2023-11-20T06:42:21.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.027+0000 7fd07992a640 1 -- 172.21.15.19:0/4164204936 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd0540664a0 msgr2=0x7fd054068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:21.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.027+0000 7fd07992a640 1 --2- 172.21.15.19:0/4164204936 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd0540664a0 0x7fd054068960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd0740c5d50 tx=0x7fd05c008040 comp rx=0 tx=0).stop 2023-11-20T06:42:21.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.027+0000 7fd07992a640 1 -- 172.21.15.19:0/4164204936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0740cf5d0 msgr2=0x7fd07415fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:21.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.027+0000 7fd07992a640 1 --2- 172.21.15.19:0/4164204936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0740cf5d0 0x7fd07415fb40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd06400d800 tx=0x7fd06400dcc0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.027+0000 7fd07992a640 1 -- 172.21.15.19:0/4164204936 shutdown_connections 2023-11-20T06:42:21.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.027+0000 7fd07992a640 1 --2- 172.21.15.19:0/4164204936 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd0540664a0 0x7fd054068960 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.027+0000 7fd07992a640 1 --2- 172.21.15.19:0/4164204936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd07415ca70 0x7fd07406c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.027+0000 7fd07992a640 1 --2- 172.21.15.19:0/4164204936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0740d3550 0x7fd07415e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.027+0000 7fd07992a640 1 --2- 172.21.15.19:0/4164204936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0740cf5d0 0x7fd07415fb40 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.027+0000 7fd07992a640 1 -- 172.21.15.19:0/4164204936 >> 172.21.15.19:0/4164204936 conn(0x7fd07409bc50 msgr2=0x7fd07406b110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:21.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.027+0000 7fd07992a640 1 -- 172.21.15.19:0/4164204936 shutdown_connections 2023-11-20T06:42:21.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.027+0000 7fd07992a640 1 -- 172.21.15.19:0/4164204936 wait complete. 2023-11-20T06:42:21.054 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:42:21.054 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:42:21.064 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:21.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.243+0000 7f99a3c46640 1 Processor -- start 2023-11-20T06:42:21.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.243+0000 7f99a3c46640 1 -- start start 2023-11-20T06:42:21.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.247+0000 7f99a3c46640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f999c0d15d0 0x7f999c0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:21.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.247+0000 7f99a3c46640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f999c0d3010 0x7f999c0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:21.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.247+0000 7f99a3c46640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f999c0ce770 con 0x7f999c15cb90 2023-11-20T06:42:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.247+0000 7f99a3c46640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f999c0d0600 con 0x7f999c0d15d0 2023-11-20T06:42:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.247+0000 7f99a3c46640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f999c0c6450 con 0x7f999c0d3010 2023-11-20T06:42:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.247+0000 7f99a11e1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f999c0d15d0 0x7f999c0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.247+0000 7f99a11e1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f999c0d15d0 0x7f999c0cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51240/0 (socket says 172.21.15.19:51240) 2023-11-20T06:42:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.247+0000 7f99a11e1640 1 -- 172.21.15.19:0/2255177777 learned_addr learned my addr 172.21.15.19:0/2255177777 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.247+0000 7f99a21e3640 1 --2- 172.21.15.19:0/2255177777 >> v2:172.21.15.190:3300/0 conn(0x7f999c0d3010 0x7f999c0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.247+0000 7f99a11e1640 1 -- 172.21.15.19:0/2255177777 >> v2:172.21.15.190:3300/0 conn(0x7f999c0d3010 msgr2=0x7f999c0c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.247+0000 7f99a11e1640 1 --2- 172.21.15.19:0/2255177777 >> v2:172.21.15.190:3300/0 conn(0x7f999c0d3010 0x7f999c0c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.247+0000 7f99a11e1640 1 -- 172.21.15.19:0/2255177777 >> v1:172.21.15.190:6789/0 conn(0x7f999c15cb90 legacy=0x7f999c0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.247+0000 7f99a11e1640 1 -- 172.21.15.19:0/2255177777 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c0d08a0 con 0x7f999c0d15d0 2023-11-20T06:42:21.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.251+0000 7f99a11e1640 1 --2- 172.21.15.19:0/2255177777 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f999c0d15d0 0x7f999c0cfb10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f999c072590 tx=0x7f998c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68344872e0317d60 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:21.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.251+0000 7f99a09e0640 1 -- 172.21.15.19:0/2255177777 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c0ab640 con 0x7f999c0d15d0 2023-11-20T06:42:21.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.251+0000 7f99a09e0640 1 -- 172.21.15.19:0/2255177777 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998c0a7070 con 0x7f999c0d15d0 2023-11-20T06:42:21.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.251+0000 7f99a09e0640 1 -- 172.21.15.19:0/2255177777 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c0ab9c0 con 0x7f999c0d15d0 2023-11-20T06:42:21.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.251+0000 7f99a3c46640 1 -- 172.21.15.19:0/2255177777 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f999c0d15d0 msgr2=0x7f999c0cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:21.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.251+0000 7f99a3c46640 1 --2- 172.21.15.19:0/2255177777 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f999c0d15d0 0x7f999c0cfb10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f999c072590 tx=0x7f998c01c440 comp rx=0 tx=0).stop 2023-11-20T06:42:21.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.251+0000 7f99a3c46640 1 -- 172.21.15.19:0/2255177777 shutdown_connections 2023-11-20T06:42:21.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.251+0000 7f99a3c46640 1 --2- 172.21.15.19:0/2255177777 >> v2:172.21.15.190:3300/0 conn(0x7f999c0d3010 0x7f999c0c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.251+0000 7f99a3c46640 1 --2- 172.21.15.19:0/2255177777 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f999c0d15d0 0x7f999c0cfb10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.251+0000 7f99a3c46640 1 -- 172.21.15.19:0/2255177777 >> 172.21.15.19:0/2255177777 conn(0x7f999c09bc50 msgr2=0x7f999c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:21.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.251+0000 7f99a3c46640 1 -- 172.21.15.19:0/2255177777 shutdown_connections 2023-11-20T06:42:21.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.251+0000 7f99a3c46640 1 -- 172.21.15.19:0/2255177777 wait complete. 2023-11-20T06:42:21.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.251+0000 7f99a3c46640 1 Processor -- start 2023-11-20T06:42:21.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.251+0000 7f99a3c46640 1 -- start start 2023-11-20T06:42:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99a3c46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f999c0d15d0 0x7f999c06bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99a3c46640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f999c0d3010 0x7f999c0cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99a3c46640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f999c15cb90 0x7f999c0cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99a3c46640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999c157ba0 con 0x7f999c0d3010 2023-11-20T06:42:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99a3c46640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999c157e80 con 0x7f999c15cb90 2023-11-20T06:42:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99a3c46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999c158160 con 0x7f999c0d15d0 2023-11-20T06:42:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99a11e1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f999c0d3010 0x7f999c0cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99a11e1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f999c0d3010 0x7f999c0cb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51246/0 (socket says 172.21.15.19:51246) 2023-11-20T06:42:21.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99a11e1640 1 -- 172.21.15.19:0/2713414022 learned_addr learned my addr 172.21.15.19:0/2713414022 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:21.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99a19e2640 1 --2- 172.21.15.19:0/2713414022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f999c0d15d0 0x7f999c06bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:21.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99a21e3640 1 --2- 172.21.15.19:0/2713414022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f999c15cb90 0x7f999c0cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:21.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99a11e1640 1 -- 172.21.15.19:0/2713414022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f999c0d15d0 msgr2=0x7f999c06bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:21.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99a11e1640 1 --2- 172.21.15.19:0/2713414022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f999c0d15d0 0x7f999c06bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99a11e1640 1 -- 172.21.15.19:0/2713414022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f999c15cb90 msgr2=0x7f999c0cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:21.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99a11e1640 1 --2- 172.21.15.19:0/2713414022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f999c15cb90 0x7f999c0cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99a11e1640 1 -- 172.21.15.19:0/2713414022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c0094d0 con 0x7f999c0d3010 2023-11-20T06:42:21.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99a11e1640 1 --2- 172.21.15.19:0/2713414022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f999c0d3010 0x7f999c0cb9f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f998c019050 tx=0x7f998c01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99927fc640 1 -- 172.21.15.19:0/2713414022 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c0be3f0 con 0x7f999c0d3010 2023-11-20T06:42:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99927fc640 1 -- 172.21.15.19:0/2713414022 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998c0be550 con 0x7f999c0d3010 2023-11-20T06:42:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99a3c46640 1 -- 172.21.15.19:0/2713414022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f999c09e2c0 con 0x7f999c0d3010 2023-11-20T06:42:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99927fc640 1 -- 172.21.15.19:0/2713414022 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c0be900 con 0x7f999c0d3010 2023-11-20T06:42:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99a3c46640 1 -- 172.21.15.19:0/2713414022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f999c09c890 con 0x7f999c0d3010 2023-11-20T06:42:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99a3c46640 1 -- 172.21.15.19:0/2713414022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f999c074010 con 0x7f999c0d3010 2023-11-20T06:42:21.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.255+0000 7f99927fc640 1 -- 172.21.15.19:0/2713414022 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f998c0b43f0 con 0x7f999c0d3010 2023-11-20T06:42:21.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.259+0000 7f99927fc640 1 --2- 172.21.15.19:0/2713414022 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f99800664d0 0x7f9980068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:21.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.259+0000 7f99927fc640 1 -- 172.21.15.19:0/2713414022 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f998c11e750 con 0x7f999c0d3010 2023-11-20T06:42:21.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.259+0000 7f99a19e2640 1 --2- 172.21.15.19:0/2713414022 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f99800664d0 0x7f9980068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:21.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.259+0000 7f99a19e2640 1 --2- 172.21.15.19:0/2713414022 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f99800664d0 0x7f9980068990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9998000fc0 tx=0x7f9998009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:21.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.263+0000 7f99927fc640 1 -- 172.21.15.19:0/2713414022 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f998c0eb820 con 0x7f999c0d3010 2023-11-20T06:42:21.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.419+0000 7f99a3c46640 1 -- 172.21.15.19:0/2713414022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f999c09e770 con 0x7f999c0d3010 2023-11-20T06:42:21.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.419+0000 7f99927fc640 1 -- 172.21.15.19:0/2713414022 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18720 (secure 0 0 0) 0x7f998c0eee40 con 0x7f999c0d3010 2023-11-20T06:42:21.426 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:21.426 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:55.472006+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:21.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.423+0000 7f99a3c46640 1 -- 172.21.15.19:0/2713414022 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f99800664d0 msgr2=0x7f9980068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:21.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.423+0000 7f99a3c46640 1 --2- 172.21.15.19:0/2713414022 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f99800664d0 0x7f9980068990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9998000fc0 tx=0x7f9998009040 comp rx=0 tx=0).stop 2023-11-20T06:42:21.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.423+0000 7f99a3c46640 1 -- 172.21.15.19:0/2713414022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f999c0d3010 msgr2=0x7f999c0cb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:21.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.423+0000 7f99a3c46640 1 --2- 172.21.15.19:0/2713414022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f999c0d3010 0x7f999c0cb9f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f998c019050 tx=0x7f998c01ac80 comp rx=0 tx=0).stop 2023-11-20T06:42:21.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.423+0000 7f99a3c46640 1 -- 172.21.15.19:0/2713414022 shutdown_connections 2023-11-20T06:42:21.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.423+0000 7f99a3c46640 1 --2- 172.21.15.19:0/2713414022 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f99800664d0 0x7f9980068990 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.423+0000 7f99a3c46640 1 --2- 172.21.15.19:0/2713414022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f999c15cb90 0x7f999c0cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.423+0000 7f99a3c46640 1 --2- 172.21.15.19:0/2713414022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f999c0d3010 0x7f999c0cb9f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.423+0000 7f99a3c46640 1 --2- 172.21.15.19:0/2713414022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f999c0d15d0 0x7f999c06bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.423+0000 7f99a3c46640 1 -- 172.21.15.19:0/2713414022 >> 172.21.15.19:0/2713414022 conn(0x7f999c09bc50 msgr2=0x7f999c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:21.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.423+0000 7f99a3c46640 1 -- 172.21.15.19:0/2713414022 shutdown_connections 2023-11-20T06:42:21.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.423+0000 7f99a3c46640 1 -- 172.21.15.19:0/2713414022 wait complete. 2023-11-20T06:42:21.447 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T06:41:11.805111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T06:41:12.614034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T06:41:16.311206+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T06:42:21.447 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:42:21.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.587+0000 7fabd8d0f640 1 Processor -- start 2023-11-20T06:42:21.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.587+0000 7fabd8d0f640 1 -- start start 2023-11-20T06:42:21.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.591+0000 7fabd8d0f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fabd4069e90 0x7fabd406d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:21.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.591+0000 7fabd8d0f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fabd406a270 0x7fabd40c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:21.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.591+0000 7fabd8d0f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fabd40702f0 0x7fabd4070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:21.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.591+0000 7fabd8d0f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd40cb090 con 0x7fabd406a270 2023-11-20T06:42:21.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.591+0000 7fabd8d0f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd415ae30 con 0x7fabd4069e90 2023-11-20T06:42:21.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.591+0000 7fabd8d0f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd40ca510 con 0x7fabd40702f0 2023-11-20T06:42:21.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.591+0000 7fabcbfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fabd406a270 0x7fabd40c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:21.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.591+0000 7fabcbfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fabd406a270 0x7fabd40c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51248/0 (socket says 172.21.15.19:51248) 2023-11-20T06:42:21.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.591+0000 7fabcbfff640 1 -- 172.21.15.19:0/1359209174 learned_addr learned my addr 172.21.15.19:0/1359209174 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:21.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.591+0000 7fabd2d9d640 1 --2- 172.21.15.19:0/1359209174 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fabd40702f0 0x7fabd4070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:21.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.591+0000 7fabd259c640 1 --2- 172.21.15.19:0/1359209174 >> v2:172.21.15.190:3300/0 conn(0x7fabd4069e90 0x7fabd406d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:21.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.591+0000 7fabcbfff640 1 -- 172.21.15.19:0/1359209174 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fabd40702f0 msgr2=0x7fabd4070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:21.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.591+0000 7fabcbfff640 1 --2- 172.21.15.19:0/1359209174 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fabd40702f0 0x7fabd4070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.591+0000 7fabcbfff640 1 -- 172.21.15.19:0/1359209174 >> v2:172.21.15.190:3300/0 conn(0x7fabd4069e90 msgr2=0x7fabd406d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:21.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.591+0000 7fabcbfff640 1 --2- 172.21.15.19:0/1359209174 >> v2:172.21.15.190:3300/0 conn(0x7fabd4069e90 0x7fabd406d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.591+0000 7fabcbfff640 1 -- 172.21.15.19:0/1359209174 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd40ca7f0 con 0x7fabd406a270 2023-11-20T06:42:21.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.595+0000 7fabcbfff640 1 --2- 172.21.15.19:0/1359209174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd406a270 0x7fabd40c9ce0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fabd4071590 tx=0x7fabbc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d877f417f7e0e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:21.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.595+0000 7fabd1d9b640 1 -- 172.21.15.19:0/1359209174 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc0aa5f0 con 0x7fabd406a270 2023-11-20T06:42:21.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.595+0000 7fabd1d9b640 1 -- 172.21.15.19:0/1359209174 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabbc0aa750 con 0x7fabd406a270 2023-11-20T06:42:21.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.595+0000 7fabd1d9b640 1 -- 172.21.15.19:0/1359209174 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc0aaae0 con 0x7fabd406a270 2023-11-20T06:42:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.595+0000 7fabd8d0f640 1 -- 172.21.15.19:0/1359209174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd406a270 msgr2=0x7fabd40c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.595+0000 7fabd8d0f640 1 --2- 172.21.15.19:0/1359209174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd406a270 0x7fabd40c9ce0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fabd4071590 tx=0x7fabbc01c4d0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.595+0000 7fabd8d0f640 1 -- 172.21.15.19:0/1359209174 shutdown_connections 2023-11-20T06:42:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.595+0000 7fabd8d0f640 1 --2- 172.21.15.19:0/1359209174 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fabd40702f0 0x7fabd4070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.595+0000 7fabd8d0f640 1 --2- 172.21.15.19:0/1359209174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd406a270 0x7fabd40c9ce0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.595+0000 7fabd8d0f640 1 --2- 172.21.15.19:0/1359209174 >> v2:172.21.15.190:3300/0 conn(0x7fabd4069e90 0x7fabd406d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.595+0000 7fabd8d0f640 1 -- 172.21.15.19:0/1359209174 >> 172.21.15.19:0/1359209174 conn(0x7fabd40b0da0 msgr2=0x7fabd40ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.595+0000 7fabd8d0f640 1 -- 172.21.15.19:0/1359209174 shutdown_connections 2023-11-20T06:42:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.595+0000 7fabd8d0f640 1 -- 172.21.15.19:0/1359209174 wait complete. 2023-11-20T06:42:21.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.595+0000 7fabd8d0f640 1 Processor -- start 2023-11-20T06:42:21.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.595+0000 7fabd8d0f640 1 -- start start 2023-11-20T06:42:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabd8d0f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fabd4069e90 0x7fabd4152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabd8d0f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd406a270 0x7fabd40c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabd8d0f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fabd40702f0 0x7fabd40c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabd8d0f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd40c4490 con 0x7fabd406a270 2023-11-20T06:42:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabd8d0f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd41531c0 con 0x7fabd4069e90 2023-11-20T06:42:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabd8d0f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd41534a0 con 0x7fabd40702f0 2023-11-20T06:42:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabcbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd406a270 0x7fabd40c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabcbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd406a270 0x7fabd40c48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51260/0 (socket says 172.21.15.19:51260) 2023-11-20T06:42:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabcbfff640 1 -- 172.21.15.19:0/1253913583 learned_addr learned my addr 172.21.15.19:0/1253913583 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:21.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabd259c640 1 --2- 172.21.15.19:0/1253913583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fabd4069e90 0x7fabd4152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:21.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabd2d9d640 1 --2- 172.21.15.19:0/1253913583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fabd40702f0 0x7fabd40c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:21.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabcbfff640 1 -- 172.21.15.19:0/1253913583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fabd40702f0 msgr2=0x7fabd40c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:21.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabcbfff640 1 --2- 172.21.15.19:0/1253913583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fabd40702f0 0x7fabd40c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabcbfff640 1 -- 172.21.15.19:0/1253913583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fabd4069e90 msgr2=0x7fabd4152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:21.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabcbfff640 1 --2- 172.21.15.19:0/1253913583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fabd4069e90 0x7fabd4152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabcbfff640 1 -- 172.21.15.19:0/1253913583 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc0094d0 con 0x7fabd406a270 2023-11-20T06:42:21.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabcbfff640 1 --2- 172.21.15.19:0/1253913583 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd406a270 0x7fabd40c48b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fabbc01ab80 tx=0x7fabbc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:21.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabcaffd640 1 -- 172.21.15.19:0/1253913583 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc0b3800 con 0x7fabd406a270 2023-11-20T06:42:21.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabcaffd640 1 -- 172.21.15.19:0/1253913583 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabbc0b3960 con 0x7fabd406a270 2023-11-20T06:42:21.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabd8d0f640 1 -- 172.21.15.19:0/1253913583 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd40c40b0 con 0x7fabd406a270 2023-11-20T06:42:21.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabcaffd640 1 -- 172.21.15.19:0/1253913583 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc0b3cd0 con 0x7fabd406a270 2023-11-20T06:42:21.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabd8d0f640 1 -- 172.21.15.19:0/1253913583 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd4152c70 con 0x7fabd406a270 2023-11-20T06:42:21.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabd8d0f640 1 -- 172.21.15.19:0/1253913583 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd40c45d0 con 0x7fabd406a270 2023-11-20T06:42:21.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.599+0000 7fabcaffd640 1 -- 172.21.15.19:0/1253913583 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fabbc0c6390 con 0x7fabd406a270 2023-11-20T06:42:21.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.603+0000 7fabcaffd640 1 --2- 172.21.15.19:0/1253913583 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fabb40664a0 0x7fabb4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:21.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.603+0000 7fabcaffd640 1 -- 172.21.15.19:0/1253913583 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fabbc0a7070 con 0x7fabd406a270 2023-11-20T06:42:21.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.603+0000 7fabd259c640 1 --2- 172.21.15.19:0/1253913583 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fabb40664a0 0x7fabb4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:21.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.603+0000 7fabd259c640 1 --2- 172.21.15.19:0/1253913583 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fabb40664a0 0x7fabb4068960 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fabc40045f0 tx=0x7fabc4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:21.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.607+0000 7fabcaffd640 1 -- 172.21.15.19:0/1253913583 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fabd40c45d0 con 0x7fabd406a270 2023-11-20T06:42:21.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.763+0000 7fabd8d0f640 1 -- 172.21.15.19:0/1253913583 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fabd40c45d0 con 0x7fabd406a270 2023-11-20T06:42:21.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.763+0000 7fabcaffd640 1 -- 172.21.15.19:0/1253913583 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fabd40c45d0 con 0x7fabd406a270 2023-11-20T06:42:21.768 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:42:21.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.763+0000 7fabd8d0f640 1 -- 172.21.15.19:0/1253913583 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fabb40664a0 msgr2=0x7fabb4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:21.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.763+0000 7fabd8d0f640 1 --2- 172.21.15.19:0/1253913583 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fabb40664a0 0x7fabb4068960 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fabc40045f0 tx=0x7fabc4008040 comp rx=0 tx=0).stop 2023-11-20T06:42:21.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.763+0000 7fabd8d0f640 1 -- 172.21.15.19:0/1253913583 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd406a270 msgr2=0x7fabd40c48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.763+0000 7fabd8d0f640 1 --2- 172.21.15.19:0/1253913583 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd406a270 0x7fabd40c48b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fabbc01ab80 tx=0x7fabbc01ad10 comp rx=0 tx=0).stop 2023-11-20T06:42:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.763+0000 7fabd8d0f640 1 -- 172.21.15.19:0/1253913583 shutdown_connections 2023-11-20T06:42:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.763+0000 7fabd8d0f640 1 --2- 172.21.15.19:0/1253913583 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fabb40664a0 0x7fabb4068960 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.763+0000 7fabd8d0f640 1 --2- 172.21.15.19:0/1253913583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fabd40702f0 0x7fabd40c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.763+0000 7fabd8d0f640 1 --2- 172.21.15.19:0/1253913583 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd406a270 0x7fabd40c48b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.763+0000 7fabd8d0f640 1 --2- 172.21.15.19:0/1253913583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fabd4069e90 0x7fabd4152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.763+0000 7fabd8d0f640 1 -- 172.21.15.19:0/1253913583 >> 172.21.15.19:0/1253913583 conn(0x7fabd40b0da0 msgr2=0x7fabd40ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.763+0000 7fabd8d0f640 1 -- 172.21.15.19:0/1253913583 shutdown_connections 2023-11-20T06:42:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.763+0000 7fabd8d0f640 1 -- 172.21.15.19:0/1253913583 wait complete. 2023-11-20T06:42:21.790 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T06:42:21.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.931+0000 7fdbd8846640 1 Processor -- start 2023-11-20T06:42:21.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.931+0000 7fdbd8846640 1 -- start start 2023-11-20T06:42:21.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.931+0000 7fdbd8846640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbd40cb040 0x7fdbd40ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:21.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.931+0000 7fdbd8846640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdbd40cebd0 0x7fdbd40cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:21.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.931+0000 7fdbd8846640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd40cc330 con 0x7fdbd415cc60 2023-11-20T06:42:21.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.931+0000 7fdbd8846640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd40cb4a0 con 0x7fdbd40cebd0 2023-11-20T06:42:21.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.931+0000 7fdbd8846640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40cefe0 con 0x7fdbd40cb040 2023-11-20T06:42:21.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.935+0000 7fdbd2d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdbd40cebd0 0x7fdbd40cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:21.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.935+0000 7fdbd2d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdbd40cebd0 0x7fdbd40cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51266/0 (socket says 172.21.15.19:51266) 2023-11-20T06:42:21.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.935+0000 7fdbd2d9d640 1 -- 172.21.15.19:0/37032330 learned_addr learned my addr 172.21.15.19:0/37032330 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:21.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.935+0000 7fdbcbfff640 1 --2- 172.21.15.19:0/37032330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbd40cb040 0x7fdbd40ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:21.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.935+0000 7fdbd2d9d640 1 -- 172.21.15.19:0/37032330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbd40cb040 msgr2=0x7fdbd40ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:21.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.935+0000 7fdbd2d9d640 1 --2- 172.21.15.19:0/37032330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbd40cb040 0x7fdbd40ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.935+0000 7fdbd2d9d640 1 -- 172.21.15.19:0/37032330 >> v1:172.21.15.190:6789/0 conn(0x7fdbd415cc60 legacy=0x7fdbd4161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:21.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.935+0000 7fdbd2d9d640 1 -- 172.21.15.19:0/37032330 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd40cb720 con 0x7fdbd40cebd0 2023-11-20T06:42:21.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.935+0000 7fdbd2d9d640 1 --2- 172.21.15.19:0/37032330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbd40cebd0 0x7fdbd40cc990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009e50 tx=0x7fdbcc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74e603bd7e9f2af server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:21.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.935+0000 7fdbd1d9b640 1 -- 172.21.15.19:0/37032330 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc0a5820 con 0x7fdbd40cebd0 2023-11-20T06:42:21.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.935+0000 7fdbd1d9b640 1 -- 172.21.15.19:0/37032330 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbcc0a5980 con 0x7fdbd40cebd0 2023-11-20T06:42:21.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.935+0000 7fdbd1d9b640 1 -- 172.21.15.19:0/37032330 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc0a5d10 con 0x7fdbd40cebd0 2023-11-20T06:42:21.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbd8846640 1 -- 172.21.15.19:0/37032330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbd40cebd0 msgr2=0x7fdbd40cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:21.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbd8846640 1 --2- 172.21.15.19:0/37032330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbd40cebd0 0x7fdbd40cc990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009e50 tx=0x7fdbcc01c9a0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbd8846640 1 -- 172.21.15.19:0/37032330 shutdown_connections 2023-11-20T06:42:21.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbd8846640 1 --2- 172.21.15.19:0/37032330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbd40cebd0 0x7fdbd40cc990 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbd8846640 1 --2- 172.21.15.19:0/37032330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbd40cb040 0x7fdbd40ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbd8846640 1 -- 172.21.15.19:0/37032330 >> 172.21.15.19:0/37032330 conn(0x7fdbd406e570 msgr2=0x7fdbd406e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:21.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbd8846640 1 -- 172.21.15.19:0/37032330 shutdown_connections 2023-11-20T06:42:21.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbd8846640 1 -- 172.21.15.19:0/37032330 wait complete. 2023-11-20T06:42:21.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbd8846640 1 Processor -- start 2023-11-20T06:42:21.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbd8846640 1 -- start start 2023-11-20T06:42:21.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbd8846640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdbd40cb040 0x7fdbd4155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:21.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbd8846640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbd40cebd0 0x7fdbd415ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:21.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbd8846640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbd415cc60 0x7fdbd415b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:21.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbd8846640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd4156460 con 0x7fdbd40cebd0 2023-11-20T06:42:21.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbd8846640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd4157800 con 0x7fdbd40cb040 2023-11-20T06:42:21.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbd8846640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd4157ae0 con 0x7fdbd415cc60 2023-11-20T06:42:21.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbcbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbd40cebd0 0x7fdbd415ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:21.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbcbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbd40cebd0 0x7fdbd415ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51272/0 (socket says 172.21.15.19:51272) 2023-11-20T06:42:21.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbcbfff640 1 -- 172.21.15.19:0/1901977895 learned_addr learned my addr 172.21.15.19:0/1901977895 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:21.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbd259c640 1 --2- 172.21.15.19:0/1901977895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdbd40cb040 0x7fdbd4155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:21.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.939+0000 7fdbd2d9d640 1 --2- 172.21.15.19:0/1901977895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbd415cc60 0x7fdbd415b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:21.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.943+0000 7fdbcbfff640 1 -- 172.21.15.19:0/1901977895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbd415cc60 msgr2=0x7fdbd415b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:21.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.943+0000 7fdbcbfff640 1 --2- 172.21.15.19:0/1901977895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbd415cc60 0x7fdbd415b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.943+0000 7fdbcbfff640 1 -- 172.21.15.19:0/1901977895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdbd40cb040 msgr2=0x7fdbd4155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:21.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.943+0000 7fdbcbfff640 1 --2- 172.21.15.19:0/1901977895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdbd40cb040 0x7fdbd4155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:21.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.943+0000 7fdbcbfff640 1 -- 172.21.15.19:0/1901977895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbcc009b30 con 0x7fdbd40cebd0 2023-11-20T06:42:21.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.943+0000 7fdbcbfff640 1 --2- 172.21.15.19:0/1901977895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbd40cebd0 0x7fdbd415ace0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00d800 tx=0x7fdbbc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:21.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.943+0000 7fdbcaffd640 1 -- 172.21.15.19:0/1901977895 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc00b6c0 con 0x7fdbd40cebd0 2023-11-20T06:42:21.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.943+0000 7fdbcaffd640 1 -- 172.21.15.19:0/1901977895 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbbc00b820 con 0x7fdbd40cebd0 2023-11-20T06:42:21.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.943+0000 7fdbcaffd640 1 -- 172.21.15.19:0/1901977895 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc00bb90 con 0x7fdbd40cebd0 2023-11-20T06:42:21.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.943+0000 7fdbd8846640 1 -- 172.21.15.19:0/1901977895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd4157dc0 con 0x7fdbd40cebd0 2023-11-20T06:42:21.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.943+0000 7fdbd8846640 1 -- 172.21.15.19:0/1901977895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd40c5ca0 con 0x7fdbd40cebd0 2023-11-20T06:42:21.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.943+0000 7fdbd8846640 1 -- 172.21.15.19:0/1901977895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd404e170 con 0x7fdbd40cebd0 2023-11-20T06:42:21.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.943+0000 7fdbcaffd640 1 -- 172.21.15.19:0/1901977895 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdbbc00bcf0 con 0x7fdbd40cebd0 2023-11-20T06:42:21.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.943+0000 7fdbcaffd640 1 --2- 172.21.15.19:0/1901977895 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdbb4066470 0x7fdbb4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:21.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.943+0000 7fdbcaffd640 1 -- 172.21.15.19:0/1901977895 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdbbc0845b0 con 0x7fdbd40cebd0 2023-11-20T06:42:21.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.947+0000 7fdbd259c640 1 --2- 172.21.15.19:0/1901977895 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdbb4066470 0x7fdbb4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:21.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.947+0000 7fdbd259c640 1 --2- 172.21.15.19:0/1901977895 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdbb4066470 0x7fdbb4068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40098e0 tx=0x7fdbc4009060 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:21.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:21.947+0000 7fdbcaffd640 1 -- 172.21.15.19:0/1901977895 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdbbc0517b0 con 0x7fdbd40cebd0 2023-11-20T06:42:22.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.107+0000 7fdbd8846640 1 -- 172.21.15.19:0/1901977895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdbd40b6830 con 0x7fdbd40cebd0 2023-11-20T06:42:22.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.107+0000 7fdbcaffd640 1 -- 172.21.15.19:0/1901977895 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdbbc054dd0 con 0x7fdbd40cebd0 2023-11-20T06:42:22.112 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:22.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.107+0000 7fdbd8846640 1 -- 172.21.15.19:0/1901977895 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdbb4066470 msgr2=0x7fdbb4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:22.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.107+0000 7fdbd8846640 1 --2- 172.21.15.19:0/1901977895 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdbb4066470 0x7fdbb4068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40098e0 tx=0x7fdbc4009060 comp rx=0 tx=0).stop 2023-11-20T06:42:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.107+0000 7fdbd8846640 1 -- 172.21.15.19:0/1901977895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbd40cebd0 msgr2=0x7fdbd415ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.107+0000 7fdbd8846640 1 --2- 172.21.15.19:0/1901977895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbd40cebd0 0x7fdbd415ace0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00d800 tx=0x7fdbbc00dcc0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.107+0000 7fdbd8846640 1 -- 172.21.15.19:0/1901977895 shutdown_connections 2023-11-20T06:42:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.107+0000 7fdbd8846640 1 --2- 172.21.15.19:0/1901977895 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdbb4066470 0x7fdbb4068930 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.107+0000 7fdbd8846640 1 --2- 172.21.15.19:0/1901977895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbd415cc60 0x7fdbd415b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.107+0000 7fdbd8846640 1 --2- 172.21.15.19:0/1901977895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbd40cebd0 0x7fdbd415ace0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.107+0000 7fdbd8846640 1 --2- 172.21.15.19:0/1901977895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdbd40cb040 0x7fdbd4155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.107+0000 7fdbd8846640 1 -- 172.21.15.19:0/1901977895 >> 172.21.15.19:0/1901977895 conn(0x7fdbd406e570 msgr2=0x7fdbd406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.107+0000 7fdbd8846640 1 -- 172.21.15.19:0/1901977895 shutdown_connections 2023-11-20T06:42:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.107+0000 7fdbd8846640 1 -- 172.21.15.19:0/1901977895 wait complete. 2023-11-20T06:42:22.133 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T06:42:22.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.275+0000 7fb6839c5640 1 Processor -- start 2023-11-20T06:42:22.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.275+0000 7fb6839c5640 1 -- start start 2023-11-20T06:42:22.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.275+0000 7fb6839c5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb67c069e90 0x7fb67c06d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:22.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.275+0000 7fb6839c5640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb67c15ae30 con 0x7fb67c06a270 2023-11-20T06:42:22.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.275+0000 7fb6839c5640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb67c0ca510 con 0x7fb67c0c26b0 2023-11-20T06:42:22.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.275+0000 7fb6839c5640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb67c0cb090 con 0x7fb67c069e90 2023-11-20T06:42:22.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.275+0000 7fb681761640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb67c069e90 0x7fb67c06d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:22.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.275+0000 7fb680f60640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb67c06a270 0x7fb67c0c9ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47722/0 (socket says 172.21.15.19:47722) 2023-11-20T06:42:22.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.275+0000 7fb680f60640 1 -- 172.21.15.19:0/268718624 learned_addr learned my addr 172.21.15.19:0/268718624 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:22.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.275+0000 7fb681761640 1 -- 172.21.15.19:0/268718624 >> v1:172.21.15.190:6789/0 conn(0x7fb67c0c26b0 legacy=0x7fb67c0c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:22.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.275+0000 7fb681761640 1 -- 172.21.15.19:0/268718624 >> v1:172.21.15.19:6789/0 conn(0x7fb67c06a270 legacy=0x7fb67c0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:22.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.275+0000 7fb681761640 1 -- 172.21.15.19:0/268718624 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c0ca7f0 con 0x7fb67c069e90 2023-11-20T06:42:22.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.279+0000 7fb681761640 1 --2- 172.21.15.19:0/268718624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb67c069e90 0x7fb67c06d010 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb6780097c0 tx=0x7fb67801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0cd2307543f2f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:22.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.279+0000 7fb673fff640 1 -- 172.21.15.19:0/268718624 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c0c3a20 con 0x7fb67c069e90 2023-11-20T06:42:22.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.279+0000 7fb673fff640 1 -- 172.21.15.19:0/268718624 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6780ab610 con 0x7fb67c069e90 2023-11-20T06:42:22.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.279+0000 7fb673fff640 1 -- 172.21.15.19:0/268718624 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6780ab9a0 con 0x7fb67c069e90 2023-11-20T06:42:22.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.279+0000 7fb6839c5640 1 -- 172.21.15.19:0/268718624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb67c069e90 msgr2=0x7fb67c06d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:22.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.279+0000 7fb6839c5640 1 --2- 172.21.15.19:0/268718624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb67c069e90 0x7fb67c06d010 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb6780097c0 tx=0x7fb67801c410 comp rx=0 tx=0).stop 2023-11-20T06:42:22.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.279+0000 7fb6839c5640 1 -- 172.21.15.19:0/268718624 shutdown_connections 2023-11-20T06:42:22.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.279+0000 7fb6839c5640 1 --2- 172.21.15.19:0/268718624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb67c069e90 0x7fb67c06d010 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.279+0000 7fb6839c5640 1 -- 172.21.15.19:0/268718624 >> 172.21.15.19:0/268718624 conn(0x7fb67c0b0da0 msgr2=0x7fb67c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:22.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.279+0000 7fb6839c5640 1 -- 172.21.15.19:0/268718624 shutdown_connections 2023-11-20T06:42:22.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.279+0000 7fb6839c5640 1 -- 172.21.15.19:0/268718624 wait complete. 2023-11-20T06:42:22.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb6839c5640 1 Processor -- start 2023-11-20T06:42:22.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb6839c5640 1 -- start start 2023-11-20T06:42:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb6839c5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb67c069e90 0x7fb67c0c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb6839c5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb67c06a270 0x7fb67c0af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb6839c5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb67c0c26b0 0x7fb67c151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb6839c5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c15ba70 con 0x7fb67c069e90 2023-11-20T06:42:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb6839c5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c15b0b0 con 0x7fb67c0c26b0 2023-11-20T06:42:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb6839c5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c15bce0 con 0x7fb67c06a270 2023-11-20T06:42:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb681761640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb67c069e90 0x7fb67c0c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb681761640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb67c069e90 0x7fb67c0c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58680/0 (socket says 172.21.15.19:58680) 2023-11-20T06:42:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb681761640 1 -- 172.21.15.19:0/2529926292 learned_addr learned my addr 172.21.15.19:0/2529926292 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb680f60640 1 --2- 172.21.15.19:0/2529926292 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb67c06a270 0x7fb67c0af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb681f62640 1 --2- 172.21.15.19:0/2529926292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb67c0c26b0 0x7fb67c151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:22.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb681761640 1 -- 172.21.15.19:0/2529926292 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb67c06a270 msgr2=0x7fb67c0af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:22.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb681761640 1 --2- 172.21.15.19:0/2529926292 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb67c06a270 0x7fb67c0af5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb681761640 1 -- 172.21.15.19:0/2529926292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb67c0c26b0 msgr2=0x7fb67c151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:22.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb681761640 1 --2- 172.21.15.19:0/2529926292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb67c0c26b0 0x7fb67c151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb681761640 1 -- 172.21.15.19:0/2529926292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb678009420 con 0x7fb67c069e90 2023-11-20T06:42:22.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb681761640 1 --2- 172.21.15.19:0/2529926292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb67c069e90 0x7fb67c0c8360 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb6780ad040 tx=0x7fb67801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:22.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb671ffb640 1 -- 172.21.15.19:0/2529926292 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6780b5810 con 0x7fb67c069e90 2023-11-20T06:42:22.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb671ffb640 1 -- 172.21.15.19:0/2529926292 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6780b5970 con 0x7fb67c069e90 2023-11-20T06:42:22.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb6839c5640 1 -- 172.21.15.19:0/2529926292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb67c15bfc0 con 0x7fb67c069e90 2023-11-20T06:42:22.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb671ffb640 1 -- 172.21.15.19:0/2529926292 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6780b5d00 con 0x7fb67c069e90 2023-11-20T06:42:22.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.283+0000 7fb6839c5640 1 -- 172.21.15.19:0/2529926292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67c151c20 con 0x7fb67c069e90 2023-11-20T06:42:22.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.287+0000 7fb6839c5640 1 -- 172.21.15.19:0/2529926292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67c0c8080 con 0x7fb67c069e90 2023-11-20T06:42:22.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.287+0000 7fb671ffb640 1 -- 172.21.15.19:0/2529926292 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb6780bf410 con 0x7fb67c069e90 2023-11-20T06:42:22.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.287+0000 7fb671ffb640 1 --2- 172.21.15.19:0/2529926292 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb6600664a0 0x7fb660068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:22.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.287+0000 7fb671ffb640 1 -- 172.21.15.19:0/2529926292 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb67811edf0 con 0x7fb67c069e90 2023-11-20T06:42:22.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.287+0000 7fb680f60640 1 --2- 172.21.15.19:0/2529926292 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb6600664a0 0x7fb660068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:22.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.287+0000 7fb680f60640 1 --2- 172.21.15.19:0/2529926292 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb6600664a0 0x7fb660068960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb67c0acfa0 tx=0x7fb66c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:22.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.291+0000 7fb671ffb640 1 -- 172.21.15.19:0/2529926292 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb67c0c8080 con 0x7fb67c069e90 2023-11-20T06:42:22.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.451+0000 7fb6839c5640 1 -- 172.21.15.19:0/2529926292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb67c0c8080 con 0x7fb67c069e90 2023-11-20T06:42:22.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.451+0000 7fb671ffb640 1 -- 172.21.15.19:0/2529926292 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb67c0c8080 con 0x7fb67c069e90 2023-11-20T06:42:22.456 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-20T06:42:22.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.451+0000 7fb6839c5640 1 -- 172.21.15.19:0/2529926292 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb6600664a0 msgr2=0x7fb660068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:22.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.451+0000 7fb6839c5640 1 --2- 172.21.15.19:0/2529926292 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb6600664a0 0x7fb660068960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb67c0acfa0 tx=0x7fb66c009040 comp rx=0 tx=0).stop 2023-11-20T06:42:22.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.451+0000 7fb6839c5640 1 -- 172.21.15.19:0/2529926292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb67c069e90 msgr2=0x7fb67c0c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:22.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.451+0000 7fb6839c5640 1 --2- 172.21.15.19:0/2529926292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb67c069e90 0x7fb67c0c8360 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb6780ad040 tx=0x7fb67801ac50 comp rx=0 tx=0).stop 2023-11-20T06:42:22.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.451+0000 7fb6839c5640 1 -- 172.21.15.19:0/2529926292 shutdown_connections 2023-11-20T06:42:22.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.451+0000 7fb6839c5640 1 --2- 172.21.15.19:0/2529926292 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb6600664a0 0x7fb660068960 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.451+0000 7fb6839c5640 1 --2- 172.21.15.19:0/2529926292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb67c0c26b0 0x7fb67c151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.451+0000 7fb6839c5640 1 --2- 172.21.15.19:0/2529926292 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb67c06a270 0x7fb67c0af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.451+0000 7fb6839c5640 1 --2- 172.21.15.19:0/2529926292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb67c069e90 0x7fb67c0c8360 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.451+0000 7fb6839c5640 1 -- 172.21.15.19:0/2529926292 >> 172.21.15.19:0/2529926292 conn(0x7fb67c0b0da0 msgr2=0x7fb67c159fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:22.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.451+0000 7fb6839c5640 1 -- 172.21.15.19:0/2529926292 shutdown_connections 2023-11-20T06:42:22.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.451+0000 7fb6839c5640 1 -- 172.21.15.19:0/2529926292 wait complete. 2023-11-20T06:42:22.477 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T06:42:22.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.615+0000 7ff00d068640 1 Processor -- start 2023-11-20T06:42:22.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.619+0000 7ff00d068640 1 -- start start 2023-11-20T06:42:22.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.619+0000 7ff00d068640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff008159900 0x7ff00806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:22.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.619+0000 7ff00d068640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff0080b3f00 0x7ff008069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:22.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.619+0000 7ff00d068640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0080b4360 con 0x7ff00806a3d0 2023-11-20T06:42:22.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.619+0000 7ff00d068640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0080cd740 con 0x7ff0080b3f00 2023-11-20T06:42:22.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.619+0000 7ff00d068640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00806a840 con 0x7ff008159900 2023-11-20T06:42:22.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.619+0000 7ff006d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff008159900 0x7ff00806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:22.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.619+0000 7ff00759e640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7ff00806a3d0 0x7ff0080cc350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:41570/0 (socket says 172.21.15.19:41570) 2023-11-20T06:42:22.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.619+0000 7ff006d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff008159900 0x7ff00806e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:44556/0 (socket says 172.21.15.19:44556) 2023-11-20T06:42:22.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.619+0000 7ff00759e640 1 -- 172.21.15.19:0/2690665756 learned_addr learned my addr 172.21.15.19:0/2690665756 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:22.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.619+0000 7ff00659c640 1 --2- 172.21.15.19:0/2690665756 >> v2:172.21.15.190:3300/0 conn(0x7ff0080b3f00 0x7ff008069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:22.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.619+0000 7ff005d9b640 1 -- 172.21.15.19:0/2690665756 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064490985 0 0) 0x7ff0080b4360 con 0x7ff00806a3d0 2023-11-20T06:42:22.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.619+0000 7ff005d9b640 1 -- 172.21.15.19:0/2690665756 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feff0005740 con 0x7ff00806a3d0 2023-11-20T06:42:22.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.619+0000 7ff006d9d640 1 -- 172.21.15.19:0/2690665756 >> v2:172.21.15.190:3300/0 conn(0x7ff0080b3f00 msgr2=0x7ff008069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:22.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.619+0000 7ff006d9d640 1 --2- 172.21.15.19:0/2690665756 >> v2:172.21.15.190:3300/0 conn(0x7ff0080b3f00 0x7ff008069e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.619+0000 7ff006d9d640 1 -- 172.21.15.19:0/2690665756 >> v1:172.21.15.190:6789/0 conn(0x7ff00806a3d0 legacy=0x7ff0080cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:22.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.619+0000 7ff006d9d640 1 -- 172.21.15.19:0/2690665756 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0080b4600 con 0x7ff008159900 2023-11-20T06:42:22.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.619+0000 7ff00659c640 1 --2- 172.21.15.19:0/2690665756 >> v2:172.21.15.190:3300/0 conn(0x7ff0080b3f00 0x7ff008069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:42:22.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.623+0000 7ff006d9d640 1 --2- 172.21.15.19:0/2690665756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff008159900 0x7ff00806e260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feff80097c0 tx=0x7feff801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=957d8719726d7ec1 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:22.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.623+0000 7ff005d9b640 1 -- 172.21.15.19:0/2690665756 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff80ab650 con 0x7ff008159900 2023-11-20T06:42:22.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.623+0000 7ff005d9b640 1 -- 172.21.15.19:0/2690665756 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff80ab7b0 con 0x7ff008159900 2023-11-20T06:42:22.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.623+0000 7ff005d9b640 1 -- 172.21.15.19:0/2690665756 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff80abb40 con 0x7ff008159900 2023-11-20T06:42:22.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.623+0000 7ff00d068640 1 -- 172.21.15.19:0/2690665756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff008159900 msgr2=0x7ff00806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:22.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.623+0000 7ff00d068640 1 --2- 172.21.15.19:0/2690665756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff008159900 0x7ff00806e260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feff80097c0 tx=0x7feff801c450 comp rx=0 tx=0).stop 2023-11-20T06:42:22.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.623+0000 7ff00d068640 1 -- 172.21.15.19:0/2690665756 shutdown_connections 2023-11-20T06:42:22.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.623+0000 7ff00d068640 1 --2- 172.21.15.19:0/2690665756 >> v2:172.21.15.190:3300/0 conn(0x7ff0080b3f00 0x7ff008069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.623+0000 7ff00d068640 1 --2- 172.21.15.19:0/2690665756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff008159900 0x7ff00806e260 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.623+0000 7ff00d068640 1 -- 172.21.15.19:0/2690665756 >> 172.21.15.19:0/2690665756 conn(0x7ff0080b0da0 msgr2=0x7ff0080ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:22.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.623+0000 7ff00d068640 1 -- 172.21.15.19:0/2690665756 shutdown_connections 2023-11-20T06:42:22.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.623+0000 7ff00d068640 1 -- 172.21.15.19:0/2690665756 wait complete. 2023-11-20T06:42:22.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff00d068640 1 Processor -- start 2023-11-20T06:42:22.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff00d068640 1 -- start start 2023-11-20T06:42:22.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff00d068640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff00806a3d0 0x7ff0080c3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:22.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff00d068640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0080b3f00 0x7ff0080b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:22.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff00d068640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff008159900 0x7ff0080b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:22.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff00d068640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00815b440 con 0x7ff00806a3d0 2023-11-20T06:42:22.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff00d068640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0080c3b60 con 0x7ff008159900 2023-11-20T06:42:22.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff00d068640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0080c3e40 con 0x7ff0080b3f00 2023-11-20T06:42:22.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff006d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff00806a3d0 0x7ff0080c3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:22.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff006d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff00806a3d0 0x7ff0080c3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58696/0 (socket says 172.21.15.19:58696) 2023-11-20T06:42:22.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff006d9d640 1 -- 172.21.15.19:0/316631069 learned_addr learned my addr 172.21.15.19:0/316631069 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:22.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff00759e640 1 --2- 172.21.15.19:0/316631069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff008159900 0x7ff0080b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:22.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff00659c640 1 --2- 172.21.15.19:0/316631069 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0080b3f00 0x7ff0080b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:22.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff006d9d640 1 -- 172.21.15.19:0/316631069 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0080b3f00 msgr2=0x7ff0080b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:22.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff006d9d640 1 --2- 172.21.15.19:0/316631069 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0080b3f00 0x7ff0080b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff006d9d640 1 -- 172.21.15.19:0/316631069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff008159900 msgr2=0x7ff0080b2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:22.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff006d9d640 1 --2- 172.21.15.19:0/316631069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff008159900 0x7ff0080b2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff006d9d640 1 -- 172.21.15.19:0/316631069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc009420 con 0x7ff00806a3d0 2023-11-20T06:42:22.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff00759e640 1 --2- 172.21.15.19:0/316631069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff008159900 0x7ff0080b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:22.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff006d9d640 1 --2- 172.21.15.19:0/316631069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff00806a3d0 0x7ff0080c3110 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7feff801ab00 tx=0x7feff80191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:22.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7fefef7fe640 1 -- 172.21.15.19:0/316631069 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff80abe70 con 0x7ff00806a3d0 2023-11-20T06:42:22.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7fefef7fe640 1 -- 172.21.15.19:0/316631069 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff80bf450 con 0x7ff00806a3d0 2023-11-20T06:42:22.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7fefef7fe640 1 -- 172.21.15.19:0/316631069 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff80bf820 con 0x7ff00806a3d0 2023-11-20T06:42:22.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff00d068640 1 -- 172.21.15.19:0/316631069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff8009420 con 0x7ff00806a3d0 2023-11-20T06:42:22.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff00d068640 1 -- 172.21.15.19:0/316631069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0080c4400 con 0x7ff00806a3d0 2023-11-20T06:42:22.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.627+0000 7ff00d068640 1 -- 172.21.15.19:0/316631069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff00804e170 con 0x7ff00806a3d0 2023-11-20T06:42:22.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.631+0000 7fefef7fe640 1 -- 172.21.15.19:0/316631069 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7feff80bf980 con 0x7ff00806a3d0 2023-11-20T06:42:22.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.631+0000 7fefef7fe640 1 --2- 172.21.15.19:0/316631069 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feff40664a0 0x7feff4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:22.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.631+0000 7fefef7fe640 1 -- 172.21.15.19:0/316631069 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feff811ec50 con 0x7ff00806a3d0 2023-11-20T06:42:22.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.631+0000 7ff00659c640 1 --2- 172.21.15.19:0/316631069 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feff40664a0 0x7feff4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:22.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.631+0000 7ff00659c640 1 --2- 172.21.15.19:0/316631069 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feff40664a0 0x7feff4068960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff0080adc40 tx=0x7feffc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:22.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.635+0000 7fefef7fe640 1 -- 172.21.15.19:0/316631069 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7feff80ebc70 con 0x7ff00806a3d0 2023-11-20T06:42:22.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.791+0000 7ff00d068640 1 -- 172.21.15.19:0/316631069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff00815a7f0 con 0x7ff00806a3d0 2023-11-20T06:42:22.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.791+0000 7fefef7fe640 1 -- 172.21.15.19:0/316631069 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7feff80ef290 con 0x7ff00806a3d0 2023-11-20T06:42:22.798 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:22.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.795+0000 7ff00d068640 1 -- 172.21.15.19:0/316631069 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feff40664a0 msgr2=0x7feff4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:22.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.795+0000 7ff00d068640 1 --2- 172.21.15.19:0/316631069 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feff40664a0 0x7feff4068960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff0080adc40 tx=0x7feffc008040 comp rx=0 tx=0).stop 2023-11-20T06:42:22.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.795+0000 7ff00d068640 1 -- 172.21.15.19:0/316631069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff00806a3d0 msgr2=0x7ff0080c3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:22.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.795+0000 7ff00d068640 1 --2- 172.21.15.19:0/316631069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff00806a3d0 0x7ff0080c3110 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7feff801ab00 tx=0x7feff80191f0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.795+0000 7ff00d068640 1 -- 172.21.15.19:0/316631069 shutdown_connections 2023-11-20T06:42:22.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.795+0000 7ff00d068640 1 --2- 172.21.15.19:0/316631069 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feff40664a0 0x7feff4068960 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.795+0000 7ff00d068640 1 --2- 172.21.15.19:0/316631069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff008159900 0x7ff0080b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.795+0000 7ff00d068640 1 --2- 172.21.15.19:0/316631069 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0080b3f00 0x7ff0080b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.795+0000 7ff00d068640 1 --2- 172.21.15.19:0/316631069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff00806a3d0 0x7ff0080c3110 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.795+0000 7ff00d068640 1 -- 172.21.15.19:0/316631069 >> 172.21.15.19:0/316631069 conn(0x7ff0080b0da0 msgr2=0x7ff00806d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:22.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.795+0000 7ff00d068640 1 -- 172.21.15.19:0/316631069 shutdown_connections 2023-11-20T06:42:22.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.795+0000 7ff00d068640 1 -- 172.21.15.19:0/316631069 wait complete. 2023-11-20T06:42:22.820 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T06:42:22.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.959+0000 7f94bd7aa640 1 Processor -- start 2023-11-20T06:42:22.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.959+0000 7f94bd7aa640 1 -- start start 2023-11-20T06:42:22.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.959+0000 7f94bd7aa640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f94b80d15d0 0x7f94b80cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:22.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.959+0000 7f94bd7aa640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f94b80d3010 0x7f94b80c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:22.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.959+0000 7f94bd7aa640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b80ce770 con 0x7f94b815cb90 2023-11-20T06:42:22.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.959+0000 7f94bd7aa640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b80d0600 con 0x7f94b80d15d0 2023-11-20T06:42:22.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.959+0000 7f94bd7aa640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b80c6450 con 0x7f94b80d3010 2023-11-20T06:42:22.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.963+0000 7f94b67fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f94b80d15d0 0x7f94b80cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:22.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.963+0000 7f94b67fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f94b80d15d0 0x7f94b80cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58712/0 (socket says 172.21.15.19:58712) 2023-11-20T06:42:22.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.963+0000 7f94b67fc640 1 -- 172.21.15.19:0/2826113788 learned_addr learned my addr 172.21.15.19:0/2826113788 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:22.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.963+0000 7f94b77fe640 1 --2- 172.21.15.19:0/2826113788 >> v2:172.21.15.190:3300/0 conn(0x7f94b80d3010 0x7f94b80c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:22.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.963+0000 7f94b67fc640 1 -- 172.21.15.19:0/2826113788 >> v2:172.21.15.190:3300/0 conn(0x7f94b80d3010 msgr2=0x7f94b80c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:22.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.963+0000 7f94b67fc640 1 --2- 172.21.15.19:0/2826113788 >> v2:172.21.15.190:3300/0 conn(0x7f94b80d3010 0x7f94b80c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.963+0000 7f94b67fc640 1 -- 172.21.15.19:0/2826113788 >> v1:172.21.15.190:6789/0 conn(0x7f94b815cb90 legacy=0x7f94b80d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:22.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.963+0000 7f94b67fc640 1 -- 172.21.15.19:0/2826113788 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b80d08a0 con 0x7f94b80d15d0 2023-11-20T06:42:22.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.963+0000 7f94b67fc640 1 --2- 172.21.15.19:0/2826113788 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b80d15d0 0x7f94b80cfb10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f94b8072590 tx=0x7f94ac01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a262538d42d92f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:22.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.963+0000 7f94b5ffb640 1 -- 172.21.15.19:0/2826113788 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac0ab640 con 0x7f94b80d15d0 2023-11-20T06:42:22.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.963+0000 7f94b5ffb640 1 -- 172.21.15.19:0/2826113788 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ac0a7070 con 0x7f94b80d15d0 2023-11-20T06:42:22.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.963+0000 7f94b5ffb640 1 -- 172.21.15.19:0/2826113788 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac0ab9c0 con 0x7f94b80d15d0 2023-11-20T06:42:22.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94bd7aa640 1 -- 172.21.15.19:0/2826113788 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b80d15d0 msgr2=0x7f94b80cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94bd7aa640 1 --2- 172.21.15.19:0/2826113788 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b80d15d0 0x7f94b80cfb10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f94b8072590 tx=0x7f94ac01c440 comp rx=0 tx=0).stop 2023-11-20T06:42:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94bd7aa640 1 -- 172.21.15.19:0/2826113788 shutdown_connections 2023-11-20T06:42:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94bd7aa640 1 --2- 172.21.15.19:0/2826113788 >> v2:172.21.15.190:3300/0 conn(0x7f94b80d3010 0x7f94b80c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94bd7aa640 1 --2- 172.21.15.19:0/2826113788 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b80d15d0 0x7f94b80cfb10 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94bd7aa640 1 -- 172.21.15.19:0/2826113788 >> 172.21.15.19:0/2826113788 conn(0x7f94b809bc50 msgr2=0x7f94b80d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94bd7aa640 1 -- 172.21.15.19:0/2826113788 shutdown_connections 2023-11-20T06:42:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94bd7aa640 1 -- 172.21.15.19:0/2826113788 wait complete. 2023-11-20T06:42:22.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94bd7aa640 1 Processor -- start 2023-11-20T06:42:22.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94bd7aa640 1 -- start start 2023-11-20T06:42:22.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94bd7aa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94b80d15d0 0x7f94b806bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:22.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94bd7aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94b80d3010 0x7f94b80cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:22.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94bd7aa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b815cb90 0x7f94b80cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:22.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94bd7aa640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8157ba0 con 0x7f94b815cb90 2023-11-20T06:42:22.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94bd7aa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8157e80 con 0x7f94b80d15d0 2023-11-20T06:42:22.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94bd7aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8158160 con 0x7f94b80d3010 2023-11-20T06:42:22.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94b77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b815cb90 0x7f94b80cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:22.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94b77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b815cb90 0x7f94b80cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58726/0 (socket says 172.21.15.19:58726) 2023-11-20T06:42:22.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94b77fe640 1 -- 172.21.15.19:0/64225413 learned_addr learned my addr 172.21.15.19:0/64225413 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:22.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94b67fc640 1 --2- 172.21.15.19:0/64225413 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94b80d3010 0x7f94b80cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.967+0000 7f94b6ffd640 1 --2- 172.21.15.19:0/64225413 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94b80d15d0 0x7f94b806bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.971+0000 7f94b77fe640 1 -- 172.21.15.19:0/64225413 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94b80d3010 msgr2=0x7f94b80cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.971+0000 7f94b77fe640 1 --2- 172.21.15.19:0/64225413 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94b80d3010 0x7f94b80cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.971+0000 7f94b77fe640 1 -- 172.21.15.19:0/64225413 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94b80d15d0 msgr2=0x7f94b806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.971+0000 7f94b77fe640 1 --2- 172.21.15.19:0/64225413 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94b80d15d0 0x7f94b806bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.971+0000 7f94b77fe640 1 -- 172.21.15.19:0/64225413 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac0094d0 con 0x7f94b815cb90 2023-11-20T06:42:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.971+0000 7f94b77fe640 1 --2- 172.21.15.19:0/64225413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b815cb90 0x7f94b80cbf30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f94b0007e40 tx=0x7f94b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.971+0000 7f949f7fe640 1 -- 172.21.15.19:0/64225413 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b0014620 con 0x7f94b815cb90 2023-11-20T06:42:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.971+0000 7f949f7fe640 1 -- 172.21.15.19:0/64225413 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b000ee90 con 0x7f94b815cb90 2023-11-20T06:42:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.971+0000 7f94bd7aa640 1 -- 172.21.15.19:0/64225413 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b809e2c0 con 0x7f94b815cb90 2023-11-20T06:42:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.971+0000 7f949f7fe640 1 -- 172.21.15.19:0/64225413 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b00149e0 con 0x7f94b815cb90 2023-11-20T06:42:22.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.971+0000 7f94bd7aa640 1 -- 172.21.15.19:0/64225413 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b809c890 con 0x7f94b815cb90 2023-11-20T06:42:22.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.971+0000 7f94bd7aa640 1 -- 172.21.15.19:0/64225413 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b8158380 con 0x7f94b815cb90 2023-11-20T06:42:22.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.971+0000 7f949f7fe640 1 -- 172.21.15.19:0/64225413 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f94b0014b40 con 0x7f94b815cb90 2023-11-20T06:42:22.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.971+0000 7f949f7fe640 1 --2- 172.21.15.19:0/64225413 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f94a40664d0 0x7f94a4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:22.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.971+0000 7f949f7fe640 1 -- 172.21.15.19:0/64225413 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f94b0084b20 con 0x7f94b815cb90 2023-11-20T06:42:22.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.975+0000 7f94b6ffd640 1 --2- 172.21.15.19:0/64225413 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f94a40664d0 0x7f94a4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:22.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.975+0000 7f94b6ffd640 1 --2- 172.21.15.19:0/64225413 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f94a40664d0 0x7f94a4068990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f94a8000fc0 tx=0x7f94a8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:22.975+0000 7f949f7fe640 1 -- 172.21.15.19:0/64225413 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f94b0051bf0 con 0x7f94b815cb90 2023-11-20T06:42:23.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.143+0000 7f94bd7aa640 1 -- 172.21.15.19:0/64225413 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f94b8074010 con 0x7f94b815cb90 2023-11-20T06:42:23.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.147+0000 7f949f7fe640 1 -- 172.21.15.19:0/64225413 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f94b0055210 con 0x7f94b815cb90 2023-11-20T06:42:23.151 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2023-11-20T06:42:23.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.147+0000 7f94bd7aa640 1 -- 172.21.15.19:0/64225413 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f94a40664d0 msgr2=0x7f94a4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:23.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.147+0000 7f94bd7aa640 1 --2- 172.21.15.19:0/64225413 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f94a40664d0 0x7f94a4068990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f94a8000fc0 tx=0x7f94a8009040 comp rx=0 tx=0).stop 2023-11-20T06:42:23.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.147+0000 7f94bd7aa640 1 -- 172.21.15.19:0/64225413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b815cb90 msgr2=0x7f94b80cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:23.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.147+0000 7f94bd7aa640 1 --2- 172.21.15.19:0/64225413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b815cb90 0x7f94b80cbf30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f94b0007e40 tx=0x7f94b000e4b0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.147+0000 7f94bd7aa640 1 -- 172.21.15.19:0/64225413 shutdown_connections 2023-11-20T06:42:23.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.147+0000 7f94bd7aa640 1 --2- 172.21.15.19:0/64225413 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f94a40664d0 0x7f94a4068990 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.147+0000 7f94bd7aa640 1 --2- 172.21.15.19:0/64225413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b815cb90 0x7f94b80cbf30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.147+0000 7f94bd7aa640 1 --2- 172.21.15.19:0/64225413 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94b80d3010 0x7f94b80cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.147+0000 7f94bd7aa640 1 --2- 172.21.15.19:0/64225413 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94b80d15d0 0x7f94b806bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.147+0000 7f94bd7aa640 1 -- 172.21.15.19:0/64225413 >> 172.21.15.19:0/64225413 conn(0x7f94b809bc50 msgr2=0x7f94b80d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:23.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.147+0000 7f94bd7aa640 1 -- 172.21.15.19:0/64225413 shutdown_connections 2023-11-20T06:42:23.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.147+0000 7f94bd7aa640 1 -- 172.21.15.19:0/64225413 wait complete. 2023-11-20T06:42:23.172 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi019.front.sepia.ceph.com... 2023-11-20T06:42:23.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:23.173 DEBUG:teuthology.orchestra.run.smithi019:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-20T06:42:23.193 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:42:23.194 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2023-11-20T06:42:23.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:23.194 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-20T06:42:23.248 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:42:23.248 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:42:23.257 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:42:23.258 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:42:23.313 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:23.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.451+0000 7f4add8c9640 1 Processor -- start 2023-11-20T06:42:23.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.451+0000 7f4add8c9640 1 -- start start 2023-11-20T06:42:23.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.451+0000 7f4add8c9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4ad8070c40 0x7f4ad815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:23.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.451+0000 7f4add8c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ad80b07f0 0x7f4ad8164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:23.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.451+0000 7f4add8c9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad815be60 con 0x7f4ad80b4020 2023-11-20T06:42:23.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.451+0000 7f4add8c9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad815b3b0 con 0x7f4ad8070c40 2023-11-20T06:42:23.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.451+0000 7f4add8c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad815c1f0 con 0x7f4ad80b07f0 2023-11-20T06:42:23.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.451+0000 7f4ad77fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ad80b07f0 0x7f4ad8164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:23.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.451+0000 7f4acffff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f4ad80b4020 0x7f4ad80b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:41580/0 (socket says 172.21.15.19:41580) 2023-11-20T06:42:23.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.451+0000 7f4acffff640 1 -- 172.21.15.19:0/2170946685 learned_addr learned my addr 172.21.15.19:0/2170946685 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:23.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.451+0000 7f4ad6ffd640 1 --2- 172.21.15.19:0/2170946685 >> v2:172.21.15.190:3300/0 conn(0x7f4ad8070c40 0x7f4ad815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:23.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.451+0000 7f4ad67fc640 1 -- 172.21.15.19:0/2170946685 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753426295 0 0) 0x7f4ad815be60 con 0x7f4ad80b4020 2023-11-20T06:42:23.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.451+0000 7f4ad67fc640 1 -- 172.21.15.19:0/2170946685 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ac4003530 con 0x7f4ad80b4020 2023-11-20T06:42:23.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.451+0000 7f4ad6ffd640 1 -- 172.21.15.19:0/2170946685 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ad80b07f0 msgr2=0x7f4ad8164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:23.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.451+0000 7f4ad6ffd640 1 --2- 172.21.15.19:0/2170946685 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ad80b07f0 0x7f4ad8164490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.451+0000 7f4ad6ffd640 1 -- 172.21.15.19:0/2170946685 >> v1:172.21.15.190:6789/0 conn(0x7f4ad80b4020 legacy=0x7f4ad80b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:23.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.451+0000 7f4ad6ffd640 1 -- 172.21.15.19:0/2170946685 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad8071020 con 0x7f4ad8070c40 2023-11-20T06:42:23.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.455+0000 7f4ad6ffd640 1 --2- 172.21.15.19:0/2170946685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ad8070c40 0x7f4ad815ae70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80097c0 tx=0x7f4ac801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=211910f8e4eeb694 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:23.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.455+0000 7f4ad67fc640 1 -- 172.21.15.19:0/2170946685 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac80ab5f0 con 0x7f4ad8070c40 2023-11-20T06:42:23.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.455+0000 7f4ad67fc640 1 -- 172.21.15.19:0/2170946685 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac80ab750 con 0x7f4ad8070c40 2023-11-20T06:42:23.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.455+0000 7f4ad67fc640 1 -- 172.21.15.19:0/2170946685 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac80abae0 con 0x7f4ad8070c40 2023-11-20T06:42:23.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.455+0000 7f4add8c9640 1 -- 172.21.15.19:0/2170946685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ad8070c40 msgr2=0x7f4ad815ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:23.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.455+0000 7f4add8c9640 1 --2- 172.21.15.19:0/2170946685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ad8070c40 0x7f4ad815ae70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80097c0 tx=0x7f4ac801c3f0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.455+0000 7f4add8c9640 1 -- 172.21.15.19:0/2170946685 shutdown_connections 2023-11-20T06:42:23.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.455+0000 7f4add8c9640 1 --2- 172.21.15.19:0/2170946685 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ad80b07f0 0x7f4ad8164490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.455+0000 7f4add8c9640 1 --2- 172.21.15.19:0/2170946685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ad8070c40 0x7f4ad815ae70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.455+0000 7f4add8c9640 1 -- 172.21.15.19:0/2170946685 >> 172.21.15.19:0/2170946685 conn(0x7f4ad806c190 msgr2=0x7f4ad806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:23.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.455+0000 7f4add8c9640 1 -- 172.21.15.19:0/2170946685 shutdown_connections 2023-11-20T06:42:23.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.455+0000 7f4add8c9640 1 -- 172.21.15.19:0/2170946685 wait complete. 2023-11-20T06:42:23.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4add8c9640 1 Processor -- start 2023-11-20T06:42:23.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4add8c9640 1 -- start start 2023-11-20T06:42:23.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4add8c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ad8070c40 0x7f4ad814ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:23.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4add8c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ad80b07f0 0x7f4ad8164050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:23.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4add8c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ad80b4020 0x7f4ad80ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:23.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4add8c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad80c2190 con 0x7f4ad8070c40 2023-11-20T06:42:23.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4add8c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad80c23e0 con 0x7f4ad80b4020 2023-11-20T06:42:23.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4add8c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad80c26c0 con 0x7f4ad80b07f0 2023-11-20T06:42:23.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4ad6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ad8070c40 0x7f4ad814ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:23.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4ad6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ad8070c40 0x7f4ad814ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58742/0 (socket says 172.21.15.19:58742) 2023-11-20T06:42:23.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4ad6ffd640 1 -- 172.21.15.19:0/3981504222 learned_addr learned my addr 172.21.15.19:0/3981504222 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:23.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4acffff640 1 --2- 172.21.15.19:0/3981504222 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ad80b07f0 0x7f4ad8164050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:23.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4ad77fe640 1 --2- 172.21.15.19:0/3981504222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ad80b4020 0x7f4ad80ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:23.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4ad6ffd640 1 -- 172.21.15.19:0/3981504222 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ad80b07f0 msgr2=0x7f4ad8164050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:23.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4ad6ffd640 1 --2- 172.21.15.19:0/3981504222 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ad80b07f0 0x7f4ad8164050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4ad6ffd640 1 -- 172.21.15.19:0/3981504222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ad80b4020 msgr2=0x7f4ad80ae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:23.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4ad6ffd640 1 --2- 172.21.15.19:0/3981504222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ad80b4020 0x7f4ad80ae7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4ad6ffd640 1 -- 172.21.15.19:0/3981504222 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac8009420 con 0x7f4ad8070c40 2023-11-20T06:42:23.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4ad77fe640 1 --2- 172.21.15.19:0/3981504222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ad80b4020 0x7f4ad80ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:23.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4ad6ffd640 1 --2- 172.21.15.19:0/3981504222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ad8070c40 0x7f4ad814ec20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4ac801a020 tx=0x7f4ac801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:23.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4ad4ff9640 1 -- 172.21.15.19:0/3981504222 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac80bf610 con 0x7f4ad8070c40 2023-11-20T06:42:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4ad4ff9640 1 -- 172.21.15.19:0/3981504222 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac80bf770 con 0x7f4ad8070c40 2023-11-20T06:42:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4ad4ff9640 1 -- 172.21.15.19:0/3981504222 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac80bfb20 con 0x7f4ad8070c40 2023-11-20T06:42:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4add8c9640 1 -- 172.21.15.19:0/3981504222 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad80c29a0 con 0x7f4ad8070c40 2023-11-20T06:42:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.459+0000 7f4add8c9640 1 -- 172.21.15.19:0/3981504222 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad80c2f60 con 0x7f4ad8070c40 2023-11-20T06:42:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.463+0000 7f4add8c9640 1 -- 172.21.15.19:0/3981504222 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad8074010 con 0x7f4ad8070c40 2023-11-20T06:42:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.463+0000 7f4ad4ff9640 1 -- 172.21.15.19:0/3981504222 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4ac80bfc80 con 0x7f4ad8070c40 2023-11-20T06:42:23.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.463+0000 7f4ad4ff9640 1 --2- 172.21.15.19:0/3981504222 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4ab80664a0 0x7f4ab8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:23.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.463+0000 7f4ad4ff9640 1 -- 172.21.15.19:0/3981504222 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4ac80a8050 con 0x7f4ad8070c40 2023-11-20T06:42:23.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.463+0000 7f4acffff640 1 --2- 172.21.15.19:0/3981504222 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4ab80664a0 0x7f4ab8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:23.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.463+0000 7f4acffff640 1 --2- 172.21.15.19:0/3981504222 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4ab80664a0 0x7f4ab8068960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4ad81549e0 tx=0x7f4ac0007d40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:23.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.467+0000 7f4ad4ff9640 1 -- 172.21.15.19:0/3981504222 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4ac80eba40 con 0x7f4ad8070c40 2023-11-20T06:42:23.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.627+0000 7f4add8c9640 1 -- 172.21.15.19:0/3981504222 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ad80cc230 con 0x7f4ad8070c40 2023-11-20T06:42:23.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.627+0000 7f4ad4ff9640 1 -- 172.21.15.19:0/3981504222 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18720 (secure 0 0 0) 0x7f4ac80ef060 con 0x7f4ad8070c40 2023-11-20T06:42:23.634 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:23.634 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:55.472006+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:23.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.631+0000 7f4add8c9640 1 -- 172.21.15.19:0/3981504222 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4ab80664a0 msgr2=0x7f4ab8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:23.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.631+0000 7f4add8c9640 1 --2- 172.21.15.19:0/3981504222 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4ab80664a0 0x7f4ab8068960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4ad81549e0 tx=0x7f4ac0007d40 comp rx=0 tx=0).stop 2023-11-20T06:42:23.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.631+0000 7f4add8c9640 1 -- 172.21.15.19:0/3981504222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ad8070c40 msgr2=0x7f4ad814ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:23.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.631+0000 7f4add8c9640 1 --2- 172.21.15.19:0/3981504222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ad8070c40 0x7f4ad814ec20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4ac801a020 tx=0x7f4ac801ac30 comp rx=0 tx=0).stop 2023-11-20T06:42:23.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.631+0000 7f4add8c9640 1 -- 172.21.15.19:0/3981504222 shutdown_connections 2023-11-20T06:42:23.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.631+0000 7f4add8c9640 1 --2- 172.21.15.19:0/3981504222 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4ab80664a0 0x7f4ab8068960 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.631+0000 7f4add8c9640 1 --2- 172.21.15.19:0/3981504222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ad80b4020 0x7f4ad80ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.631+0000 7f4add8c9640 1 --2- 172.21.15.19:0/3981504222 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ad80b07f0 0x7f4ad8164050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.631+0000 7f4add8c9640 1 --2- 172.21.15.19:0/3981504222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ad8070c40 0x7f4ad814ec20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.631+0000 7f4add8c9640 1 -- 172.21.15.19:0/3981504222 >> 172.21.15.19:0/3981504222 conn(0x7f4ad806c190 msgr2=0x7f4ad8151700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:23.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.631+0000 7f4add8c9640 1 -- 172.21.15.19:0/3981504222 shutdown_connections 2023-11-20T06:42:23.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.631+0000 7f4add8c9640 1 -- 172.21.15.19:0/3981504222 wait complete. 2023-11-20T06:42:23.656 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T06:41:11.805111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T06:41:12.614034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T06:41:16.311206+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T06:42:23.657 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:42:23.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.799+0000 7f4e529b8640 1 Processor -- start 2023-11-20T06:42:23.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.799+0000 7f4e529b8640 1 -- start start 2023-11-20T06:42:23.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.799+0000 7f4e529b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c15cba0 0x7f4e4c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:23.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.799+0000 7f4e529b8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4e4c0b84e0 0x7f4e4c0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:23.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.799+0000 7f4e529b8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4e4c0d0040 0x7f4e4c0d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:23.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.799+0000 7f4e529b8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e4c0d1460 con 0x7f4e4c0b84e0 2023-11-20T06:42:23.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.799+0000 7f4e529b8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e4c0d04b0 con 0x7f4e4c0d0040 2023-11-20T06:42:23.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.799+0000 7f4e529b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c0d1670 con 0x7f4e4c15cba0 2023-11-20T06:42:23.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.799+0000 7f4e4b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4e4c0b84e0 0x7f4e4c0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:23.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.799+0000 7f4e4b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4e4c0b84e0 0x7f4e4c0cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58758/0 (socket says 172.21.15.19:58758) 2023-11-20T06:42:23.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.799+0000 7f4e4b7fe640 1 -- 172.21.15.19:0/3786478473 learned_addr learned my addr 172.21.15.19:0/3786478473 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:23.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.799+0000 7f4e4bfff640 1 --2- 172.21.15.19:0/3786478473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c15cba0 0x7f4e4c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:23.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.799+0000 7f4e50f55640 1 --2- 172.21.15.19:0/3786478473 >> v2:172.21.15.190:3300/0 conn(0x7f4e4c0d0040 0x7f4e4c0d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:23.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.799+0000 7f4e4b7fe640 1 -- 172.21.15.19:0/3786478473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c15cba0 msgr2=0x7f4e4c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:23.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.799+0000 7f4e4b7fe640 1 --2- 172.21.15.19:0/3786478473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c15cba0 0x7f4e4c0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.799+0000 7f4e4b7fe640 1 -- 172.21.15.19:0/3786478473 >> v2:172.21.15.190:3300/0 conn(0x7f4e4c0d0040 msgr2=0x7f4e4c0d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:23.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.799+0000 7f4e4b7fe640 1 --2- 172.21.15.19:0/3786478473 >> v2:172.21.15.190:3300/0 conn(0x7f4e4c0d0040 0x7f4e4c0d2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.799+0000 7f4e4b7fe640 1 -- 172.21.15.19:0/3786478473 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c0d1950 con 0x7f4e4c0b84e0 2023-11-20T06:42:23.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.803+0000 7f4e4b7fe640 1 --2- 172.21.15.19:0/3786478473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e4c0b84e0 0x7f4e4c0cfb00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0cf040 tx=0x7f4e4001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab4777d1152f1f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:23.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.803+0000 7f4e4affd640 1 -- 172.21.15.19:0/3786478473 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e400ab600 con 0x7f4e4c0b84e0 2023-11-20T06:42:23.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.803+0000 7f4e4affd640 1 -- 172.21.15.19:0/3786478473 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e400a7050 con 0x7f4e4c0b84e0 2023-11-20T06:42:23.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.803+0000 7f4e4affd640 1 -- 172.21.15.19:0/3786478473 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e400ab980 con 0x7f4e4c0b84e0 2023-11-20T06:42:23.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.803+0000 7f4e529b8640 1 -- 172.21.15.19:0/3786478473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e4c0b84e0 msgr2=0x7f4e4c0cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:23.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.803+0000 7f4e529b8640 1 --2- 172.21.15.19:0/3786478473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e4c0b84e0 0x7f4e4c0cfb00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0cf040 tx=0x7f4e4001c240 comp rx=0 tx=0).stop 2023-11-20T06:42:23.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.803+0000 7f4e529b8640 1 -- 172.21.15.19:0/3786478473 shutdown_connections 2023-11-20T06:42:23.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.803+0000 7f4e529b8640 1 --2- 172.21.15.19:0/3786478473 >> v2:172.21.15.190:3300/0 conn(0x7f4e4c0d0040 0x7f4e4c0d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.803+0000 7f4e529b8640 1 --2- 172.21.15.19:0/3786478473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e4c0b84e0 0x7f4e4c0cfb00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.803+0000 7f4e529b8640 1 --2- 172.21.15.19:0/3786478473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c15cba0 0x7f4e4c0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.803+0000 7f4e529b8640 1 -- 172.21.15.19:0/3786478473 >> 172.21.15.19:0/3786478473 conn(0x7f4e4c0719c0 msgr2=0x7f4e4c071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:23.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.803+0000 7f4e529b8640 1 -- 172.21.15.19:0/3786478473 shutdown_connections 2023-11-20T06:42:23.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.803+0000 7f4e529b8640 1 -- 172.21.15.19:0/3786478473 wait complete. 2023-11-20T06:42:23.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.803+0000 7f4e529b8640 1 Processor -- start 2023-11-20T06:42:23.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.803+0000 7f4e529b8640 1 -- start start 2023-11-20T06:42:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e529b8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e4c0b84e0 0x7f4e4c14e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e529b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c0d0040 0x7f4e4c14d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e529b8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e4c15cba0 0x7f4e4c155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e529b8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c159210 con 0x7f4e4c0b84e0 2023-11-20T06:42:23.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e529b8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c1553e0 con 0x7f4e4c15cba0 2023-11-20T06:42:23.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e529b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c159460 con 0x7f4e4c0d0040 2023-11-20T06:42:23.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e4bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e4c0b84e0 0x7f4e4c14e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:23.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e4bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e4c0b84e0 0x7f4e4c14e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58770/0 (socket says 172.21.15.19:58770) 2023-11-20T06:42:23.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e4bfff640 1 -- 172.21.15.19:0/1043757092 learned_addr learned my addr 172.21.15.19:0/1043757092 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:23.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e50f55640 1 --2- 172.21.15.19:0/1043757092 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e4c15cba0 0x7f4e4c155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:23.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e4b7fe640 1 --2- 172.21.15.19:0/1043757092 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c0d0040 0x7f4e4c14d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:23.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e4bfff640 1 -- 172.21.15.19:0/1043757092 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c0d0040 msgr2=0x7f4e4c14d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:23.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e4bfff640 1 --2- 172.21.15.19:0/1043757092 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c0d0040 0x7f4e4c14d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e4bfff640 1 -- 172.21.15.19:0/1043757092 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e4c15cba0 msgr2=0x7f4e4c155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:23.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e4bfff640 1 --2- 172.21.15.19:0/1043757092 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e4c15cba0 0x7f4e4c155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e4bfff640 1 -- 172.21.15.19:0/1043757092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e400094d0 con 0x7f4e4c0b84e0 2023-11-20T06:42:23.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e4bfff640 1 --2- 172.21.15.19:0/1043757092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e4c0b84e0 0x7f4e4c14e070 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00e870 tx=0x7f4e3c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:23.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e48ff9640 1 -- 172.21.15.19:0/1043757092 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c009510 con 0x7f4e4c0b84e0 2023-11-20T06:42:23.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e48ff9640 1 -- 172.21.15.19:0/1043757092 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3c00eec0 con 0x7f4e4c0b84e0 2023-11-20T06:42:23.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e48ff9640 1 -- 172.21.15.19:0/1043757092 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c00cb40 con 0x7f4e4c0b84e0 2023-11-20T06:42:23.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e529b8640 1 -- 172.21.15.19:0/1043757092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e4c159740 con 0x7f4e4c0b84e0 2023-11-20T06:42:23.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e529b8640 1 -- 172.21.15.19:0/1043757092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e4c155910 con 0x7f4e4c0b84e0 2023-11-20T06:42:23.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.807+0000 7f4e529b8640 1 -- 172.21.15.19:0/1043757092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4c04e170 con 0x7f4e4c0b84e0 2023-11-20T06:42:23.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.811+0000 7f4e48ff9640 1 -- 172.21.15.19:0/1043757092 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4e3c00cca0 con 0x7f4e4c0b84e0 2023-11-20T06:42:23.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.811+0000 7f4e48ff9640 1 --2- 172.21.15.19:0/1043757092 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4e380664a0 0x7f4e38068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:23.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.811+0000 7f4e48ff9640 1 -- 172.21.15.19:0/1043757092 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4e3c0842a0 con 0x7f4e4c0b84e0 2023-11-20T06:42:23.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.811+0000 7f4e4b7fe640 1 --2- 172.21.15.19:0/1043757092 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4e380664a0 0x7f4e38068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:23.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.811+0000 7f4e4b7fe640 1 --2- 172.21.15.19:0/1043757092 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4e380664a0 0x7f4e38068960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4e400ad000 tx=0x7f4e40008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:23.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.815+0000 7f4e48ff9640 1 -- 172.21.15.19:0/1043757092 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4e3c051480 con 0x7f4e4c0b84e0 2023-11-20T06:42:23.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.971+0000 7f4e529b8640 1 -- 172.21.15.19:0/1043757092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e4c0713a0 con 0x7f4e4c0b84e0 2023-11-20T06:42:23.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.975+0000 7f4e48ff9640 1 -- 172.21.15.19:0/1043757092 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e3c054aa0 con 0x7f4e4c0b84e0 2023-11-20T06:42:23.979 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:42:23.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.975+0000 7f4e529b8640 1 -- 172.21.15.19:0/1043757092 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4e380664a0 msgr2=0x7f4e38068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:23.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.975+0000 7f4e529b8640 1 --2- 172.21.15.19:0/1043757092 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4e380664a0 0x7f4e38068960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4e400ad000 tx=0x7f4e40008040 comp rx=0 tx=0).stop 2023-11-20T06:42:23.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.975+0000 7f4e529b8640 1 -- 172.21.15.19:0/1043757092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e4c0b84e0 msgr2=0x7f4e4c14e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:23.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.975+0000 7f4e529b8640 1 --2- 172.21.15.19:0/1043757092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e4c0b84e0 0x7f4e4c14e070 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00e870 tx=0x7f4e3c00ec70 comp rx=0 tx=0).stop 2023-11-20T06:42:23.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.975+0000 7f4e529b8640 1 -- 172.21.15.19:0/1043757092 shutdown_connections 2023-11-20T06:42:23.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.975+0000 7f4e529b8640 1 --2- 172.21.15.19:0/1043757092 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4e380664a0 0x7f4e38068960 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.975+0000 7f4e529b8640 1 --2- 172.21.15.19:0/1043757092 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e4c15cba0 0x7f4e4c155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.975+0000 7f4e529b8640 1 --2- 172.21.15.19:0/1043757092 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e4c0d0040 0x7f4e4c14d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.975+0000 7f4e529b8640 1 --2- 172.21.15.19:0/1043757092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e4c0b84e0 0x7f4e4c14e070 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:23.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.975+0000 7f4e529b8640 1 -- 172.21.15.19:0/1043757092 >> 172.21.15.19:0/1043757092 conn(0x7f4e4c0719c0 msgr2=0x7f4e4c071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:23.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.975+0000 7f4e529b8640 1 -- 172.21.15.19:0/1043757092 shutdown_connections 2023-11-20T06:42:23.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:23.975+0000 7f4e529b8640 1 -- 172.21.15.19:0/1043757092 wait complete. 2023-11-20T06:42:24.001 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T06:42:24.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b35fb8640 1 Processor -- start 2023-11-20T06:42:24.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b35fb8640 1 -- start start 2023-11-20T06:42:24.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b35fb8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6b30159900 0x7f6b3006e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b35fb8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b3006a5a0 0x7f6b300c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b35fb8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b300b4390 con 0x7f6b300b3f00 2023-11-20T06:42:24.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b35fb8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b300cd740 con 0x7f6b30159900 2023-11-20T06:42:24.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b35fb8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b300b4600 con 0x7f6b3006a5a0 2023-11-20T06:42:24.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2effd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6b300b3f00 0x7f6b30069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47734/0 (socket says 172.21.15.19:47734) 2023-11-20T06:42:24.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2effd640 1 -- 172.21.15.19:0/427803724 learned_addr learned my addr 172.21.15.19:0/427803724 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:24.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2ffff640 1 --2- 172.21.15.19:0/427803724 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b3006a5a0 0x7f6b300c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:24.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2f7fe640 1 --2- 172.21.15.19:0/427803724 >> v2:172.21.15.190:3300/0 conn(0x7f6b30159900 0x7f6b3006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:24.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2e7fc640 1 -- 172.21.15.19:0/427803724 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218833301 0 0) 0x7f6b300b4390 con 0x7f6b300b3f00 2023-11-20T06:42:24.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2e7fc640 1 -- 172.21.15.19:0/427803724 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b18003530 con 0x7f6b300b3f00 2023-11-20T06:42:24.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2e7fc640 1 -- 172.21.15.19:0/427803724 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3224438584 0 0) 0x7f6b18003530 con 0x7f6b300b3f00 2023-11-20T06:42:24.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2e7fc640 1 -- 172.21.15.19:0/427803724 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b3006a5a0 msgr2=0x7f6b300c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:24.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2e7fc640 1 --2- 172.21.15.19:0/427803724 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b3006a5a0 0x7f6b300c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2e7fc640 1 -- 172.21.15.19:0/427803724 >> v2:172.21.15.190:3300/0 conn(0x7f6b30159900 msgr2=0x7f6b3006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:24.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2e7fc640 1 --2- 172.21.15.19:0/427803724 >> v2:172.21.15.190:3300/0 conn(0x7f6b30159900 0x7f6b3006e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2e7fc640 1 -- 172.21.15.19:0/427803724 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b300c8dd0 con 0x7f6b300b3f00 2023-11-20T06:42:24.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2e7fc640 1 -- 172.21.15.19:0/427803724 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7f6b24001680 con 0x7f6b300b3f00 2023-11-20T06:42:24.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2e7fc640 1 -- 172.21.15.19:0/427803724 >> v1:172.21.15.19:6789/0 conn(0x7f6b300b3f00 legacy=0x7f6b30069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:24.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2e7fc640 1 --2- 172.21.15.19:0/427803724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b18003980 0x7f6b18003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2e7fc640 1 --2- 172.21.15.19:0/427803724 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b180047d0 0x7f6b18004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2e7fc640 1 --2- 172.21.15.19:0/427803724 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b3006a5a0 0x7f6b18005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2e7fc640 1 -- 172.21.15.19:0/427803724 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b300cd740 con 0x7f6b18003980 2023-11-20T06:42:24.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2e7fc640 1 -- 172.21.15.19:0/427803724 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b300b4600 con 0x7f6b180047d0 2023-11-20T06:42:24.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2e7fc640 1 -- 172.21.15.19:0/427803724 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1800b990 con 0x7f6b3006a5a0 2023-11-20T06:42:24.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2f7fe640 1 --2- 172.21.15.19:0/427803724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b18003980 0x7f6b18003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:24.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2ffff640 1 --2- 172.21.15.19:0/427803724 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b3006a5a0 0x7f6b18005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:24.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2effd640 1 --2- 172.21.15.19:0/427803724 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b180047d0 0x7f6b18004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:24.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2f7fe640 1 -- 172.21.15.19:0/427803724 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b3006a5a0 msgr2=0x7f6b18005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:24.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2f7fe640 1 --2- 172.21.15.19:0/427803724 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b3006a5a0 0x7f6b18005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2f7fe640 1 -- 172.21.15.19:0/427803724 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b180047d0 msgr2=0x7f6b18004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:24.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2f7fe640 1 --2- 172.21.15.19:0/427803724 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b180047d0 0x7f6b18004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2f7fe640 1 -- 172.21.15.19:0/427803724 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b18003530 con 0x7f6b18003980 2023-11-20T06:42:24.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.143+0000 7f6b2ffff640 1 --2- 172.21.15.19:0/427803724 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b3006a5a0 0x7f6b18005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.147+0000 7f6b2f7fe640 1 --2- 172.21.15.19:0/427803724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b18003980 0x7f6b18003da0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6b20009b10 tx=0x7f6b2001ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411531642867bc43 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.147+0000 7f6b2e7fc640 1 -- 172.21.15.19:0/427803724 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b200a6420 con 0x7f6b18003980 2023-11-20T06:42:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.147+0000 7f6b2e7fc640 1 -- 172.21.15.19:0/427803724 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b200a6580 con 0x7f6b18003980 2023-11-20T06:42:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.147+0000 7f6b2e7fc640 1 -- 172.21.15.19:0/427803724 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b200a6930 con 0x7f6b18003980 2023-11-20T06:42:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.147+0000 7f6b35fb8640 1 -- 172.21.15.19:0/427803724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b18003980 msgr2=0x7f6b18003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.147+0000 7f6b35fb8640 1 --2- 172.21.15.19:0/427803724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b18003980 0x7f6b18003da0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6b20009b10 tx=0x7f6b2001ca60 comp rx=0 tx=0).stop 2023-11-20T06:42:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.147+0000 7f6b2ffff640 1 -- 172.21.15.19:0/427803724 reap_dead start 2023-11-20T06:42:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.147+0000 7f6b35fb8640 1 -- 172.21.15.19:0/427803724 shutdown_connections 2023-11-20T06:42:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.147+0000 7f6b35fb8640 1 -- 172.21.15.19:0/427803724 >> 172.21.15.19:0/427803724 conn(0x7f6b300b0da0 msgr2=0x7f6b300ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.147+0000 7f6b35fb8640 1 -- 172.21.15.19:0/427803724 shutdown_connections 2023-11-20T06:42:24.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.147+0000 7f6b35fb8640 1 -- 172.21.15.19:0/427803724 wait complete. 2023-11-20T06:42:24.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.151+0000 7f6b35fb8640 1 Processor -- start 2023-11-20T06:42:24.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.151+0000 7f6b35fb8640 1 -- start start 2023-11-20T06:42:24.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.151+0000 7f6b35fb8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b18003980 0x7f6b3014eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.151+0000 7f6b35fb8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b30155f40 0x7f6b300c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.151+0000 7f6b35fb8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b30157a30 0x7f6b30157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.151+0000 7f6b35fb8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b30158400 con 0x7f6b30157a30 2023-11-20T06:42:24.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.151+0000 7f6b35fb8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b300c35a0 con 0x7f6b18003980 2023-11-20T06:42:24.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.151+0000 7f6b35fb8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b300c3880 con 0x7f6b30155f40 2023-11-20T06:42:24.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.151+0000 7f6b2ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b30157a30 0x7f6b30157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:24.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.151+0000 7f6b2ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b30157a30 0x7f6b30157ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58782/0 (socket says 172.21.15.19:58782) 2023-11-20T06:42:24.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.151+0000 7f6b2ffff640 1 -- 172.21.15.19:0/4195430887 learned_addr learned my addr 172.21.15.19:0/4195430887 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:24.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.151+0000 7f6b2f7fe640 1 --2- 172.21.15.19:0/4195430887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b18003980 0x7f6b3014eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:24.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.151+0000 7f6b2effd640 1 --2- 172.21.15.19:0/4195430887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b30155f40 0x7f6b300c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:24.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.151+0000 7f6b2ffff640 1 -- 172.21.15.19:0/4195430887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b30155f40 msgr2=0x7f6b300c2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:24.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.151+0000 7f6b2ffff640 1 --2- 172.21.15.19:0/4195430887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b30155f40 0x7f6b300c2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.151+0000 7f6b2ffff640 1 -- 172.21.15.19:0/4195430887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b18003980 msgr2=0x7f6b3014eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:24.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.151+0000 7f6b2ffff640 1 --2- 172.21.15.19:0/4195430887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b18003980 0x7f6b3014eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.151+0000 7f6b2ffff640 1 -- 172.21.15.19:0/4195430887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b300c3b60 con 0x7f6b30157a30 2023-11-20T06:42:24.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.151+0000 7f6b2ffff640 1 --2- 172.21.15.19:0/4195430887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b30157a30 0x7f6b30157ec0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6b300ce750 tx=0x7f6b28010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:24.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.155+0000 7f6b17fff640 1 -- 172.21.15.19:0/4195430887 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2801b070 con 0x7f6b30157a30 2023-11-20T06:42:24.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.155+0000 7f6b17fff640 1 -- 172.21.15.19:0/4195430887 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2800f040 con 0x7f6b30157a30 2023-11-20T06:42:24.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.155+0000 7f6b17fff640 1 -- 172.21.15.19:0/4195430887 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2800e050 con 0x7f6b30157a30 2023-11-20T06:42:24.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.155+0000 7f6b35fb8640 1 -- 172.21.15.19:0/4195430887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b300c3e40 con 0x7f6b30157a30 2023-11-20T06:42:24.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.155+0000 7f6b35fb8640 1 -- 172.21.15.19:0/4195430887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b300c4640 con 0x7f6b30157a30 2023-11-20T06:42:24.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.155+0000 7f6b35fb8640 1 -- 172.21.15.19:0/4195430887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b3004e170 con 0x7f6b30157a30 2023-11-20T06:42:24.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.155+0000 7f6b17fff640 1 -- 172.21.15.19:0/4195430887 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6b28003be0 con 0x7f6b30157a30 2023-11-20T06:42:24.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.155+0000 7f6b17fff640 1 --2- 172.21.15.19:0/4195430887 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6b1c0664a0 0x7f6b1c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.155+0000 7f6b17fff640 1 -- 172.21.15.19:0/4195430887 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6b28084760 con 0x7f6b30157a30 2023-11-20T06:42:24.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.155+0000 7f6b2f7fe640 1 --2- 172.21.15.19:0/4195430887 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6b1c0664a0 0x7f6b1c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:24.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.159+0000 7f6b2f7fe640 1 --2- 172.21.15.19:0/4195430887 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6b1c0664a0 0x7f6b1c068960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6b200ad000 tx=0x7f6b200b2040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:24.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.159+0000 7f6b17fff640 1 -- 172.21.15.19:0/4195430887 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6b280518c0 con 0x7f6b30157a30 2023-11-20T06:42:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.319+0000 7f6b35fb8640 1 -- 172.21.15.19:0/4195430887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b300c42f0 con 0x7f6b30157a30 2023-11-20T06:42:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.319+0000 7f6b17fff640 1 -- 172.21.15.19:0/4195430887 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6b28054ee0 con 0x7f6b30157a30 2023-11-20T06:42:24.324 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.319+0000 7f6b35fb8640 1 -- 172.21.15.19:0/4195430887 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6b1c0664a0 msgr2=0x7f6b1c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.319+0000 7f6b35fb8640 1 --2- 172.21.15.19:0/4195430887 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6b1c0664a0 0x7f6b1c068960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6b200ad000 tx=0x7f6b200b2040 comp rx=0 tx=0).stop 2023-11-20T06:42:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.319+0000 7f6b35fb8640 1 -- 172.21.15.19:0/4195430887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b30157a30 msgr2=0x7f6b30157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.319+0000 7f6b35fb8640 1 --2- 172.21.15.19:0/4195430887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b30157a30 0x7f6b30157ec0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6b300ce750 tx=0x7f6b28010590 comp rx=0 tx=0).stop 2023-11-20T06:42:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.319+0000 7f6b35fb8640 1 -- 172.21.15.19:0/4195430887 shutdown_connections 2023-11-20T06:42:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.319+0000 7f6b35fb8640 1 --2- 172.21.15.19:0/4195430887 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6b1c0664a0 0x7f6b1c068960 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.319+0000 7f6b35fb8640 1 --2- 172.21.15.19:0/4195430887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b30157a30 0x7f6b30157ec0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.319+0000 7f6b35fb8640 1 --2- 172.21.15.19:0/4195430887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b30155f40 0x7f6b300c2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.319+0000 7f6b35fb8640 1 --2- 172.21.15.19:0/4195430887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b18003980 0x7f6b3014eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.319+0000 7f6b35fb8640 1 -- 172.21.15.19:0/4195430887 >> 172.21.15.19:0/4195430887 conn(0x7f6b300b0da0 msgr2=0x7f6b30069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:24.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.319+0000 7f6b35fb8640 1 -- 172.21.15.19:0/4195430887 shutdown_connections 2023-11-20T06:42:24.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.319+0000 7f6b35fb8640 1 -- 172.21.15.19:0/4195430887 wait complete. 2023-11-20T06:42:24.346 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T06:42:24.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.487+0000 7fb658654640 1 Processor -- start 2023-11-20T06:42:24.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.487+0000 7fb658654640 1 -- start start 2023-11-20T06:42:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.487+0000 7fb658654640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb6500d0210 0x7fb6500d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.487+0000 7fb658654640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6500b84e0 0x7fb6500b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.487+0000 7fb658654640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6500d1670 con 0x7fb65015cba0 2023-11-20T06:42:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.487+0000 7fb658654640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6500d1460 con 0x7fb6500d0210 2023-11-20T06:42:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.487+0000 7fb658654640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6500d1950 con 0x7fb6500b84e0 2023-11-20T06:42:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.487+0000 7fb655bef640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb6500d0210 0x7fb6500d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.487+0000 7fb6563f0640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb65015cba0 0x7fb6500cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47738/0 (socket says 172.21.15.19:47738) 2023-11-20T06:42:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.487+0000 7fb6563f0640 1 -- 172.21.15.19:0/2245903702 learned_addr learned my addr 172.21.15.19:0/2245903702 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:24.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.487+0000 7fb656bf1640 1 --2- 172.21.15.19:0/2245903702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6500b84e0 0x7fb6500b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:24.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.487+0000 7fb655bef640 1 -- 172.21.15.19:0/2245903702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6500b84e0 msgr2=0x7fb6500b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:24.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.487+0000 7fb655bef640 1 --2- 172.21.15.19:0/2245903702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6500b84e0 0x7fb6500b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.487+0000 7fb655bef640 1 -- 172.21.15.19:0/2245903702 >> v1:172.21.15.19:6789/0 conn(0x7fb65015cba0 legacy=0x7fb6500cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:24.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.487+0000 7fb655bef640 1 -- 172.21.15.19:0/2245903702 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6500d1c30 con 0x7fb6500d0210 2023-11-20T06:42:24.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.487+0000 7fb6553ee640 1 -- 172.21.15.19:0/2245903702 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088363371 0 0) 0x7fb6500d1670 con 0x7fb65015cba0 2023-11-20T06:42:24.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.491+0000 7fb655bef640 1 --2- 172.21.15.19:0/2245903702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6500d0210 0x7fb6500d0f20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb6400097c0 tx=0x7fb64001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55eb6a184d589350 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:24.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.491+0000 7fb6553ee640 1 -- 172.21.15.19:0/2245903702 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6400ab680 con 0x7fb6500d0210 2023-11-20T06:42:24.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.491+0000 7fb6553ee640 1 -- 172.21.15.19:0/2245903702 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6400ab7e0 con 0x7fb6500d0210 2023-11-20T06:42:24.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.491+0000 7fb6553ee640 1 -- 172.21.15.19:0/2245903702 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6400abb70 con 0x7fb6500d0210 2023-11-20T06:42:24.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.491+0000 7fb658654640 1 -- 172.21.15.19:0/2245903702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6500d0210 msgr2=0x7fb6500d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:24.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.491+0000 7fb658654640 1 --2- 172.21.15.19:0/2245903702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6500d0210 0x7fb6500d0f20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb6400097c0 tx=0x7fb64001c480 comp rx=0 tx=0).stop 2023-11-20T06:42:24.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.491+0000 7fb658654640 1 -- 172.21.15.19:0/2245903702 shutdown_connections 2023-11-20T06:42:24.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.491+0000 7fb658654640 1 --2- 172.21.15.19:0/2245903702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6500b84e0 0x7fb6500b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.491+0000 7fb658654640 1 --2- 172.21.15.19:0/2245903702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6500d0210 0x7fb6500d0f20 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.491+0000 7fb658654640 1 -- 172.21.15.19:0/2245903702 >> 172.21.15.19:0/2245903702 conn(0x7fb6500719c0 msgr2=0x7fb650071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:24.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.491+0000 7fb658654640 1 -- 172.21.15.19:0/2245903702 shutdown_connections 2023-11-20T06:42:24.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.491+0000 7fb658654640 1 -- 172.21.15.19:0/2245903702 wait complete. 2023-11-20T06:42:24.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb658654640 1 Processor -- start 2023-11-20T06:42:24.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb658654640 1 -- start start 2023-11-20T06:42:24.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb658654640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6500b84e0 0x7fb65015fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb658654640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6500d0210 0x7fb650150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb658654640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb65015cba0 0x7fb650150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb658654640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb650158820 con 0x7fb6500d0210 2023-11-20T06:42:24.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb658654640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb650157c30 con 0x7fb6500b84e0 2023-11-20T06:42:24.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb658654640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6501602e0 con 0x7fb65015cba0 2023-11-20T06:42:24.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb655bef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6500d0210 0x7fb650150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:24.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb655bef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6500d0210 0x7fb650150850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58794/0 (socket says 172.21.15.19:58794) 2023-11-20T06:42:24.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb655bef640 1 -- 172.21.15.19:0/3892689217 learned_addr learned my addr 172.21.15.19:0/3892689217 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:24.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb655bef640 1 -- 172.21.15.19:0/3892689217 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb65015cba0 msgr2=0x7fb650150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:24.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb655bef640 1 --2- 172.21.15.19:0/3892689217 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb65015cba0 0x7fb650150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb655bef640 1 -- 172.21.15.19:0/3892689217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6500b84e0 msgr2=0x7fb65015fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:24.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb655bef640 1 --2- 172.21.15.19:0/3892689217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6500b84e0 0x7fb65015fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb655bef640 1 -- 172.21.15.19:0/3892689217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb640009420 con 0x7fb6500d0210 2023-11-20T06:42:24.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb655bef640 1 --2- 172.21.15.19:0/3892689217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6500d0210 0x7fb650150850 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb64001ab30 tx=0x7fb64001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:24.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb646ffd640 1 -- 172.21.15.19:0/3892689217 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6400b5810 con 0x7fb6500d0210 2023-11-20T06:42:24.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb646ffd640 1 -- 172.21.15.19:0/3892689217 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6400b5970 con 0x7fb6500d0210 2023-11-20T06:42:24.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb646ffd640 1 -- 172.21.15.19:0/3892689217 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6400b5d20 con 0x7fb6500d0210 2023-11-20T06:42:24.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb658654640 1 -- 172.21.15.19:0/3892689217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb650157e80 con 0x7fb6500d0210 2023-11-20T06:42:24.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb658654640 1 -- 172.21.15.19:0/3892689217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb650158440 con 0x7fb6500d0210 2023-11-20T06:42:24.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.495+0000 7fb658654640 1 -- 172.21.15.19:0/3892689217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65004e170 con 0x7fb6500d0210 2023-11-20T06:42:24.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.499+0000 7fb646ffd640 1 -- 172.21.15.19:0/3892689217 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb6400b4390 con 0x7fb6500d0210 2023-11-20T06:42:24.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.499+0000 7fb646ffd640 1 --2- 172.21.15.19:0/3892689217 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb6340664a0 0x7fb634068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.499+0000 7fb646ffd640 1 -- 172.21.15.19:0/3892689217 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb64011eb40 con 0x7fb6500d0210 2023-11-20T06:42:24.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.499+0000 7fb6563f0640 1 --2- 172.21.15.19:0/3892689217 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb6340664a0 0x7fb634068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:24.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.499+0000 7fb6563f0640 1 --2- 172.21.15.19:0/3892689217 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb6340664a0 0x7fb634068960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb64c0015a0 tx=0x7fb64c007970 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:24.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.503+0000 7fb646ffd640 1 -- 172.21.15.19:0/3892689217 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb6400ebb60 con 0x7fb6500d0210 2023-11-20T06:42:24.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.659+0000 7fb658654640 1 -- 172.21.15.19:0/3892689217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb6501539b0 con 0x7fb6500d0210 2023-11-20T06:42:24.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.659+0000 7fb646ffd640 1 -- 172.21.15.19:0/3892689217 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb6400ef180 con 0x7fb6500d0210 2023-11-20T06:42:24.663 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-20T06:42:24.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.659+0000 7fb658654640 1 -- 172.21.15.19:0/3892689217 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb6340664a0 msgr2=0x7fb634068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:24.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.659+0000 7fb658654640 1 --2- 172.21.15.19:0/3892689217 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb6340664a0 0x7fb634068960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb64c0015a0 tx=0x7fb64c007970 comp rx=0 tx=0).stop 2023-11-20T06:42:24.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.659+0000 7fb658654640 1 -- 172.21.15.19:0/3892689217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6500d0210 msgr2=0x7fb650150850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:24.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.659+0000 7fb658654640 1 --2- 172.21.15.19:0/3892689217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6500d0210 0x7fb650150850 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb64001ab30 tx=0x7fb64001acc0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.659+0000 7fb658654640 1 -- 172.21.15.19:0/3892689217 shutdown_connections 2023-11-20T06:42:24.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.659+0000 7fb658654640 1 --2- 172.21.15.19:0/3892689217 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb6340664a0 0x7fb634068960 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.659+0000 7fb658654640 1 --2- 172.21.15.19:0/3892689217 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb65015cba0 0x7fb650150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.659+0000 7fb658654640 1 --2- 172.21.15.19:0/3892689217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6500d0210 0x7fb650150850 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.659+0000 7fb658654640 1 --2- 172.21.15.19:0/3892689217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6500b84e0 0x7fb65015fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.659+0000 7fb658654640 1 -- 172.21.15.19:0/3892689217 >> 172.21.15.19:0/3892689217 conn(0x7fb6500719c0 msgr2=0x7fb650071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:24.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.659+0000 7fb658654640 1 -- 172.21.15.19:0/3892689217 shutdown_connections 2023-11-20T06:42:24.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.659+0000 7fb658654640 1 -- 172.21.15.19:0/3892689217 wait complete. 2023-11-20T06:42:24.684 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T06:42:24.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.823+0000 7f4e626ea640 1 Processor -- start 2023-11-20T06:42:24.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.823+0000 7f4e626ea640 1 -- start start 2023-11-20T06:42:24.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.827+0000 7f4e626ea640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4e5c159900 0x7f4e5c06e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.827+0000 7f4e626ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e5c06a5a0 0x7f4e5c0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.827+0000 7f4e626ea640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5c0b4390 con 0x7f4e5c0b3f00 2023-11-20T06:42:24.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.827+0000 7f4e626ea640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5c0cd740 con 0x7f4e5c159900 2023-11-20T06:42:24.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.827+0000 7f4e626ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c0b4600 con 0x7f4e5c06a5a0 2023-11-20T06:42:24.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.827+0000 7f4e5bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4e5c159900 0x7f4e5c06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:24.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.827+0000 7f4e5b7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4e5c0b3f00 0x7f4e5c069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47754/0 (socket says 172.21.15.19:47754) 2023-11-20T06:42:24.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.827+0000 7f4e5b7fe640 1 -- 172.21.15.19:0/1545926444 learned_addr learned my addr 172.21.15.19:0/1545926444 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:24.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.827+0000 7f4e60c87640 1 --2- 172.21.15.19:0/1545926444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e5c06a5a0 0x7f4e5c0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:24.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.827+0000 7f4e5bfff640 1 -- 172.21.15.19:0/1545926444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e5c06a5a0 msgr2=0x7f4e5c0c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:24.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.827+0000 7f4e5bfff640 1 --2- 172.21.15.19:0/1545926444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e5c06a5a0 0x7f4e5c0c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.827+0000 7f4e5bfff640 1 -- 172.21.15.19:0/1545926444 >> v1:172.21.15.19:6789/0 conn(0x7f4e5c0b3f00 legacy=0x7f4e5c069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:24.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.827+0000 7f4e5bfff640 1 -- 172.21.15.19:0/1545926444 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c0c8dd0 con 0x7f4e5c159900 2023-11-20T06:42:24.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.827+0000 7f4e5affd640 1 -- 172.21.15.19:0/1545926444 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255055757 0 0) 0x7f4e5c0b4390 con 0x7f4e5c0b3f00 2023-11-20T06:42:24.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.831+0000 7f4e5bfff640 1 --2- 172.21.15.19:0/1545926444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e5c159900 0x7f4e5c06e260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0097c0 tx=0x7f4e4c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd57316b7981aeb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:24.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.831+0000 7f4e5affd640 1 -- 172.21.15.19:0/1545926444 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c0ab650 con 0x7f4e5c159900 2023-11-20T06:42:24.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.831+0000 7f4e5affd640 1 -- 172.21.15.19:0/1545926444 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c0ab7b0 con 0x7f4e5c159900 2023-11-20T06:42:24.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.831+0000 7f4e5affd640 1 -- 172.21.15.19:0/1545926444 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c0abb40 con 0x7f4e5c159900 2023-11-20T06:42:24.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.831+0000 7f4e626ea640 1 -- 172.21.15.19:0/1545926444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e5c159900 msgr2=0x7f4e5c06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:24.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.831+0000 7f4e626ea640 1 --2- 172.21.15.19:0/1545926444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e5c159900 0x7f4e5c06e260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0097c0 tx=0x7f4e4c01c450 comp rx=0 tx=0).stop 2023-11-20T06:42:24.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.831+0000 7f4e626ea640 1 -- 172.21.15.19:0/1545926444 shutdown_connections 2023-11-20T06:42:24.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.831+0000 7f4e626ea640 1 --2- 172.21.15.19:0/1545926444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e5c06a5a0 0x7f4e5c0c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.831+0000 7f4e626ea640 1 --2- 172.21.15.19:0/1545926444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e5c159900 0x7f4e5c06e260 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.831+0000 7f4e626ea640 1 -- 172.21.15.19:0/1545926444 >> 172.21.15.19:0/1545926444 conn(0x7f4e5c0b0da0 msgr2=0x7f4e5c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:24.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.831+0000 7f4e626ea640 1 -- 172.21.15.19:0/1545926444 shutdown_connections 2023-11-20T06:42:24.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.831+0000 7f4e626ea640 1 -- 172.21.15.19:0/1545926444 wait complete. 2023-11-20T06:42:24.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.831+0000 7f4e626ea640 1 Processor -- start 2023-11-20T06:42:24.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.831+0000 7f4e626ea640 1 -- start start 2023-11-20T06:42:24.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e626ea640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e5c06a5a0 0x7f4e5c1543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e626ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e5c0b3f00 0x7f4e5c0c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e626ea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e5c159900 0x7f4e5c15a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e626ea640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c14cba0 con 0x7f4e5c159900 2023-11-20T06:42:24.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e626ea640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c0b3980 con 0x7f4e5c06a5a0 2023-11-20T06:42:24.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e626ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c1538c0 con 0x7f4e5c0b3f00 2023-11-20T06:42:24.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e60c87640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e5c159900 0x7f4e5c15a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:24.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e60c87640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e5c159900 0x7f4e5c15a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58814/0 (socket says 172.21.15.19:58814) 2023-11-20T06:42:24.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e60c87640 1 -- 172.21.15.19:0/2689484414 learned_addr learned my addr 172.21.15.19:0/2689484414 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:24.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e5bfff640 1 --2- 172.21.15.19:0/2689484414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e5c06a5a0 0x7f4e5c1543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:24.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e5b7fe640 1 --2- 172.21.15.19:0/2689484414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e5c0b3f00 0x7f4e5c0c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:24.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e60c87640 1 -- 172.21.15.19:0/2689484414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e5c0b3f00 msgr2=0x7f4e5c0c2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:24.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e60c87640 1 --2- 172.21.15.19:0/2689484414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e5c0b3f00 0x7f4e5c0c2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e60c87640 1 -- 172.21.15.19:0/2689484414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e5c06a5a0 msgr2=0x7f4e5c1543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:24.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e60c87640 1 --2- 172.21.15.19:0/2689484414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e5c06a5a0 0x7f4e5c1543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:24.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e60c87640 1 -- 172.21.15.19:0/2689484414 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c009420 con 0x7f4e5c159900 2023-11-20T06:42:24.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e60c87640 1 --2- 172.21.15.19:0/2689484414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e5c159900 0x7f4e5c15a030 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4e54007e40 tx=0x7f4e5400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:24.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e58ff9640 1 -- 172.21.15.19:0/2689484414 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54014620 con 0x7f4e5c159900 2023-11-20T06:42:24.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e58ff9640 1 -- 172.21.15.19:0/2689484414 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5400ee90 con 0x7f4e5c159900 2023-11-20T06:42:24.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e58ff9640 1 -- 172.21.15.19:0/2689484414 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e540149e0 con 0x7f4e5c159900 2023-11-20T06:42:24.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e626ea640 1 -- 172.21.15.19:0/2689484414 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5c153ba0 con 0x7f4e5c159900 2023-11-20T06:42:24.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e626ea640 1 -- 172.21.15.19:0/2689484414 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5c0b3c60 con 0x7f4e5c159900 2023-11-20T06:42:24.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e626ea640 1 -- 172.21.15.19:0/2689484414 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5c04e170 con 0x7f4e5c159900 2023-11-20T06:42:24.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.835+0000 7f4e58ff9640 1 -- 172.21.15.19:0/2689484414 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4e54014b40 con 0x7f4e5c159900 2023-11-20T06:42:24.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.839+0000 7f4e58ff9640 1 --2- 172.21.15.19:0/2689484414 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4e480664a0 0x7f4e48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:24.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.839+0000 7f4e58ff9640 1 -- 172.21.15.19:0/2689484414 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4e54084b50 con 0x7f4e5c159900 2023-11-20T06:42:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.839+0000 7f4e5bfff640 1 --2- 172.21.15.19:0/2689484414 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4e480664a0 0x7f4e48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.839+0000 7f4e5bfff640 1 --2- 172.21.15.19:0/2689484414 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4e480664a0 0x7f4e48068960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0af000 tx=0x7f4e4c0a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.843+0000 7f4e58ff9640 1 -- 172.21.15.19:0/2689484414 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4e54051c20 con 0x7f4e5c159900 2023-11-20T06:42:25.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.999+0000 7f4e626ea640 1 -- 172.21.15.19:0/2689484414 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4e5c0cabc0 con 0x7f4e5c159900 2023-11-20T06:42:25.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.999+0000 7f4e58ff9640 1 -- 172.21.15.19:0/2689484414 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4e54055240 con 0x7f4e5c159900 2023-11-20T06:42:25.004 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:25.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.999+0000 7f4e626ea640 1 -- 172.21.15.19:0/2689484414 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4e480664a0 msgr2=0x7f4e48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:25.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.999+0000 7f4e626ea640 1 --2- 172.21.15.19:0/2689484414 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4e480664a0 0x7f4e48068960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0af000 tx=0x7f4e4c0a7000 comp rx=0 tx=0).stop 2023-11-20T06:42:25.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.999+0000 7f4e626ea640 1 -- 172.21.15.19:0/2689484414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e5c159900 msgr2=0x7f4e5c15a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:25.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.999+0000 7f4e626ea640 1 --2- 172.21.15.19:0/2689484414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e5c159900 0x7f4e5c15a030 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4e54007e40 tx=0x7f4e5400e4b0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.999+0000 7f4e626ea640 1 -- 172.21.15.19:0/2689484414 shutdown_connections 2023-11-20T06:42:25.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.999+0000 7f4e626ea640 1 --2- 172.21.15.19:0/2689484414 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4e480664a0 0x7f4e48068960 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.999+0000 7f4e626ea640 1 --2- 172.21.15.19:0/2689484414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e5c159900 0x7f4e5c15a030 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.999+0000 7f4e626ea640 1 --2- 172.21.15.19:0/2689484414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e5c0b3f00 0x7f4e5c0c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.999+0000 7f4e626ea640 1 --2- 172.21.15.19:0/2689484414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e5c06a5a0 0x7f4e5c1543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.999+0000 7f4e626ea640 1 -- 172.21.15.19:0/2689484414 >> 172.21.15.19:0/2689484414 conn(0x7f4e5c0b0da0 msgr2=0x7f4e5c1586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:25.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.999+0000 7f4e626ea640 1 -- 172.21.15.19:0/2689484414 shutdown_connections 2023-11-20T06:42:25.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:24.999+0000 7f4e626ea640 1 -- 172.21.15.19:0/2689484414 wait complete. 2023-11-20T06:42:25.026 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T06:42:25.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.163+0000 7f3432809640 1 Processor -- start 2023-11-20T06:42:25.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.163+0000 7f3432809640 1 -- start start 2023-11-20T06:42:25.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.167+0000 7f3432809640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f342c15ca70 0x7f342c0d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.167+0000 7f3432809640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f342c0d3550 0x7f342c0cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.167+0000 7f3432809640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f342c0cf5d0 0x7f342c0d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.167+0000 7f3432809640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342c0ce820 con 0x7f342c0d3550 2023-11-20T06:42:25.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.167+0000 7f3432809640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342c0cfa40 con 0x7f342c15ca70 2023-11-20T06:42:25.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.167+0000 7f3432809640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342c0c65f0 con 0x7f342c0cf5d0 2023-11-20T06:42:25.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.167+0000 7f342b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f342c0d3550 0x7f342c0cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:25.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.167+0000 7f342b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f342c0d3550 0x7f342c0cf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58820/0 (socket says 172.21.15.19:58820) 2023-11-20T06:42:25.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.167+0000 7f342b7fe640 1 -- 172.21.15.19:0/1226914603 learned_addr learned my addr 172.21.15.19:0/1226914603 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:25.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.167+0000 7f3430da6640 1 --2- 172.21.15.19:0/1226914603 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f342c0cf5d0 0x7f342c0d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:25.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.167+0000 7f342b7fe640 1 -- 172.21.15.19:0/1226914603 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f342c0cf5d0 msgr2=0x7f342c0d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:25.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.167+0000 7f342b7fe640 1 --2- 172.21.15.19:0/1226914603 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f342c0cf5d0 0x7f342c0d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.167+0000 7f342b7fe640 1 -- 172.21.15.19:0/1226914603 >> v2:172.21.15.190:3300/0 conn(0x7f342c15ca70 msgr2=0x7f342c0d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:25.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.167+0000 7f342b7fe640 1 --2- 172.21.15.19:0/1226914603 >> v2:172.21.15.190:3300/0 conn(0x7f342c15ca70 0x7f342c0d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.167+0000 7f342b7fe640 1 -- 172.21.15.19:0/1226914603 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c0cdf80 con 0x7f342c0d3550 2023-11-20T06:42:25.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.171+0000 7f342b7fe640 1 --2- 172.21.15.19:0/1226914603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f342c0d3550 0x7f342c0cf090 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f342c08a880 tx=0x7f342001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f48f5cac0f71ef server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:25.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.171+0000 7f342affd640 1 -- 172.21.15.19:0/1226914603 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34200ab600 con 0x7f342c0d3550 2023-11-20T06:42:25.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.171+0000 7f342affd640 1 -- 172.21.15.19:0/1226914603 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34200a7050 con 0x7f342c0d3550 2023-11-20T06:42:25.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.171+0000 7f342affd640 1 -- 172.21.15.19:0/1226914603 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34200ab980 con 0x7f342c0d3550 2023-11-20T06:42:25.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.171+0000 7f3432809640 1 -- 172.21.15.19:0/1226914603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f342c0d3550 msgr2=0x7f342c0cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:25.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.171+0000 7f3432809640 1 --2- 172.21.15.19:0/1226914603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f342c0d3550 0x7f342c0cf090 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f342c08a880 tx=0x7f342001c210 comp rx=0 tx=0).stop 2023-11-20T06:42:25.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.171+0000 7f3432809640 1 -- 172.21.15.19:0/1226914603 shutdown_connections 2023-11-20T06:42:25.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.171+0000 7f3432809640 1 --2- 172.21.15.19:0/1226914603 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f342c0cf5d0 0x7f342c0d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.171+0000 7f3432809640 1 --2- 172.21.15.19:0/1226914603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f342c0d3550 0x7f342c0cf090 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.171+0000 7f3432809640 1 --2- 172.21.15.19:0/1226914603 >> v2:172.21.15.190:3300/0 conn(0x7f342c15ca70 0x7f342c0d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.171+0000 7f3432809640 1 -- 172.21.15.19:0/1226914603 >> 172.21.15.19:0/1226914603 conn(0x7f342c09bc50 msgr2=0x7f342c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:25.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.171+0000 7f3432809640 1 -- 172.21.15.19:0/1226914603 shutdown_connections 2023-11-20T06:42:25.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.171+0000 7f3432809640 1 -- 172.21.15.19:0/1226914603 wait complete. 2023-11-20T06:42:25.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.171+0000 7f3432809640 1 Processor -- start 2023-11-20T06:42:25.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.171+0000 7f3432809640 1 -- start start 2023-11-20T06:42:25.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f3432809640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f342c0cf5d0 0x7f342c152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f3432809640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f342c0d3550 0x7f342c15db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f3432809640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f342c15ca70 0x7f342c0cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f3432809640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342c15e090 con 0x7f342c0d3550 2023-11-20T06:42:25.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f3432809640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342c0b64b0 con 0x7f342c15ca70 2023-11-20T06:42:25.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f3432809640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342c0b5f30 con 0x7f342c0cf5d0 2023-11-20T06:42:25.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f342b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f342c0d3550 0x7f342c15db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:25.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f342b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f342c0d3550 0x7f342c15db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58826/0 (socket says 172.21.15.19:58826) 2023-11-20T06:42:25.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f342b7fe640 1 -- 172.21.15.19:0/750659488 learned_addr learned my addr 172.21.15.19:0/750659488 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:25.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f3430da6640 1 --2- 172.21.15.19:0/750659488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f342c15ca70 0x7f342c0cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:25.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f342bfff640 1 --2- 172.21.15.19:0/750659488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f342c0cf5d0 0x7f342c152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:25.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f342b7fe640 1 -- 172.21.15.19:0/750659488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f342c0cf5d0 msgr2=0x7f342c152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:25.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f342b7fe640 1 --2- 172.21.15.19:0/750659488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f342c0cf5d0 0x7f342c152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f342b7fe640 1 -- 172.21.15.19:0/750659488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f342c15ca70 msgr2=0x7f342c0cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:25.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f342b7fe640 1 --2- 172.21.15.19:0/750659488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f342c15ca70 0x7f342c0cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f342b7fe640 1 -- 172.21.15.19:0/750659488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34200094d0 con 0x7f342c0d3550 2023-11-20T06:42:25.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f342b7fe640 1 --2- 172.21.15.19:0/750659488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f342c0d3550 0x7f342c15db50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f342001a8c0 tx=0x7f342001aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:25.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f3428ff9640 1 -- 172.21.15.19:0/750659488 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34200b6620 con 0x7f342c0d3550 2023-11-20T06:42:25.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f3428ff9640 1 -- 172.21.15.19:0/750659488 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34200b67a0 con 0x7f342c0d3550 2023-11-20T06:42:25.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f3428ff9640 1 -- 172.21.15.19:0/750659488 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34200b6b50 con 0x7f342c0d3550 2023-11-20T06:42:25.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f3432809640 1 -- 172.21.15.19:0/750659488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f342c0b55c0 con 0x7f342c0d3550 2023-11-20T06:42:25.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f3432809640 1 -- 172.21.15.19:0/750659488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f342c0b58a0 con 0x7f342c0d3550 2023-11-20T06:42:25.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.175+0000 7f3432809640 1 -- 172.21.15.19:0/750659488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342c074010 con 0x7f342c0d3550 2023-11-20T06:42:25.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.179+0000 7f3428ff9640 1 -- 172.21.15.19:0/750659488 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f34200b2040 con 0x7f342c0d3550 2023-11-20T06:42:25.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.179+0000 7f3428ff9640 1 --2- 172.21.15.19:0/750659488 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f34180664a0 0x7f3418068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.179+0000 7f3428ff9640 1 -- 172.21.15.19:0/750659488 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f342011e420 con 0x7f342c0d3550 2023-11-20T06:42:25.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.179+0000 7f342bfff640 1 --2- 172.21.15.19:0/750659488 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f34180664a0 0x7f3418068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:25.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.179+0000 7f342bfff640 1 --2- 172.21.15.19:0/750659488 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f34180664a0 0x7f3418068960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f342c0a08d0 tx=0x7f341c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:25.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.183+0000 7f3428ff9640 1 -- 172.21.15.19:0/750659488 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f34200eb440 con 0x7f342c0d3550 2023-11-20T06:42:25.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.351+0000 7f3432809640 1 -- 172.21.15.19:0/750659488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f342c0d0290 con 0x7f342c0d3550 2023-11-20T06:42:25.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.355+0000 7f3428ff9640 1 -- 172.21.15.19:0/750659488 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f34200eea60 con 0x7f342c0d3550 2023-11-20T06:42:25.360 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2023-11-20T06:42:25.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.355+0000 7f3432809640 1 -- 172.21.15.19:0/750659488 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f34180664a0 msgr2=0x7f3418068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:25.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.355+0000 7f3432809640 1 --2- 172.21.15.19:0/750659488 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f34180664a0 0x7f3418068960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f342c0a08d0 tx=0x7f341c008040 comp rx=0 tx=0).stop 2023-11-20T06:42:25.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.355+0000 7f3432809640 1 -- 172.21.15.19:0/750659488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f342c0d3550 msgr2=0x7f342c15db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:25.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.355+0000 7f3432809640 1 --2- 172.21.15.19:0/750659488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f342c0d3550 0x7f342c15db50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f342001a8c0 tx=0x7f342001aa50 comp rx=0 tx=0).stop 2023-11-20T06:42:25.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.355+0000 7f3432809640 1 -- 172.21.15.19:0/750659488 shutdown_connections 2023-11-20T06:42:25.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.355+0000 7f3432809640 1 --2- 172.21.15.19:0/750659488 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f34180664a0 0x7f3418068960 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.355+0000 7f3432809640 1 --2- 172.21.15.19:0/750659488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f342c15ca70 0x7f342c0cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.355+0000 7f3432809640 1 --2- 172.21.15.19:0/750659488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f342c0d3550 0x7f342c15db50 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.355+0000 7f3432809640 1 --2- 172.21.15.19:0/750659488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f342c0cf5d0 0x7f342c152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.355+0000 7f3432809640 1 -- 172.21.15.19:0/750659488 >> 172.21.15.19:0/750659488 conn(0x7f342c09bc50 msgr2=0x7f342c0c6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:25.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.355+0000 7f3432809640 1 -- 172.21.15.19:0/750659488 shutdown_connections 2023-11-20T06:42:25.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.355+0000 7f3432809640 1 -- 172.21.15.19:0/750659488 wait complete. 2023-11-20T06:42:25.381 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:42:25.381 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:42:25.405 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:25.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5e06e54640 1 Processor -- start 2023-11-20T06:42:25.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5e06e54640 1 -- start start 2023-11-20T06:42:25.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5e06e54640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e00070c40 0x7f5e0015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5e06e54640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0015be60 con 0x7f5e000b07f0 2023-11-20T06:42:25.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5e06e54640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0015c1f0 con 0x7f5e000b4020 2023-11-20T06:42:25.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5e06e54640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0015b3b0 con 0x7f5e00070c40 2023-11-20T06:42:25.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5e053f1640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5e000b07f0 0x7f5e00164490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47762/0 (socket says 172.21.15.19:47762) 2023-11-20T06:42:25.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5e053f1640 1 -- 172.21.15.19:0/1920573027 learned_addr learned my addr 172.21.15.19:0/1920573027 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:25.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5e04bf0640 1 --2- 172.21.15.19:0/1920573027 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e00070c40 0x7f5e0015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:25.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5dff7fe640 1 -- 172.21.15.19:0/1920573027 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239981752 0 0) 0x7f5e0015be60 con 0x7f5e000b07f0 2023-11-20T06:42:25.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5dff7fe640 1 -- 172.21.15.19:0/1920573027 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5df0003530 con 0x7f5e000b07f0 2023-11-20T06:42:25.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5dff7fe640 1 -- 172.21.15.19:0/1920573027 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1873322848 0 0) 0x7f5e0015c1f0 con 0x7f5e000b4020 2023-11-20T06:42:25.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5dff7fe640 1 -- 172.21.15.19:0/1920573027 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e0015be60 con 0x7f5e000b4020 2023-11-20T06:42:25.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5dff7fe640 1 -- 172.21.15.19:0/1920573027 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3665939407 0 0) 0x7f5df0003530 con 0x7f5e000b07f0 2023-11-20T06:42:25.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5dff7fe640 1 -- 172.21.15.19:0/1920573027 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e00070c40 msgr2=0x7f5e0015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:25.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5dff7fe640 1 --2- 172.21.15.19:0/1920573027 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e00070c40 0x7f5e0015ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5dff7fe640 1 -- 172.21.15.19:0/1920573027 >> v1:172.21.15.190:6789/0 conn(0x7f5e000b4020 legacy=0x7f5e000b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:25.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5dff7fe640 1 -- 172.21.15.19:0/1920573027 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e00071020 con 0x7f5e000b07f0 2023-11-20T06:42:25.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5dff7fe640 1 -- 172.21.15.19:0/1920573027 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7f5df8001a00 con 0x7f5e000b07f0 2023-11-20T06:42:25.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5e04bf0640 1 --2- 172.21.15.19:0/1920573027 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e00070c40 0x7f5e0015ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:42:25.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5dff7fe640 1 -- 172.21.15.19:0/1920573027 >> v1:172.21.15.19:6789/0 conn(0x7f5e000b07f0 legacy=0x7f5e00164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:25.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5dff7fe640 1 --2- 172.21.15.19:0/1920573027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0003b40 0x7f5df0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5dff7fe640 1 --2- 172.21.15.19:0/1920573027 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e00070c40 0x7f5df00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5dff7fe640 1 --2- 172.21.15.19:0/1920573027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5df0004d10 0x7f5df0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5dff7fe640 1 -- 172.21.15.19:0/1920573027 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0015b3b0 con 0x7f5df0003b40 2023-11-20T06:42:25.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5dff7fe640 1 -- 172.21.15.19:0/1920573027 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df000ba70 con 0x7f5df0004d10 2023-11-20T06:42:25.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5dff7fe640 1 -- 172.21.15.19:0/1920573027 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df000bc30 con 0x7f5e00070c40 2023-11-20T06:42:25.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5e04bf0640 1 --2- 172.21.15.19:0/1920573027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0003b40 0x7f5df0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:25.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5dfffff640 1 --2- 172.21.15.19:0/1920573027 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e00070c40 0x7f5df00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:25.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5e053f1640 1 --2- 172.21.15.19:0/1920573027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5df0004d10 0x7f5df0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:25.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5e04bf0640 1 -- 172.21.15.19:0/1920573027 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e00070c40 msgr2=0x7f5df00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:25.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5e04bf0640 1 --2- 172.21.15.19:0/1920573027 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e00070c40 0x7f5df00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5e04bf0640 1 -- 172.21.15.19:0/1920573027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5df0004d10 msgr2=0x7f5df0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:25.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5e04bf0640 1 --2- 172.21.15.19:0/1920573027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5df0004d10 0x7f5df0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5e04bf0640 1 -- 172.21.15.19:0/1920573027 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df4009420 con 0x7f5df0003b40 2023-11-20T06:42:25.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.547+0000 7f5e053f1640 1 --2- 172.21.15.19:0/1920573027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5df0004d10 0x7f5df0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:25.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.551+0000 7f5e04bf0640 1 --2- 172.21.15.19:0/1920573027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0003b40 0x7f5df0003f40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009cb0 tx=0x7f5df401cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b9b4fe114eff87 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:25.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.551+0000 7f5dff7fe640 1 -- 172.21.15.19:0/1920573027 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df40a5890 con 0x7f5df0003b40 2023-11-20T06:42:25.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.551+0000 7f5dff7fe640 1 -- 172.21.15.19:0/1920573027 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df40a59f0 con 0x7f5df0003b40 2023-11-20T06:42:25.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.551+0000 7f5dff7fe640 1 -- 172.21.15.19:0/1920573027 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df40a5da0 con 0x7f5df0003b40 2023-11-20T06:42:25.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.551+0000 7f5e06e54640 1 -- 172.21.15.19:0/1920573027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0003b40 msgr2=0x7f5df0003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:25.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.551+0000 7f5e06e54640 1 --2- 172.21.15.19:0/1920573027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0003b40 0x7f5df0003f40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009cb0 tx=0x7f5df401cbf0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.551+0000 7f5e053f1640 1 -- 172.21.15.19:0/1920573027 reap_dead start 2023-11-20T06:42:25.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.551+0000 7f5e06e54640 1 -- 172.21.15.19:0/1920573027 shutdown_connections 2023-11-20T06:42:25.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.551+0000 7f5e06e54640 1 -- 172.21.15.19:0/1920573027 >> 172.21.15.19:0/1920573027 conn(0x7f5e0006c190 msgr2=0x7f5e0006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:25.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.551+0000 7f5e06e54640 1 -- 172.21.15.19:0/1920573027 shutdown_connections 2023-11-20T06:42:25.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.551+0000 7f5e06e54640 1 -- 172.21.15.19:0/1920573027 wait complete. 2023-11-20T06:42:25.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5e06e54640 1 Processor -- start 2023-11-20T06:42:25.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5e06e54640 1 -- start start 2023-11-20T06:42:25.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5e06e54640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0003b40 0x7f5e00152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5e06e54640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e00150e50 0x7f5e00144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5e06e54640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e00162660 0x7f5e00160470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5e06e54640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e00152ad0 con 0x7f5df0003b40 2023-11-20T06:42:25.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5e06e54640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e00162ff0 con 0x7f5e00150e50 2023-11-20T06:42:25.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5e06e54640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e001632d0 con 0x7f5e00162660 2023-11-20T06:42:25.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5e04bf0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0003b40 0x7f5e00152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:25.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5e04bf0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0003b40 0x7f5e00152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58832/0 (socket says 172.21.15.19:58832) 2023-11-20T06:42:25.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5e04bf0640 1 -- 172.21.15.19:0/2908153726 learned_addr learned my addr 172.21.15.19:0/2908153726 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:25.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5e04bf0640 1 -- 172.21.15.19:0/2908153726 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e00162660 msgr2=0x7f5e00160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:25.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5e04bf0640 1 --2- 172.21.15.19:0/2908153726 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e00162660 0x7f5e00160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5e04bf0640 1 -- 172.21.15.19:0/2908153726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e00150e50 msgr2=0x7f5e00144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:25.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5e04bf0640 1 --2- 172.21.15.19:0/2908153726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e00150e50 0x7f5e00144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5e04bf0640 1 -- 172.21.15.19:0/2908153726 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e001635b0 con 0x7f5df0003b40 2023-11-20T06:42:25.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5e04bf0640 1 --2- 172.21.15.19:0/2908153726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0003b40 0x7f5e00152590 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009cb0 tx=0x7f5df0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:25.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5dfd7fa640 1 -- 172.21.15.19:0/2908153726 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df40be070 con 0x7f5df0003b40 2023-11-20T06:42:25.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5dfd7fa640 1 -- 172.21.15.19:0/2908153726 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df400f000 con 0x7f5df0003b40 2023-11-20T06:42:25.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5e06e54640 1 -- 172.21.15.19:0/2908153726 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e00163890 con 0x7f5df0003b40 2023-11-20T06:42:25.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5dfd7fa640 1 -- 172.21.15.19:0/2908153726 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4004240 con 0x7f5df0003b40 2023-11-20T06:42:25.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.555+0000 7f5e06e54640 1 -- 172.21.15.19:0/2908153726 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e00144e60 con 0x7f5df0003b40 2023-11-20T06:42:25.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.559+0000 7f5e06e54640 1 -- 172.21.15.19:0/2908153726 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e00074010 con 0x7f5df0003b40 2023-11-20T06:42:25.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.559+0000 7f5dfd7fa640 1 -- 172.21.15.19:0/2908153726 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5df40b4040 con 0x7f5df0003b40 2023-11-20T06:42:25.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.559+0000 7f5dfd7fa640 1 --2- 172.21.15.19:0/2908153726 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f5de40664d0 0x7f5de4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.559+0000 7f5dfd7fa640 1 -- 172.21.15.19:0/2908153726 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5df411e1a0 con 0x7f5df0003b40 2023-11-20T06:42:25.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.559+0000 7f5dfffff640 1 --2- 172.21.15.19:0/2908153726 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f5de40664d0 0x7f5de4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:25.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.559+0000 7f5dfffff640 1 --2- 172.21.15.19:0/2908153726 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f5de40664d0 0x7f5de4068990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5e001f8ab0 tx=0x7f5dec009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:25.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.563+0000 7f5dfd7fa640 1 -- 172.21.15.19:0/2908153726 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5df40eb1f0 con 0x7f5df0003b40 2023-11-20T06:42:25.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.731+0000 7f5e06e54640 1 -- 172.21.15.19:0/2908153726 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e00163d40 con 0x7f5df0003b40 2023-11-20T06:42:25.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.731+0000 7f5dfd7fa640 1 -- 172.21.15.19:0/2908153726 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18720 (secure 0 0 0) 0x7f5df40b2090 con 0x7f5df0003b40 2023-11-20T06:42:25.739 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:25.739 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:55.472006+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:25.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.731+0000 7f5e06e54640 1 -- 172.21.15.19:0/2908153726 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f5de40664d0 msgr2=0x7f5de4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:25.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.731+0000 7f5e06e54640 1 --2- 172.21.15.19:0/2908153726 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f5de40664d0 0x7f5de4068990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5e001f8ab0 tx=0x7f5dec009040 comp rx=0 tx=0).stop 2023-11-20T06:42:25.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.731+0000 7f5e06e54640 1 -- 172.21.15.19:0/2908153726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0003b40 msgr2=0x7f5e00152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:25.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.731+0000 7f5e06e54640 1 --2- 172.21.15.19:0/2908153726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0003b40 0x7f5e00152590 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009cb0 tx=0x7f5df0005800 comp rx=0 tx=0).stop 2023-11-20T06:42:25.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.731+0000 7f5e06e54640 1 -- 172.21.15.19:0/2908153726 shutdown_connections 2023-11-20T06:42:25.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.731+0000 7f5e06e54640 1 --2- 172.21.15.19:0/2908153726 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f5de40664d0 0x7f5de4068990 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.731+0000 7f5e06e54640 1 --2- 172.21.15.19:0/2908153726 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e00162660 0x7f5e00160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.731+0000 7f5e06e54640 1 --2- 172.21.15.19:0/2908153726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e00150e50 0x7f5e00144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.731+0000 7f5e06e54640 1 --2- 172.21.15.19:0/2908153726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0003b40 0x7f5e00152590 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.731+0000 7f5e06e54640 1 -- 172.21.15.19:0/2908153726 >> 172.21.15.19:0/2908153726 conn(0x7f5e0006c190 msgr2=0x7f5e000b31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:25.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.731+0000 7f5e06e54640 1 -- 172.21.15.19:0/2908153726 shutdown_connections 2023-11-20T06:42:25.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.731+0000 7f5e06e54640 1 -- 172.21.15.19:0/2908153726 wait complete. 2023-11-20T06:42:25.759 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T06:41:11.805111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T06:41:12.614034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T06:41:16.311206+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T06:42:25.760 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:42:25.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.907+0000 7fa574b3e640 1 Processor -- start 2023-11-20T06:42:25.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.907+0000 7fa574b3e640 1 -- start start 2023-11-20T06:42:25.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.907+0000 7fa574b3e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa5700d0210 0x7fa5700d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.907+0000 7fa574b3e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa5700b84e0 0x7fa5700b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.907+0000 7fa574b3e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5700d1670 con 0x7fa57015cba0 2023-11-20T06:42:25.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.907+0000 7fa574b3e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5700d1460 con 0x7fa5700d0210 2023-11-20T06:42:25.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.907+0000 7fa574b3e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5700d1950 con 0x7fa5700b84e0 2023-11-20T06:42:25.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.907+0000 7fa567fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa5700d0210 0x7fa5700d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:25.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.907+0000 7fa56e59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa57015cba0 0x7fa5700cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47768/0 (socket says 172.21.15.19:47768) 2023-11-20T06:42:25.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.907+0000 7fa56e59c640 1 -- 172.21.15.19:0/4197166276 learned_addr learned my addr 172.21.15.19:0/4197166276 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:25.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.907+0000 7fa56ed9d640 1 --2- 172.21.15.19:0/4197166276 >> v2:172.21.15.190:3300/0 conn(0x7fa5700b84e0 0x7fa5700b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:25.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.907+0000 7fa567fff640 1 -- 172.21.15.19:0/4197166276 >> v2:172.21.15.190:3300/0 conn(0x7fa5700b84e0 msgr2=0x7fa5700b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:25.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.907+0000 7fa567fff640 1 --2- 172.21.15.19:0/4197166276 >> v2:172.21.15.190:3300/0 conn(0x7fa5700b84e0 0x7fa5700b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.907+0000 7fa567fff640 1 -- 172.21.15.19:0/4197166276 >> v1:172.21.15.19:6789/0 conn(0x7fa57015cba0 legacy=0x7fa5700cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:25.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.907+0000 7fa56dd9b640 1 -- 172.21.15.19:0/4197166276 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744661150 0 0) 0x7fa5700d1670 con 0x7fa57015cba0 2023-11-20T06:42:25.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.907+0000 7fa567fff640 1 -- 172.21.15.19:0/4197166276 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5700d1c30 con 0x7fa5700d0210 2023-11-20T06:42:25.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.911+0000 7fa567fff640 1 --2- 172.21.15.19:0/4197166276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5700d0210 0x7fa5700d0f20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa5700ce450 tx=0x7fa55801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bed2e6d5153cf3a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:25.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.911+0000 7fa56dd9b640 1 -- 172.21.15.19:0/4197166276 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5580ac630 con 0x7fa5700d0210 2023-11-20T06:42:25.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.911+0000 7fa56dd9b640 1 -- 172.21.15.19:0/4197166276 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5580ac790 con 0x7fa5700d0210 2023-11-20T06:42:25.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.911+0000 7fa56dd9b640 1 -- 172.21.15.19:0/4197166276 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5580acb20 con 0x7fa5700d0210 2023-11-20T06:42:25.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.911+0000 7fa574b3e640 1 -- 172.21.15.19:0/4197166276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5700d0210 msgr2=0x7fa5700d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:25.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.911+0000 7fa574b3e640 1 --2- 172.21.15.19:0/4197166276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5700d0210 0x7fa5700d0f20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa5700ce450 tx=0x7fa55801c3d0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.911+0000 7fa574b3e640 1 -- 172.21.15.19:0/4197166276 shutdown_connections 2023-11-20T06:42:25.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.911+0000 7fa574b3e640 1 --2- 172.21.15.19:0/4197166276 >> v2:172.21.15.190:3300/0 conn(0x7fa5700b84e0 0x7fa5700b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.911+0000 7fa574b3e640 1 --2- 172.21.15.19:0/4197166276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5700d0210 0x7fa5700d0f20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.911+0000 7fa574b3e640 1 -- 172.21.15.19:0/4197166276 >> 172.21.15.19:0/4197166276 conn(0x7fa5700719c0 msgr2=0x7fa570071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:25.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.911+0000 7fa574b3e640 1 -- 172.21.15.19:0/4197166276 shutdown_connections 2023-11-20T06:42:25.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.911+0000 7fa574b3e640 1 -- 172.21.15.19:0/4197166276 wait complete. 2023-11-20T06:42:25.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa574b3e640 1 Processor -- start 2023-11-20T06:42:25.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa574b3e640 1 -- start start 2023-11-20T06:42:25.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa574b3e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa5700b84e0 0x7fa5700cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa574b3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa5700d0210 0x7fa570155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa574b3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa57015cba0 0x7fa5700c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa574b3e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa570149880 con 0x7fa57015cba0 2023-11-20T06:42:25.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa574b3e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa570149b60 con 0x7fa5700b84e0 2023-11-20T06:42:25.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa574b3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa570149e40 con 0x7fa5700d0210 2023-11-20T06:42:25.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa56ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa57015cba0 0x7fa5700c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:25.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa56ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa57015cba0 0x7fa5700c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58848/0 (socket says 172.21.15.19:58848) 2023-11-20T06:42:25.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa56ed9d640 1 -- 172.21.15.19:0/3660672029 learned_addr learned my addr 172.21.15.19:0/3660672029 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:25.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa56e59c640 1 --2- 172.21.15.19:0/3660672029 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa5700b84e0 0x7fa5700cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:25.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa567fff640 1 --2- 172.21.15.19:0/3660672029 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa5700d0210 0x7fa570155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:25.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa56ed9d640 1 -- 172.21.15.19:0/3660672029 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa5700d0210 msgr2=0x7fa570155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:25.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa56ed9d640 1 --2- 172.21.15.19:0/3660672029 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa5700d0210 0x7fa570155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa56ed9d640 1 -- 172.21.15.19:0/3660672029 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa5700b84e0 msgr2=0x7fa5700cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:25.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa56ed9d640 1 --2- 172.21.15.19:0/3660672029 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa5700b84e0 0x7fa5700cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:25.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa56ed9d640 1 -- 172.21.15.19:0/3660672029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa558009420 con 0x7fa57015cba0 2023-11-20T06:42:25.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa56e59c640 1 --2- 172.21.15.19:0/3660672029 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa5700b84e0 0x7fa5700cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:25.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa56ed9d640 1 --2- 172.21.15.19:0/3660672029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa57015cba0 0x7fa5700c52b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa568007e30 tx=0x7fa56800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:25.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa566ffd640 1 -- 172.21.15.19:0/3660672029 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa568014620 con 0x7fa57015cba0 2023-11-20T06:42:25.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa566ffd640 1 -- 172.21.15.19:0/3660672029 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56800ee90 con 0x7fa57015cba0 2023-11-20T06:42:25.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa574b3e640 1 -- 172.21.15.19:0/3660672029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa570155540 con 0x7fa57015cba0 2023-11-20T06:42:25.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa566ffd640 1 -- 172.21.15.19:0/3660672029 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5680149c0 con 0x7fa57015cba0 2023-11-20T06:42:25.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.915+0000 7fa574b3e640 1 -- 172.21.15.19:0/3660672029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa570156280 con 0x7fa57015cba0 2023-11-20T06:42:25.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.919+0000 7fa574b3e640 1 -- 172.21.15.19:0/3660672029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5701553a0 con 0x7fa57015cba0 2023-11-20T06:42:25.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.919+0000 7fa566ffd640 1 -- 172.21.15.19:0/3660672029 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa568014b20 con 0x7fa57015cba0 2023-11-20T06:42:25.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.919+0000 7fa566ffd640 1 --2- 172.21.15.19:0/3660672029 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa5500664a0 0x7fa550068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:25.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.919+0000 7fa566ffd640 1 -- 172.21.15.19:0/3660672029 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa568084c10 con 0x7fa57015cba0 2023-11-20T06:42:25.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.919+0000 7fa56e59c640 1 --2- 172.21.15.19:0/3660672029 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa5500664a0 0x7fa550068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:25.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.919+0000 7fa56e59c640 1 --2- 172.21.15.19:0/3660672029 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa5500664a0 0x7fa550068960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa560000f70 tx=0x7fa560007cb0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:25.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:25.923+0000 7fa566ffd640 1 -- 172.21.15.19:0/3660672029 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa5701553a0 con 0x7fa57015cba0 2023-11-20T06:42:26.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.079+0000 7fa574b3e640 1 -- 172.21.15.19:0/3660672029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5701553a0 con 0x7fa57015cba0 2023-11-20T06:42:26.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.079+0000 7fa566ffd640 1 -- 172.21.15.19:0/3660672029 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5701553a0 con 0x7fa57015cba0 2023-11-20T06:42:26.086 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:42:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.083+0000 7fa574b3e640 1 -- 172.21.15.19:0/3660672029 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa5500664a0 msgr2=0x7fa550068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.083+0000 7fa574b3e640 1 --2- 172.21.15.19:0/3660672029 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa5500664a0 0x7fa550068960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa560000f70 tx=0x7fa560007cb0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.083+0000 7fa574b3e640 1 -- 172.21.15.19:0/3660672029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa57015cba0 msgr2=0x7fa5700c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.083+0000 7fa574b3e640 1 --2- 172.21.15.19:0/3660672029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa57015cba0 0x7fa5700c52b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa568007e30 tx=0x7fa56800e4b0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.083+0000 7fa574b3e640 1 -- 172.21.15.19:0/3660672029 shutdown_connections 2023-11-20T06:42:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.083+0000 7fa574b3e640 1 --2- 172.21.15.19:0/3660672029 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa5500664a0 0x7fa550068960 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.083+0000 7fa574b3e640 1 --2- 172.21.15.19:0/3660672029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa57015cba0 0x7fa5700c52b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.083+0000 7fa574b3e640 1 --2- 172.21.15.19:0/3660672029 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa5700d0210 0x7fa570155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.083+0000 7fa574b3e640 1 --2- 172.21.15.19:0/3660672029 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa5700b84e0 0x7fa5700cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.083+0000 7fa574b3e640 1 -- 172.21.15.19:0/3660672029 >> 172.21.15.19:0/3660672029 conn(0x7fa5700719c0 msgr2=0x7fa5700d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:26.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.083+0000 7fa574b3e640 1 -- 172.21.15.19:0/3660672029 shutdown_connections 2023-11-20T06:42:26.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.083+0000 7fa574b3e640 1 -- 172.21.15.19:0/3660672029 wait complete. 2023-11-20T06:42:26.108 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T06:42:26.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.251+0000 7f86cd2d6640 1 Processor -- start 2023-11-20T06:42:26.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.251+0000 7f86cd2d6640 1 -- start start 2023-11-20T06:42:26.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.251+0000 7f86cd2d6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f86c815cba0 0x7f86c80d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:26.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.251+0000 7f86cd2d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86c80b84e0 0x7f86c80cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:26.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.251+0000 7f86cd2d6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c80d1670 con 0x7f86c80d0040 2023-11-20T06:42:26.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.251+0000 7f86cd2d6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c80d1460 con 0x7f86c815cba0 2023-11-20T06:42:26.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.251+0000 7f86cd2d6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80d04b0 con 0x7f86c80b84e0 2023-11-20T06:42:26.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.251+0000 7f86c77fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f86c80d0040 0x7f86c80d2ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47782/0 (socket says 172.21.15.19:47782) 2023-11-20T06:42:26.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.251+0000 7f86c77fe640 1 -- 172.21.15.19:0/3469239487 learned_addr learned my addr 172.21.15.19:0/3469239487 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:26.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.251+0000 7f86c6ffd640 1 --2- 172.21.15.19:0/3469239487 >> v2:172.21.15.190:3300/0 conn(0x7f86c815cba0 0x7f86c80d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:26.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.251+0000 7f86c67fc640 1 --2- 172.21.15.19:0/3469239487 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86c80b84e0 0x7f86c80cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:26.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.255+0000 7f86c5ffb640 1 -- 172.21.15.19:0/3469239487 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618386630 0 0) 0x7f86c80d1670 con 0x7f86c80d0040 2023-11-20T06:42:26.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.255+0000 7f86c5ffb640 1 -- 172.21.15.19:0/3469239487 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86b0003530 con 0x7f86c80d0040 2023-11-20T06:42:26.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.255+0000 7f86c6ffd640 1 -- 172.21.15.19:0/3469239487 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86c80b84e0 msgr2=0x7f86c80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:26.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.255+0000 7f86c6ffd640 1 --2- 172.21.15.19:0/3469239487 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86c80b84e0 0x7f86c80cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.255+0000 7f86c6ffd640 1 -- 172.21.15.19:0/3469239487 >> v1:172.21.15.19:6789/0 conn(0x7f86c80d0040 legacy=0x7f86c80d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:26.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.255+0000 7f86c6ffd640 1 -- 172.21.15.19:0/3469239487 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c80d1950 con 0x7f86c815cba0 2023-11-20T06:42:26.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.255+0000 7f86c67fc640 1 --2- 172.21.15.19:0/3469239487 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86c80b84e0 0x7f86c80cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:42:26.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.255+0000 7f86c6ffd640 1 --2- 172.21.15.19:0/3469239487 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86c815cba0 0x7f86c80d0f20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f86b80097c0 tx=0x7f86b801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a758502290c1a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:26.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.255+0000 7f86c5ffb640 1 -- 172.21.15.19:0/3469239487 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b80ac600 con 0x7f86c815cba0 2023-11-20T06:42:26.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.255+0000 7f86c5ffb640 1 -- 172.21.15.19:0/3469239487 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b80a8050 con 0x7f86c815cba0 2023-11-20T06:42:26.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.255+0000 7f86c5ffb640 1 -- 172.21.15.19:0/3469239487 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b80ac980 con 0x7f86c815cba0 2023-11-20T06:42:26.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.259+0000 7f86cd2d6640 1 -- 172.21.15.19:0/3469239487 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86c815cba0 msgr2=0x7f86c80d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:26.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.259+0000 7f86cd2d6640 1 --2- 172.21.15.19:0/3469239487 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86c815cba0 0x7f86c80d0f20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f86b80097c0 tx=0x7f86b801c480 comp rx=0 tx=0).stop 2023-11-20T06:42:26.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.259+0000 7f86cd2d6640 1 -- 172.21.15.19:0/3469239487 shutdown_connections 2023-11-20T06:42:26.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.259+0000 7f86cd2d6640 1 --2- 172.21.15.19:0/3469239487 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86c80b84e0 0x7f86c80cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.259+0000 7f86cd2d6640 1 --2- 172.21.15.19:0/3469239487 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86c815cba0 0x7f86c80d0f20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.259+0000 7f86cd2d6640 1 -- 172.21.15.19:0/3469239487 >> 172.21.15.19:0/3469239487 conn(0x7f86c80719c0 msgr2=0x7f86c8071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:26.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.259+0000 7f86cd2d6640 1 -- 172.21.15.19:0/3469239487 shutdown_connections 2023-11-20T06:42:26.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.259+0000 7f86cd2d6640 1 -- 172.21.15.19:0/3469239487 wait complete. 2023-11-20T06:42:26.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.259+0000 7f86cd2d6640 1 Processor -- start 2023-11-20T06:42:26.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.259+0000 7f86cd2d6640 1 -- start start 2023-11-20T06:42:26.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.259+0000 7f86cd2d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86c80b84e0 0x7f86c80cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:26.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.259+0000 7f86cd2d6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86c80d0040 0x7f86c80c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:26.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.259+0000 7f86cd2d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86c815cba0 0x7f86c80c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:26.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.259+0000 7f86cd2d6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c8157f80 con 0x7f86c80b84e0 2023-11-20T06:42:26.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.259+0000 7f86cd2d6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80c7290 con 0x7f86c80d0040 2023-11-20T06:42:26.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.259+0000 7f86cd2d6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80c7570 con 0x7f86c815cba0 2023-11-20T06:42:26.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.263+0000 7f86c6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86c80b84e0 0x7f86c80cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:26.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.263+0000 7f86c6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86c80b84e0 0x7f86c80cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58854/0 (socket says 172.21.15.19:58854) 2023-11-20T06:42:26.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.263+0000 7f86c6ffd640 1 -- 172.21.15.19:0/3609555999 learned_addr learned my addr 172.21.15.19:0/3609555999 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:26.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.263+0000 7f86c77fe640 1 --2- 172.21.15.19:0/3609555999 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86c815cba0 0x7f86c80c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:26.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.263+0000 7f86c67fc640 1 --2- 172.21.15.19:0/3609555999 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86c80d0040 0x7f86c80c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:26.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.263+0000 7f86c6ffd640 1 -- 172.21.15.19:0/3609555999 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86c815cba0 msgr2=0x7f86c80c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:26.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.263+0000 7f86c6ffd640 1 --2- 172.21.15.19:0/3609555999 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86c815cba0 0x7f86c80c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.263+0000 7f86c6ffd640 1 -- 172.21.15.19:0/3609555999 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86c80d0040 msgr2=0x7f86c80c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:26.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.263+0000 7f86c6ffd640 1 --2- 172.21.15.19:0/3609555999 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86c80d0040 0x7f86c80c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.263+0000 7f86c6ffd640 1 -- 172.21.15.19:0/3609555999 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86bc009420 con 0x7f86c80b84e0 2023-11-20T06:42:26.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.263+0000 7f86c77fe640 1 --2- 172.21.15.19:0/3609555999 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86c815cba0 0x7f86c80c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:26.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.263+0000 7f86c6ffd640 1 --2- 172.21.15.19:0/3609555999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86c80b84e0 0x7f86c80cc2b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f86b801ab30 tx=0x7f86b801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:26.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.263+0000 7f86af7fe640 1 -- 172.21.15.19:0/3609555999 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b80b7420 con 0x7f86c80b84e0 2023-11-20T06:42:26.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.263+0000 7f86af7fe640 1 -- 172.21.15.19:0/3609555999 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b80b75a0 con 0x7f86c80b84e0 2023-11-20T06:42:26.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.263+0000 7f86cd2d6640 1 -- 172.21.15.19:0/3609555999 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b8009420 con 0x7f86c80b84e0 2023-11-20T06:42:26.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.263+0000 7f86af7fe640 1 -- 172.21.15.19:0/3609555999 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b80b7950 con 0x7f86c80b84e0 2023-11-20T06:42:26.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.263+0000 7f86cd2d6640 1 -- 172.21.15.19:0/3609555999 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c80c7b30 con 0x7f86c80b84e0 2023-11-20T06:42:26.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.263+0000 7f86cd2d6640 1 -- 172.21.15.19:0/3609555999 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c804e170 con 0x7f86c80b84e0 2023-11-20T06:42:26.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.263+0000 7f86af7fe640 1 -- 172.21.15.19:0/3609555999 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f86b80b3040 con 0x7f86c80b84e0 2023-11-20T06:42:26.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.267+0000 7f86af7fe640 1 --2- 172.21.15.19:0/3609555999 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f86b40664d0 0x7f86b4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:26.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.267+0000 7f86af7fe640 1 -- 172.21.15.19:0/3609555999 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f86b811e1e0 con 0x7f86c80b84e0 2023-11-20T06:42:26.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.267+0000 7f86c67fc640 1 --2- 172.21.15.19:0/3609555999 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f86b40664d0 0x7f86b4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:26.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.267+0000 7f86c67fc640 1 --2- 172.21.15.19:0/3609555999 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f86b40664d0 0x7f86b4068990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f86c81595f0 tx=0x7f86bc009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:26.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.271+0000 7f86af7fe640 1 -- 172.21.15.19:0/3609555999 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f86b80eb2a0 con 0x7f86c80b84e0 2023-11-20T06:42:26.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.423+0000 7f86cd2d6640 1 -- 172.21.15.19:0/3609555999 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86c80c76b0 con 0x7f86c80b84e0 2023-11-20T06:42:26.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.423+0000 7f86af7fe640 1 -- 172.21.15.19:0/3609555999 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f86c80c76b0 con 0x7f86c80b84e0 2023-11-20T06:42:26.430 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.427+0000 7f86cd2d6640 1 -- 172.21.15.19:0/3609555999 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f86b40664d0 msgr2=0x7f86b4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.427+0000 7f86cd2d6640 1 --2- 172.21.15.19:0/3609555999 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f86b40664d0 0x7f86b4068990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f86c81595f0 tx=0x7f86bc009190 comp rx=0 tx=0).stop 2023-11-20T06:42:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.427+0000 7f86cd2d6640 1 -- 172.21.15.19:0/3609555999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86c80b84e0 msgr2=0x7f86c80cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.427+0000 7f86cd2d6640 1 --2- 172.21.15.19:0/3609555999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86c80b84e0 0x7f86c80cc2b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f86b801ab30 tx=0x7f86b801acc0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.427+0000 7f86cd2d6640 1 -- 172.21.15.19:0/3609555999 shutdown_connections 2023-11-20T06:42:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.427+0000 7f86cd2d6640 1 --2- 172.21.15.19:0/3609555999 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f86b40664d0 0x7f86b4068990 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.427+0000 7f86cd2d6640 1 --2- 172.21.15.19:0/3609555999 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86c815cba0 0x7f86c80c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.427+0000 7f86cd2d6640 1 --2- 172.21.15.19:0/3609555999 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86c80d0040 0x7f86c80c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.427+0000 7f86cd2d6640 1 --2- 172.21.15.19:0/3609555999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86c80b84e0 0x7f86c80cc2b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.427+0000 7f86cd2d6640 1 -- 172.21.15.19:0/3609555999 >> 172.21.15.19:0/3609555999 conn(0x7f86c80719c0 msgr2=0x7f86c815b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:26.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.427+0000 7f86cd2d6640 1 -- 172.21.15.19:0/3609555999 shutdown_connections 2023-11-20T06:42:26.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.427+0000 7f86cd2d6640 1 -- 172.21.15.19:0/3609555999 wait complete. 2023-11-20T06:42:26.451 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T06:42:26.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.591+0000 7f388186b640 1 Processor -- start 2023-11-20T06:42:26.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.591+0000 7f388186b640 1 -- start start 2023-11-20T06:42:26.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.595+0000 7f388186b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c15cba0 0x7f387c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:26.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.595+0000 7f388186b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f387c0b84e0 0x7f387c0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:26.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.595+0000 7f388186b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f387c0d0040 0x7f387c0d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:26.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.595+0000 7f388186b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387c0d1460 con 0x7f387c0d0040 2023-11-20T06:42:26.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.595+0000 7f388186b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387c0d04b0 con 0x7f387c0b84e0 2023-11-20T06:42:26.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.595+0000 7f388186b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0d1670 con 0x7f387c15cba0 2023-11-20T06:42:26.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.595+0000 7f387b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f387c0d0040 0x7f387c0d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:26.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.595+0000 7f387b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f387c0d0040 0x7f387c0d2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58858/0 (socket says 172.21.15.19:58858) 2023-11-20T06:42:26.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.595+0000 7f387b7fe640 1 -- 172.21.15.19:0/2786036670 learned_addr learned my addr 172.21.15.19:0/2786036670 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:26.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.595+0000 7f3873fff640 1 --2- 172.21.15.19:0/2786036670 >> v2:172.21.15.190:3300/0 conn(0x7f387c0b84e0 0x7f387c0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:26.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.595+0000 7f387affd640 1 --2- 172.21.15.19:0/2786036670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c15cba0 0x7f387c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:26.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.595+0000 7f387b7fe640 1 -- 172.21.15.19:0/2786036670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c15cba0 msgr2=0x7f387c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:26.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.595+0000 7f387b7fe640 1 --2- 172.21.15.19:0/2786036670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c15cba0 0x7f387c0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.595+0000 7f387b7fe640 1 -- 172.21.15.19:0/2786036670 >> v2:172.21.15.190:3300/0 conn(0x7f387c0b84e0 msgr2=0x7f387c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:26.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.595+0000 7f387b7fe640 1 --2- 172.21.15.19:0/2786036670 >> v2:172.21.15.190:3300/0 conn(0x7f387c0b84e0 0x7f387c0cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.595+0000 7f387b7fe640 1 -- 172.21.15.19:0/2786036670 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c0d1950 con 0x7f387c0d0040 2023-11-20T06:42:26.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.595+0000 7f3873fff640 1 --2- 172.21.15.19:0/2786036670 >> v2:172.21.15.190:3300/0 conn(0x7f387c0b84e0 0x7f387c0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:26.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.595+0000 7f387affd640 1 --2- 172.21.15.19:0/2786036670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c15cba0 0x7f387c0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:26.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.595+0000 7f387b7fe640 1 --2- 172.21.15.19:0/2786036670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f387c0d0040 0x7f387c0d2ae0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f387c0d3bb0 tx=0x7f387401c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87027a1ecb373e58 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:26.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.599+0000 7f387a7fc640 1 -- 172.21.15.19:0/2786036670 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38740a5590 con 0x7f387c0d0040 2023-11-20T06:42:26.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.599+0000 7f387a7fc640 1 -- 172.21.15.19:0/2786036670 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38740a56f0 con 0x7f387c0d0040 2023-11-20T06:42:26.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.599+0000 7f387a7fc640 1 -- 172.21.15.19:0/2786036670 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38740a5a80 con 0x7f387c0d0040 2023-11-20T06:42:26.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.599+0000 7f388186b640 1 -- 172.21.15.19:0/2786036670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f387c0d0040 msgr2=0x7f387c0d2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:26.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.599+0000 7f388186b640 1 --2- 172.21.15.19:0/2786036670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f387c0d0040 0x7f387c0d2ae0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f387c0d3bb0 tx=0x7f387401c710 comp rx=0 tx=0).stop 2023-11-20T06:42:26.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.599+0000 7f388186b640 1 -- 172.21.15.19:0/2786036670 shutdown_connections 2023-11-20T06:42:26.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.599+0000 7f388186b640 1 --2- 172.21.15.19:0/2786036670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f387c0d0040 0x7f387c0d2ae0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.599+0000 7f388186b640 1 --2- 172.21.15.19:0/2786036670 >> v2:172.21.15.190:3300/0 conn(0x7f387c0b84e0 0x7f387c0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.599+0000 7f388186b640 1 --2- 172.21.15.19:0/2786036670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c15cba0 0x7f387c0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.599+0000 7f388186b640 1 -- 172.21.15.19:0/2786036670 >> 172.21.15.19:0/2786036670 conn(0x7f387c0719c0 msgr2=0x7f387c071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:26.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.599+0000 7f388186b640 1 -- 172.21.15.19:0/2786036670 shutdown_connections 2023-11-20T06:42:26.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.599+0000 7f388186b640 1 -- 172.21.15.19:0/2786036670 wait complete. 2023-11-20T06:42:26.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.599+0000 7f388186b640 1 Processor -- start 2023-11-20T06:42:26.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.599+0000 7f388186b640 1 -- start start 2023-11-20T06:42:26.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.599+0000 7f388186b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f387c0b84e0 0x7f387c0c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:26.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.599+0000 7f388186b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f387c0d0040 0x7f387c1f8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:26.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.599+0000 7f388186b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c15cba0 0x7f387c1f90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:26.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.599+0000 7f388186b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c1593d0 con 0x7f387c0b84e0 2023-11-20T06:42:26.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.599+0000 7f388186b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c158750 con 0x7f387c0d0040 2023-11-20T06:42:26.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.599+0000 7f388186b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c158a30 con 0x7f387c15cba0 2023-11-20T06:42:26.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.603+0000 7f387affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f387c0b84e0 0x7f387c0c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:26.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.603+0000 7f387affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f387c0b84e0 0x7f387c0c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58870/0 (socket says 172.21.15.19:58870) 2023-11-20T06:42:26.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.603+0000 7f387affd640 1 -- 172.21.15.19:0/3565050865 learned_addr learned my addr 172.21.15.19:0/3565050865 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:26.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.603+0000 7f387b7fe640 1 --2- 172.21.15.19:0/3565050865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c15cba0 0x7f387c1f90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:26.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.603+0000 7f3873fff640 1 --2- 172.21.15.19:0/3565050865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f387c0d0040 0x7f387c1f8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:26.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.603+0000 7f387affd640 1 -- 172.21.15.19:0/3565050865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c15cba0 msgr2=0x7f387c1f90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:26.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.603+0000 7f387affd640 1 --2- 172.21.15.19:0/3565050865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c15cba0 0x7f387c1f90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.603+0000 7f387affd640 1 -- 172.21.15.19:0/3565050865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f387c0d0040 msgr2=0x7f387c1f8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:26.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.603+0000 7f387affd640 1 --2- 172.21.15.19:0/3565050865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f387c0d0040 0x7f387c1f8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.603+0000 7f387affd640 1 -- 172.21.15.19:0/3565050865 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3874009b30 con 0x7f387c0b84e0 2023-11-20T06:42:26.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.603+0000 7f387affd640 1 --2- 172.21.15.19:0/3565050865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f387c0b84e0 0x7f387c0c8920 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f386c00d800 tx=0x7f386c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:26.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.603+0000 7f3878ff9640 1 -- 172.21.15.19:0/3565050865 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c0096c0 con 0x7f387c0b84e0 2023-11-20T06:42:26.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.603+0000 7f3878ff9640 1 -- 172.21.15.19:0/3565050865 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386c009820 con 0x7f387c0b84e0 2023-11-20T06:42:26.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.603+0000 7f388186b640 1 -- 172.21.15.19:0/3565050865 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387c158d10 con 0x7f387c0b84e0 2023-11-20T06:42:26.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.603+0000 7f3878ff9640 1 -- 172.21.15.19:0/3565050865 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c009bd0 con 0x7f387c0b84e0 2023-11-20T06:42:26.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.603+0000 7f388186b640 1 -- 172.21.15.19:0/3565050865 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387c0c8e60 con 0x7f387c0b84e0 2023-11-20T06:42:26.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.603+0000 7f388186b640 1 -- 172.21.15.19:0/3565050865 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387c0d2c90 con 0x7f387c0b84e0 2023-11-20T06:42:26.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.603+0000 7f3878ff9640 1 -- 172.21.15.19:0/3565050865 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f386c009d30 con 0x7f387c0b84e0 2023-11-20T06:42:26.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.607+0000 7f3878ff9640 1 --2- 172.21.15.19:0/3565050865 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f385c0664a0 0x7f385c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:26.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.607+0000 7f3878ff9640 1 -- 172.21.15.19:0/3565050865 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f386c0848d0 con 0x7f387c0b84e0 2023-11-20T06:42:26.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.607+0000 7f3873fff640 1 --2- 172.21.15.19:0/3565050865 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f385c0664a0 0x7f385c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:26.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.607+0000 7f3873fff640 1 --2- 172.21.15.19:0/3565050865 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f385c0664a0 0x7f385c068960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f387c0d2e80 tx=0x7f3864008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:26.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.607+0000 7f3878ff9640 1 -- 172.21.15.19:0/3565050865 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f386c051980 con 0x7f387c0b84e0 2023-11-20T06:42:26.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.767+0000 7f388186b640 1 -- 172.21.15.19:0/3565050865 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f387c04e170 con 0x7f387c0b84e0 2023-11-20T06:42:26.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.767+0000 7f3878ff9640 1 -- 172.21.15.19:0/3565050865 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f386c054fa0 con 0x7f387c0b84e0 2023-11-20T06:42:26.774 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-20T06:42:26.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.771+0000 7f388186b640 1 -- 172.21.15.19:0/3565050865 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f385c0664a0 msgr2=0x7f385c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:26.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.771+0000 7f388186b640 1 --2- 172.21.15.19:0/3565050865 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f385c0664a0 0x7f385c068960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f387c0d2e80 tx=0x7f3864008040 comp rx=0 tx=0).stop 2023-11-20T06:42:26.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.771+0000 7f388186b640 1 -- 172.21.15.19:0/3565050865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f387c0b84e0 msgr2=0x7f387c0c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:26.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.771+0000 7f388186b640 1 --2- 172.21.15.19:0/3565050865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f387c0b84e0 0x7f387c0c8920 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f386c00d800 tx=0x7f386c00dcc0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.771+0000 7f388186b640 1 -- 172.21.15.19:0/3565050865 shutdown_connections 2023-11-20T06:42:26.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.771+0000 7f388186b640 1 --2- 172.21.15.19:0/3565050865 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f385c0664a0 0x7f385c068960 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.771+0000 7f388186b640 1 --2- 172.21.15.19:0/3565050865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c15cba0 0x7f387c1f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.771+0000 7f388186b640 1 --2- 172.21.15.19:0/3565050865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f387c0d0040 0x7f387c1f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.771+0000 7f388186b640 1 --2- 172.21.15.19:0/3565050865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f387c0b84e0 0x7f387c0c8920 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.771+0000 7f388186b640 1 -- 172.21.15.19:0/3565050865 >> 172.21.15.19:0/3565050865 conn(0x7f387c0719c0 msgr2=0x7f387c072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:26.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.771+0000 7f388186b640 1 -- 172.21.15.19:0/3565050865 shutdown_connections 2023-11-20T06:42:26.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.771+0000 7f388186b640 1 -- 172.21.15.19:0/3565050865 wait complete. 2023-11-20T06:42:26.794 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T06:42:26.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.935+0000 7fd86a1f5640 1 Processor -- start 2023-11-20T06:42:26.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.935+0000 7fd86a1f5640 1 -- start start 2023-11-20T06:42:26.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.935+0000 7fd86a1f5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd86415cb60 0x7fd8640c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:26.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.935+0000 7fd86a1f5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd86406f560 0x7fd864071400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:26.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.935+0000 7fd86a1f5640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86406ac10 con 0x7fd86415cf40 2023-11-20T06:42:26.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.935+0000 7fd86a1f5640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8640723f0 con 0x7fd86415cb60 2023-11-20T06:42:26.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.935+0000 7fd86a1f5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd864072110 con 0x7fd86406f560 2023-11-20T06:42:26.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.939+0000 7fd863fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd86406f560 0x7fd864071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:26.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.939+0000 7fd8637fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd86415cb60 0x7fd8640c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:26.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.939+0000 7fd85bfff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fd86415cf40 0x7fd86406ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:41608/0 (socket says 172.21.15.19:41608) 2023-11-20T06:42:26.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.939+0000 7fd85bfff640 1 -- 172.21.15.19:0/1350136568 learned_addr learned my addr 172.21.15.19:0/1350136568 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:26.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.939+0000 7fd862ffd640 1 -- 172.21.15.19:0/1350136568 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454837435 0 0) 0x7fd86406ac10 con 0x7fd86415cf40 2023-11-20T06:42:26.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.939+0000 7fd863fff640 1 -- 172.21.15.19:0/1350136568 >> v2:172.21.15.190:3300/0 conn(0x7fd86415cb60 msgr2=0x7fd8640c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:26.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.939+0000 7fd863fff640 1 --2- 172.21.15.19:0/1350136568 >> v2:172.21.15.190:3300/0 conn(0x7fd86415cb60 0x7fd8640c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.939+0000 7fd863fff640 1 -- 172.21.15.19:0/1350136568 >> v1:172.21.15.190:6789/0 conn(0x7fd86415cf40 legacy=0x7fd86406ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:26.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.939+0000 7fd863fff640 1 -- 172.21.15.19:0/1350136568 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86406a5c0 con 0x7fd86406f560 2023-11-20T06:42:26.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.939+0000 7fd8637fe640 1 --2- 172.21.15.19:0/1350136568 >> v2:172.21.15.190:3300/0 conn(0x7fd86415cb60 0x7fd8640c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:42:26.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.939+0000 7fd863fff640 1 --2- 172.21.15.19:0/1350136568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd86406f560 0x7fd864071400 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009d90 tx=0x7fd85c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d88f3af3e4955528 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:26.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd862ffd640 1 -- 172.21.15.19:0/1350136568 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c0a58f0 con 0x7fd86406f560 2023-11-20T06:42:26.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd862ffd640 1 -- 172.21.15.19:0/1350136568 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c0a5a50 con 0x7fd86406f560 2023-11-20T06:42:26.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd862ffd640 1 -- 172.21.15.19:0/1350136568 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c0a5de0 con 0x7fd86406f560 2023-11-20T06:42:26.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd86a1f5640 1 -- 172.21.15.19:0/1350136568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd86406f560 msgr2=0x7fd864071400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:26.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd86a1f5640 1 --2- 172.21.15.19:0/1350136568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd86406f560 0x7fd864071400 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009d90 tx=0x7fd85c01c920 comp rx=0 tx=0).stop 2023-11-20T06:42:26.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd86a1f5640 1 -- 172.21.15.19:0/1350136568 shutdown_connections 2023-11-20T06:42:26.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd86a1f5640 1 --2- 172.21.15.19:0/1350136568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd86406f560 0x7fd864071400 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd86a1f5640 1 --2- 172.21.15.19:0/1350136568 >> v2:172.21.15.190:3300/0 conn(0x7fd86415cb60 0x7fd8640c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd86a1f5640 1 -- 172.21.15.19:0/1350136568 >> 172.21.15.19:0/1350136568 conn(0x7fd8640cf7a0 msgr2=0x7fd8640cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:26.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd86a1f5640 1 -- 172.21.15.19:0/1350136568 shutdown_connections 2023-11-20T06:42:26.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd86a1f5640 1 -- 172.21.15.19:0/1350136568 wait complete. 2023-11-20T06:42:26.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd86a1f5640 1 Processor -- start 2023-11-20T06:42:26.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd86a1f5640 1 -- start start 2023-11-20T06:42:26.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd86a1f5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd86406f560 0x7fd864157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd86a1f5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd86415cb60 0x7fd864158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd86a1f5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd86415cf40 0x7fd8641592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd86a1f5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8640b4f80 con 0x7fd86415cf40 2023-11-20T06:42:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd86a1f5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8640b1720 con 0x7fd86406f560 2023-11-20T06:42:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd86a1f5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd864156860 con 0x7fd86415cb60 2023-11-20T06:42:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd863fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd86415cf40 0x7fd8641592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd863fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd86415cf40 0x7fd8641592d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58882/0 (socket says 172.21.15.19:58882) 2023-11-20T06:42:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd863fff640 1 -- 172.21.15.19:0/342046579 learned_addr learned my addr 172.21.15.19:0/342046579 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd85bfff640 1 --2- 172.21.15.19:0/342046579 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd86415cb60 0x7fd864158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.943+0000 7fd8637fe640 1 --2- 172.21.15.19:0/342046579 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd86406f560 0x7fd864157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:26.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.947+0000 7fd863fff640 1 -- 172.21.15.19:0/342046579 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd86415cb60 msgr2=0x7fd864158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.947+0000 7fd863fff640 1 --2- 172.21.15.19:0/342046579 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd86415cb60 0x7fd864158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.947+0000 7fd863fff640 1 -- 172.21.15.19:0/342046579 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd86406f560 msgr2=0x7fd864157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.947+0000 7fd863fff640 1 --2- 172.21.15.19:0/342046579 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd86406f560 0x7fd864157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.947+0000 7fd863fff640 1 -- 172.21.15.19:0/342046579 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd854009420 con 0x7fd86415cf40 2023-11-20T06:42:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.947+0000 7fd863fff640 1 --2- 172.21.15.19:0/342046579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd86415cf40 0x7fd8641592d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0b0040 tx=0x7fd85c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.947+0000 7fd860ff9640 1 -- 172.21.15.19:0/342046579 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c0b9860 con 0x7fd86415cf40 2023-11-20T06:42:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.947+0000 7fd860ff9640 1 -- 172.21.15.19:0/342046579 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c0b99c0 con 0x7fd86415cf40 2023-11-20T06:42:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.947+0000 7fd860ff9640 1 -- 172.21.15.19:0/342046579 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c0b9d50 con 0x7fd86415cf40 2023-11-20T06:42:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.947+0000 7fd86a1f5640 1 -- 172.21.15.19:0/342046579 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85c009a70 con 0x7fd86415cf40 2023-11-20T06:42:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.947+0000 7fd86a1f5640 1 -- 172.21.15.19:0/342046579 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd864156ad0 con 0x7fd86415cf40 2023-11-20T06:42:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.947+0000 7fd86a1f5640 1 -- 172.21.15.19:0/342046579 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8640b3040 con 0x7fd86415cf40 2023-11-20T06:42:26.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.947+0000 7fd860ff9640 1 -- 172.21.15.19:0/342046579 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd85c0ad440 con 0x7fd86415cf40 2023-11-20T06:42:26.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.947+0000 7fd860ff9640 1 --2- 172.21.15.19:0/342046579 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd8440664a0 0x7fd844068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:26.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.947+0000 7fd860ff9640 1 -- 172.21.15.19:0/342046579 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd85c11f520 con 0x7fd86415cf40 2023-11-20T06:42:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.951+0000 7fd8637fe640 1 --2- 172.21.15.19:0/342046579 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd8440664a0 0x7fd844068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.951+0000 7fd8637fe640 1 --2- 172.21.15.19:0/342046579 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd8440664a0 0x7fd844068960 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd86415eda0 tx=0x7fd854009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:26.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:26.951+0000 7fd860ff9640 1 -- 172.21.15.19:0/342046579 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd8640b3040 con 0x7fd86415cf40 2023-11-20T06:42:27.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.119+0000 7fd86a1f5640 1 -- 172.21.15.19:0/342046579 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd8640b3040 con 0x7fd86415cf40 2023-11-20T06:42:27.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.119+0000 7fd860ff9640 1 -- 172.21.15.19:0/342046579 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd8640b3040 con 0x7fd86415cf40 2023-11-20T06:42:27.125 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:27.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.119+0000 7fd86a1f5640 1 -- 172.21.15.19:0/342046579 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd8440664a0 msgr2=0x7fd844068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:27.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.119+0000 7fd86a1f5640 1 --2- 172.21.15.19:0/342046579 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd8440664a0 0x7fd844068960 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd86415eda0 tx=0x7fd854009190 comp rx=0 tx=0).stop 2023-11-20T06:42:27.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.119+0000 7fd86a1f5640 1 -- 172.21.15.19:0/342046579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd86415cf40 msgr2=0x7fd8641592d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:27.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.119+0000 7fd86a1f5640 1 --2- 172.21.15.19:0/342046579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd86415cf40 0x7fd8641592d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0b0040 tx=0x7fd85c0196c0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.119+0000 7fd86a1f5640 1 -- 172.21.15.19:0/342046579 shutdown_connections 2023-11-20T06:42:27.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.119+0000 7fd86a1f5640 1 --2- 172.21.15.19:0/342046579 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd8440664a0 0x7fd844068960 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.119+0000 7fd86a1f5640 1 --2- 172.21.15.19:0/342046579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd86415cf40 0x7fd8641592d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.119+0000 7fd86a1f5640 1 --2- 172.21.15.19:0/342046579 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd86415cb60 0x7fd864158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.119+0000 7fd86a1f5640 1 --2- 172.21.15.19:0/342046579 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd86406f560 0x7fd864157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.119+0000 7fd86a1f5640 1 -- 172.21.15.19:0/342046579 >> 172.21.15.19:0/342046579 conn(0x7fd8640cf7a0 msgr2=0x7fd8640b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:27.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.123+0000 7fd86a1f5640 1 -- 172.21.15.19:0/342046579 shutdown_connections 2023-11-20T06:42:27.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.123+0000 7fd86a1f5640 1 -- 172.21.15.19:0/342046579 wait complete. 2023-11-20T06:42:27.149 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T06:42:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.287+0000 7f44ab8c9640 1 Processor -- start 2023-11-20T06:42:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.287+0000 7f44ab8c9640 1 -- start start 2023-11-20T06:42:27.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.287+0000 7f44ab8c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44a4164520 0x7f44a40ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:27.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.287+0000 7f44ab8c9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f44a40b07f0 0x7f44a40cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.287+0000 7f44ab8c9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a40c96f0 con 0x7f44a40ad960 2023-11-20T06:42:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.287+0000 7f44ab8c9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a4164900 con 0x7f44a40b07f0 2023-11-20T06:42:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.287+0000 7f44ab8c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a40cb950 con 0x7f44a4164520 2023-11-20T06:42:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.291+0000 7f44a9e66640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f44a40b07f0 0x7f44a40cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.291+0000 7f44a8e64640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f44a40ad960 0x7f44a40b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:41610/0 (socket says 172.21.15.19:41610) 2023-11-20T06:42:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.291+0000 7f44a9665640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44a4164520 0x7f44a40ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.291+0000 7f44a8e64640 1 -- 172.21.15.19:0/643956276 learned_addr learned my addr 172.21.15.19:0/643956276 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.291+0000 7f44a9e66640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f44a40b07f0 0x7f44a40cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58896/0 (socket says 172.21.15.19:58896) 2023-11-20T06:42:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.291+0000 7f44a9e66640 1 -- 172.21.15.19:0/643956276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44a4164520 msgr2=0x7f44a40ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.291+0000 7f44a9e66640 1 --2- 172.21.15.19:0/643956276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44a4164520 0x7f44a40ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.291+0000 7f44a9e66640 1 -- 172.21.15.19:0/643956276 >> v1:172.21.15.190:6789/0 conn(0x7f44a40ad960 legacy=0x7f44a40b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:27.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.291+0000 7f44a9e66640 1 -- 172.21.15.19:0/643956276 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a40cbed0 con 0x7f44a40b07f0 2023-11-20T06:42:27.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.291+0000 7f449bfff640 1 -- 172.21.15.19:0/643956276 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833584951 0 0) 0x7f44a40c96f0 con 0x7f44a40ad960 2023-11-20T06:42:27.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.291+0000 7f44a9e66640 1 --2- 172.21.15.19:0/643956276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44a40b07f0 0x7f44a40cc870 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f449c009d90 tx=0x7f449c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d29fd6a8ad171e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:27.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.291+0000 7f449bfff640 1 -- 172.21.15.19:0/643956276 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c0a5a00 con 0x7f44a40b07f0 2023-11-20T06:42:27.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.291+0000 7f449bfff640 1 -- 172.21.15.19:0/643956276 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c0a5b60 con 0x7f44a40b07f0 2023-11-20T06:42:27.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.291+0000 7f449bfff640 1 -- 172.21.15.19:0/643956276 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c0ad440 con 0x7f44a40b07f0 2023-11-20T06:42:27.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44ab8c9640 1 -- 172.21.15.19:0/643956276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44a40b07f0 msgr2=0x7f44a40cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:27.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44ab8c9640 1 --2- 172.21.15.19:0/643956276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44a40b07f0 0x7f44a40cc870 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f449c009d90 tx=0x7f449c01c920 comp rx=0 tx=0).stop 2023-11-20T06:42:27.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44ab8c9640 1 -- 172.21.15.19:0/643956276 shutdown_connections 2023-11-20T06:42:27.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44ab8c9640 1 --2- 172.21.15.19:0/643956276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44a40b07f0 0x7f44a40cc870 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44ab8c9640 1 --2- 172.21.15.19:0/643956276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44a4164520 0x7f44a40ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44ab8c9640 1 -- 172.21.15.19:0/643956276 >> 172.21.15.19:0/643956276 conn(0x7f44a406c190 msgr2=0x7f44a406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:27.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44ab8c9640 1 -- 172.21.15.19:0/643956276 shutdown_connections 2023-11-20T06:42:27.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44ab8c9640 1 -- 172.21.15.19:0/643956276 wait complete. 2023-11-20T06:42:27.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44ab8c9640 1 Processor -- start 2023-11-20T06:42:27.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44ab8c9640 1 -- start start 2023-11-20T06:42:27.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44ab8c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44a40ad960 0x7f44a40afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:27.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44ab8c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44a40b07f0 0x7f44a4147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:27.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44ab8c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44a4164520 0x7f44a41475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:27.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44ab8c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a4149b70 con 0x7f44a40ad960 2023-11-20T06:42:27.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44ab8c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a4148ad0 con 0x7f44a40b07f0 2023-11-20T06:42:27.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44ab8c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a4148db0 con 0x7f44a4164520 2023-11-20T06:42:27.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44a9665640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44a40ad960 0x7f44a40afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:27.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44a9665640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44a40ad960 0x7f44a40afea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58910/0 (socket says 172.21.15.19:58910) 2023-11-20T06:42:27.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44a9665640 1 -- 172.21.15.19:0/4070089472 learned_addr learned my addr 172.21.15.19:0/4070089472 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:27.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44a8e64640 1 --2- 172.21.15.19:0/4070089472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44a40b07f0 0x7f44a4147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:27.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44a9e66640 1 --2- 172.21.15.19:0/4070089472 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44a4164520 0x7f44a41475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:27.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44a9665640 1 -- 172.21.15.19:0/4070089472 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44a4164520 msgr2=0x7f44a41475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:27.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44a9665640 1 --2- 172.21.15.19:0/4070089472 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44a4164520 0x7f44a41475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44a9665640 1 -- 172.21.15.19:0/4070089472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44a40b07f0 msgr2=0x7f44a4147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:27.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44a9665640 1 --2- 172.21.15.19:0/4070089472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44a40b07f0 0x7f44a4147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44a9665640 1 -- 172.21.15.19:0/4070089472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c009a70 con 0x7f44a40ad960 2023-11-20T06:42:27.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.295+0000 7f44a9665640 1 --2- 172.21.15.19:0/4070089472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44a40ad960 0x7f44a40afea0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f44a000e930 tx=0x7f44a000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:27.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.299+0000 7f4499ffb640 1 -- 172.21.15.19:0/4070089472 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0009690 con 0x7f44a40ad960 2023-11-20T06:42:27.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.299+0000 7f4499ffb640 1 -- 172.21.15.19:0/4070089472 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a000ca00 con 0x7f44a40ad960 2023-11-20T06:42:27.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.299+0000 7f44ab8c9640 1 -- 172.21.15.19:0/4070089472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a4149090 con 0x7f44a40ad960 2023-11-20T06:42:27.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.299+0000 7f4499ffb640 1 -- 172.21.15.19:0/4070089472 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a000cd70 con 0x7f44a40ad960 2023-11-20T06:42:27.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.299+0000 7f44ab8c9640 1 -- 172.21.15.19:0/4070089472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a4149650 con 0x7f44a40ad960 2023-11-20T06:42:27.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.299+0000 7f44ab8c9640 1 -- 172.21.15.19:0/4070089472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a40cc300 con 0x7f44a40ad960 2023-11-20T06:42:27.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.299+0000 7f4499ffb640 1 -- 172.21.15.19:0/4070089472 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f44a0013470 con 0x7f44a40ad960 2023-11-20T06:42:27.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.299+0000 7f4499ffb640 1 --2- 172.21.15.19:0/4070089472 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f44880664a0 0x7f4488068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:27.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.299+0000 7f4499ffb640 1 -- 172.21.15.19:0/4070089472 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f44a0084530 con 0x7f44a40ad960 2023-11-20T06:42:27.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.299+0000 7f44a8e64640 1 --2- 172.21.15.19:0/4070089472 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f44880664a0 0x7f4488068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:27.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.303+0000 7f44a8e64640 1 --2- 172.21.15.19:0/4070089472 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f44880664a0 0x7f4488068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f44a415e420 tx=0x7f4494007c10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:27.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.303+0000 7f4499ffb640 1 -- 172.21.15.19:0/4070089472 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f44a0051610 con 0x7f44a40ad960 2023-11-20T06:42:27.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.475+0000 7f44ab8c9640 1 -- 172.21.15.19:0/4070089472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f44a4073ff0 con 0x7f44a40ad960 2023-11-20T06:42:27.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.475+0000 7f4499ffb640 1 -- 172.21.15.19:0/4070089472 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f44a0054c30 con 0x7f44a40ad960 2023-11-20T06:42:27.479 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2023-11-20T06:42:27.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.475+0000 7f44ab8c9640 1 -- 172.21.15.19:0/4070089472 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f44880664a0 msgr2=0x7f4488068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:27.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.475+0000 7f44ab8c9640 1 --2- 172.21.15.19:0/4070089472 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f44880664a0 0x7f4488068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f44a415e420 tx=0x7f4494007c10 comp rx=0 tx=0).stop 2023-11-20T06:42:27.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.475+0000 7f44ab8c9640 1 -- 172.21.15.19:0/4070089472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44a40ad960 msgr2=0x7f44a40afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:27.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.475+0000 7f44ab8c9640 1 --2- 172.21.15.19:0/4070089472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44a40ad960 0x7f44a40afea0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f44a000e930 tx=0x7f44a000edf0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.475+0000 7f44ab8c9640 1 -- 172.21.15.19:0/4070089472 shutdown_connections 2023-11-20T06:42:27.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.475+0000 7f44ab8c9640 1 --2- 172.21.15.19:0/4070089472 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f44880664a0 0x7f4488068960 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.475+0000 7f44ab8c9640 1 --2- 172.21.15.19:0/4070089472 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44a4164520 0x7f44a41475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.475+0000 7f44ab8c9640 1 --2- 172.21.15.19:0/4070089472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44a40b07f0 0x7f44a4147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.475+0000 7f44ab8c9640 1 --2- 172.21.15.19:0/4070089472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44a40ad960 0x7f44a40afea0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.475+0000 7f44ab8c9640 1 -- 172.21.15.19:0/4070089472 >> 172.21.15.19:0/4070089472 conn(0x7f44a406c190 msgr2=0x7f44a40c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:27.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.475+0000 7f44ab8c9640 1 -- 172.21.15.19:0/4070089472 shutdown_connections 2023-11-20T06:42:27.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.475+0000 7f44ab8c9640 1 -- 172.21.15.19:0/4070089472 wait complete. 2023-11-20T06:42:27.501 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi190.front.sepia.ceph.com... 2023-11-20T06:42:27.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:27.501 DEBUG:teuthology.orchestra.run.smithi190:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-20T06:42:27.525 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:42:27.525 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-11-20T06:42:27.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:27.526 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-20T06:42:27.581 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-20T06:42:27.582 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T06:42:27.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.719+0000 7f00f9654640 1 Processor -- start 2023-11-20T06:42:27.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.719+0000 7f00f9654640 1 -- start start 2023-11-20T06:42:27.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f9654640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f00f40d3010 0x7f00f40cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:27.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f9654640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f40ce770 con 0x7f00f40d15d0 2023-11-20T06:42:27.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f9654640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f40d0600 con 0x7f00f415cb90 2023-11-20T06:42:27.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f9654640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f40c6450 con 0x7f00f40d3010 2023-11-20T06:42:27.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00ebfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f00f40d15d0 0x7f00f40c6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47788/0 (socket says 172.21.15.19:47788) 2023-11-20T06:42:27.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00ebfff640 1 -- 172.21.15.19:0/245365975 learned_addr learned my addr 172.21.15.19:0/245365975 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:27.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f37fe640 1 --2- 172.21.15.19:0/245365975 >> v2:172.21.15.190:3300/0 conn(0x7f00f40d3010 0x7f00f40cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f27fc640 1 -- 172.21.15.19:0/245365975 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1220535491 0 0) 0x7f00f40ce770 con 0x7f00f40d15d0 2023-11-20T06:42:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f27fc640 1 -- 172.21.15.19:0/245365975 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00e0003530 con 0x7f00f40d15d0 2023-11-20T06:42:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f27fc640 1 -- 172.21.15.19:0/245365975 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272553982 0 0) 0x7f00f40d0600 con 0x7f00f415cb90 2023-11-20T06:42:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f27fc640 1 -- 172.21.15.19:0/245365975 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00f40ce770 con 0x7f00f415cb90 2023-11-20T06:42:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f27fc640 1 -- 172.21.15.19:0/245365975 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4006307771 0 0) 0x7f00e0003530 con 0x7f00f40d15d0 2023-11-20T06:42:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f27fc640 1 -- 172.21.15.19:0/245365975 >> v2:172.21.15.190:3300/0 conn(0x7f00f40d3010 msgr2=0x7f00f40cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f27fc640 1 --2- 172.21.15.19:0/245365975 >> v2:172.21.15.190:3300/0 conn(0x7f00f40d3010 0x7f00f40cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f27fc640 1 -- 172.21.15.19:0/245365975 >> v1:172.21.15.190:6789/0 conn(0x7f00f415cb90 legacy=0x7f00f40d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f27fc640 1 -- 172.21.15.19:0/245365975 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f40d08a0 con 0x7f00f40d15d0 2023-11-20T06:42:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f27fc640 1 -- 172.21.15.19:0/245365975 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7f00dc001680 con 0x7f00f40d15d0 2023-11-20T06:42:27.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f27fc640 1 -- 172.21.15.19:0/245365975 >> v1:172.21.15.19:6789/0 conn(0x7f00f40d15d0 legacy=0x7f00f40c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:27.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f27fc640 1 --2- 172.21.15.19:0/245365975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e0003b60 0x7f00e0003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:27.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f27fc640 1 --2- 172.21.15.19:0/245365975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00e00047d0 0x7f00e0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:27.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f27fc640 1 --2- 172.21.15.19:0/245365975 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00e00051e0 0x7f00e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:27.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f27fc640 1 -- 172.21.15.19:0/245365975 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40c6450 con 0x7f00e0003b60 2023-11-20T06:42:27.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f27fc640 1 -- 172.21.15.19:0/245365975 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e000c110 con 0x7f00e00047d0 2023-11-20T06:42:27.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f27fc640 1 -- 172.21.15.19:0/245365975 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e000c2d0 con 0x7f00e00051e0 2023-11-20T06:42:27.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f2ffd640 1 --2- 172.21.15.19:0/245365975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e0003b60 0x7f00e0003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:27.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00ebfff640 1 --2- 172.21.15.19:0/245365975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00e00047d0 0x7f00e0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:27.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f37fe640 1 --2- 172.21.15.19:0/245365975 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00e00051e0 0x7f00e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:27.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f2ffd640 1 -- 172.21.15.19:0/245365975 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00e00051e0 msgr2=0x7f00e000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:27.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f2ffd640 1 --2- 172.21.15.19:0/245365975 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00e00051e0 0x7f00e000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f2ffd640 1 -- 172.21.15.19:0/245365975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00e00047d0 msgr2=0x7f00e0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:27.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f2ffd640 1 --2- 172.21.15.19:0/245365975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00e00047d0 0x7f00e0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f2ffd640 1 -- 172.21.15.19:0/245365975 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e0003530 con 0x7f00e0003b60 2023-11-20T06:42:27.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f37fe640 1 --2- 172.21.15.19:0/245365975 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00e00051e0 0x7f00e000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:27.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00ebfff640 1 --2- 172.21.15.19:0/245365975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00e00047d0 0x7f00e0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:27.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.723+0000 7f00f37fe640 1 -- 172.21.15.19:0/245365975 reap_dead start 2023-11-20T06:42:27.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.727+0000 7f00f2ffd640 1 --2- 172.21.15.19:0/245365975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e0003b60 0x7f00e0003f60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f00e4001930 tx=0x7f00e401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8cc18d59bb7dd15 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:27.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.727+0000 7f00f27fc640 1 -- 172.21.15.19:0/245365975 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e40052d0 con 0x7f00e0003b60 2023-11-20T06:42:27.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.727+0000 7f00f27fc640 1 -- 172.21.15.19:0/245365975 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e40a7050 con 0x7f00e0003b60 2023-11-20T06:42:27.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.727+0000 7f00f27fc640 1 -- 172.21.15.19:0/245365975 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e4003650 con 0x7f00e0003b60 2023-11-20T06:42:27.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.727+0000 7f00f9654640 1 -- 172.21.15.19:0/245365975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e0003b60 msgr2=0x7f00e0003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:27.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.727+0000 7f00f9654640 1 --2- 172.21.15.19:0/245365975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e0003b60 0x7f00e0003f60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f00e4001930 tx=0x7f00e401c4d0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.727+0000 7f00f9654640 1 -- 172.21.15.19:0/245365975 shutdown_connections 2023-11-20T06:42:27.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.727+0000 7f00f9654640 1 --2- 172.21.15.19:0/245365975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e0003b60 0x7f00e0003f60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.727+0000 7f00f9654640 1 -- 172.21.15.19:0/245365975 >> 172.21.15.19:0/245365975 conn(0x7f00f409bc50 msgr2=0x7f00f40d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:27.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.727+0000 7f00f9654640 1 -- 172.21.15.19:0/245365975 shutdown_connections 2023-11-20T06:42:27.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.727+0000 7f00f9654640 1 -- 172.21.15.19:0/245365975 wait complete. 2023-11-20T06:42:27.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.727+0000 7f00f9654640 1 Processor -- start 2023-11-20T06:42:27.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.727+0000 7f00f9654640 1 -- start start 2023-11-20T06:42:27.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00f9654640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e0003b60 0x7f00f4157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:27.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00f9654640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00f41e8410 0x7f00f40b7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:27.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00f9654640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00f4144a60 0x7f00f4144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:27.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00f9654640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40b77d0 con 0x7f00e0003b60 2023-11-20T06:42:27.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00f9654640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f41e8890 con 0x7f00f41e8410 2023-11-20T06:42:27.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00f9654640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f41439c0 con 0x7f00f4144a60 2023-11-20T06:42:27.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00f2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e0003b60 0x7f00f4157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:27.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00f2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e0003b60 0x7f00f4157ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58930/0 (socket says 172.21.15.19:58930) 2023-11-20T06:42:27.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00f2ffd640 1 -- 172.21.15.19:0/2232352732 learned_addr learned my addr 172.21.15.19:0/2232352732 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:27.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00f37fe640 1 --2- 172.21.15.19:0/2232352732 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00f4144a60 0x7f00f4144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:27.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00ebfff640 1 --2- 172.21.15.19:0/2232352732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00f41e8410 0x7f00f40b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:27.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00f2ffd640 1 -- 172.21.15.19:0/2232352732 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00f4144a60 msgr2=0x7f00f4144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:27.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00f2ffd640 1 --2- 172.21.15.19:0/2232352732 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00f4144a60 0x7f00f4144ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00f2ffd640 1 -- 172.21.15.19:0/2232352732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00f41e8410 msgr2=0x7f00f40b7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:27.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00f2ffd640 1 --2- 172.21.15.19:0/2232352732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00f41e8410 0x7f00f40b7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00f2ffd640 1 -- 172.21.15.19:0/2232352732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f4143ca0 con 0x7f00e0003b60 2023-11-20T06:42:27.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00f2ffd640 1 --2- 172.21.15.19:0/2232352732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e0003b60 0x7f00f4157ca0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f00e4001930 tx=0x7f00e0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:27.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00eb7fe640 1 -- 172.21.15.19:0/2232352732 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e4006a30 con 0x7f00e0003b60 2023-11-20T06:42:27.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00eb7fe640 1 -- 172.21.15.19:0/2232352732 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e4006b90 con 0x7f00e0003b60 2023-11-20T06:42:27.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00eb7fe640 1 -- 172.21.15.19:0/2232352732 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e4007040 con 0x7f00e0003b60 2023-11-20T06:42:27.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00f9654640 1 -- 172.21.15.19:0/2232352732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f4143f80 con 0x7f00e0003b60 2023-11-20T06:42:27.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00f9654640 1 -- 172.21.15.19:0/2232352732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f4144540 con 0x7f00e0003b60 2023-11-20T06:42:27.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.731+0000 7f00f9654640 1 -- 172.21.15.19:0/2232352732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f4144700 con 0x7f00e0003b60 2023-11-20T06:42:27.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.735+0000 7f00eb7fe640 1 -- 172.21.15.19:0/2232352732 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f00e40071a0 con 0x7f00e0003b60 2023-11-20T06:42:27.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.735+0000 7f00eb7fe640 1 --2- 172.21.15.19:0/2232352732 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f00d40664d0 0x7f00d4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:27.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.735+0000 7f00eb7fe640 1 -- 172.21.15.19:0/2232352732 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f00e411e530 con 0x7f00e0003b60 2023-11-20T06:42:27.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.735+0000 7f00ebfff640 1 --2- 172.21.15.19:0/2232352732 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f00d40664d0 0x7f00d4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:27.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.735+0000 7f00ebfff640 1 --2- 172.21.15.19:0/2232352732 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f00d40664d0 0x7f00d4068990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f00dc001210 tx=0x7f00dc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:27.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.739+0000 7f00eb7fe640 1 -- 172.21.15.19:0/2232352732 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f00e40eb550 con 0x7f00e0003b60 2023-11-20T06:42:27.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.927+0000 7f00f9654640 1 -- 172.21.15.19:0/2232352732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00f4074010 con 0x7f00e0003b60 2023-11-20T06:42:27.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.927+0000 7f00eb7fe640 1 -- 172.21.15.19:0/2232352732 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f00e40aae80 con 0x7f00e0003b60 2023-11-20T06:42:27.933 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:27.933 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/212787745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":212787745},{"type":"v1","addr":"172.21.15.190:6836","nonce":212787745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1874314285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1874314285},{"type":"v1","addr":"172.21.15.190:6837","nonce":1874314285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3845638593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3845638593},{"type":"v1","addr":"172.21.15.19:6833","nonce":3845638593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T06:41:13.620144+0000","modified":"2023-11-20T06:41:37.768410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/1973335825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1973335825},{"type":"v1","addr":"172.21.15.19:6835","nonce":1973335825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-20T06:42:27.933 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 9 2023-11-20T06:42:27.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.927+0000 7f00f9654640 1 -- 172.21.15.19:0/2232352732 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f00d40664d0 msgr2=0x7f00d4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:27.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.927+0000 7f00f9654640 1 --2- 172.21.15.19:0/2232352732 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f00d40664d0 0x7f00d4068990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f00dc001210 tx=0x7f00dc009040 comp rx=0 tx=0).stop 2023-11-20T06:42:27.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.927+0000 7f00f9654640 1 -- 172.21.15.19:0/2232352732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e0003b60 msgr2=0x7f00f4157ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:27.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.927+0000 7f00f9654640 1 --2- 172.21.15.19:0/2232352732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e0003b60 0x7f00f4157ca0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f00e4001930 tx=0x7f00e0005800 comp rx=0 tx=0).stop 2023-11-20T06:42:27.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.931+0000 7f00f9654640 1 -- 172.21.15.19:0/2232352732 shutdown_connections 2023-11-20T06:42:27.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.931+0000 7f00f9654640 1 --2- 172.21.15.19:0/2232352732 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f00d40664d0 0x7f00d4068990 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.931+0000 7f00f9654640 1 --2- 172.21.15.19:0/2232352732 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00f4144a60 0x7f00f4144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.931+0000 7f00f9654640 1 --2- 172.21.15.19:0/2232352732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00f41e8410 0x7f00f40b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.931+0000 7f00f9654640 1 --2- 172.21.15.19:0/2232352732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e0003b60 0x7f00f4157ca0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.931+0000 7f00f9654640 1 -- 172.21.15.19:0/2232352732 >> 172.21.15.19:0/2232352732 conn(0x7f00f409bc50 msgr2=0x7f00f40b5580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.931+0000 7f00f9654640 1 -- 172.21.15.19:0/2232352732 shutdown_connections 2023-11-20T06:42:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:27.931+0000 7f00f9654640 1 -- 172.21.15.19:0/2232352732 wait complete. 2023-11-20T06:42:27.955 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:28.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.091+0000 7f8b92e09640 1 Processor -- start 2023-11-20T06:42:28.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.091+0000 7f8b92e09640 1 -- start start 2023-11-20T06:42:28.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.091+0000 7f8b92e09640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b8c15d690 0x7f8b8c15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.091+0000 7f8b92e09640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b8c15be60 con 0x7f8b8c070c40 2023-11-20T06:42:28.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.091+0000 7f8b92e09640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b8c15c1f0 con 0x7f8b8c0b07f0 2023-11-20T06:42:28.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.091+0000 7f8b92e09640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c15b3b0 con 0x7f8b8c15d690 2023-11-20T06:42:28.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b90ba5640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8b8c070c40 0x7f8b8c0b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47804/0 (socket says 172.21.15.19:47804) 2023-11-20T06:42:28.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b90ba5640 1 -- 172.21.15.19:0/499761165 learned_addr learned my addr 172.21.15.19:0/499761165 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:28.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b913a6640 1 --2- 172.21.15.19:0/499761165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b8c15d690 0x7f8b8c15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b8b7fe640 1 -- 172.21.15.19:0/499761165 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365498539 0 0) 0x7f8b8c15be60 con 0x7f8b8c070c40 2023-11-20T06:42:28.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b8b7fe640 1 -- 172.21.15.19:0/499761165 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b7c003530 con 0x7f8b8c070c40 2023-11-20T06:42:28.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b8b7fe640 1 -- 172.21.15.19:0/499761165 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682720668 0 0) 0x7f8b8c15c1f0 con 0x7f8b8c0b07f0 2023-11-20T06:42:28.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b8b7fe640 1 -- 172.21.15.19:0/499761165 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b8c15be60 con 0x7f8b8c0b07f0 2023-11-20T06:42:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b8b7fe640 1 -- 172.21.15.19:0/499761165 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3817194525 0 0) 0x7f8b7c003530 con 0x7f8b8c070c40 2023-11-20T06:42:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b8b7fe640 1 -- 172.21.15.19:0/499761165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b8c15d690 msgr2=0x7f8b8c15ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b8b7fe640 1 --2- 172.21.15.19:0/499761165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b8c15d690 0x7f8b8c15ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b8b7fe640 1 -- 172.21.15.19:0/499761165 >> v1:172.21.15.190:6789/0 conn(0x7f8b8c0b07f0 legacy=0x7f8b8c162480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b8b7fe640 1 -- 172.21.15.19:0/499761165 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c071020 con 0x7f8b8c070c40 2023-11-20T06:42:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b8b7fe640 1 -- 172.21.15.19:0/499761165 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7f8b80001680 con 0x7f8b8c070c40 2023-11-20T06:42:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b8b7fe640 1 -- 172.21.15.19:0/499761165 >> v1:172.21.15.19:6789/0 conn(0x7f8b8c070c40 legacy=0x7f8b8c0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b8b7fe640 1 --2- 172.21.15.19:0/499761165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b7c003b40 0x7f8b7c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b8b7fe640 1 --2- 172.21.15.19:0/499761165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c0047d0 0x7f8b7c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b8b7fe640 1 --2- 172.21.15.19:0/499761165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b7c0051e0 0x7f8b7c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b8b7fe640 1 -- 172.21.15.19:0/499761165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c15b3b0 con 0x7f8b7c003b40 2023-11-20T06:42:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b8b7fe640 1 -- 172.21.15.19:0/499761165 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c00c0c0 con 0x7f8b7c0047d0 2023-11-20T06:42:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b8b7fe640 1 -- 172.21.15.19:0/499761165 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c00c280 con 0x7f8b7c0051e0 2023-11-20T06:42:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b913a6640 1 --2- 172.21.15.19:0/499761165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b8c15d690 0x7f8b8c15ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:42:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b90ba5640 1 --2- 172.21.15.19:0/499761165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b7c003b40 0x7f8b7c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b8bfff640 1 --2- 172.21.15.19:0/499761165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c0047d0 0x7f8b7c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b913a6640 1 --2- 172.21.15.19:0/499761165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b7c0051e0 0x7f8b7c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b90ba5640 1 -- 172.21.15.19:0/499761165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b7c0051e0 msgr2=0x7f8b7c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b90ba5640 1 --2- 172.21.15.19:0/499761165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b7c0051e0 0x7f8b7c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b90ba5640 1 -- 172.21.15.19:0/499761165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c0047d0 msgr2=0x7f8b7c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b90ba5640 1 --2- 172.21.15.19:0/499761165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c0047d0 0x7f8b7c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b90ba5640 1 -- 172.21.15.19:0/499761165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7c003530 con 0x7f8b7c003b40 2023-11-20T06:42:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b913a6640 1 --2- 172.21.15.19:0/499761165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b7c0051e0 0x7f8b7c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:28.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.095+0000 7f8b8bfff640 1 --2- 172.21.15.19:0/499761165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c0047d0 0x7f8b7c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.099+0000 7f8b90ba5640 1 --2- 172.21.15.19:0/499761165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b7c003b40 0x7f8b7c003f40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000c190 tx=0x7f8b8001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119b398c8551dbd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.099+0000 7f8b8b7fe640 1 -- 172.21.15.19:0/499761165 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b800058e0 con 0x7f8b7c003b40 2023-11-20T06:42:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.099+0000 7f8b8b7fe640 1 -- 172.21.15.19:0/499761165 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b80005a40 con 0x7f8b7c003b40 2023-11-20T06:42:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.099+0000 7f8b8b7fe640 1 -- 172.21.15.19:0/499761165 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80005e10 con 0x7f8b7c003b40 2023-11-20T06:42:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.099+0000 7f8b92e09640 1 -- 172.21.15.19:0/499761165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b7c003b40 msgr2=0x7f8b7c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.099+0000 7f8b92e09640 1 --2- 172.21.15.19:0/499761165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b7c003b40 0x7f8b7c003f40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000c190 tx=0x7f8b8001cbc0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.099+0000 7f8b913a6640 1 -- 172.21.15.19:0/499761165 reap_dead start 2023-11-20T06:42:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.099+0000 7f8b92e09640 1 -- 172.21.15.19:0/499761165 shutdown_connections 2023-11-20T06:42:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.099+0000 7f8b92e09640 1 -- 172.21.15.19:0/499761165 >> 172.21.15.19:0/499761165 conn(0x7f8b8c06c190 msgr2=0x7f8b8c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.099+0000 7f8b92e09640 1 -- 172.21.15.19:0/499761165 shutdown_connections 2023-11-20T06:42:28.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.099+0000 7f8b92e09640 1 -- 172.21.15.19:0/499761165 wait complete. 2023-11-20T06:42:28.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.099+0000 7f8b92e09640 1 Processor -- start 2023-11-20T06:42:28.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.099+0000 7f8b92e09640 1 -- start start 2023-11-20T06:42:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b92e09640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c003b40 0x7f8b8c153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b92e09640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b8c1546c0 0x7f8b8c15f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b92e09640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b8c1604b0 0x7f8b8c0c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b92e09640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c15e2e0 con 0x7f8b8c1546c0 2023-11-20T06:42:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b92e09640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c15e5c0 con 0x7f8b7c003b40 2023-11-20T06:42:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b92e09640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c15e8a0 con 0x7f8b8c1604b0 2023-11-20T06:42:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b8bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b8c1546c0 0x7f8b8c15f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b8bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b8c1546c0 0x7f8b8c15f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58956/0 (socket says 172.21.15.19:58956) 2023-11-20T06:42:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b8bfff640 1 -- 172.21.15.19:0/3412737038 learned_addr learned my addr 172.21.15.19:0/3412737038 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b90ba5640 1 --2- 172.21.15.19:0/3412737038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c003b40 0x7f8b8c153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b913a6640 1 --2- 172.21.15.19:0/3412737038 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b8c1604b0 0x7f8b8c0c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b8bfff640 1 -- 172.21.15.19:0/3412737038 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b8c1604b0 msgr2=0x7f8b8c0c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b8bfff640 1 --2- 172.21.15.19:0/3412737038 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b8c1604b0 0x7f8b8c0c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b8bfff640 1 -- 172.21.15.19:0/3412737038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c003b40 msgr2=0x7f8b8c153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b8bfff640 1 --2- 172.21.15.19:0/3412737038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c003b40 0x7f8b8c153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b8bfff640 1 -- 172.21.15.19:0/3412737038 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c15eb80 con 0x7f8b8c1546c0 2023-11-20T06:42:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b913a6640 1 --2- 172.21.15.19:0/3412737038 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b8c1604b0 0x7f8b8c0c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b8bfff640 1 --2- 172.21.15.19:0/3412737038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b8c1546c0 0x7f8b8c15f380 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8b7800e500 tx=0x7f8b7800e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b897fa640 1 -- 172.21.15.19:0/3412737038 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b78017070 con 0x7f8b8c1546c0 2023-11-20T06:42:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b897fa640 1 -- 172.21.15.19:0/3412737038 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b780052e0 con 0x7f8b8c1546c0 2023-11-20T06:42:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b897fa640 1 -- 172.21.15.19:0/3412737038 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b78005470 con 0x7f8b8c1546c0 2023-11-20T06:42:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b92e09640 1 -- 172.21.15.19:0/3412737038 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8c15ee60 con 0x7f8b8c1546c0 2023-11-20T06:42:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b92e09640 1 -- 172.21.15.19:0/3412737038 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8c160b00 con 0x7f8b8c1546c0 2023-11-20T06:42:28.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b92e09640 1 -- 172.21.15.19:0/3412737038 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8c15f8c0 con 0x7f8b8c1546c0 2023-11-20T06:42:28.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.103+0000 7f8b897fa640 1 -- 172.21.15.19:0/3412737038 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8b78007020 con 0x7f8b8c1546c0 2023-11-20T06:42:28.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.107+0000 7f8b897fa640 1 --2- 172.21.15.19:0/3412737038 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8b700664d0 0x7f8b70068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.107+0000 7f8b897fa640 1 -- 172.21.15.19:0/3412737038 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8b78083a70 con 0x7f8b8c1546c0 2023-11-20T06:42:28.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.107+0000 7f8b90ba5640 1 --2- 172.21.15.19:0/3412737038 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8b700664d0 0x7f8b70068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.107+0000 7f8b90ba5640 1 --2- 172.21.15.19:0/3412737038 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8b700664d0 0x7f8b70068990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8b800aa000 tx=0x7f8b80001990 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.111+0000 7f8b897fa640 1 -- 172.21.15.19:0/3412737038 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8b78054530 con 0x7f8b8c1546c0 2023-11-20T06:42:28.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.267+0000 7f8b92e09640 1 -- 172.21.15.19:0/3412737038 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b8c15f050 con 0x7f8b8c1546c0 2023-11-20T06:42:28.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.267+0000 7f8b897fa640 1 -- 172.21.15.19:0/3412737038 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18720 (secure 0 0 0) 0x7f8b780540c0 con 0x7f8b8c1546c0 2023-11-20T06:42:28.274 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:28.274 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:55.472006+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.271+0000 7f8b92e09640 1 -- 172.21.15.19:0/3412737038 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8b700664d0 msgr2=0x7f8b70068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.271+0000 7f8b92e09640 1 --2- 172.21.15.19:0/3412737038 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8b700664d0 0x7f8b70068990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8b800aa000 tx=0x7f8b80001990 comp rx=0 tx=0).stop 2023-11-20T06:42:28.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.271+0000 7f8b92e09640 1 -- 172.21.15.19:0/3412737038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b8c1546c0 msgr2=0x7f8b8c15f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:28.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.271+0000 7f8b92e09640 1 --2- 172.21.15.19:0/3412737038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b8c1546c0 0x7f8b8c15f380 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8b7800e500 tx=0x7f8b7800e9c0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.271+0000 7f8b92e09640 1 -- 172.21.15.19:0/3412737038 shutdown_connections 2023-11-20T06:42:28.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.271+0000 7f8b92e09640 1 --2- 172.21.15.19:0/3412737038 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8b700664d0 0x7f8b70068990 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.271+0000 7f8b92e09640 1 --2- 172.21.15.19:0/3412737038 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b8c1604b0 0x7f8b8c0c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.271+0000 7f8b92e09640 1 --2- 172.21.15.19:0/3412737038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b8c1546c0 0x7f8b8c15f380 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.271+0000 7f8b92e09640 1 --2- 172.21.15.19:0/3412737038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c003b40 0x7f8b8c153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.271+0000 7f8b92e09640 1 -- 172.21.15.19:0/3412737038 >> 172.21.15.19:0/3412737038 conn(0x7f8b8c06c190 msgr2=0x7f8b8c0b31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:28.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.271+0000 7f8b92e09640 1 -- 172.21.15.19:0/3412737038 shutdown_connections 2023-11-20T06:42:28.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.271+0000 7f8b92e09640 1 -- 172.21.15.19:0/3412737038 wait complete. 2023-11-20T06:42:28.296 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T06:41:11.805111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T06:41:12.614034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T06:41:16.311206+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T06:42:28.297 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:42:28.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.439+0000 7f71475c4640 1 Processor -- start 2023-11-20T06:42:28.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.439+0000 7f71475c4640 1 -- start start 2023-11-20T06:42:28.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.439+0000 7f71475c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f714015cba0 0x7f71400d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.439+0000 7f71475c4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f71400b84e0 0x7f71400cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.439+0000 7f71475c4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71400d1670 con 0x7f71400d0040 2023-11-20T06:42:28.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.439+0000 7f71475c4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71400d1460 con 0x7f71400b84e0 2023-11-20T06:42:28.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.439+0000 7f71475c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71400d04b0 con 0x7f714015cba0 2023-11-20T06:42:28.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.439+0000 7f7145360640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f714015cba0 0x7f71400d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.439+0000 7f7145b61640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f71400d0040 0x7f71400d2ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:41634/0 (socket says 172.21.15.19:41634) 2023-11-20T06:42:28.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.439+0000 7f7145b61640 1 -- 172.21.15.19:0/1937318716 learned_addr learned my addr 172.21.15.19:0/1937318716 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:28.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.439+0000 7f7144b5f640 1 --2- 172.21.15.19:0/1937318716 >> v2:172.21.15.190:3300/0 conn(0x7f71400b84e0 0x7f71400cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.439+0000 7f7137fff640 1 -- 172.21.15.19:0/1937318716 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808308765 0 0) 0x7f71400d1670 con 0x7f71400d0040 2023-11-20T06:42:28.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.439+0000 7f7137fff640 1 -- 172.21.15.19:0/1937318716 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f712c003530 con 0x7f71400d0040 2023-11-20T06:42:28.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.439+0000 7f7145360640 1 -- 172.21.15.19:0/1937318716 >> v2:172.21.15.190:3300/0 conn(0x7f71400b84e0 msgr2=0x7f71400cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:28.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.439+0000 7f7145360640 1 --2- 172.21.15.19:0/1937318716 >> v2:172.21.15.190:3300/0 conn(0x7f71400b84e0 0x7f71400cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.439+0000 7f7145360640 1 -- 172.21.15.19:0/1937318716 >> v1:172.21.15.190:6789/0 conn(0x7f71400d0040 legacy=0x7f71400d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:28.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.439+0000 7f7145360640 1 -- 172.21.15.19:0/1937318716 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71400d1950 con 0x7f714015cba0 2023-11-20T06:42:28.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.439+0000 7f7144b5f640 1 --2- 172.21.15.19:0/1937318716 >> v2:172.21.15.190:3300/0 conn(0x7f71400b84e0 0x7f71400cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:42:28.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.443+0000 7f7145360640 1 --2- 172.21.15.19:0/1937318716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f714015cba0 0x7f71400d0f20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f713c0097c0 tx=0x7f713c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c58b36a957609d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:28.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.443+0000 7f7137fff640 1 -- 172.21.15.19:0/1937318716 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c0ac600 con 0x7f714015cba0 2023-11-20T06:42:28.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.443+0000 7f7137fff640 1 -- 172.21.15.19:0/1937318716 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713c0a8050 con 0x7f714015cba0 2023-11-20T06:42:28.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.443+0000 7f7137fff640 1 -- 172.21.15.19:0/1937318716 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c0ac980 con 0x7f714015cba0 2023-11-20T06:42:28.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.443+0000 7f71475c4640 1 -- 172.21.15.19:0/1937318716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f714015cba0 msgr2=0x7f71400d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:28.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.443+0000 7f71475c4640 1 --2- 172.21.15.19:0/1937318716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f714015cba0 0x7f71400d0f20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f713c0097c0 tx=0x7f713c01c480 comp rx=0 tx=0).stop 2023-11-20T06:42:28.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.443+0000 7f71475c4640 1 -- 172.21.15.19:0/1937318716 shutdown_connections 2023-11-20T06:42:28.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.443+0000 7f71475c4640 1 --2- 172.21.15.19:0/1937318716 >> v2:172.21.15.190:3300/0 conn(0x7f71400b84e0 0x7f71400cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.443+0000 7f71475c4640 1 --2- 172.21.15.19:0/1937318716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f714015cba0 0x7f71400d0f20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.443+0000 7f71475c4640 1 -- 172.21.15.19:0/1937318716 >> 172.21.15.19:0/1937318716 conn(0x7f71400719c0 msgr2=0x7f7140071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:28.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.443+0000 7f71475c4640 1 -- 172.21.15.19:0/1937318716 shutdown_connections 2023-11-20T06:42:28.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.443+0000 7f71475c4640 1 -- 172.21.15.19:0/1937318716 wait complete. 2023-11-20T06:42:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f71475c4640 1 Processor -- start 2023-11-20T06:42:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f71475c4640 1 -- start start 2023-11-20T06:42:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f71475c4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71400b84e0 0x7f71400b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f71475c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71400d0040 0x7f714014f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f71475c4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714015cba0 0x7f714014fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f71475c4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71401505a0 con 0x7f714015cba0 2023-11-20T06:42:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f71475c4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7140150110 con 0x7f71400b84e0 2023-11-20T06:42:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f71475c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71401527b0 con 0x7f71400d0040 2023-11-20T06:42:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f7145b61640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714015cba0 0x7f714014fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f7145b61640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714015cba0 0x7f714014fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58972/0 (socket says 172.21.15.19:58972) 2023-11-20T06:42:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f7145b61640 1 -- 172.21.15.19:0/2236807913 learned_addr learned my addr 172.21.15.19:0/2236807913 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:28.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f7145360640 1 --2- 172.21.15.19:0/2236807913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71400b84e0 0x7f71400b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f7144b5f640 1 --2- 172.21.15.19:0/2236807913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71400d0040 0x7f714014f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f7145b61640 1 -- 172.21.15.19:0/2236807913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71400d0040 msgr2=0x7f714014f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:28.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f7145b61640 1 --2- 172.21.15.19:0/2236807913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71400d0040 0x7f714014f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f7145b61640 1 -- 172.21.15.19:0/2236807913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71400b84e0 msgr2=0x7f71400b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:28.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f7145b61640 1 --2- 172.21.15.19:0/2236807913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71400b84e0 0x7f71400b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f7145b61640 1 -- 172.21.15.19:0/2236807913 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7130009420 con 0x7f714015cba0 2023-11-20T06:42:28.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f7144b5f640 1 --2- 172.21.15.19:0/2236807913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71400d0040 0x7f714014f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:28.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f7145360640 1 --2- 172.21.15.19:0/2236807913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71400b84e0 0x7f71400b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:28.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f7145b61640 1 --2- 172.21.15.19:0/2236807913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714015cba0 0x7f714014fbd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f713800cb70 tx=0x7f713800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:28.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f7135ffb640 1 -- 172.21.15.19:0/2236807913 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713800ad40 con 0x7f714015cba0 2023-11-20T06:42:28.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f7135ffb640 1 -- 172.21.15.19:0/2236807913 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7138012400 con 0x7f714015cba0 2023-11-20T06:42:28.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f7135ffb640 1 -- 172.21.15.19:0/2236807913 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713800aea0 con 0x7f714015cba0 2023-11-20T06:42:28.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f71475c4640 1 -- 172.21.15.19:0/2236807913 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713c009420 con 0x7f714015cba0 2023-11-20T06:42:28.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f71475c4640 1 -- 172.21.15.19:0/2236807913 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714014e8d0 con 0x7f714015cba0 2023-11-20T06:42:28.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.447+0000 7f71475c4640 1 -- 172.21.15.19:0/2236807913 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714004e170 con 0x7f714015cba0 2023-11-20T06:42:28.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.451+0000 7f7135ffb640 1 -- 172.21.15.19:0/2236807913 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7138007070 con 0x7f714015cba0 2023-11-20T06:42:28.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.451+0000 7f7135ffb640 1 --2- 172.21.15.19:0/2236807913 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f71240664a0 0x7f7124068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.451+0000 7f7135ffb640 1 -- 172.21.15.19:0/2236807913 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f71380842b0 con 0x7f714015cba0 2023-11-20T06:42:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.451+0000 7f7145360640 1 --2- 172.21.15.19:0/2236807913 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f71240664a0 0x7f7124068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.451+0000 7f7145360640 1 --2- 172.21.15.19:0/2236807913 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f71240664a0 0x7f7124068960 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f713c0ae000 tx=0x7f713c0a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:28.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.455+0000 7f7135ffb640 1 -- 172.21.15.19:0/2236807913 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7138051360 con 0x7f714015cba0 2023-11-20T06:42:28.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.611+0000 7f71475c4640 1 -- 172.21.15.19:0/2236807913 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f71400cfe20 con 0x7f714015cba0 2023-11-20T06:42:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.611+0000 7f7135ffb640 1 -- 172.21.15.19:0/2236807913 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7138054980 con 0x7f714015cba0 2023-11-20T06:42:28.618 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:42:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.615+0000 7f71475c4640 1 -- 172.21.15.19:0/2236807913 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f71240664a0 msgr2=0x7f7124068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.615+0000 7f71475c4640 1 --2- 172.21.15.19:0/2236807913 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f71240664a0 0x7f7124068960 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f713c0ae000 tx=0x7f713c0a7000 comp rx=0 tx=0).stop 2023-11-20T06:42:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.615+0000 7f71475c4640 1 -- 172.21.15.19:0/2236807913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714015cba0 msgr2=0x7f714014fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.615+0000 7f71475c4640 1 --2- 172.21.15.19:0/2236807913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714015cba0 0x7f714014fbd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f713800cb70 tx=0x7f713800a430 comp rx=0 tx=0).stop 2023-11-20T06:42:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.615+0000 7f71475c4640 1 -- 172.21.15.19:0/2236807913 shutdown_connections 2023-11-20T06:42:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.615+0000 7f71475c4640 1 --2- 172.21.15.19:0/2236807913 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f71240664a0 0x7f7124068960 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.615+0000 7f71475c4640 1 --2- 172.21.15.19:0/2236807913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714015cba0 0x7f714014fbd0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.615+0000 7f71475c4640 1 --2- 172.21.15.19:0/2236807913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71400d0040 0x7f714014f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.615+0000 7f71475c4640 1 --2- 172.21.15.19:0/2236807913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71400b84e0 0x7f71400b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.615+0000 7f71475c4640 1 -- 172.21.15.19:0/2236807913 >> 172.21.15.19:0/2236807913 conn(0x7f71400719c0 msgr2=0x7f714015b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.615+0000 7f71475c4640 1 -- 172.21.15.19:0/2236807913 shutdown_connections 2023-11-20T06:42:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.615+0000 7f71475c4640 1 -- 172.21.15.19:0/2236807913 wait complete. 2023-11-20T06:42:28.639 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T06:42:28.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.779+0000 7f8018dc4640 1 Processor -- start 2023-11-20T06:42:28.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.779+0000 7f8018dc4640 1 -- start start 2023-11-20T06:42:28.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.783+0000 7f8018dc4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8014069e90 0x7f801406d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.783+0000 7f8018dc4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f801406a270 0x7f80140c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.783+0000 7f8018dc4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f80140702f0 0x7f8014070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.783+0000 7f8018dc4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80140cb090 con 0x7f801406a270 2023-11-20T06:42:28.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.783+0000 7f8018dc4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801415ae30 con 0x7f80140702f0 2023-11-20T06:42:28.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.783+0000 7f8018dc4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80140ca510 con 0x7f8014069e90 2023-11-20T06:42:28.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.783+0000 7f800bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f801406a270 0x7f80140c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.783+0000 7f800bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f801406a270 0x7f80140c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58978/0 (socket says 172.21.15.19:58978) 2023-11-20T06:42:28.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.783+0000 7f800bfff640 1 -- 172.21.15.19:0/2385671669 learned_addr learned my addr 172.21.15.19:0/2385671669 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:28.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.783+0000 7f801259c640 1 --2- 172.21.15.19:0/2385671669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8014069e90 0x7f801406d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.783+0000 7f8012d9d640 1 --2- 172.21.15.19:0/2385671669 >> v2:172.21.15.190:3300/0 conn(0x7f80140702f0 0x7f8014070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.783+0000 7f800bfff640 1 -- 172.21.15.19:0/2385671669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8014069e90 msgr2=0x7f801406d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:28.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.783+0000 7f800bfff640 1 --2- 172.21.15.19:0/2385671669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8014069e90 0x7f801406d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.783+0000 7f800bfff640 1 -- 172.21.15.19:0/2385671669 >> v2:172.21.15.190:3300/0 conn(0x7f80140702f0 msgr2=0x7f8014070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:28.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.783+0000 7f800bfff640 1 --2- 172.21.15.19:0/2385671669 >> v2:172.21.15.190:3300/0 conn(0x7f80140702f0 0x7f8014070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.783+0000 7f800bfff640 1 -- 172.21.15.19:0/2385671669 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80140ca7f0 con 0x7f801406a270 2023-11-20T06:42:28.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.783+0000 7f8012d9d640 1 --2- 172.21.15.19:0/2385671669 >> v2:172.21.15.190:3300/0 conn(0x7f80140702f0 0x7f8014070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:28.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.783+0000 7f801259c640 1 --2- 172.21.15.19:0/2385671669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8014069e90 0x7f801406d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:28.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.783+0000 7f800bfff640 1 --2- 172.21.15.19:0/2385671669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f801406a270 0x7f80140c9ce0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f80140b16e0 tx=0x7f7ffc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a391cd48e610de server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:28.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f8011d9b640 1 -- 172.21.15.19:0/2385671669 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc0aa5f0 con 0x7f801406a270 2023-11-20T06:42:28.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f8011d9b640 1 -- 172.21.15.19:0/2385671669 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc0aa750 con 0x7f801406a270 2023-11-20T06:42:28.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f8011d9b640 1 -- 172.21.15.19:0/2385671669 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc0aaae0 con 0x7f801406a270 2023-11-20T06:42:28.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f8018dc4640 1 -- 172.21.15.19:0/2385671669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f801406a270 msgr2=0x7f80140c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:28.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f8018dc4640 1 --2- 172.21.15.19:0/2385671669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f801406a270 0x7f80140c9ce0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f80140b16e0 tx=0x7f7ffc01c4d0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f8018dc4640 1 -- 172.21.15.19:0/2385671669 shutdown_connections 2023-11-20T06:42:28.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f8018dc4640 1 --2- 172.21.15.19:0/2385671669 >> v2:172.21.15.190:3300/0 conn(0x7f80140702f0 0x7f8014070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f8018dc4640 1 --2- 172.21.15.19:0/2385671669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f801406a270 0x7f80140c9ce0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f8018dc4640 1 --2- 172.21.15.19:0/2385671669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8014069e90 0x7f801406d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f8018dc4640 1 -- 172.21.15.19:0/2385671669 >> 172.21.15.19:0/2385671669 conn(0x7f80140b0da0 msgr2=0x7f80140ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:28.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f8018dc4640 1 -- 172.21.15.19:0/2385671669 shutdown_connections 2023-11-20T06:42:28.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f8018dc4640 1 -- 172.21.15.19:0/2385671669 wait complete. 2023-11-20T06:42:28.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f8018dc4640 1 Processor -- start 2023-11-20T06:42:28.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f8018dc4640 1 -- start start 2023-11-20T06:42:28.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f8018dc4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8014069e90 0x7f8014155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f8018dc4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f801406a270 0x7f801414bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f8018dc4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80140702f0 0x7f80140cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f8018dc4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8014157740 con 0x7f801406a270 2023-11-20T06:42:28.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f8018dc4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80140c6980 con 0x7f8014069e90 2023-11-20T06:42:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f8018dc4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801414c240 con 0x7f80140702f0 2023-11-20T06:42:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f800bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f801406a270 0x7f801414bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f800bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f801406a270 0x7f801414bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58988/0 (socket says 172.21.15.19:58988) 2023-11-20T06:42:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.787+0000 7f800bfff640 1 -- 172.21.15.19:0/3425444765 learned_addr learned my addr 172.21.15.19:0/3425444765 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.791+0000 7f8012d9d640 1 --2- 172.21.15.19:0/3425444765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80140702f0 0x7f80140cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.791+0000 7f801259c640 1 --2- 172.21.15.19:0/3425444765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8014069e90 0x7f8014155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.791+0000 7f800bfff640 1 -- 172.21.15.19:0/3425444765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80140702f0 msgr2=0x7f80140cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.791+0000 7f800bfff640 1 --2- 172.21.15.19:0/3425444765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80140702f0 0x7f80140cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.791+0000 7f800bfff640 1 -- 172.21.15.19:0/3425444765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8014069e90 msgr2=0x7f8014155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.791+0000 7f800bfff640 1 --2- 172.21.15.19:0/3425444765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8014069e90 0x7f8014155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.791+0000 7f800bfff640 1 -- 172.21.15.19:0/3425444765 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc0094d0 con 0x7f801406a270 2023-11-20T06:42:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.791+0000 7f8012d9d640 1 --2- 172.21.15.19:0/3425444765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80140702f0 0x7f80140cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:28.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.791+0000 7f800bfff640 1 --2- 172.21.15.19:0/3425444765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f801406a270 0x7f801414bd00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc0ac040 tx=0x7f7ffc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:28.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.791+0000 7f800affd640 1 -- 172.21.15.19:0/3425444765 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc0b3800 con 0x7f801406a270 2023-11-20T06:42:28.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.791+0000 7f800affd640 1 -- 172.21.15.19:0/3425444765 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc0b3960 con 0x7f801406a270 2023-11-20T06:42:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.791+0000 7f800affd640 1 -- 172.21.15.19:0/3425444765 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc0b3cf0 con 0x7f801406a270 2023-11-20T06:42:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.791+0000 7f8018dc4640 1 -- 172.21.15.19:0/3425444765 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8014157950 con 0x7f801406a270 2023-11-20T06:42:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.791+0000 7f8018dc4640 1 -- 172.21.15.19:0/3425444765 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8014157f10 con 0x7f801406a270 2023-11-20T06:42:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.791+0000 7f8018dc4640 1 -- 172.21.15.19:0/3425444765 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80140c6b30 con 0x7f801406a270 2023-11-20T06:42:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.791+0000 7f800affd640 1 -- 172.21.15.19:0/3425444765 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7ffc0b2380 con 0x7f801406a270 2023-11-20T06:42:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.791+0000 7f800affd640 1 --2- 172.21.15.19:0/3425444765 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7ff40664a0 0x7f7ff4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:28.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.791+0000 7f800affd640 1 -- 172.21.15.19:0/3425444765 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7ffc0a7070 con 0x7f801406a270 2023-11-20T06:42:28.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.795+0000 7f801259c640 1 --2- 172.21.15.19:0/3425444765 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7ff40664a0 0x7f7ff4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:28.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.795+0000 7f801259c640 1 --2- 172.21.15.19:0/3425444765 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7ff40664a0 0x7f7ff4068960 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f800400c880 tx=0x7f8004008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:28.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.795+0000 7f800affd640 1 -- 172.21.15.19:0/3425444765 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7ffc0eb930 con 0x7f801406a270 2023-11-20T06:42:28.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.955+0000 7f8018dc4640 1 -- 172.21.15.19:0/3425444765 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80140c5110 con 0x7f801406a270 2023-11-20T06:42:28.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.955+0000 7f800affd640 1 -- 172.21.15.19:0/3425444765 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ffc0eef50 con 0x7f801406a270 2023-11-20T06:42:28.960 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:28.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.955+0000 7f8018dc4640 1 -- 172.21.15.19:0/3425444765 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7ff40664a0 msgr2=0x7f7ff4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:28.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.955+0000 7f8018dc4640 1 --2- 172.21.15.19:0/3425444765 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7ff40664a0 0x7f7ff4068960 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f800400c880 tx=0x7f8004008040 comp rx=0 tx=0).stop 2023-11-20T06:42:28.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.955+0000 7f8018dc4640 1 -- 172.21.15.19:0/3425444765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f801406a270 msgr2=0x7f801414bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:28.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.955+0000 7f8018dc4640 1 --2- 172.21.15.19:0/3425444765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f801406a270 0x7f801414bd00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc0ac040 tx=0x7f7ffc01ad10 comp rx=0 tx=0).stop 2023-11-20T06:42:28.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.955+0000 7f8018dc4640 1 -- 172.21.15.19:0/3425444765 shutdown_connections 2023-11-20T06:42:28.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.955+0000 7f8018dc4640 1 --2- 172.21.15.19:0/3425444765 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7ff40664a0 0x7f7ff4068960 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.955+0000 7f8018dc4640 1 --2- 172.21.15.19:0/3425444765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80140702f0 0x7f80140cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.955+0000 7f8018dc4640 1 --2- 172.21.15.19:0/3425444765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f801406a270 0x7f801414bd00 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.955+0000 7f8018dc4640 1 --2- 172.21.15.19:0/3425444765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8014069e90 0x7f8014155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:28.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.955+0000 7f8018dc4640 1 -- 172.21.15.19:0/3425444765 >> 172.21.15.19:0/3425444765 conn(0x7f80140b0da0 msgr2=0x7f801414c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:28.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.955+0000 7f8018dc4640 1 -- 172.21.15.19:0/3425444765 shutdown_connections 2023-11-20T06:42:28.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:28.955+0000 7f8018dc4640 1 -- 172.21.15.19:0/3425444765 wait complete. 2023-11-20T06:42:28.981 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T06:42:29.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.119+0000 7f874cf3e640 1 Processor -- start 2023-11-20T06:42:29.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.119+0000 7f874cf3e640 1 -- start start 2023-11-20T06:42:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.123+0000 7f874cf3e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f874806d010 0x7f87480c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.123+0000 7f874cf3e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f87480c26b0 0x7f87480c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.123+0000 7f874cf3e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f874815ae30 con 0x7f8748069e90 2023-11-20T06:42:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.123+0000 7f874cf3e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87480cb090 con 0x7f87480c26b0 2023-11-20T06:42:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.123+0000 7f874cf3e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f874806d470 con 0x7f874806d010 2023-11-20T06:42:29.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.123+0000 7f874659c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8748069e90 0x7f874806a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47806/0 (socket says 172.21.15.19:47806) 2023-11-20T06:42:29.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.123+0000 7f874659c640 1 -- 172.21.15.19:0/3580427499 learned_addr learned my addr 172.21.15.19:0/3580427499 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:29.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.123+0000 7f8746d9d640 1 --2- 172.21.15.19:0/3580427499 >> v2:172.21.15.19:3300/0 conn(0x7f87480c26b0 0x7f87480c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:29.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.123+0000 7f873ffff640 1 --2- 172.21.15.19:0/3580427499 >> v2:172.21.15.190:3300/0 conn(0x7f874806d010 0x7f87480c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:29.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.123+0000 7f8745d9b640 1 -- 172.21.15.19:0/3580427499 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012385579 0 0) 0x7f874815ae30 con 0x7f8748069e90 2023-11-20T06:42:29.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.123+0000 7f8745d9b640 1 -- 172.21.15.19:0/3580427499 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8734003530 con 0x7f8748069e90 2023-11-20T06:42:29.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.123+0000 7f8746d9d640 1 -- 172.21.15.19:0/3580427499 >> v2:172.21.15.190:3300/0 conn(0x7f874806d010 msgr2=0x7f87480c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:29.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.123+0000 7f8746d9d640 1 --2- 172.21.15.19:0/3580427499 >> v2:172.21.15.190:3300/0 conn(0x7f874806d010 0x7f87480c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.123+0000 7f8746d9d640 1 -- 172.21.15.19:0/3580427499 >> v1:172.21.15.19:6789/0 conn(0x7f8748069e90 legacy=0x7f874806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:29.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.123+0000 7f8746d9d640 1 -- 172.21.15.19:0/3580427499 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87480ca510 con 0x7f87480c26b0 2023-11-20T06:42:29.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.127+0000 7f8746d9d640 1 --2- 172.21.15.19:0/3580427499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87480c26b0 0x7f87480c2b20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f874806ada0 tx=0x7f874001f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb3188e8557ae13 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:29.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.127+0000 7f8745d9b640 1 -- 172.21.15.19:0/3580427499 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400b0440 con 0x7f87480c26b0 2023-11-20T06:42:29.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.127+0000 7f8745d9b640 1 -- 172.21.15.19:0/3580427499 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87400b05a0 con 0x7f87480c26b0 2023-11-20T06:42:29.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.127+0000 7f8745d9b640 1 -- 172.21.15.19:0/3580427499 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400b0930 con 0x7f87480c26b0 2023-11-20T06:42:29.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.127+0000 7f874cf3e640 1 -- 172.21.15.19:0/3580427499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87480c26b0 msgr2=0x7f87480c2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:29.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.127+0000 7f874cf3e640 1 --2- 172.21.15.19:0/3580427499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87480c26b0 0x7f87480c2b20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f874806ada0 tx=0x7f874001f0f0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.127+0000 7f874cf3e640 1 -- 172.21.15.19:0/3580427499 shutdown_connections 2023-11-20T06:42:29.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.127+0000 7f874cf3e640 1 --2- 172.21.15.19:0/3580427499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87480c26b0 0x7f87480c2b20 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.127+0000 7f874cf3e640 1 --2- 172.21.15.19:0/3580427499 >> v2:172.21.15.190:3300/0 conn(0x7f874806d010 0x7f87480c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.127+0000 7f874cf3e640 1 -- 172.21.15.19:0/3580427499 >> 172.21.15.19:0/3580427499 conn(0x7f87480b0da0 msgr2=0x7f87480ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:29.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.127+0000 7f874cf3e640 1 -- 172.21.15.19:0/3580427499 shutdown_connections 2023-11-20T06:42:29.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.127+0000 7f874cf3e640 1 -- 172.21.15.19:0/3580427499 wait complete. 2023-11-20T06:42:29.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.127+0000 7f874cf3e640 1 Processor -- start 2023-11-20T06:42:29.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.127+0000 7f874cf3e640 1 -- start start 2023-11-20T06:42:29.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f874cf3e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8748069e90 0x7f87480c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:29.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f874cf3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f874806d010 0x7f87481f3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:29.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f874cf3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87480c26b0 0x7f8748157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:29.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f874cf3e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874815c0f0 con 0x7f87480c26b0 2023-11-20T06:42:29.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f874cf3e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87481f3e30 con 0x7f8748069e90 2023-11-20T06:42:29.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f874cf3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87481f4110 con 0x7f874806d010 2023-11-20T06:42:29.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f8746d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87480c26b0 0x7f8748157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:29.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f8746d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87480c26b0 0x7f8748157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59008/0 (socket says 172.21.15.19:59008) 2023-11-20T06:42:29.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f8746d9d640 1 -- 172.21.15.19:0/2003622500 learned_addr learned my addr 172.21.15.19:0/2003622500 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:29.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f874659c640 1 --2- 172.21.15.19:0/2003622500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8748069e90 0x7f87480c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:29.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f873ffff640 1 --2- 172.21.15.19:0/2003622500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f874806d010 0x7f87481f3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:29.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f8746d9d640 1 -- 172.21.15.19:0/2003622500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f874806d010 msgr2=0x7f87481f3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:29.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f8746d9d640 1 --2- 172.21.15.19:0/2003622500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f874806d010 0x7f87481f3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f8746d9d640 1 -- 172.21.15.19:0/2003622500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8748069e90 msgr2=0x7f87480c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:29.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f8746d9d640 1 --2- 172.21.15.19:0/2003622500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8748069e90 0x7f87480c9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f8746d9d640 1 -- 172.21.15.19:0/2003622500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8740009a70 con 0x7f87480c26b0 2023-11-20T06:42:29.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f874659c640 1 --2- 172.21.15.19:0/2003622500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8748069e90 0x7f87480c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:29.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f8746d9d640 1 --2- 172.21.15.19:0/2003622500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87480c26b0 0x7f8748157410 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f874001bd00 tx=0x7f874001be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:29.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f873effd640 1 -- 172.21.15.19:0/2003622500 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400b0440 con 0x7f87480c26b0 2023-11-20T06:42:29.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f873effd640 1 -- 172.21.15.19:0/2003622500 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87400bc650 con 0x7f87480c26b0 2023-11-20T06:42:29.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f873effd640 1 -- 172.21.15.19:0/2003622500 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400bca00 con 0x7f87480c26b0 2023-11-20T06:42:29.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f874cf3e640 1 -- 172.21.15.19:0/2003622500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87481f43f0 con 0x7f87480c26b0 2023-11-20T06:42:29.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f874cf3e640 1 -- 172.21.15.19:0/2003622500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8748157b20 con 0x7f87480c26b0 2023-11-20T06:42:29.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.131+0000 7f874cf3e640 1 -- 172.21.15.19:0/2003622500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87481f45e0 con 0x7f87480c26b0 2023-11-20T06:42:29.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.135+0000 7f873effd640 1 -- 172.21.15.19:0/2003622500 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f87400bcb60 con 0x7f87480c26b0 2023-11-20T06:42:29.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.135+0000 7f873effd640 1 --2- 172.21.15.19:0/2003622500 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f87280664a0 0x7f8728068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:29.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.135+0000 7f873effd640 1 -- 172.21.15.19:0/2003622500 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8740122ef0 con 0x7f87480c26b0 2023-11-20T06:42:29.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.135+0000 7f874659c640 1 --2- 172.21.15.19:0/2003622500 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f87280664a0 0x7f8728068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:29.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.135+0000 7f874659c640 1 --2- 172.21.15.19:0/2003622500 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f87280664a0 0x7f8728068960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f87380011f0 tx=0x7f8738009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:29.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.139+0000 7f873effd640 1 -- 172.21.15.19:0/2003622500 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f87400f3ac0 con 0x7f87480c26b0 2023-11-20T06:42:29.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.291+0000 7f874cf3e640 1 -- 172.21.15.19:0/2003622500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f874804e170 con 0x7f87480c26b0 2023-11-20T06:42:29.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.291+0000 7f873effd640 1 -- 172.21.15.19:0/2003622500 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8740009450 con 0x7f87480c26b0 2023-11-20T06:42:29.299 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-20T06:42:29.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.295+0000 7f874cf3e640 1 -- 172.21.15.19:0/2003622500 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f87280664a0 msgr2=0x7f8728068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:29.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.295+0000 7f874cf3e640 1 --2- 172.21.15.19:0/2003622500 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f87280664a0 0x7f8728068960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f87380011f0 tx=0x7f8738009040 comp rx=0 tx=0).stop 2023-11-20T06:42:29.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.295+0000 7f874cf3e640 1 -- 172.21.15.19:0/2003622500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87480c26b0 msgr2=0x7f8748157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:29.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.295+0000 7f874cf3e640 1 --2- 172.21.15.19:0/2003622500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87480c26b0 0x7f8748157410 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f874001bd00 tx=0x7f874001be90 comp rx=0 tx=0).stop 2023-11-20T06:42:29.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.295+0000 7f874cf3e640 1 -- 172.21.15.19:0/2003622500 shutdown_connections 2023-11-20T06:42:29.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.295+0000 7f874cf3e640 1 --2- 172.21.15.19:0/2003622500 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f87280664a0 0x7f8728068960 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.295+0000 7f874cf3e640 1 --2- 172.21.15.19:0/2003622500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87480c26b0 0x7f8748157410 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.295+0000 7f874cf3e640 1 --2- 172.21.15.19:0/2003622500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f874806d010 0x7f87481f3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.295+0000 7f874cf3e640 1 --2- 172.21.15.19:0/2003622500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8748069e90 0x7f87480c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.295+0000 7f874cf3e640 1 -- 172.21.15.19:0/2003622500 >> 172.21.15.19:0/2003622500 conn(0x7f87480b0da0 msgr2=0x7f87480ae2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:29.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.295+0000 7f874cf3e640 1 -- 172.21.15.19:0/2003622500 shutdown_connections 2023-11-20T06:42:29.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.295+0000 7f874cf3e640 1 -- 172.21.15.19:0/2003622500 wait complete. 2023-11-20T06:42:29.320 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T06:42:29.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.459+0000 7fe16b4ea640 1 Processor -- start 2023-11-20T06:42:29.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.459+0000 7fe16b4ea640 1 -- start start 2023-11-20T06:42:29.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.463+0000 7fe16b4ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe164069e90 0x7fe16406d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:29.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.463+0000 7fe16b4ea640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe1640c26b0 0x7fe1640c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:29.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.463+0000 7fe16b4ea640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16415ae30 con 0x7fe16406a270 2023-11-20T06:42:29.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.463+0000 7fe16b4ea640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1640cb090 con 0x7fe1640c26b0 2023-11-20T06:42:29.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.463+0000 7fe16b4ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1640ca510 con 0x7fe164069e90 2023-11-20T06:42:29.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.463+0000 7fe169286640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe164069e90 0x7fe16406d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:29.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.463+0000 7fe169286640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe164069e90 0x7fe16406d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:44922/0 (socket says 172.21.15.19:44922) 2023-11-20T06:42:29.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.463+0000 7fe168a85640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fe16406a270 0x7fe1640c9ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:41646/0 (socket says 172.21.15.19:41646) 2023-11-20T06:42:29.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.463+0000 7fe169286640 1 -- 172.21.15.19:0/1463783964 learned_addr learned my addr 172.21.15.19:0/1463783964 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:29.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.463+0000 7fe169a87640 1 --2- 172.21.15.19:0/1463783964 >> v2:172.21.15.190:3300/0 conn(0x7fe1640c26b0 0x7fe1640c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:29.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.463+0000 7fe15bfff640 1 -- 172.21.15.19:0/1463783964 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151053856 0 0) 0x7fe16415ae30 con 0x7fe16406a270 2023-11-20T06:42:29.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.463+0000 7fe15bfff640 1 -- 172.21.15.19:0/1463783964 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe150003530 con 0x7fe16406a270 2023-11-20T06:42:29.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.463+0000 7fe169286640 1 -- 172.21.15.19:0/1463783964 >> v2:172.21.15.190:3300/0 conn(0x7fe1640c26b0 msgr2=0x7fe1640c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:29.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.463+0000 7fe169286640 1 --2- 172.21.15.19:0/1463783964 >> v2:172.21.15.190:3300/0 conn(0x7fe1640c26b0 0x7fe1640c2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.463+0000 7fe169286640 1 -- 172.21.15.19:0/1463783964 >> v1:172.21.15.190:6789/0 conn(0x7fe16406a270 legacy=0x7fe1640c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:29.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.463+0000 7fe169286640 1 -- 172.21.15.19:0/1463783964 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1640ca7f0 con 0x7fe164069e90 2023-11-20T06:42:29.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.463+0000 7fe169a87640 1 --2- 172.21.15.19:0/1463783964 >> v2:172.21.15.190:3300/0 conn(0x7fe1640c26b0 0x7fe1640c2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:42:29.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.467+0000 7fe169286640 1 --2- 172.21.15.19:0/1463783964 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe164069e90 0x7fe16406d010 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe160009870 tx=0x7fe16001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8407619ff1196b39 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:29.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.467+0000 7fe15bfff640 1 -- 172.21.15.19:0/1463783964 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1600aa670 con 0x7fe164069e90 2023-11-20T06:42:29.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.467+0000 7fe15bfff640 1 -- 172.21.15.19:0/1463783964 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1600aa7d0 con 0x7fe164069e90 2023-11-20T06:42:29.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.467+0000 7fe15bfff640 1 -- 172.21.15.19:0/1463783964 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1600aab60 con 0x7fe164069e90 2023-11-20T06:42:29.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.467+0000 7fe16b4ea640 1 -- 172.21.15.19:0/1463783964 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe164069e90 msgr2=0x7fe16406d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:29.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.467+0000 7fe16b4ea640 1 --2- 172.21.15.19:0/1463783964 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe164069e90 0x7fe16406d010 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe160009870 tx=0x7fe16001c510 comp rx=0 tx=0).stop 2023-11-20T06:42:29.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.467+0000 7fe16b4ea640 1 -- 172.21.15.19:0/1463783964 shutdown_connections 2023-11-20T06:42:29.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.467+0000 7fe16b4ea640 1 --2- 172.21.15.19:0/1463783964 >> v2:172.21.15.190:3300/0 conn(0x7fe1640c26b0 0x7fe1640c2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.467+0000 7fe16b4ea640 1 --2- 172.21.15.19:0/1463783964 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe164069e90 0x7fe16406d010 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.467+0000 7fe16b4ea640 1 -- 172.21.15.19:0/1463783964 >> 172.21.15.19:0/1463783964 conn(0x7fe1640b0da0 msgr2=0x7fe1640ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:29.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.467+0000 7fe16b4ea640 1 -- 172.21.15.19:0/1463783964 shutdown_connections 2023-11-20T06:42:29.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.467+0000 7fe16b4ea640 1 -- 172.21.15.19:0/1463783964 wait complete. 2023-11-20T06:42:29.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.467+0000 7fe16b4ea640 1 Processor -- start 2023-11-20T06:42:29.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.467+0000 7fe16b4ea640 1 -- start start 2023-11-20T06:42:29.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.467+0000 7fe16b4ea640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe164069e90 0x7fe16414fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:29.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.467+0000 7fe16b4ea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe16406a270 0x7fe16414c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:29.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.467+0000 7fe16b4ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1640c26b0 0x7fe16414cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:29.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.467+0000 7fe16b4ea640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1640cd6a0 con 0x7fe16406a270 2023-11-20T06:42:29.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.467+0000 7fe16b4ea640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1640b00a0 con 0x7fe164069e90 2023-11-20T06:42:29.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.467+0000 7fe16b4ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1640cce00 con 0x7fe1640c26b0 2023-11-20T06:42:29.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.471+0000 7fe168a85640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe16406a270 0x7fe16414c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:29.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.471+0000 7fe168a85640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe16406a270 0x7fe16414c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59018/0 (socket says 172.21.15.19:59018) 2023-11-20T06:42:29.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.471+0000 7fe168a85640 1 -- 172.21.15.19:0/2595257586 learned_addr learned my addr 172.21.15.19:0/2595257586 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:29.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.471+0000 7fe169286640 1 --2- 172.21.15.19:0/2595257586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe164069e90 0x7fe16414fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:29.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.471+0000 7fe168a85640 1 -- 172.21.15.19:0/2595257586 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1640c26b0 msgr2=0x7fe16414cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:29.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.471+0000 7fe169a87640 1 --2- 172.21.15.19:0/2595257586 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1640c26b0 0x7fe16414cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:29.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.471+0000 7fe168a85640 1 --2- 172.21.15.19:0/2595257586 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1640c26b0 0x7fe16414cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.471+0000 7fe168a85640 1 -- 172.21.15.19:0/2595257586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe164069e90 msgr2=0x7fe16414fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:29.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.471+0000 7fe168a85640 1 --2- 172.21.15.19:0/2595257586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe164069e90 0x7fe16414fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.471+0000 7fe168a85640 1 -- 172.21.15.19:0/2595257586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c009a70 con 0x7fe16406a270 2023-11-20T06:42:29.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.471+0000 7fe168a85640 1 --2- 172.21.15.19:0/2595257586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe16406a270 0x7fe16414c760 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe15400c4d0 tx=0x7fe15400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:29.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.471+0000 7fe159ffb640 1 -- 172.21.15.19:0/2595257586 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe154007480 con 0x7fe16406a270 2023-11-20T06:42:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.471+0000 7fe159ffb640 1 -- 172.21.15.19:0/2595257586 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1540075e0 con 0x7fe16406a270 2023-11-20T06:42:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.471+0000 7fe159ffb640 1 -- 172.21.15.19:0/2595257586 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe154004a30 con 0x7fe16406a270 2023-11-20T06:42:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.471+0000 7fe16b4ea640 1 -- 172.21.15.19:0/2595257586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1600094d0 con 0x7fe16406a270 2023-11-20T06:42:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.471+0000 7fe16b4ea640 1 -- 172.21.15.19:0/2595257586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1640cd3c0 con 0x7fe16406a270 2023-11-20T06:42:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.471+0000 7fe16b4ea640 1 -- 172.21.15.19:0/2595257586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe164150ba0 con 0x7fe16406a270 2023-11-20T06:42:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.471+0000 7fe159ffb640 1 -- 172.21.15.19:0/2595257586 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe154004b90 con 0x7fe16406a270 2023-11-20T06:42:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.471+0000 7fe159ffb640 1 --2- 172.21.15.19:0/2595257586 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe1480664a0 0x7fe148068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.475+0000 7fe159ffb640 1 -- 172.21.15.19:0/2595257586 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe154083460 con 0x7fe16406a270 2023-11-20T06:42:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.475+0000 7fe169286640 1 --2- 172.21.15.19:0/2595257586 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe1480664a0 0x7fe148068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:29.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.475+0000 7fe169286640 1 --2- 172.21.15.19:0/2595257586 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe1480664a0 0x7fe148068960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe1600ae000 tx=0x7fe1600a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:29.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.475+0000 7fe159ffb640 1 -- 172.21.15.19:0/2595257586 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe164150ba0 con 0x7fe16406a270 2023-11-20T06:42:29.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.635+0000 7fe16b4ea640 1 -- 172.21.15.19:0/2595257586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe164150ba0 con 0x7fe16406a270 2023-11-20T06:42:29.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.635+0000 7fe159ffb640 1 -- 172.21.15.19:0/2595257586 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe164150ba0 con 0x7fe16406a270 2023-11-20T06:42:29.640 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:29.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.635+0000 7fe16b4ea640 1 -- 172.21.15.19:0/2595257586 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe1480664a0 msgr2=0x7fe148068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:29.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.635+0000 7fe16b4ea640 1 --2- 172.21.15.19:0/2595257586 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe1480664a0 0x7fe148068960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe1600ae000 tx=0x7fe1600a7000 comp rx=0 tx=0).stop 2023-11-20T06:42:29.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.635+0000 7fe16b4ea640 1 -- 172.21.15.19:0/2595257586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe16406a270 msgr2=0x7fe16414c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:29.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.635+0000 7fe16b4ea640 1 --2- 172.21.15.19:0/2595257586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe16406a270 0x7fe16414c760 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe15400c4d0 tx=0x7fe15400c990 comp rx=0 tx=0).stop 2023-11-20T06:42:29.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.635+0000 7fe16b4ea640 1 -- 172.21.15.19:0/2595257586 shutdown_connections 2023-11-20T06:42:29.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.635+0000 7fe16b4ea640 1 --2- 172.21.15.19:0/2595257586 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe1480664a0 0x7fe148068960 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.635+0000 7fe16b4ea640 1 --2- 172.21.15.19:0/2595257586 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1640c26b0 0x7fe16414cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.635+0000 7fe16b4ea640 1 --2- 172.21.15.19:0/2595257586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe16406a270 0x7fe16414c760 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.635+0000 7fe16b4ea640 1 --2- 172.21.15.19:0/2595257586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe164069e90 0x7fe16414fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.635+0000 7fe16b4ea640 1 -- 172.21.15.19:0/2595257586 >> 172.21.15.19:0/2595257586 conn(0x7fe1640b0da0 msgr2=0x7fe1640abb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:29.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.635+0000 7fe16b4ea640 1 -- 172.21.15.19:0/2595257586 shutdown_connections 2023-11-20T06:42:29.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.635+0000 7fe16b4ea640 1 -- 172.21.15.19:0/2595257586 wait complete. 2023-11-20T06:42:29.662 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T06:42:29.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.799+0000 7fee006c9640 1 Processor -- start 2023-11-20T06:42:29.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.799+0000 7fee006c9640 1 -- start start 2023-11-20T06:42:29.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.799+0000 7fee006c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf8070c40 0x7fedf815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:29.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.799+0000 7fee006c9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fedf80b4020 0x7fedf80b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:29.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.799+0000 7fee006c9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf815be60 con 0x7fedf80b0620 2023-11-20T06:42:29.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.799+0000 7fee006c9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf815b3b0 con 0x7fedf80b4020 2023-11-20T06:42:29.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.799+0000 7fee006c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf80b0a90 con 0x7fedf8070c40 2023-11-20T06:42:29.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.799+0000 7fedfe465640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf8070c40 0x7fedf815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:29.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.799+0000 7fedfdc64640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fedf80b4020 0x7fedf80b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:29.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.799+0000 7fedfe465640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf8070c40 0x7fedf815ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:44938/0 (socket says 172.21.15.19:44938) 2023-11-20T06:42:29.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.799+0000 7fedfe465640 1 -- 172.21.15.19:0/1885577531 learned_addr learned my addr 172.21.15.19:0/1885577531 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:29.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.799+0000 7fedfdc64640 1 --2- 172.21.15.19:0/1885577531 >> v2:172.21.15.190:3300/0 conn(0x7fedf80b4020 0x7fedf80b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:37572/0 (socket says 172.21.15.19:37572) 2023-11-20T06:42:29.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.803+0000 7fedfd463640 1 -- 172.21.15.19:0/1885577531 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719366456 0 0) 0x7fedf815be60 con 0x7fedf80b0620 2023-11-20T06:42:29.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.803+0000 7fedfe465640 1 -- 172.21.15.19:0/1885577531 >> v2:172.21.15.190:3300/0 conn(0x7fedf80b4020 msgr2=0x7fedf80b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:29.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.803+0000 7fedfe465640 1 --2- 172.21.15.19:0/1885577531 >> v2:172.21.15.190:3300/0 conn(0x7fedf80b4020 0x7fedf80b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.803+0000 7fedfe465640 1 -- 172.21.15.19:0/1885577531 >> v1:172.21.15.190:6789/0 conn(0x7fedf80b0620 legacy=0x7fedf815c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:29.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.803+0000 7fedfe465640 1 -- 172.21.15.19:0/1885577531 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf815c1f0 con 0x7fedf8070c40 2023-11-20T06:42:29.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.803+0000 7fedfe465640 1 --2- 172.21.15.19:0/1885577531 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf8070c40 0x7fedf815ae70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fedf4009870 tx=0x7fedf401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8865ffff9f7e15cf server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:29.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.803+0000 7fedfd463640 1 -- 172.21.15.19:0/1885577531 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf40aa610 con 0x7fedf8070c40 2023-11-20T06:42:29.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.803+0000 7fedfd463640 1 -- 172.21.15.19:0/1885577531 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf40a6040 con 0x7fedf8070c40 2023-11-20T06:42:29.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.803+0000 7fedfd463640 1 -- 172.21.15.19:0/1885577531 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf40aa990 con 0x7fedf8070c40 2023-11-20T06:42:29.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fee006c9640 1 -- 172.21.15.19:0/1885577531 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf8070c40 msgr2=0x7fedf815ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:29.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fee006c9640 1 --2- 172.21.15.19:0/1885577531 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf8070c40 0x7fedf815ae70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fedf4009870 tx=0x7fedf401c4b0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fee006c9640 1 -- 172.21.15.19:0/1885577531 shutdown_connections 2023-11-20T06:42:29.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fee006c9640 1 --2- 172.21.15.19:0/1885577531 >> v2:172.21.15.190:3300/0 conn(0x7fedf80b4020 0x7fedf80b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fee006c9640 1 --2- 172.21.15.19:0/1885577531 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf8070c40 0x7fedf815ae70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fee006c9640 1 -- 172.21.15.19:0/1885577531 >> 172.21.15.19:0/1885577531 conn(0x7fedf806c190 msgr2=0x7fedf806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:29.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fee006c9640 1 -- 172.21.15.19:0/1885577531 shutdown_connections 2023-11-20T06:42:29.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fee006c9640 1 -- 172.21.15.19:0/1885577531 wait complete. 2023-11-20T06:42:29.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fee006c9640 1 Processor -- start 2023-11-20T06:42:29.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fee006c9640 1 -- start start 2023-11-20T06:42:29.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fee006c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedf8070c40 0x7fedf8157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:29.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fee006c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedf80b0620 0x7fedf814e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:29.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fee006c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf80b4020 0x7fedf80adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:29.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fee006c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf815a740 con 0x7fedf8070c40 2023-11-20T06:42:29.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fee006c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf8158010 con 0x7fedf80b0620 2023-11-20T06:42:29.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fee006c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf8158240 con 0x7fedf80b4020 2023-11-20T06:42:29.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fedfe465640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedf8070c40 0x7fedf8157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:29.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fedfe465640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedf8070c40 0x7fedf8157ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59028/0 (socket says 172.21.15.19:59028) 2023-11-20T06:42:29.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fedfe465640 1 -- 172.21.15.19:0/2269769190 learned_addr learned my addr 172.21.15.19:0/2269769190 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:29.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fedfdc64640 1 --2- 172.21.15.19:0/2269769190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedf80b0620 0x7fedf814e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:29.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fedfec66640 1 --2- 172.21.15.19:0/2269769190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf80b4020 0x7fedf80adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:29.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fedfe465640 1 -- 172.21.15.19:0/2269769190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf80b4020 msgr2=0x7fedf80adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:29.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fedfe465640 1 --2- 172.21.15.19:0/2269769190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf80b4020 0x7fedf80adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fedfe465640 1 -- 172.21.15.19:0/2269769190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedf80b0620 msgr2=0x7fedf814e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fedfe465640 1 --2- 172.21.15.19:0/2269769190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedf80b0620 0x7fedf814e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.807+0000 7fedfe465640 1 -- 172.21.15.19:0/2269769190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf40094d0 con 0x7fedf8070c40 2023-11-20T06:42:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.811+0000 7fedfe465640 1 --2- 172.21.15.19:0/2269769190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedf8070c40 0x7fedf8157ad0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fedf40ac040 tx=0x7fedf401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:29.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.811+0000 7fedeeffd640 1 -- 172.21.15.19:0/2269769190 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf40bd5f0 con 0x7fedf8070c40 2023-11-20T06:42:29.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.811+0000 7fedeeffd640 1 -- 172.21.15.19:0/2269769190 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf40bd750 con 0x7fedf8070c40 2023-11-20T06:42:29.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.811+0000 7fee006c9640 1 -- 172.21.15.19:0/2269769190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf8158520 con 0x7fedf8070c40 2023-11-20T06:42:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.811+0000 7fedeeffd640 1 -- 172.21.15.19:0/2269769190 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf40bdb00 con 0x7fedf8070c40 2023-11-20T06:42:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.811+0000 7fee006c9640 1 -- 172.21.15.19:0/2269769190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf8158ae0 con 0x7fedf8070c40 2023-11-20T06:42:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.811+0000 7fee006c9640 1 -- 172.21.15.19:0/2269769190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf8074010 con 0x7fedf8070c40 2023-11-20T06:42:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.811+0000 7fedeeffd640 1 -- 172.21.15.19:0/2269769190 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fedf40b33f0 con 0x7fedf8070c40 2023-11-20T06:42:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.811+0000 7fedeeffd640 1 --2- 172.21.15.19:0/2269769190 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feddc0664a0 0x7feddc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.811+0000 7fedeeffd640 1 -- 172.21.15.19:0/2269769190 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fedf411ee30 con 0x7fedf8070c40 2023-11-20T06:42:29.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.811+0000 7fedfdc64640 1 --2- 172.21.15.19:0/2269769190 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feddc0664a0 0x7feddc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:29.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.815+0000 7fedfdc64640 1 --2- 172.21.15.19:0/2269769190 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feddc0664a0 0x7feddc068960 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fedf80c46d0 tx=0x7fede8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:29.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:29.815+0000 7fedeeffd640 1 -- 172.21.15.19:0/2269769190 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fedf40ebe80 con 0x7fedf8070c40 2023-11-20T06:42:30.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.003+0000 7fee006c9640 1 -- 172.21.15.19:0/2269769190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedf8072b30 con 0x7fedf8070c40 2023-11-20T06:42:30.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.003+0000 7fedeeffd640 1 -- 172.21.15.19:0/2269769190 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fedf40c3090 con 0x7fedf8070c40 2023-11-20T06:42:30.011 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:30.011 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/212787745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":212787745},{"type":"v1","addr":"172.21.15.190:6836","nonce":212787745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1874314285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1874314285},{"type":"v1","addr":"172.21.15.190:6837","nonce":1874314285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3845638593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3845638593},{"type":"v1","addr":"172.21.15.19:6833","nonce":3845638593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T06:41:13.620144+0000","modified":"2023-11-20T06:41:37.768410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/1973335825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1973335825},{"type":"v1","addr":"172.21.15.19:6835","nonce":1973335825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-20T06:42:30.011 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 9 2023-11-20T06:42:30.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.007+0000 7fee006c9640 1 -- 172.21.15.19:0/2269769190 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feddc0664a0 msgr2=0x7feddc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:30.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.007+0000 7fee006c9640 1 --2- 172.21.15.19:0/2269769190 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feddc0664a0 0x7feddc068960 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fedf80c46d0 tx=0x7fede8008040 comp rx=0 tx=0).stop 2023-11-20T06:42:30.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.007+0000 7fee006c9640 1 -- 172.21.15.19:0/2269769190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedf8070c40 msgr2=0x7fedf8157ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:30.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.007+0000 7fee006c9640 1 --2- 172.21.15.19:0/2269769190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedf8070c40 0x7fedf8157ad0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fedf40ac040 tx=0x7fedf401acf0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.007+0000 7fee006c9640 1 -- 172.21.15.19:0/2269769190 shutdown_connections 2023-11-20T06:42:30.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.007+0000 7fee006c9640 1 --2- 172.21.15.19:0/2269769190 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feddc0664a0 0x7feddc068960 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.007+0000 7fee006c9640 1 --2- 172.21.15.19:0/2269769190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf80b4020 0x7fedf80adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.007+0000 7fee006c9640 1 --2- 172.21.15.19:0/2269769190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedf80b0620 0x7fedf814e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.007+0000 7fee006c9640 1 --2- 172.21.15.19:0/2269769190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedf8070c40 0x7fedf8157ad0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.007+0000 7fee006c9640 1 -- 172.21.15.19:0/2269769190 >> 172.21.15.19:0/2269769190 conn(0x7fedf806c190 msgr2=0x7fedf80c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:30.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.007+0000 7fee006c9640 1 -- 172.21.15.19:0/2269769190 shutdown_connections 2023-11-20T06:42:30.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.007+0000 7fee006c9640 1 -- 172.21.15.19:0/2269769190 wait complete. 2023-11-20T06:42:30.032 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:30.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.167+0000 7f073a73e640 1 Processor -- start 2023-11-20T06:42:30.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.171+0000 7f073a73e640 1 -- start start 2023-11-20T06:42:30.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.171+0000 7f073a73e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f073415ca70 0x7f07340d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:30.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.171+0000 7f073a73e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f07340d3550 0x7f07340cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:30.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.171+0000 7f073a73e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07340cfa00 con 0x7f07340cf5d0 2023-11-20T06:42:30.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.171+0000 7f073a73e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07340ce820 con 0x7f073415ca70 2023-11-20T06:42:30.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.171+0000 7f073a73e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07340c65f0 con 0x7f07340d3550 2023-11-20T06:42:30.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.171+0000 7f0733fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f073415ca70 0x7f07340d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:30.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.171+0000 7f0733fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f073415ca70 0x7f07340d3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59032/0 (socket says 172.21.15.19:59032) 2023-11-20T06:42:30.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.171+0000 7f0733fff640 1 -- 172.21.15.19:0/3595744685 learned_addr learned my addr 172.21.15.19:0/3595744685 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:30.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.171+0000 7f07337fe640 1 --2- 172.21.15.19:0/3595744685 >> v2:172.21.15.190:3300/0 conn(0x7f07340d3550 0x7f07340cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:30.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.171+0000 7f0733fff640 1 -- 172.21.15.19:0/3595744685 >> v2:172.21.15.190:3300/0 conn(0x7f07340d3550 msgr2=0x7f07340cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:30.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.171+0000 7f0733fff640 1 --2- 172.21.15.19:0/3595744685 >> v2:172.21.15.190:3300/0 conn(0x7f07340d3550 0x7f07340cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.171+0000 7f0733fff640 1 -- 172.21.15.19:0/3595744685 >> v1:172.21.15.190:6789/0 conn(0x7f07340cf5d0 legacy=0x7f07340d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:30.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.171+0000 7f0733fff640 1 -- 172.21.15.19:0/3595744685 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07340cdf80 con 0x7f073415ca70 2023-11-20T06:42:30.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.171+0000 7f07337fe640 1 --2- 172.21.15.19:0/3595744685 >> v2:172.21.15.190:3300/0 conn(0x7f07340d3550 0x7f07340cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:30.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.175+0000 7f0733fff640 1 --2- 172.21.15.19:0/3595744685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f073415ca70 0x7f07340d3010 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f07340b54f0 tx=0x7f072401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c32c6e56276b67b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:30.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.175+0000 7f0732ffd640 1 -- 172.21.15.19:0/3595744685 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07240aa430 con 0x7f073415ca70 2023-11-20T06:42:30.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.175+0000 7f0732ffd640 1 -- 172.21.15.19:0/3595744685 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07240aa590 con 0x7f073415ca70 2023-11-20T06:42:30.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.175+0000 7f0732ffd640 1 -- 172.21.15.19:0/3595744685 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07240aa920 con 0x7f073415ca70 2023-11-20T06:42:30.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.175+0000 7f073a73e640 1 -- 172.21.15.19:0/3595744685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f073415ca70 msgr2=0x7f07340d3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:30.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.175+0000 7f073a73e640 1 --2- 172.21.15.19:0/3595744685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f073415ca70 0x7f07340d3010 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f07340b54f0 tx=0x7f072401c4d0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.175+0000 7f073a73e640 1 -- 172.21.15.19:0/3595744685 shutdown_connections 2023-11-20T06:42:30.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.175+0000 7f073a73e640 1 --2- 172.21.15.19:0/3595744685 >> v2:172.21.15.190:3300/0 conn(0x7f07340d3550 0x7f07340cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.175+0000 7f073a73e640 1 --2- 172.21.15.19:0/3595744685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f073415ca70 0x7f07340d3010 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.175+0000 7f073a73e640 1 -- 172.21.15.19:0/3595744685 >> 172.21.15.19:0/3595744685 conn(0x7f073409bc50 msgr2=0x7f07340d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:30.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.175+0000 7f073a73e640 1 -- 172.21.15.19:0/3595744685 shutdown_connections 2023-11-20T06:42:30.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.175+0000 7f073a73e640 1 -- 172.21.15.19:0/3595744685 wait complete. 2023-11-20T06:42:30.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.175+0000 7f073a73e640 1 Processor -- start 2023-11-20T06:42:30.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f073a73e640 1 -- start start 2023-11-20T06:42:30.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f073a73e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07340cf5d0 0x7f07340b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:30.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f073a73e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07340d3550 0x7f07340d2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:30.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f073a73e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f073415ca70 0x7f07340d2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:30.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f073a73e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0734153ba0 con 0x7f07340cf5d0 2023-11-20T06:42:30.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f073a73e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0734153e80 con 0x7f073415ca70 2023-11-20T06:42:30.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f073a73e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0734154160 con 0x7f07340d3550 2023-11-20T06:42:30.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f0733fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07340cf5d0 0x7f07340b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:30.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f0733fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07340cf5d0 0x7f07340b5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59044/0 (socket says 172.21.15.19:59044) 2023-11-20T06:42:30.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f0733fff640 1 -- 172.21.15.19:0/468327481 learned_addr learned my addr 172.21.15.19:0/468327481 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:30.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f07337fe640 1 --2- 172.21.15.19:0/468327481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07340d3550 0x7f07340d2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:30.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f0738cdb640 1 --2- 172.21.15.19:0/468327481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f073415ca70 0x7f07340d2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:30.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f0733fff640 1 -- 172.21.15.19:0/468327481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07340d3550 msgr2=0x7f07340d2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:30.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f0733fff640 1 --2- 172.21.15.19:0/468327481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07340d3550 0x7f07340d2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f0733fff640 1 -- 172.21.15.19:0/468327481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f073415ca70 msgr2=0x7f07340d2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:30.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f0733fff640 1 --2- 172.21.15.19:0/468327481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f073415ca70 0x7f07340d2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f0733fff640 1 -- 172.21.15.19:0/468327481 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0724009480 con 0x7f07340cf5d0 2023-11-20T06:42:30.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f0738cdb640 1 --2- 172.21.15.19:0/468327481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f073415ca70 0x7f07340d2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:30.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f07337fe640 1 --2- 172.21.15.19:0/468327481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07340d3550 0x7f07340d2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:30.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f0733fff640 1 --2- 172.21.15.19:0/468327481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07340cf5d0 0x7f07340b5b40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f07240190e0 tx=0x7f0724019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:30.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f0730ff9640 1 -- 172.21.15.19:0/468327481 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07240aabd0 con 0x7f07340cf5d0 2023-11-20T06:42:30.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f0730ff9640 1 -- 172.21.15.19:0/468327481 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07240aad30 con 0x7f07340cf5d0 2023-11-20T06:42:30.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f073a73e640 1 -- 172.21.15.19:0/468327481 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0734154440 con 0x7f07340cf5d0 2023-11-20T06:42:30.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f0730ff9640 1 -- 172.21.15.19:0/468327481 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07240aaea0 con 0x7f07340cf5d0 2023-11-20T06:42:30.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f073a73e640 1 -- 172.21.15.19:0/468327481 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0734154c40 con 0x7f07340cf5d0 2023-11-20T06:42:30.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.179+0000 7f073a73e640 1 -- 172.21.15.19:0/468327481 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f073406b970 con 0x7f07340cf5d0 2023-11-20T06:42:30.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.183+0000 7f0730ff9640 1 -- 172.21.15.19:0/468327481 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0724003620 con 0x7f07340cf5d0 2023-11-20T06:42:30.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.183+0000 7f0730ff9640 1 --2- 172.21.15.19:0/468327481 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f07200664a0 0x7f0720068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:30.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.183+0000 7f0730ff9640 1 -- 172.21.15.19:0/468327481 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f072411ea90 con 0x7f07340cf5d0 2023-11-20T06:42:30.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.183+0000 7f07337fe640 1 --2- 172.21.15.19:0/468327481 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f07200664a0 0x7f0720068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:30.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.183+0000 7f07337fe640 1 --2- 172.21.15.19:0/468327481 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f07200664a0 0x7f0720068960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f07340b67f0 tx=0x7f0728008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:30.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.187+0000 7f0730ff9640 1 -- 172.21.15.19:0/468327481 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f07240ebb40 con 0x7f07340cf5d0 2023-11-20T06:42:30.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.347+0000 7f073a73e640 1 -- 172.21.15.19:0/468327481 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0734074010 con 0x7f07340cf5d0 2023-11-20T06:42:30.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.347+0000 7f0730ff9640 1 -- 172.21.15.19:0/468327481 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18720 (secure 0 0 0) 0x7f07240c1090 con 0x7f07340cf5d0 2023-11-20T06:42:30.354 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:30.354 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:55.472006+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:30.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.351+0000 7f073a73e640 1 -- 172.21.15.19:0/468327481 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f07200664a0 msgr2=0x7f0720068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:30.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.351+0000 7f073a73e640 1 --2- 172.21.15.19:0/468327481 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f07200664a0 0x7f0720068960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f07340b67f0 tx=0x7f0728008040 comp rx=0 tx=0).stop 2023-11-20T06:42:30.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.351+0000 7f073a73e640 1 -- 172.21.15.19:0/468327481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07340cf5d0 msgr2=0x7f07340b5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:30.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.351+0000 7f073a73e640 1 --2- 172.21.15.19:0/468327481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07340cf5d0 0x7f07340b5b40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f07240190e0 tx=0x7f0724019270 comp rx=0 tx=0).stop 2023-11-20T06:42:30.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.351+0000 7f073a73e640 1 -- 172.21.15.19:0/468327481 shutdown_connections 2023-11-20T06:42:30.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.351+0000 7f073a73e640 1 --2- 172.21.15.19:0/468327481 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f07200664a0 0x7f0720068960 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.351+0000 7f073a73e640 1 --2- 172.21.15.19:0/468327481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f073415ca70 0x7f07340d2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.351+0000 7f073a73e640 1 --2- 172.21.15.19:0/468327481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07340d3550 0x7f07340d2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.351+0000 7f073a73e640 1 --2- 172.21.15.19:0/468327481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07340cf5d0 0x7f07340b5b40 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.351+0000 7f073a73e640 1 -- 172.21.15.19:0/468327481 >> 172.21.15.19:0/468327481 conn(0x7f073409bc50 msgr2=0x7f0734155550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:30.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.351+0000 7f073a73e640 1 -- 172.21.15.19:0/468327481 shutdown_connections 2023-11-20T06:42:30.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.351+0000 7f073a73e640 1 -- 172.21.15.19:0/468327481 wait complete. 2023-11-20T06:42:30.375 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-20T06:42:30.376 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T06:42:30.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.511+0000 7fece929e640 1 Processor -- start 2023-11-20T06:42:30.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.511+0000 7fece929e640 1 -- start start 2023-11-20T06:42:30.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.515+0000 7fece929e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fece4159ba0 0x7fece40cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:30.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.515+0000 7fece929e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fece40c8cb0 0x7fece40cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:30.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.515+0000 7fece929e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece40723d0 con 0x7fece41597c0 2023-11-20T06:42:30.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.515+0000 7fece929e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece40717c0 con 0x7fece4159ba0 2023-11-20T06:42:30.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.515+0000 7fece929e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece4071aa0 con 0x7fece40c8cb0 2023-11-20T06:42:30.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.515+0000 7fece27fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fece4159ba0 0x7fece40cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:30.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.515+0000 7fece2ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fece41597c0 0x7fece40ad6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47814/0 (socket says 172.21.15.19:47814) 2023-11-20T06:42:30.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.515+0000 7fece2ffd640 1 -- 172.21.15.19:0/2763756871 learned_addr learned my addr 172.21.15.19:0/2763756871 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:30.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.515+0000 7fece37fe640 1 --2- 172.21.15.19:0/2763756871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fece40c8cb0 0x7fece40cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:30.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.515+0000 7fece27fc640 1 -- 172.21.15.19:0/2763756871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fece40c8cb0 msgr2=0x7fece40cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:30.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.515+0000 7fece27fc640 1 --2- 172.21.15.19:0/2763756871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fece40c8cb0 0x7fece40cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.515+0000 7fece27fc640 1 -- 172.21.15.19:0/2763756871 >> v1:172.21.15.19:6789/0 conn(0x7fece41597c0 legacy=0x7fece40ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:30.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.515+0000 7fece1ffb640 1 -- 172.21.15.19:0/2763756871 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678311713 0 0) 0x7fece40723d0 con 0x7fece41597c0 2023-11-20T06:42:30.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.515+0000 7fece27fc640 1 -- 172.21.15.19:0/2763756871 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece4071d80 con 0x7fece4159ba0 2023-11-20T06:42:30.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.519+0000 7fece27fc640 1 --2- 172.21.15.19:0/2763756871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fece4159ba0 0x7fece40cae10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fecd80097c0 tx=0x7fecd801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4bf4981a1eb4a86 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:30.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.519+0000 7fece1ffb640 1 -- 172.21.15.19:0/2763756871 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd80ab5f0 con 0x7fece4159ba0 2023-11-20T06:42:30.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.519+0000 7fece1ffb640 1 -- 172.21.15.19:0/2763756871 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd80ab750 con 0x7fece4159ba0 2023-11-20T06:42:30.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.519+0000 7fece1ffb640 1 -- 172.21.15.19:0/2763756871 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd80abae0 con 0x7fece4159ba0 2023-11-20T06:42:30.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.519+0000 7fece929e640 1 -- 172.21.15.19:0/2763756871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fece4159ba0 msgr2=0x7fece40cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:30.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.519+0000 7fece929e640 1 --2- 172.21.15.19:0/2763756871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fece4159ba0 0x7fece40cae10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fecd80097c0 tx=0x7fecd801c450 comp rx=0 tx=0).stop 2023-11-20T06:42:30.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.519+0000 7fece929e640 1 -- 172.21.15.19:0/2763756871 shutdown_connections 2023-11-20T06:42:30.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.519+0000 7fece929e640 1 --2- 172.21.15.19:0/2763756871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fece40c8cb0 0x7fece40cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.519+0000 7fece929e640 1 --2- 172.21.15.19:0/2763756871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fece4159ba0 0x7fece40cae10 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.519+0000 7fece929e640 1 -- 172.21.15.19:0/2763756871 >> 172.21.15.19:0/2763756871 conn(0x7fece406c190 msgr2=0x7fece406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:30.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.519+0000 7fece929e640 1 -- 172.21.15.19:0/2763756871 shutdown_connections 2023-11-20T06:42:30.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.519+0000 7fece929e640 1 -- 172.21.15.19:0/2763756871 wait complete. 2023-11-20T06:42:30.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.519+0000 7fece929e640 1 Processor -- start 2023-11-20T06:42:30.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.519+0000 7fece929e640 1 -- start start 2023-11-20T06:42:30.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece929e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fece40c8cb0 0x7fece4156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:30.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece929e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fece41597c0 0x7fece415bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:30.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece929e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fece4159ba0 0x7fece4157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:30.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece929e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece415b7d0 con 0x7fece40c8cb0 2023-11-20T06:42:30.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece929e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece415ae70 con 0x7fece4159ba0 2023-11-20T06:42:30.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece929e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece415b110 con 0x7fece41597c0 2023-11-20T06:42:30.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fece40c8cb0 0x7fece4156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:30.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fece40c8cb0 0x7fece4156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59062/0 (socket says 172.21.15.19:59062) 2023-11-20T06:42:30.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece2ffd640 1 -- 172.21.15.19:0/863755245 learned_addr learned my addr 172.21.15.19:0/863755245 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:30.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece37fe640 1 --2- 172.21.15.19:0/863755245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fece4159ba0 0x7fece4157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:30.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece27fc640 1 --2- 172.21.15.19:0/863755245 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fece41597c0 0x7fece415bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:30.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece2ffd640 1 -- 172.21.15.19:0/863755245 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fece41597c0 msgr2=0x7fece415bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:30.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece2ffd640 1 --2- 172.21.15.19:0/863755245 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fece41597c0 0x7fece415bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece2ffd640 1 -- 172.21.15.19:0/863755245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fece4159ba0 msgr2=0x7fece4157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:30.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece2ffd640 1 --2- 172.21.15.19:0/863755245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fece4159ba0 0x7fece4157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece2ffd640 1 -- 172.21.15.19:0/863755245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd8009420 con 0x7fece40c8cb0 2023-11-20T06:42:30.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece37fe640 1 --2- 172.21.15.19:0/863755245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fece4159ba0 0x7fece4157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:30.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece2ffd640 1 --2- 172.21.15.19:0/863755245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fece40c8cb0 0x7fece4156dc0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fecd40011f0 tx=0x7fecd400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:30.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7feccb7fe640 1 -- 172.21.15.19:0/863755245 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40074e0 con 0x7fece40c8cb0 2023-11-20T06:42:30.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7feccb7fe640 1 -- 172.21.15.19:0/863755245 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd4007640 con 0x7fece40c8cb0 2023-11-20T06:42:30.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7feccb7fe640 1 -- 172.21.15.19:0/863755245 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4004a10 con 0x7fece40c8cb0 2023-11-20T06:42:30.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece929e640 1 -- 172.21.15.19:0/863755245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece415b3f0 con 0x7fece40c8cb0 2023-11-20T06:42:30.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece929e640 1 -- 172.21.15.19:0/863755245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece41584f0 con 0x7fece40c8cb0 2023-11-20T06:42:30.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7fece929e640 1 -- 172.21.15.19:0/863755245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece415b910 con 0x7fece40c8cb0 2023-11-20T06:42:30.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.523+0000 7feccb7fe640 1 -- 172.21.15.19:0/863755245 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fecd4004b70 con 0x7fece40c8cb0 2023-11-20T06:42:30.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.527+0000 7feccb7fe640 1 --2- 172.21.15.19:0/863755245 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fecd0066520 0x7fecd00689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:30.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.527+0000 7feccb7fe640 1 -- 172.21.15.19:0/863755245 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fecd4083860 con 0x7fece40c8cb0 2023-11-20T06:42:30.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.527+0000 7fece27fc640 1 --2- 172.21.15.19:0/863755245 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fecd0066520 0x7fecd00689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:30.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.527+0000 7fece27fc640 1 --2- 172.21.15.19:0/863755245 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fecd0066520 0x7fecd00689e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fecd80af000 tx=0x7fecd80a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:30.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.531+0000 7feccb7fe640 1 -- 172.21.15.19:0/863755245 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fece415b910 con 0x7fece40c8cb0 2023-11-20T06:42:30.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.719+0000 7fece929e640 1 -- 172.21.15.19:0/863755245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fece415b910 con 0x7fece40c8cb0 2023-11-20T06:42:30.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.719+0000 7feccb7fe640 1 -- 172.21.15.19:0/863755245 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fece415b910 con 0x7fece40c8cb0 2023-11-20T06:42:30.725 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:30.725 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/212787745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":212787745},{"type":"v1","addr":"172.21.15.190:6836","nonce":212787745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1874314285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1874314285},{"type":"v1","addr":"172.21.15.190:6837","nonce":1874314285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3845638593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3845638593},{"type":"v1","addr":"172.21.15.19:6833","nonce":3845638593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T06:41:13.620144+0000","modified":"2023-11-20T06:41:37.768410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/1973335825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1973335825},{"type":"v1","addr":"172.21.15.19:6835","nonce":1973335825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-20T06:42:30.726 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 9 2023-11-20T06:42:30.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.723+0000 7fece929e640 1 -- 172.21.15.19:0/863755245 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fecd0066520 msgr2=0x7fecd00689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:30.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.723+0000 7fece929e640 1 --2- 172.21.15.19:0/863755245 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fecd0066520 0x7fecd00689e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fecd80af000 tx=0x7fecd80a7000 comp rx=0 tx=0).stop 2023-11-20T06:42:30.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.723+0000 7fece929e640 1 -- 172.21.15.19:0/863755245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fece40c8cb0 msgr2=0x7fece4156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:30.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.723+0000 7fece929e640 1 --2- 172.21.15.19:0/863755245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fece40c8cb0 0x7fece4156dc0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fecd40011f0 tx=0x7fecd400c9b0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.723+0000 7fece929e640 1 -- 172.21.15.19:0/863755245 shutdown_connections 2023-11-20T06:42:30.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.723+0000 7fece929e640 1 --2- 172.21.15.19:0/863755245 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fecd0066520 0x7fecd00689e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.723+0000 7fece929e640 1 --2- 172.21.15.19:0/863755245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fece4159ba0 0x7fece4157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.723+0000 7fece929e640 1 --2- 172.21.15.19:0/863755245 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fece41597c0 0x7fece415bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.723+0000 7fece929e640 1 --2- 172.21.15.19:0/863755245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fece40c8cb0 0x7fece4156dc0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.723+0000 7fece929e640 1 -- 172.21.15.19:0/863755245 >> 172.21.15.19:0/863755245 conn(0x7fece406c190 msgr2=0x7fece40cb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:30.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.723+0000 7fece929e640 1 -- 172.21.15.19:0/863755245 shutdown_connections 2023-11-20T06:42:30.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.723+0000 7fece929e640 1 -- 172.21.15.19:0/863755245 wait complete. 2023-11-20T06:42:30.747 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T06:42:30.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.883+0000 7faa62980640 1 Processor -- start 2023-11-20T06:42:30.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.883+0000 7faa62980640 1 -- start start 2023-11-20T06:42:30.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.887+0000 7faa62980640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa5c1597c0 0x7faa5c0ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:30.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.887+0000 7faa62980640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7faa5c0adc10 0x7faa5c0cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:30.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.887+0000 7faa62980640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5c0723d0 con 0x7faa5c159ba0 2023-11-20T06:42:30.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.887+0000 7faa62980640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5c0717c0 con 0x7faa5c0adc10 2023-11-20T06:42:30.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.887+0000 7faa62980640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c071aa0 con 0x7faa5c1597c0 2023-11-20T06:42:30.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.887+0000 7faa5bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa5c1597c0 0x7faa5c0ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:30.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.887+0000 7faa60f1d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7faa5c0adc10 0x7faa5c0cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:30.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.887+0000 7faa5bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa5c1597c0 0x7faa5c0ad6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:44990/0 (socket says 172.21.15.19:44990) 2023-11-20T06:42:30.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.887+0000 7faa5bfff640 1 -- 172.21.15.19:0/3365743620 learned_addr learned my addr 172.21.15.19:0/3365743620 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:30.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.887+0000 7faa5b7fe640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7faa5c159ba0 0x7faa5c0cae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:41678/0 (socket says 172.21.15.19:41678) 2023-11-20T06:42:30.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.887+0000 7faa60f1d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7faa5c0adc10 0x7faa5c0cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:37612/0 (socket says 172.21.15.19:37612) 2023-11-20T06:42:30.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.887+0000 7faa5bfff640 1 -- 172.21.15.19:0/3365743620 >> v2:172.21.15.190:3300/0 conn(0x7faa5c0adc10 msgr2=0x7faa5c0cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:30.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.887+0000 7faa5bfff640 1 --2- 172.21.15.19:0/3365743620 >> v2:172.21.15.190:3300/0 conn(0x7faa5c0adc10 0x7faa5c0cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.887+0000 7faa5bfff640 1 -- 172.21.15.19:0/3365743620 >> v1:172.21.15.190:6789/0 conn(0x7faa5c159ba0 legacy=0x7faa5c0cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:30.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.887+0000 7faa5bfff640 1 -- 172.21.15.19:0/3365743620 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5c071d80 con 0x7faa5c1597c0 2023-11-20T06:42:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.891+0000 7faa5bfff640 1 --2- 172.21.15.19:0/3365743620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa5c1597c0 0x7faa5c0ad6d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009870 tx=0x7faa4c01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3533b61c5723f39c server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.891+0000 7faa5affd640 1 -- 172.21.15.19:0/3365743620 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c0aa640 con 0x7faa5c1597c0 2023-11-20T06:42:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.891+0000 7faa5affd640 1 -- 172.21.15.19:0/3365743620 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c0aa7a0 con 0x7faa5c1597c0 2023-11-20T06:42:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.891+0000 7faa5affd640 1 -- 172.21.15.19:0/3365743620 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c0aab30 con 0x7faa5c1597c0 2023-11-20T06:42:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.891+0000 7faa62980640 1 -- 172.21.15.19:0/3365743620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa5c1597c0 msgr2=0x7faa5c0ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.891+0000 7faa62980640 1 --2- 172.21.15.19:0/3365743620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa5c1597c0 0x7faa5c0ad6d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009870 tx=0x7faa4c01c540 comp rx=0 tx=0).stop 2023-11-20T06:42:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.891+0000 7faa62980640 1 -- 172.21.15.19:0/3365743620 shutdown_connections 2023-11-20T06:42:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.891+0000 7faa62980640 1 --2- 172.21.15.19:0/3365743620 >> v2:172.21.15.190:3300/0 conn(0x7faa5c0adc10 0x7faa5c0cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.891+0000 7faa62980640 1 --2- 172.21.15.19:0/3365743620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa5c1597c0 0x7faa5c0ad6d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.891+0000 7faa62980640 1 -- 172.21.15.19:0/3365743620 >> 172.21.15.19:0/3365743620 conn(0x7faa5c06c190 msgr2=0x7faa5c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:30.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.891+0000 7faa62980640 1 -- 172.21.15.19:0/3365743620 shutdown_connections 2023-11-20T06:42:30.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.891+0000 7faa62980640 1 -- 172.21.15.19:0/3365743620 wait complete. 2023-11-20T06:42:30.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.891+0000 7faa62980640 1 Processor -- start 2023-11-20T06:42:30.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa62980640 1 -- start start 2023-11-20T06:42:30.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa62980640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa5c0adc10 0x7faa5c14f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:30.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa62980640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa5c1597c0 0x7faa5c167890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:30.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa62980640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa5c159ba0 0x7faa5c167dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:30.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa62980640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c14fb50 con 0x7faa5c159ba0 2023-11-20T06:42:30.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa62980640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c148c40 con 0x7faa5c1597c0 2023-11-20T06:42:30.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa62980640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c0c6f10 con 0x7faa5c0adc10 2023-11-20T06:42:30.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa5b7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa5c1597c0 0x7faa5c167890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:30.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa60f1d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa5c159ba0 0x7faa5c167dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:30.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa5b7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa5c1597c0 0x7faa5c167890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:37614/0 (socket says 172.21.15.19:37614) 2023-11-20T06:42:30.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa5b7fe640 1 -- 172.21.15.19:0/175873864 learned_addr learned my addr 172.21.15.19:0/175873864 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:30.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa5bfff640 1 --2- 172.21.15.19:0/175873864 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa5c0adc10 0x7faa5c14f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa5bfff640 1 -- 172.21.15.19:0/175873864 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa5c1597c0 msgr2=0x7faa5c167890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa5bfff640 1 --2- 172.21.15.19:0/175873864 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa5c1597c0 0x7faa5c167890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa5bfff640 1 -- 172.21.15.19:0/175873864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa5c159ba0 msgr2=0x7faa5c167dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa5bfff640 1 --2- 172.21.15.19:0/175873864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa5c159ba0 0x7faa5c167dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa5bfff640 1 -- 172.21.15.19:0/175873864 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c0094d0 con 0x7faa5c0adc10 2023-11-20T06:42:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa5b7fe640 1 --2- 172.21.15.19:0/175873864 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa5c1597c0 0x7faa5c167890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa60f1d640 1 --2- 172.21.15.19:0/175873864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa5c159ba0 0x7faa5c167dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:42:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa5bfff640 1 --2- 172.21.15.19:0/175873864 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa5c0adc10 0x7faa5c14f610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0ab000 tx=0x7faa4c01ad80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa58ff9640 1 -- 172.21.15.19:0/175873864 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c0bd5f0 con 0x7faa5c0adc10 2023-11-20T06:42:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa58ff9640 1 -- 172.21.15.19:0/175873864 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c0bd750 con 0x7faa5c0adc10 2023-11-20T06:42:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa62980640 1 -- 172.21.15.19:0/175873864 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5c0c71f0 con 0x7faa5c0adc10 2023-11-20T06:42:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.895+0000 7faa58ff9640 1 -- 172.21.15.19:0/175873864 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c0bdb00 con 0x7faa5c0adc10 2023-11-20T06:42:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.899+0000 7faa62980640 1 -- 172.21.15.19:0/175873864 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5c0c77b0 con 0x7faa5c0adc10 2023-11-20T06:42:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.899+0000 7faa62980640 1 -- 172.21.15.19:0/175873864 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5c074010 con 0x7faa5c0adc10 2023-11-20T06:42:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.899+0000 7faa58ff9640 1 -- 172.21.15.19:0/175873864 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faa4c0a8050 con 0x7faa5c0adc10 2023-11-20T06:42:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.899+0000 7faa58ff9640 1 --2- 172.21.15.19:0/175873864 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faa480664f0 0x7faa480689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.899+0000 7faa58ff9640 1 -- 172.21.15.19:0/175873864 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faa4c11f060 con 0x7faa5c0adc10 2023-11-20T06:42:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.899+0000 7faa5b7fe640 1 --2- 172.21.15.19:0/175873864 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faa480664f0 0x7faa480689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:30.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.903+0000 7faa5b7fe640 1 --2- 172.21.15.19:0/175873864 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faa480664f0 0x7faa480689b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa5c1591e0 tx=0x7faa50007e10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:30.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:30.903+0000 7faa58ff9640 1 -- 172.21.15.19:0/175873864 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faa4c0ec2d0 con 0x7faa5c0adc10 2023-11-20T06:42:31.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.091+0000 7faa62980640 1 -- 172.21.15.19:0/175873864 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa5c0b4170 con 0x7faa5c0adc10 2023-11-20T06:42:31.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.091+0000 7faa58ff9640 1 -- 172.21.15.19:0/175873864 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7faa4c0ef8f0 con 0x7faa5c0adc10 2023-11-20T06:42:31.099 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:31.099 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/212787745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":212787745},{"type":"v1","addr":"172.21.15.190:6836","nonce":212787745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1874314285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1874314285},{"type":"v1","addr":"172.21.15.190:6837","nonce":1874314285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3845638593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3845638593},{"type":"v1","addr":"172.21.15.19:6833","nonce":3845638593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T06:41:13.620144+0000","modified":"2023-11-20T06:41:37.768410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/1973335825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1973335825},{"type":"v1","addr":"172.21.15.19:6835","nonce":1973335825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-20T06:42:31.099 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 9 2023-11-20T06:42:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.095+0000 7faa62980640 1 -- 172.21.15.19:0/175873864 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faa480664f0 msgr2=0x7faa480689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.095+0000 7faa62980640 1 --2- 172.21.15.19:0/175873864 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faa480664f0 0x7faa480689b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa5c1591e0 tx=0x7faa50007e10 comp rx=0 tx=0).stop 2023-11-20T06:42:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.095+0000 7faa62980640 1 -- 172.21.15.19:0/175873864 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa5c0adc10 msgr2=0x7faa5c14f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.095+0000 7faa62980640 1 --2- 172.21.15.19:0/175873864 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa5c0adc10 0x7faa5c14f610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0ab000 tx=0x7faa4c01ad80 comp rx=0 tx=0).stop 2023-11-20T06:42:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.095+0000 7faa62980640 1 -- 172.21.15.19:0/175873864 shutdown_connections 2023-11-20T06:42:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.095+0000 7faa62980640 1 --2- 172.21.15.19:0/175873864 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faa480664f0 0x7faa480689b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.095+0000 7faa62980640 1 --2- 172.21.15.19:0/175873864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa5c159ba0 0x7faa5c167dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.095+0000 7faa62980640 1 --2- 172.21.15.19:0/175873864 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa5c1597c0 0x7faa5c167890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.095+0000 7faa62980640 1 --2- 172.21.15.19:0/175873864 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa5c0adc10 0x7faa5c14f610 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.095+0000 7faa62980640 1 -- 172.21.15.19:0/175873864 >> 172.21.15.19:0/175873864 conn(0x7faa5c06c190 msgr2=0x7faa5c14b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:31.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.095+0000 7faa62980640 1 -- 172.21.15.19:0/175873864 shutdown_connections 2023-11-20T06:42:31.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.095+0000 7faa62980640 1 -- 172.21.15.19:0/175873864 wait complete. 2023-11-20T06:42:31.120 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:31.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.255+0000 7feb0f59e640 1 Processor -- start 2023-11-20T06:42:31.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.255+0000 7feb0f59e640 1 -- start start 2023-11-20T06:42:31.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.259+0000 7feb0f59e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7feb100d1490 0x7feb1006af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:31.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.259+0000 7feb0f59e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7feb1015cd60 0x7feb100b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:31.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.259+0000 7feb0f59e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb100d3510 con 0x7feb1015c980 2023-11-20T06:42:31.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.259+0000 7feb0f59e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb100cd2b0 con 0x7feb1015cd60 2023-11-20T06:42:31.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.259+0000 7feb0f59e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb100d2f50 con 0x7feb100d1490 2023-11-20T06:42:31.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.259+0000 7feb0ed9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7feb1015cd60 0x7feb100b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:31.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.259+0000 7feb0ed9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7feb1015cd60 0x7feb100b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59070/0 (socket says 172.21.15.19:59070) 2023-11-20T06:42:31.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.259+0000 7feb0ed9d640 1 -- 172.21.15.19:0/2912500950 learned_addr learned my addr 172.21.15.19:0/2912500950 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:31.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.259+0000 7feb0dd9b640 1 --2- 172.21.15.19:0/2912500950 >> v2:172.21.15.190:3300/0 conn(0x7feb100d1490 0x7feb1006af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:31.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.259+0000 7feb0ed9d640 1 -- 172.21.15.19:0/2912500950 >> v2:172.21.15.190:3300/0 conn(0x7feb100d1490 msgr2=0x7feb1006af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:31.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.259+0000 7feb0ed9d640 1 --2- 172.21.15.19:0/2912500950 >> v2:172.21.15.190:3300/0 conn(0x7feb100d1490 0x7feb1006af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.259+0000 7feb0ed9d640 1 -- 172.21.15.19:0/2912500950 >> v1:172.21.15.190:6789/0 conn(0x7feb1015c980 legacy=0x7feb100d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:31.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.259+0000 7feb0ed9d640 1 -- 172.21.15.19:0/2912500950 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb100d3230 con 0x7feb1015cd60 2023-11-20T06:42:31.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.259+0000 7feb0dd9b640 1 --2- 172.21.15.19:0/2912500950 >> v2:172.21.15.190:3300/0 conn(0x7feb100d1490 0x7feb1006af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:31.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.263+0000 7feb0ed9d640 1 --2- 172.21.15.19:0/2912500950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb1015cd60 0x7feb100b1b90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7feb100d1900 tx=0x7feb0801d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d326036b7cc068a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:31.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.263+0000 7feb0d59a640 1 -- 172.21.15.19:0/2912500950 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb080a56d0 con 0x7feb1015cd60 2023-11-20T06:42:31.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.263+0000 7feb0d59a640 1 -- 172.21.15.19:0/2912500950 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb080a5830 con 0x7feb1015cd60 2023-11-20T06:42:31.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.263+0000 7feb0d59a640 1 -- 172.21.15.19:0/2912500950 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb080a5bc0 con 0x7feb1015cd60 2023-11-20T06:42:31.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.263+0000 7feb0f59e640 1 -- 172.21.15.19:0/2912500950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb1015cd60 msgr2=0x7feb100b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:31.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.263+0000 7feb0f59e640 1 --2- 172.21.15.19:0/2912500950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb1015cd60 0x7feb100b1b90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7feb100d1900 tx=0x7feb0801d360 comp rx=0 tx=0).stop 2023-11-20T06:42:31.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.263+0000 7feb0f59e640 1 -- 172.21.15.19:0/2912500950 shutdown_connections 2023-11-20T06:42:31.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.263+0000 7feb0f59e640 1 --2- 172.21.15.19:0/2912500950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb1015cd60 0x7feb100b1b90 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.263+0000 7feb0f59e640 1 --2- 172.21.15.19:0/2912500950 >> v2:172.21.15.190:3300/0 conn(0x7feb100d1490 0x7feb1006af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.263+0000 7feb0f59e640 1 -- 172.21.15.19:0/2912500950 >> 172.21.15.19:0/2912500950 conn(0x7feb1009ba80 msgr2=0x7feb100d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:31.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.263+0000 7feb0f59e640 1 -- 172.21.15.19:0/2912500950 shutdown_connections 2023-11-20T06:42:31.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.263+0000 7feb0f59e640 1 -- 172.21.15.19:0/2912500950 wait complete. 2023-11-20T06:42:31.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.263+0000 7feb0f59e640 1 Processor -- start 2023-11-20T06:42:31.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.263+0000 7feb0f59e640 1 -- start start 2023-11-20T06:42:31.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feb0f59e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb100d1490 0x7feb100c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:31.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feb0f59e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb1015c980 0x7feb1015aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:31.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feb0f59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb1015cd60 0x7feb100c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:31.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feb0f59e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb10150fe0 con 0x7feb1015cd60 2023-11-20T06:42:31.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feb0f59e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb101503d0 con 0x7feb100d1490 2023-11-20T06:42:31.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feb0f59e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb101506b0 con 0x7feb1015c980 2023-11-20T06:42:31.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feb0ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb1015cd60 0x7feb100c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:31.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feb0ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb1015cd60 0x7feb100c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59084/0 (socket says 172.21.15.19:59084) 2023-11-20T06:42:31.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feb0ed9d640 1 -- 172.21.15.19:0/920955029 learned_addr learned my addr 172.21.15.19:0/920955029 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:31.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feb0e59c640 1 --2- 172.21.15.19:0/920955029 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb100d1490 0x7feb100c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:31.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feb0dd9b640 1 --2- 172.21.15.19:0/920955029 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb1015c980 0x7feb1015aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feb0ed9d640 1 -- 172.21.15.19:0/920955029 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb1015c980 msgr2=0x7feb1015aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feb0ed9d640 1 --2- 172.21.15.19:0/920955029 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb1015c980 0x7feb1015aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feb0ed9d640 1 -- 172.21.15.19:0/920955029 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb100d1490 msgr2=0x7feb100c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feb0ed9d640 1 --2- 172.21.15.19:0/920955029 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb100d1490 0x7feb100c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feb0ed9d640 1 -- 172.21.15.19:0/920955029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb08009b30 con 0x7feb1015cd60 2023-11-20T06:42:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feb0ed9d640 1 --2- 172.21.15.19:0/920955029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb1015cd60 0x7feb100c78a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7feb080af040 tx=0x7feb080196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feafeffd640 1 -- 172.21.15.19:0/920955029 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb080b8670 con 0x7feb1015cd60 2023-11-20T06:42:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feafeffd640 1 -- 172.21.15.19:0/920955029 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb080b87d0 con 0x7feb1015cd60 2023-11-20T06:42:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feb0f59e640 1 -- 172.21.15.19:0/920955029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb10150990 con 0x7feb1015cd60 2023-11-20T06:42:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feafeffd640 1 -- 172.21.15.19:0/920955029 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb080b8b60 con 0x7feb1015cd60 2023-11-20T06:42:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feb0f59e640 1 -- 172.21.15.19:0/920955029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb100c9060 con 0x7feb1015cd60 2023-11-20T06:42:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.267+0000 7feb0f59e640 1 -- 172.21.15.19:0/920955029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb10151190 con 0x7feb1015cd60 2023-11-20T06:42:31.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.271+0000 7feafeffd640 1 -- 172.21.15.19:0/920955029 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7feb080b8cc0 con 0x7feb1015cd60 2023-11-20T06:42:31.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.271+0000 7feafeffd640 1 --2- 172.21.15.19:0/920955029 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feaf00664a0 0x7feaf0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:31.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.271+0000 7feafeffd640 1 -- 172.21.15.19:0/920955029 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feb0811f6a0 con 0x7feb1015cd60 2023-11-20T06:42:31.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.271+0000 7feb0e59c640 1 --2- 172.21.15.19:0/920955029 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feaf00664a0 0x7feaf0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:31.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.271+0000 7feb0e59c640 1 --2- 172.21.15.19:0/920955029 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feaf00664a0 0x7feaf0068960 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7feb101586b0 tx=0x7feb00007e90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:31.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.275+0000 7feafeffd640 1 -- 172.21.15.19:0/920955029 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7feb080ec7e0 con 0x7feb1015cd60 2023-11-20T06:42:31.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.431+0000 7feb0f59e640 1 -- 172.21.15.19:0/920955029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb1004e9c0 con 0x7feb1015cd60 2023-11-20T06:42:31.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.431+0000 7feafeffd640 1 -- 172.21.15.19:0/920955029 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18720 (secure 0 0 0) 0x7feb080efe00 con 0x7feb1015cd60 2023-11-20T06:42:31.438 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:31.439 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:41:55.472006+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:41:11.805111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T06:41:12.614034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T06:41:16.311206+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:31.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.435+0000 7feb0f59e640 1 -- 172.21.15.19:0/920955029 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feaf00664a0 msgr2=0x7feaf0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:31.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.435+0000 7feb0f59e640 1 --2- 172.21.15.19:0/920955029 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feaf00664a0 0x7feaf0068960 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7feb101586b0 tx=0x7feb00007e90 comp rx=0 tx=0).stop 2023-11-20T06:42:31.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.435+0000 7feb0f59e640 1 -- 172.21.15.19:0/920955029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb1015cd60 msgr2=0x7feb100c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:31.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.435+0000 7feb0f59e640 1 --2- 172.21.15.19:0/920955029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb1015cd60 0x7feb100c78a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7feb080af040 tx=0x7feb080196a0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.435+0000 7feb0f59e640 1 -- 172.21.15.19:0/920955029 shutdown_connections 2023-11-20T06:42:31.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.435+0000 7feb0f59e640 1 --2- 172.21.15.19:0/920955029 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feaf00664a0 0x7feaf0068960 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.435+0000 7feb0f59e640 1 --2- 172.21.15.19:0/920955029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb1015cd60 0x7feb100c78a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.435+0000 7feb0f59e640 1 --2- 172.21.15.19:0/920955029 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb1015c980 0x7feb1015aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.435+0000 7feb0f59e640 1 --2- 172.21.15.19:0/920955029 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb100d1490 0x7feb100c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.435+0000 7feb0f59e640 1 -- 172.21.15.19:0/920955029 >> 172.21.15.19:0/920955029 conn(0x7feb1009ba80 msgr2=0x7feb10158fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:31.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.435+0000 7feb0f59e640 1 -- 172.21.15.19:0/920955029 shutdown_connections 2023-11-20T06:42:31.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.435+0000 7feb0f59e640 1 -- 172.21.15.19:0/920955029 wait complete. 2023-11-20T06:42:31.460 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-20T06:42:31.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.599+0000 7ff55cc91640 1 Processor -- start 2023-11-20T06:42:31.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.599+0000 7ff55cc91640 1 -- start start 2023-11-20T06:42:31.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.599+0000 7ff55cc91640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5580cf520 0x7ff5580c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:31.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.599+0000 7ff55cc91640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5580c65f0 con 0x7ff5580cf090 2023-11-20T06:42:31.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.599+0000 7ff55cc91640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5580cf990 con 0x7ff55815ca70 2023-11-20T06:42:31.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.599+0000 7ff55cc91640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5580ce820 con 0x7ff5580cf520 2023-11-20T06:42:31.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.599+0000 7ff54ffff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff5580cf090 0x7ff5580c6ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47828/0 (socket says 172.21.15.19:47828) 2023-11-20T06:42:31.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.599+0000 7ff54ffff640 1 -- 172.21.15.19:0/1980489682 learned_addr learned my addr 172.21.15.19:0/1980489682 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:31.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.599+0000 7ff556d9d640 1 --2- 172.21.15.19:0/1980489682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5580cf520 0x7ff5580c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:31.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff555d9b640 1 -- 172.21.15.19:0/1980489682 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115591984 0 0) 0x7ff5580c65f0 con 0x7ff5580cf090 2023-11-20T06:42:31.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff555d9b640 1 -- 172.21.15.19:0/1980489682 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff544003530 con 0x7ff5580cf090 2023-11-20T06:42:31.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff555d9b640 1 -- 172.21.15.19:0/1980489682 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265291789 0 0) 0x7ff5580cf990 con 0x7ff55815ca70 2023-11-20T06:42:31.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff555d9b640 1 -- 172.21.15.19:0/1980489682 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5580c65f0 con 0x7ff55815ca70 2023-11-20T06:42:31.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff555d9b640 1 -- 172.21.15.19:0/1980489682 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3700918756 0 0) 0x7ff544003530 con 0x7ff5580cf090 2023-11-20T06:42:31.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff555d9b640 1 -- 172.21.15.19:0/1980489682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5580cf520 msgr2=0x7ff5580c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:31.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff555d9b640 1 --2- 172.21.15.19:0/1980489682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5580cf520 0x7ff5580c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff555d9b640 1 -- 172.21.15.19:0/1980489682 >> v1:172.21.15.190:6789/0 conn(0x7ff55815ca70 legacy=0x7ff5580d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:31.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff555d9b640 1 -- 172.21.15.19:0/1980489682 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5580cdf80 con 0x7ff5580cf090 2023-11-20T06:42:31.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff555d9b640 1 -- 172.21.15.19:0/1980489682 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7ff540001680 con 0x7ff5580cf090 2023-11-20T06:42:31.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff555d9b640 1 -- 172.21.15.19:0/1980489682 >> v1:172.21.15.19:6789/0 conn(0x7ff5580cf090 legacy=0x7ff5580c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:31.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff555d9b640 1 --2- 172.21.15.19:0/1980489682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5580cf520 0x7ff544003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:31.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff555d9b640 1 --2- 172.21.15.19:0/1980489682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5440040a0 0x7ff5440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:31.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff555d9b640 1 --2- 172.21.15.19:0/1980489682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff544004d10 0x7ff544005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:31.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff555d9b640 1 -- 172.21.15.19:0/1980489682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5580ce820 con 0x7ff5440040a0 2023-11-20T06:42:31.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff555d9b640 1 -- 172.21.15.19:0/1980489682 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54400ba70 con 0x7ff544004d10 2023-11-20T06:42:31.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff555d9b640 1 -- 172.21.15.19:0/1980489682 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54400bc30 con 0x7ff5580cf520 2023-11-20T06:42:31.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff54ffff640 1 --2- 172.21.15.19:0/1980489682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5440040a0 0x7ff5440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:31.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff55659c640 1 --2- 172.21.15.19:0/1980489682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5580cf520 0x7ff544003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:31.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff556d9d640 1 --2- 172.21.15.19:0/1980489682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff544004d10 0x7ff544005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:31.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff54ffff640 1 -- 172.21.15.19:0/1980489682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5580cf520 msgr2=0x7ff544003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:31.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff54ffff640 1 --2- 172.21.15.19:0/1980489682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5580cf520 0x7ff544003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff54ffff640 1 -- 172.21.15.19:0/1980489682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff544004d10 msgr2=0x7ff544005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:31.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff54ffff640 1 --2- 172.21.15.19:0/1980489682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff544004d10 0x7ff544005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.603+0000 7ff54ffff640 1 -- 172.21.15.19:0/1980489682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff544003530 con 0x7ff5440040a0 2023-11-20T06:42:31.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.607+0000 7ff54ffff640 1 --2- 172.21.15.19:0/1980489682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5440040a0 0x7ff5440047d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff54000c160 tx=0x7ff54001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6eb2af3b6fd720 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:31.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.607+0000 7ff555d9b640 1 -- 172.21.15.19:0/1980489682 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5400058e0 con 0x7ff5440040a0 2023-11-20T06:42:31.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.607+0000 7ff555d9b640 1 -- 172.21.15.19:0/1980489682 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff540005a60 con 0x7ff5440040a0 2023-11-20T06:42:31.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.607+0000 7ff555d9b640 1 -- 172.21.15.19:0/1980489682 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff540005e50 con 0x7ff5440040a0 2023-11-20T06:42:31.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.607+0000 7ff55cc91640 1 -- 172.21.15.19:0/1980489682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5440040a0 msgr2=0x7ff5440047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:31.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.607+0000 7ff55cc91640 1 --2- 172.21.15.19:0/1980489682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5440040a0 0x7ff5440047d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff54000c160 tx=0x7ff54001c9c0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.607+0000 7ff556d9d640 1 -- 172.21.15.19:0/1980489682 reap_dead start 2023-11-20T06:42:31.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.607+0000 7ff55cc91640 1 -- 172.21.15.19:0/1980489682 shutdown_connections 2023-11-20T06:42:31.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.607+0000 7ff55cc91640 1 -- 172.21.15.19:0/1980489682 >> 172.21.15.19:0/1980489682 conn(0x7ff55809bc50 msgr2=0x7ff5580d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:31.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.607+0000 7ff55cc91640 1 -- 172.21.15.19:0/1980489682 shutdown_connections 2023-11-20T06:42:31.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.607+0000 7ff55cc91640 1 -- 172.21.15.19:0/1980489682 wait complete. 2023-11-20T06:42:31.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.607+0000 7ff55cc91640 1 Processor -- start 2023-11-20T06:42:31.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.607+0000 7ff55cc91640 1 -- start start 2023-11-20T06:42:31.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff55cc91640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5440040a0 0x7ff55815d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:31.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff55cc91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff558145710 0x7ff558145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:31.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff55cc91640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff558159a80 0x7ff558159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:31.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff55cc91640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5581460d0 con 0x7ff558145710 2023-11-20T06:42:31.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff55cc91640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55815a470 con 0x7ff5440040a0 2023-11-20T06:42:31.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff55cc91640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55815df10 con 0x7ff558159a80 2023-11-20T06:42:31.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff54ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff558145710 0x7ff558145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:31.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff54ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff558145710 0x7ff558145b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59092/0 (socket says 172.21.15.19:59092) 2023-11-20T06:42:31.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff54ffff640 1 -- 172.21.15.19:0/2109498204 learned_addr learned my addr 172.21.15.19:0/2109498204 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:31.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff55659c640 1 --2- 172.21.15.19:0/2109498204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5440040a0 0x7ff55815d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:31.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff556d9d640 1 --2- 172.21.15.19:0/2109498204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff558159a80 0x7ff558159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:31.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff54ffff640 1 -- 172.21.15.19:0/2109498204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff558159a80 msgr2=0x7ff558159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:31.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff54ffff640 1 --2- 172.21.15.19:0/2109498204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff558159a80 0x7ff558159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff54ffff640 1 -- 172.21.15.19:0/2109498204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5440040a0 msgr2=0x7ff55815d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:31.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff54ffff640 1 --2- 172.21.15.19:0/2109498204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5440040a0 0x7ff55815d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff54ffff640 1 -- 172.21.15.19:0/2109498204 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55815d540 con 0x7ff558145710 2023-11-20T06:42:31.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff556d9d640 1 --2- 172.21.15.19:0/2109498204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff558159a80 0x7ff558159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:31.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff54ffff640 1 --2- 172.21.15.19:0/2109498204 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff558145710 0x7ff558145b90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff54001c7f0 tx=0x7ff544005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:31.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff54effd640 1 -- 172.21.15.19:0/2109498204 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff540004c00 con 0x7ff558145710 2023-11-20T06:42:31.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff54effd640 1 -- 172.21.15.19:0/2109498204 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff540004d60 con 0x7ff558145710 2023-11-20T06:42:31.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff54effd640 1 -- 172.21.15.19:0/2109498204 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5400072f0 con 0x7ff558145710 2023-11-20T06:42:31.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff55cc91640 1 -- 172.21.15.19:0/2109498204 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff558146570 con 0x7ff558145710 2023-11-20T06:42:31.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff55cc91640 1 -- 172.21.15.19:0/2109498204 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5581f63b0 con 0x7ff558145710 2023-11-20T06:42:31.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff55cc91640 1 -- 172.21.15.19:0/2109498204 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff55815d6d0 con 0x7ff558145710 2023-11-20T06:42:31.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.611+0000 7ff54effd640 1 -- 172.21.15.19:0/2109498204 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff540007450 con 0x7ff558145710 2023-11-20T06:42:31.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.615+0000 7ff54effd640 1 --2- 172.21.15.19:0/2109498204 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff5380664d0 0x7ff538068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:31.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.615+0000 7ff54effd640 1 -- 172.21.15.19:0/2109498204 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff54011d920 con 0x7ff558145710 2023-11-20T06:42:31.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.615+0000 7ff55659c640 1 --2- 172.21.15.19:0/2109498204 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff5380664d0 0x7ff538068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:31.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.615+0000 7ff55659c640 1 --2- 172.21.15.19:0/2109498204 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff5380664d0 0x7ff538068990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff548000f00 tx=0x7ff548009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:31.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.619+0000 7ff54effd640 1 -- 172.21.15.19:0/2109498204 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff5400ea940 con 0x7ff558145710 2023-11-20T06:42:31.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.811+0000 7ff55cc91640 1 -- 172.21.15.19:0/2109498204 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff558074010 con 0x7ff558145710 2023-11-20T06:42:31.815 INFO:tasks.ceph.mon.a.smithi019.stderr:2023-11-20T06:42:31.811+0000 7f6bb0e90640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-20T06:42:31.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.815+0000 7ff54effd640 1 -- 172.21.15.19:0/2109498204 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff540001be0 con 0x7ff558145710 2023-11-20T06:42:31.819 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-20T06:42:31.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.815+0000 7ff55cc91640 1 -- 172.21.15.19:0/2109498204 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff5380664d0 msgr2=0x7ff538068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:31.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.815+0000 7ff55cc91640 1 --2- 172.21.15.19:0/2109498204 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff5380664d0 0x7ff538068990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff548000f00 tx=0x7ff548009040 comp rx=0 tx=0).stop 2023-11-20T06:42:31.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.815+0000 7ff55cc91640 1 -- 172.21.15.19:0/2109498204 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff558145710 msgr2=0x7ff558145b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:31.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.815+0000 7ff55cc91640 1 --2- 172.21.15.19:0/2109498204 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff558145710 0x7ff558145b90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff54001c7f0 tx=0x7ff544005800 comp rx=0 tx=0).stop 2023-11-20T06:42:31.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.815+0000 7ff55cc91640 1 -- 172.21.15.19:0/2109498204 shutdown_connections 2023-11-20T06:42:31.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.815+0000 7ff55cc91640 1 --2- 172.21.15.19:0/2109498204 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff5380664d0 0x7ff538068990 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.815+0000 7ff55cc91640 1 --2- 172.21.15.19:0/2109498204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff558159a80 0x7ff558159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.815+0000 7ff55cc91640 1 --2- 172.21.15.19:0/2109498204 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff558145710 0x7ff558145b90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.815+0000 7ff55cc91640 1 --2- 172.21.15.19:0/2109498204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5440040a0 0x7ff55815d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.815+0000 7ff55cc91640 1 -- 172.21.15.19:0/2109498204 >> 172.21.15.19:0/2109498204 conn(0x7ff55809bc50 msgr2=0x7ff5580b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:31.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.815+0000 7ff55cc91640 1 -- 172.21.15.19:0/2109498204 shutdown_connections 2023-11-20T06:42:31.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.815+0000 7ff55cc91640 1 -- 172.21.15.19:0/2109498204 wait complete. 2023-11-20T06:42:31.831 INFO:tasks.ceph.mds.c.smithi019.stderr: -4497> 2023-11-20T06:41:18.072+0000 7fd251d55640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-20T06:42:31.843 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-20T06:42:31.879 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2023-11-20T06:42:31.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.987+0000 7f435f3d3640 1 Processor -- start 2023-11-20T06:42:31.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.987+0000 7f435f3d3640 1 -- start start 2023-11-20T06:42:31.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.987+0000 7f435f3d3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f435806f560 0x7f43580c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:31.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.987+0000 7f435f3d3640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f435815cf40 0x7f4358071400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:31.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.987+0000 7f435f3d3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435806ac10 con 0x7f435815cb60 2023-11-20T06:42:31.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.987+0000 7f435f3d3640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43580723f0 con 0x7f435815cf40 2023-11-20T06:42:31.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.987+0000 7f435f3d3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4358072110 con 0x7f435806f560 2023-11-20T06:42:31.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.987+0000 7f435c96e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f435806f560 0x7f43580c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:31.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.987+0000 7f435d970640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f435815cf40 0x7f4358071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:31.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.987+0000 7f435c96e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f435806f560 0x7f43580c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:45054/0 (socket says 172.21.15.19:45054) 2023-11-20T06:42:31.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.987+0000 7f435c96e640 1 -- 172.21.15.19:0/450616519 learned_addr learned my addr 172.21.15.19:0/450616519 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:31.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.987+0000 7f435d16f640 1 --1- 172.21.15.19:0/450616519 >> v1:172.21.15.190:6789/0 conn(0x7f435815cb60 0x7f435806ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:41712/0 (socket says 172.21.15.19:41712) 2023-11-20T06:42:31.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.987+0000 7f435c96e640 1 -- 172.21.15.19:0/450616519 >> v2:172.21.15.190:3300/0 conn(0x7f435815cf40 msgr2=0x7f4358071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:31.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.987+0000 7f434ffff640 1 -- 172.21.15.19:0/450616519 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190309410 0 0) 0x7f435806ac10 con 0x7f435815cb60 2023-11-20T06:42:31.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.987+0000 7f435c96e640 1 --2- 172.21.15.19:0/450616519 >> v2:172.21.15.190:3300/0 conn(0x7f435815cf40 0x7f4358071400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.987+0000 7f435c96e640 1 -- 172.21.15.19:0/450616519 >> v1:172.21.15.190:6789/0 conn(0x7f435815cb60 legacy=0x7f435806ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:31.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.987+0000 7f435c96e640 1 -- 172.21.15.19:0/450616519 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435806a5c0 con 0x7f435806f560 2023-11-20T06:42:31.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.987+0000 7f435d970640 1 --2- 172.21.15.19:0/450616519 >> v2:172.21.15.190:3300/0 conn(0x7f435815cf40 0x7f4358071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:42:31.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.991+0000 7f435c96e640 1 --2- 172.21.15.19:0/450616519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f435806f560 0x7f43580c9fd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4348009870 tx=0x7f434801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a0d95703b678976 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:31.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.991+0000 7f434ffff640 1 -- 172.21.15.19:0/450616519 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43480ab620 con 0x7f435806f560 2023-11-20T06:42:31.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.991+0000 7f434ffff640 1 -- 172.21.15.19:0/450616519 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43480ab780 con 0x7f435806f560 2023-11-20T06:42:31.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.991+0000 7f434ffff640 1 -- 172.21.15.19:0/450616519 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43480abb10 con 0x7f435806f560 2023-11-20T06:42:31.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.991+0000 7f435f3d3640 1 -- 172.21.15.19:0/450616519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f435806f560 msgr2=0x7f43580c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:31.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.991+0000 7f435f3d3640 1 --2- 172.21.15.19:0/450616519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f435806f560 0x7f43580c9fd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4348009870 tx=0x7f434801c510 comp rx=0 tx=0).stop 2023-11-20T06:42:31.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.991+0000 7f435f3d3640 1 -- 172.21.15.19:0/450616519 shutdown_connections 2023-11-20T06:42:31.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.991+0000 7f435f3d3640 1 --2- 172.21.15.19:0/450616519 >> v2:172.21.15.190:3300/0 conn(0x7f435815cf40 0x7f4358071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.991+0000 7f435f3d3640 1 --2- 172.21.15.19:0/450616519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f435806f560 0x7f43580c9fd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:31.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.991+0000 7f435f3d3640 1 -- 172.21.15.19:0/450616519 >> 172.21.15.19:0/450616519 conn(0x7f43580cf7a0 msgr2=0x7f43580cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:31.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.991+0000 7f435f3d3640 1 -- 172.21.15.19:0/450616519 shutdown_connections 2023-11-20T06:42:31.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.991+0000 7f435f3d3640 1 -- 172.21.15.19:0/450616519 wait complete. 2023-11-20T06:42:32.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435f3d3640 1 Processor -- start 2023-11-20T06:42:32.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435f3d3640 1 -- start start 2023-11-20T06:42:32.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435f3d3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f435806f560 0x7f43580c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:32.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435f3d3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f435815cb60 0x7f43580c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:32.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435f3d3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f435815cf40 0x7f43580b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:32.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435f3d3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43580b3410 con 0x7f435815cb60 2023-11-20T06:42:32.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435f3d3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43580b36f0 con 0x7f435806f560 2023-11-20T06:42:32.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435f3d3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43580b39d0 con 0x7f435815cf40 2023-11-20T06:42:32.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435c96e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f435815cb60 0x7f43580c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:32.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435c96e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f435815cb60 0x7f43580c6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59114/0 (socket says 172.21.15.19:59114) 2023-11-20T06:42:32.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435c96e640 1 -- 172.21.15.19:0/3107247359 learned_addr learned my addr 172.21.15.19:0/3107247359 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:32.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435d970640 1 --2- 172.21.15.19:0/3107247359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f435815cf40 0x7f43580b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:32.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435d16f640 1 --2- 172.21.15.19:0/3107247359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f435806f560 0x7f43580c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:32.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435c96e640 1 -- 172.21.15.19:0/3107247359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f435815cf40 msgr2=0x7f43580b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:32.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435c96e640 1 --2- 172.21.15.19:0/3107247359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f435815cf40 0x7f43580b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:32.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435c96e640 1 -- 172.21.15.19:0/3107247359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f435806f560 msgr2=0x7f43580c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:32.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435c96e640 1 --2- 172.21.15.19:0/3107247359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f435806f560 0x7f43580c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:32.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435c96e640 1 -- 172.21.15.19:0/3107247359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4350009a70 con 0x7f435815cb60 2023-11-20T06:42:32.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435c96e640 1 --2- 172.21.15.19:0/3107247359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f435815cb60 0x7f43580c6db0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f43480ad040 tx=0x7f434801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:32.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f434dffb640 1 -- 172.21.15.19:0/3107247359 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43480abe80 con 0x7f435815cb60 2023-11-20T06:42:32.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f434dffb640 1 -- 172.21.15.19:0/3107247359 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43480be3f0 con 0x7f435815cb60 2023-11-20T06:42:32.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435f3d3640 1 -- 172.21.15.19:0/3107247359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43480094d0 con 0x7f435815cb60 2023-11-20T06:42:32.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f434dffb640 1 -- 172.21.15.19:0/3107247359 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43480be780 con 0x7f435815cb60 2023-11-20T06:42:32.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.995+0000 7f435f3d3640 1 -- 172.21.15.19:0/3107247359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43580b3f90 con 0x7f435815cb60 2023-11-20T06:42:32.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.999+0000 7f435f3d3640 1 -- 172.21.15.19:0/3107247359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43580b4180 con 0x7f435815cb60 2023-11-20T06:42:32.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.999+0000 7f434dffb640 1 -- 172.21.15.19:0/3107247359 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f43480b43f0 con 0x7f435815cb60 2023-11-20T06:42:32.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.999+0000 7f434dffb640 1 --2- 172.21.15.19:0/3107247359 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f433c0664a0 0x7f433c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:32.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.999+0000 7f434dffb640 1 -- 172.21.15.19:0/3107247359 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f434811e8c0 con 0x7f435815cb60 2023-11-20T06:42:32.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.999+0000 7f435d16f640 1 --2- 172.21.15.19:0/3107247359 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f433c0664a0 0x7f433c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:32.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:31.999+0000 7f435d16f640 1 --2- 172.21.15.19:0/3107247359 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f433c0664a0 0x7f433c068960 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4354000f70 tx=0x7f4354007b60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:32.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:32.003+0000 7f434dffb640 1 -- 172.21.15.19:0/3107247359 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f43480eb890 con 0x7f435815cb60 2023-11-20T06:42:32.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:32.195+0000 7f435f3d3640 1 -- 172.21.15.19:0/3107247359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f435804e170 con 0x7f435815cb60 2023-11-20T06:42:32.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:32.815+0000 7f434dffb640 1 -- 172.21.15.19:0/3107247359 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f43480eeeb0 con 0x7f435815cb60 2023-11-20T06:42:32.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:32.819+0000 7f435f3d3640 1 -- 172.21.15.19:0/3107247359 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f433c0664a0 msgr2=0x7f433c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:32.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:32.819+0000 7f435f3d3640 1 --2- 172.21.15.19:0/3107247359 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f433c0664a0 0x7f433c068960 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4354000f70 tx=0x7f4354007b60 comp rx=0 tx=0).stop 2023-11-20T06:42:32.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:32.819+0000 7f435f3d3640 1 -- 172.21.15.19:0/3107247359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f435815cb60 msgr2=0x7f43580c6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:32.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:32.819+0000 7f435f3d3640 1 --2- 172.21.15.19:0/3107247359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f435815cb60 0x7f43580c6db0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f43480ad040 tx=0x7f434801ad50 comp rx=0 tx=0).stop 2023-11-20T06:42:32.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:32.819+0000 7f435f3d3640 1 -- 172.21.15.19:0/3107247359 shutdown_connections 2023-11-20T06:42:32.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:32.819+0000 7f435f3d3640 1 --2- 172.21.15.19:0/3107247359 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f433c0664a0 0x7f433c068960 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:32.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:32.819+0000 7f435f3d3640 1 --2- 172.21.15.19:0/3107247359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f435815cf40 0x7f43580b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:32.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:32.819+0000 7f435f3d3640 1 --2- 172.21.15.19:0/3107247359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f435815cb60 0x7f43580c6db0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:32.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:32.819+0000 7f435f3d3640 1 --2- 172.21.15.19:0/3107247359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f435806f560 0x7f43580c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:32.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:32.819+0000 7f435f3d3640 1 -- 172.21.15.19:0/3107247359 >> 172.21.15.19:0/3107247359 conn(0x7f43580cf7a0 msgr2=0x7f435815f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:32.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:32.819+0000 7f435f3d3640 1 -- 172.21.15.19:0/3107247359 shutdown_connections 2023-11-20T06:42:32.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:32.819+0000 7f435f3d3640 1 -- 172.21.15.19:0/3107247359 wait complete. 2023-11-20T06:42:32.847 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-20T06:42:33.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.031+0000 7f2629046640 1 Processor -- start 2023-11-20T06:42:33.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.031+0000 7f2629046640 1 -- start start 2023-11-20T06:42:33.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.035+0000 7f2629046640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f26240ccdb0 0x7f26240cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:33.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.035+0000 7f2629046640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26240cb940 con 0x7f2624153540 2023-11-20T06:42:33.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.035+0000 7f2629046640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2624159510 con 0x7f26240cb510 2023-11-20T06:42:33.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.035+0000 7f2629046640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2624159790 con 0x7f26240ccdb0 2023-11-20T06:42:33.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.035+0000 7f2622d9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2624153540 0x7f26240afaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39098/0 (socket says 172.21.15.19:39098) 2023-11-20T06:42:33.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.035+0000 7f2622d9d640 1 -- 172.21.15.19:0/3296825614 learned_addr learned my addr 172.21.15.19:0/3296825614 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:33.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.035+0000 7f261bfff640 1 --2- 172.21.15.19:0/3296825614 >> v2:172.21.15.19:3300/0 conn(0x7f26240ccdb0 0x7f26240cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:33.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.035+0000 7f262259c640 1 -- 172.21.15.19:0/3296825614 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702446123 0 0) 0x7f26240cb940 con 0x7f2624153540 2023-11-20T06:42:33.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.035+0000 7f262259c640 1 -- 172.21.15.19:0/3296825614 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2610003530 con 0x7f2624153540 2023-11-20T06:42:33.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.035+0000 7f261bfff640 1 -- 172.21.15.19:0/3296825614 >> v1:172.21.15.190:6789/0 conn(0x7f26240cb510 legacy=0x7f262415ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:33.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.035+0000 7f261bfff640 1 -- 172.21.15.19:0/3296825614 >> v1:172.21.15.19:6789/0 conn(0x7f2624153540 legacy=0x7f26240afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:33.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.035+0000 7f261bfff640 1 -- 172.21.15.19:0/3296825614 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2624159a70 con 0x7f26240ccdb0 2023-11-20T06:42:33.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.039+0000 7f261bfff640 1 --2- 172.21.15.19:0/3296825614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26240ccdb0 0x7f26240cafd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f260c0097c0 tx=0x7f260c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08669792ed619d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.039+0000 7f262259c640 1 -- 172.21.15.19:0/3296825614 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0ab600 con 0x7f26240ccdb0 2023-11-20T06:42:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.039+0000 7f262259c640 1 -- 172.21.15.19:0/3296825614 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c0a7050 con 0x7f26240ccdb0 2023-11-20T06:42:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.039+0000 7f262259c640 1 -- 172.21.15.19:0/3296825614 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0ab980 con 0x7f26240ccdb0 2023-11-20T06:42:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.039+0000 7f2629046640 1 -- 172.21.15.19:0/3296825614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26240ccdb0 msgr2=0x7f26240cafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.039+0000 7f2629046640 1 --2- 172.21.15.19:0/3296825614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26240ccdb0 0x7f26240cafd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f260c0097c0 tx=0x7f260c01c390 comp rx=0 tx=0).stop 2023-11-20T06:42:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.039+0000 7f2629046640 1 -- 172.21.15.19:0/3296825614 shutdown_connections 2023-11-20T06:42:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.039+0000 7f2629046640 1 --2- 172.21.15.19:0/3296825614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26240ccdb0 0x7f26240cafd0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:33.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.039+0000 7f2629046640 1 -- 172.21.15.19:0/3296825614 >> 172.21.15.19:0/3296825614 conn(0x7f262406a820 msgr2=0x7f26240b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:33.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.039+0000 7f2629046640 1 -- 172.21.15.19:0/3296825614 shutdown_connections 2023-11-20T06:42:33.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.039+0000 7f2629046640 1 -- 172.21.15.19:0/3296825614 wait complete. 2023-11-20T06:42:33.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.039+0000 7f2629046640 1 Processor -- start 2023-11-20T06:42:33.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.039+0000 7f2629046640 1 -- start start 2023-11-20T06:42:33.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f2629046640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26240cb510 0x7f2624148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:33.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f2629046640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26240ccdb0 0x7f26241489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:33.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f2629046640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2624153540 0x7f2624166ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:33.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f2629046640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26240701a0 con 0x7f26240cb510 2023-11-20T06:42:33.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f2629046640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262415b730 con 0x7f2624153540 2023-11-20T06:42:33.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f2629046640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262415ba10 con 0x7f26240ccdb0 2023-11-20T06:42:33.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f2622d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26240cb510 0x7f2624148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:33.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f2622d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26240cb510 0x7f2624148170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53410/0 (socket says 172.21.15.19:53410) 2023-11-20T06:42:33.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f2622d9d640 1 -- 172.21.15.19:0/1570358211 learned_addr learned my addr 172.21.15.19:0/1570358211 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:33.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f262359e640 1 --2- 172.21.15.19:0/1570358211 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2624153540 0x7f2624166ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:33.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f261bfff640 1 --2- 172.21.15.19:0/1570358211 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26240ccdb0 0x7f26241489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:33.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f2622d9d640 1 -- 172.21.15.19:0/1570358211 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26240ccdb0 msgr2=0x7f26241489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:33.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f2622d9d640 1 --2- 172.21.15.19:0/1570358211 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26240ccdb0 0x7f26241489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:33.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f2622d9d640 1 -- 172.21.15.19:0/1570358211 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2624153540 msgr2=0x7f2624166ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:33.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f2622d9d640 1 --2- 172.21.15.19:0/1570358211 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2624153540 0x7f2624166ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:33.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f2622d9d640 1 -- 172.21.15.19:0/1570358211 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c009420 con 0x7f26240cb510 2023-11-20T06:42:33.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f261bfff640 1 --2- 172.21.15.19:0/1570358211 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26240ccdb0 0x7f26241489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:33.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f262359e640 1 --2- 172.21.15.19:0/1570358211 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2624153540 0x7f2624166ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:33.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f2622d9d640 1 --2- 172.21.15.19:0/1570358211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26240cb510 0x7f2624148170 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f261400c420 tx=0x7f261400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:33.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f261b7fe640 1 -- 172.21.15.19:0/1570358211 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614005cf0 con 0x7f26240cb510 2023-11-20T06:42:33.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f261b7fe640 1 -- 172.21.15.19:0/1570358211 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2614005e50 con 0x7f26240cb510 2023-11-20T06:42:33.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f2629046640 1 -- 172.21.15.19:0/1570358211 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262415bcf0 con 0x7f26240cb510 2023-11-20T06:42:33.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f261b7fe640 1 -- 172.21.15.19:0/1570358211 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26140072d0 con 0x7f26240cb510 2023-11-20T06:42:33.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f2629046640 1 -- 172.21.15.19:0/1570358211 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262414d110 con 0x7f26240cb510 2023-11-20T06:42:33.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f2629046640 1 -- 172.21.15.19:0/1570358211 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2624070310 con 0x7f26240cb510 2023-11-20T06:42:33.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.043+0000 7f261b7fe640 1 -- 172.21.15.19:0/1570358211 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2614007450 con 0x7f26240cb510 2023-11-20T06:42:33.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.047+0000 7f261b7fe640 1 --2- 172.21.15.19:0/1570358211 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f26040664a0 0x7f2604068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:33.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.047+0000 7f261b7fe640 1 -- 172.21.15.19:0/1570358211 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f2614083850 con 0x7f26240cb510 2023-11-20T06:42:33.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.047+0000 7f261bfff640 1 --2- 172.21.15.19:0/1570358211 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f26040664a0 0x7f2604068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:33.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.047+0000 7f261bfff640 1 --2- 172.21.15.19:0/1570358211 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f26040664a0 0x7f2604068960 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f262406e7b0 tx=0x7f260c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:33.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.051+0000 7f261b7fe640 1 -- 172.21.15.19:0/1570358211 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f26140544a0 con 0x7f26240cb510 2023-11-20T06:42:33.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.207+0000 7f2629046640 1 -- 172.21.15.19:0/1570358211 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f262404e170 con 0x7f26240cb510 2023-11-20T06:42:33.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.819+0000 7f261b7fe640 1 -- 172.21.15.19:0/1570358211 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7f26140170d0 con 0x7f26240cb510 2023-11-20T06:42:33.824 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2023-11-20T06:42:33.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.823+0000 7f2629046640 1 -- 172.21.15.19:0/1570358211 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f26040664a0 msgr2=0x7f2604068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:33.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.823+0000 7f2629046640 1 --2- 172.21.15.19:0/1570358211 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f26040664a0 0x7f2604068960 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f262406e7b0 tx=0x7f260c008040 comp rx=0 tx=0).stop 2023-11-20T06:42:33.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.823+0000 7f2629046640 1 -- 172.21.15.19:0/1570358211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26240cb510 msgr2=0x7f2624148170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:33.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.823+0000 7f2629046640 1 --2- 172.21.15.19:0/1570358211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26240cb510 0x7f2624148170 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f261400c420 tx=0x7f261400c8e0 comp rx=0 tx=0).stop 2023-11-20T06:42:33.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.823+0000 7f2629046640 1 -- 172.21.15.19:0/1570358211 shutdown_connections 2023-11-20T06:42:33.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.823+0000 7f2629046640 1 --2- 172.21.15.19:0/1570358211 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f26040664a0 0x7f2604068960 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:33.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.823+0000 7f2629046640 1 --2- 172.21.15.19:0/1570358211 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2624153540 0x7f2624166ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:33.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.823+0000 7f2629046640 1 --2- 172.21.15.19:0/1570358211 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26240ccdb0 0x7f26241489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:33.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.823+0000 7f2629046640 1 --2- 172.21.15.19:0/1570358211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26240cb510 0x7f2624148170 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:33.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.823+0000 7f2629046640 1 -- 172.21.15.19:0/1570358211 >> 172.21.15.19:0/1570358211 conn(0x7f262406a820 msgr2=0x7f26240cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:33.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.823+0000 7f2629046640 1 -- 172.21.15.19:0/1570358211 shutdown_connections 2023-11-20T06:42:33.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:33.823+0000 7f2629046640 1 -- 172.21.15.19:0/1570358211 wait complete. 2023-11-20T06:42:33.856 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-20T06:42:34.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.003+0000 7f4de0f2a640 1 Processor -- start 2023-11-20T06:42:34.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.003+0000 7f4de0f2a640 1 -- start start 2023-11-20T06:42:34.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.003+0000 7f4de0f2a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4ddc159980 0x7f4ddc0b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:34.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.003+0000 7f4de0f2a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ddc06cbc0 0x7f4ddc0b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:34.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.003+0000 7f4de0f2a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ddc0c8a20 con 0x7f4ddc1595a0 2023-11-20T06:42:34.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.003+0000 7f4de0f2a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ddc15e300 con 0x7f4ddc159980 2023-11-20T06:42:34.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.003+0000 7f4de0f2a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc0c8c10 con 0x7f4ddc06cbc0 2023-11-20T06:42:34.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.003+0000 7f4dd9d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4ddc159980 0x7f4ddc0b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:34.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.003+0000 7f4dd9d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4ddc159980 0x7f4ddc0b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53422/0 (socket says 172.21.15.19:53422) 2023-11-20T06:42:34.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.003+0000 7f4dd9d9b640 1 -- 172.21.15.19:0/3639613728 learned_addr learned my addr 172.21.15.19:0/3639613728 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:34.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.003+0000 7f4ddad9d640 1 --2- 172.21.15.19:0/3639613728 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ddc06cbc0 0x7f4ddc0b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:34.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.003+0000 7f4dd9d9b640 1 -- 172.21.15.19:0/3639613728 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ddc06cbc0 msgr2=0x7f4ddc0b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:34.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.003+0000 7f4dd9d9b640 1 --2- 172.21.15.19:0/3639613728 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ddc06cbc0 0x7f4ddc0b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:34.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.003+0000 7f4dd9d9b640 1 -- 172.21.15.19:0/3639613728 >> v1:172.21.15.190:6789/0 conn(0x7f4ddc1595a0 legacy=0x7f4ddc06c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:34.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.003+0000 7f4dd9d9b640 1 -- 172.21.15.19:0/3639613728 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc0c8ef0 con 0x7f4ddc159980 2023-11-20T06:42:34.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.007+0000 7f4dd9d9b640 1 --2- 172.21.15.19:0/3639613728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ddc159980 0x7f4ddc0b3bc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0009870 tx=0x7f4dd001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85766e652ebbeca3 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:34.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.007+0000 7f4dd959a640 1 -- 172.21.15.19:0/3639613728 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd00ac600 con 0x7f4ddc159980 2023-11-20T06:42:34.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.007+0000 7f4dd959a640 1 -- 172.21.15.19:0/3639613728 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd00a8050 con 0x7f4ddc159980 2023-11-20T06:42:34.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.007+0000 7f4dd959a640 1 -- 172.21.15.19:0/3639613728 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd00ac980 con 0x7f4ddc159980 2023-11-20T06:42:34.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.007+0000 7f4de0f2a640 1 -- 172.21.15.19:0/3639613728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ddc159980 msgr2=0x7f4ddc0b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:34.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.007+0000 7f4de0f2a640 1 --2- 172.21.15.19:0/3639613728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ddc159980 0x7f4ddc0b3bc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0009870 tx=0x7f4dd001c4b0 comp rx=0 tx=0).stop 2023-11-20T06:42:34.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.007+0000 7f4de0f2a640 1 -- 172.21.15.19:0/3639613728 shutdown_connections 2023-11-20T06:42:34.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.007+0000 7f4de0f2a640 1 --2- 172.21.15.19:0/3639613728 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ddc06cbc0 0x7f4ddc0b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:34.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.007+0000 7f4de0f2a640 1 --2- 172.21.15.19:0/3639613728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ddc159980 0x7f4ddc0b3bc0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:34.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.007+0000 7f4de0f2a640 1 -- 172.21.15.19:0/3639613728 >> 172.21.15.19:0/3639613728 conn(0x7f4ddc06a820 msgr2=0x7f4ddc0b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:34.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.007+0000 7f4de0f2a640 1 -- 172.21.15.19:0/3639613728 shutdown_connections 2023-11-20T06:42:34.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.007+0000 7f4de0f2a640 1 -- 172.21.15.19:0/3639613728 wait complete. 2023-11-20T06:42:34.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4de0f2a640 1 Processor -- start 2023-11-20T06:42:34.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4de0f2a640 1 -- start start 2023-11-20T06:42:34.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4de0f2a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ddc06cbc0 0x7f4ddc14ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:34.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4de0f2a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ddc1595a0 0x7f4ddc0cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:34.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4de0f2a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ddc1541d0 0x7f4ddc154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:34.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4de0f2a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc0cc370 con 0x7f4ddc1541d0 2023-11-20T06:42:34.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4de0f2a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc14d480 con 0x7f4ddc06cbc0 2023-11-20T06:42:34.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4de0f2a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc14d760 con 0x7f4ddc1595a0 2023-11-20T06:42:34.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4ddad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ddc1541d0 0x7f4ddc154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:34.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4ddad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ddc1541d0 0x7f4ddc154660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53434/0 (socket says 172.21.15.19:53434) 2023-11-20T06:42:34.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4ddad9d640 1 -- 172.21.15.19:0/3411245006 learned_addr learned my addr 172.21.15.19:0/3411245006 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:34.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4dda59c640 1 --2- 172.21.15.19:0/3411245006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ddc06cbc0 0x7f4ddc14ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:34.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4dd9d9b640 1 --2- 172.21.15.19:0/3411245006 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ddc1595a0 0x7f4ddc0cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:34.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4ddad9d640 1 -- 172.21.15.19:0/3411245006 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ddc1595a0 msgr2=0x7f4ddc0cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:34.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4ddad9d640 1 --2- 172.21.15.19:0/3411245006 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ddc1595a0 0x7f4ddc0cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:34.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4ddad9d640 1 -- 172.21.15.19:0/3411245006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ddc06cbc0 msgr2=0x7f4ddc14ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:34.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4ddad9d640 1 --2- 172.21.15.19:0/3411245006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ddc06cbc0 0x7f4ddc14ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:34.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4ddad9d640 1 -- 172.21.15.19:0/3411245006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd00094d0 con 0x7f4ddc1541d0 2023-11-20T06:42:34.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4ddad9d640 1 --2- 172.21.15.19:0/3411245006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ddc1541d0 0x7f4ddc154660 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4007e40 tx=0x7f4dd400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:34.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4dcaffd640 1 -- 172.21.15.19:0/3411245006 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4014620 con 0x7f4ddc1541d0 2023-11-20T06:42:34.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4dcaffd640 1 -- 172.21.15.19:0/3411245006 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd400ee90 con 0x7f4ddc1541d0 2023-11-20T06:42:34.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4de0f2a640 1 -- 172.21.15.19:0/3411245006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ddc14da40 con 0x7f4ddc1541d0 2023-11-20T06:42:34.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4dcaffd640 1 -- 172.21.15.19:0/3411245006 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd40149e0 con 0x7f4ddc1541d0 2023-11-20T06:42:34.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4de0f2a640 1 -- 172.21.15.19:0/3411245006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc156c40 con 0x7f4ddc1541d0 2023-11-20T06:42:34.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.011+0000 7f4de0f2a640 1 -- 172.21.15.19:0/3411245006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ddc156e30 con 0x7f4ddc1541d0 2023-11-20T06:42:34.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.015+0000 7f4dcaffd640 1 -- 172.21.15.19:0/3411245006 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4dd4014b40 con 0x7f4ddc1541d0 2023-11-20T06:42:34.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.015+0000 7f4dcaffd640 1 --2- 172.21.15.19:0/3411245006 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4dbc0664a0 0x7f4dbc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:34.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.015+0000 7f4dcaffd640 1 -- 172.21.15.19:0/3411245006 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f4dd4084af0 con 0x7f4ddc1541d0 2023-11-20T06:42:34.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.015+0000 7f4dda59c640 1 --2- 172.21.15.19:0/3411245006 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4dbc0664a0 0x7f4dbc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:34.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.015+0000 7f4dda59c640 1 --2- 172.21.15.19:0/3411245006 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4dbc0664a0 0x7f4dbc068960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc0b0800 tx=0x7f4dcc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:34.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.019+0000 7f4dcaffd640 1 -- 172.21.15.19:0/3411245006 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4dd4051d00 con 0x7f4ddc1541d0 2023-11-20T06:42:34.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.179+0000 7f4de0f2a640 1 -- 172.21.15.19:0/3411245006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4ddc04e170 con 0x7f4ddc1541d0 2023-11-20T06:42:34.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.819+0000 7f4dcaffd640 1 -- 172.21.15.19:0/3411245006 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4dd4055320 con 0x7f4ddc1541d0 2023-11-20T06:42:34.826 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2023-11-20T06:42:34.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.823+0000 7f4de0f2a640 1 -- 172.21.15.19:0/3411245006 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4dbc0664a0 msgr2=0x7f4dbc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:34.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.823+0000 7f4de0f2a640 1 --2- 172.21.15.19:0/3411245006 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4dbc0664a0 0x7f4dbc068960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc0b0800 tx=0x7f4dcc009040 comp rx=0 tx=0).stop 2023-11-20T06:42:34.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.823+0000 7f4de0f2a640 1 -- 172.21.15.19:0/3411245006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ddc1541d0 msgr2=0x7f4ddc154660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:34.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.823+0000 7f4de0f2a640 1 --2- 172.21.15.19:0/3411245006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ddc1541d0 0x7f4ddc154660 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4007e40 tx=0x7f4dd400e4b0 comp rx=0 tx=0).stop 2023-11-20T06:42:34.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.823+0000 7f4de0f2a640 1 -- 172.21.15.19:0/3411245006 shutdown_connections 2023-11-20T06:42:34.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.823+0000 7f4de0f2a640 1 --2- 172.21.15.19:0/3411245006 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4dbc0664a0 0x7f4dbc068960 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:34.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.823+0000 7f4de0f2a640 1 --2- 172.21.15.19:0/3411245006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ddc1541d0 0x7f4ddc154660 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:34.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.823+0000 7f4de0f2a640 1 --2- 172.21.15.19:0/3411245006 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ddc1595a0 0x7f4ddc0cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:34.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.823+0000 7f4de0f2a640 1 --2- 172.21.15.19:0/3411245006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ddc06cbc0 0x7f4ddc14ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:34.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.823+0000 7f4de0f2a640 1 -- 172.21.15.19:0/3411245006 >> 172.21.15.19:0/3411245006 conn(0x7f4ddc06a820 msgr2=0x7f4ddc0b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:34.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.823+0000 7f4de0f2a640 1 -- 172.21.15.19:0/3411245006 shutdown_connections 2023-11-20T06:42:34.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.823+0000 7f4de0f2a640 1 -- 172.21.15.19:0/3411245006 wait complete. 2023-11-20T06:42:34.856 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-11-20T06:42:35.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.999+0000 7f428d217640 1 Processor -- start 2023-11-20T06:42:35.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.999+0000 7f428d217640 1 -- start start 2023-11-20T06:42:35.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.999+0000 7f428d217640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f42880d2570 0x7f4288161210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:35.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.999+0000 7f428d217640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f42880cdc80 0x7f42880cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:35.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.999+0000 7f428d217640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f428815dec0 0x7f42880cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:35.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.999+0000 7f428d217640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42880cd830 con 0x7f42880d2570 2023-11-20T06:42:35.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.999+0000 7f428d217640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42880ce460 con 0x7f42880cdc80 2023-11-20T06:42:35.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.999+0000 7f428d217640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428815da30 con 0x7f428815dec0 2023-11-20T06:42:35.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.999+0000 7f4286d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f42880d2570 0x7f4288161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:35.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.999+0000 7f4286d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f42880d2570 0x7f4288161210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53440/0 (socket says 172.21.15.19:53440) 2023-11-20T06:42:35.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.999+0000 7f4286d9d640 1 -- 172.21.15.19:0/515532710 learned_addr learned my addr 172.21.15.19:0/515532710 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:35.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.999+0000 7f428759e640 1 --2- 172.21.15.19:0/515532710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f428815dec0 0x7f42880cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:35.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.999+0000 7f427ffff640 1 --2- 172.21.15.19:0/515532710 >> v2:172.21.15.190:3300/0 conn(0x7f42880cdc80 0x7f42880cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:35.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.999+0000 7f4286d9d640 1 -- 172.21.15.19:0/515532710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f428815dec0 msgr2=0x7f42880cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:35.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.999+0000 7f4286d9d640 1 --2- 172.21.15.19:0/515532710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f428815dec0 0x7f42880cfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:35.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.999+0000 7f4286d9d640 1 -- 172.21.15.19:0/515532710 >> v2:172.21.15.190:3300/0 conn(0x7f42880cdc80 msgr2=0x7f42880cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:35.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.999+0000 7f4286d9d640 1 --2- 172.21.15.19:0/515532710 >> v2:172.21.15.190:3300/0 conn(0x7f42880cdc80 0x7f42880cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:35.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.999+0000 7f4286d9d640 1 -- 172.21.15.19:0/515532710 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4288161750 con 0x7f42880d2570 2023-11-20T06:42:35.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.999+0000 7f427ffff640 1 --2- 172.21.15.19:0/515532710 >> v2:172.21.15.190:3300/0 conn(0x7f42880cdc80 0x7f42880cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:35.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:34.999+0000 7f428759e640 1 --2- 172.21.15.19:0/515532710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f428815dec0 0x7f42880cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:35.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.003+0000 7f4286d9d640 1 --2- 172.21.15.19:0/515532710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42880d2570 0x7f4288161210 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f42880664e0 tx=0x7f427801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3956e8260c17e9f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:35.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.003+0000 7f428659c640 1 -- 172.21.15.19:0/515532710 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780ab600 con 0x7f42880d2570 2023-11-20T06:42:35.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.003+0000 7f428659c640 1 -- 172.21.15.19:0/515532710 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42780ab760 con 0x7f42880d2570 2023-11-20T06:42:35.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.003+0000 7f428659c640 1 -- 172.21.15.19:0/515532710 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780abaf0 con 0x7f42880d2570 2023-11-20T06:42:35.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.003+0000 7f428d217640 1 -- 172.21.15.19:0/515532710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42880d2570 msgr2=0x7f4288161210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:35.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.003+0000 7f428d217640 1 --2- 172.21.15.19:0/515532710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42880d2570 0x7f4288161210 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f42880664e0 tx=0x7f427801c440 comp rx=0 tx=0).stop 2023-11-20T06:42:35.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.003+0000 7f428d217640 1 -- 172.21.15.19:0/515532710 shutdown_connections 2023-11-20T06:42:35.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.003+0000 7f428d217640 1 --2- 172.21.15.19:0/515532710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f428815dec0 0x7f42880cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:35.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.003+0000 7f428d217640 1 --2- 172.21.15.19:0/515532710 >> v2:172.21.15.190:3300/0 conn(0x7f42880cdc80 0x7f42880cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:35.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.003+0000 7f428d217640 1 --2- 172.21.15.19:0/515532710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42880d2570 0x7f4288161210 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:35.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.003+0000 7f428d217640 1 -- 172.21.15.19:0/515532710 >> 172.21.15.19:0/515532710 conn(0x7f42880715c0 msgr2=0x7f42880719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:35.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.003+0000 7f428d217640 1 -- 172.21.15.19:0/515532710 shutdown_connections 2023-11-20T06:42:35.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.003+0000 7f428d217640 1 -- 172.21.15.19:0/515532710 wait complete. 2023-11-20T06:42:35.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.007+0000 7f428d217640 1 Processor -- start 2023-11-20T06:42:35.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.007+0000 7f428d217640 1 -- start start 2023-11-20T06:42:35.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.007+0000 7f428d217640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42880cdc80 0x7f42880c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:35.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.007+0000 7f428d217640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42880d2570 0x7f4288150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:35.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.007+0000 7f428d217640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f428815dec0 0x7f428815f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:35.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.007+0000 7f428d217640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42880c7940 con 0x7f42880cdc80 2023-11-20T06:42:35.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.007+0000 7f428d217640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42880c8510 con 0x7f42880d2570 2023-11-20T06:42:35.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.007+0000 7f428d217640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42880c6cc0 con 0x7f428815dec0 2023-11-20T06:42:35.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.007+0000 7f4286d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42880cdc80 0x7f42880c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:35.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.007+0000 7f4286d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42880cdc80 0x7f42880c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53448/0 (socket says 172.21.15.19:53448) 2023-11-20T06:42:35.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.007+0000 7f4286d9d640 1 -- 172.21.15.19:0/1328775781 learned_addr learned my addr 172.21.15.19:0/1328775781 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:35.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.007+0000 7f428759e640 1 --2- 172.21.15.19:0/1328775781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f428815dec0 0x7f428815f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:35.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.007+0000 7f427ffff640 1 --2- 172.21.15.19:0/1328775781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42880d2570 0x7f4288150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:35.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.007+0000 7f4286d9d640 1 -- 172.21.15.19:0/1328775781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f428815dec0 msgr2=0x7f428815f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:35.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.007+0000 7f4286d9d640 1 --2- 172.21.15.19:0/1328775781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f428815dec0 0x7f428815f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:35.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.007+0000 7f4286d9d640 1 -- 172.21.15.19:0/1328775781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42880d2570 msgr2=0x7f4288150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:35.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.007+0000 7f4286d9d640 1 --2- 172.21.15.19:0/1328775781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42880d2570 0x7f4288150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:35.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.007+0000 7f4286d9d640 1 -- 172.21.15.19:0/1328775781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42780094d0 con 0x7f42880cdc80 2023-11-20T06:42:35.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.007+0000 7f4286d9d640 1 --2- 172.21.15.19:0/1328775781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42880cdc80 0x7f42880c8870 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f427801cce0 tx=0x7f427801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:35.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.007+0000 7f427f7fe640 1 -- 172.21.15.19:0/1328775781 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780b4800 con 0x7f42880cdc80 2023-11-20T06:42:35.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.011+0000 7f427f7fe640 1 -- 172.21.15.19:0/1328775781 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42780b4980 con 0x7f42880cdc80 2023-11-20T06:42:35.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.011+0000 7f427f7fe640 1 -- 172.21.15.19:0/1328775781 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780b4d30 con 0x7f42880cdc80 2023-11-20T06:42:35.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.011+0000 7f428d217640 1 -- 172.21.15.19:0/1328775781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42880c6fa0 con 0x7f42880cdc80 2023-11-20T06:42:35.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.011+0000 7f428d217640 1 -- 172.21.15.19:0/1328775781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42880c7560 con 0x7f42880cdc80 2023-11-20T06:42:35.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.011+0000 7f428d217640 1 -- 172.21.15.19:0/1328775781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42880c7a80 con 0x7f42880cdc80 2023-11-20T06:42:35.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.011+0000 7f427f7fe640 1 -- 172.21.15.19:0/1328775781 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f42780c7440 con 0x7f42880cdc80 2023-11-20T06:42:35.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.011+0000 7f427f7fe640 1 --2- 172.21.15.19:0/1328775781 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f42680664a0 0x7f4268068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:35.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.011+0000 7f427f7fe640 1 -- 172.21.15.19:0/1328775781 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f427811eaa0 con 0x7f42880cdc80 2023-11-20T06:42:35.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.011+0000 7f427ffff640 1 --2- 172.21.15.19:0/1328775781 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f42680664a0 0x7f4268068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:35.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.015+0000 7f427ffff640 1 --2- 172.21.15.19:0/1328775781 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f42680664a0 0x7f4268068960 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f42880c7e60 tx=0x7f4270008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.015+0000 7f427f7fe640 1 -- 172.21.15.19:0/1328775781 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f42880c7a80 con 0x7f42880cdc80 2023-11-20T06:42:35.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.183+0000 7f428d217640 1 -- 172.21.15.19:0/1328775781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f42880c7a80 con 0x7f42880cdc80 2023-11-20T06:42:35.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.835+0000 7f427f7fe640 1 -- 172.21.15.19:0/1328775781 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7f42880c7a80 con 0x7f42880cdc80 2023-11-20T06:42:35.841 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data_ec' removed 2023-11-20T06:42:35.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.839+0000 7f428d217640 1 -- 172.21.15.19:0/1328775781 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f42680664a0 msgr2=0x7f4268068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:35.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.839+0000 7f428d217640 1 --2- 172.21.15.19:0/1328775781 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f42680664a0 0x7f4268068960 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f42880c7e60 tx=0x7f4270008040 comp rx=0 tx=0).stop 2023-11-20T06:42:35.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.839+0000 7f428d217640 1 -- 172.21.15.19:0/1328775781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42880cdc80 msgr2=0x7f42880c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:35.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.839+0000 7f428d217640 1 --2- 172.21.15.19:0/1328775781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42880cdc80 0x7f42880c8870 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f427801cce0 tx=0x7f427801ac80 comp rx=0 tx=0).stop 2023-11-20T06:42:35.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.839+0000 7f428d217640 1 -- 172.21.15.19:0/1328775781 shutdown_connections 2023-11-20T06:42:35.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.839+0000 7f428d217640 1 --2- 172.21.15.19:0/1328775781 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f42680664a0 0x7f4268068960 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:35.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.839+0000 7f428d217640 1 --2- 172.21.15.19:0/1328775781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f428815dec0 0x7f428815f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:35.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.839+0000 7f428d217640 1 --2- 172.21.15.19:0/1328775781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42880d2570 0x7f4288150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:35.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.839+0000 7f428d217640 1 --2- 172.21.15.19:0/1328775781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42880cdc80 0x7f42880c8870 secure :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f427801cce0 tx=0x7f427801ac80 comp rx=0 tx=0).stop 2023-11-20T06:42:35.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.839+0000 7f428d217640 1 -- 172.21.15.19:0/1328775781 >> 172.21.15.19:0/1328775781 conn(0x7f42880715c0 msgr2=0x7f4288159a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:35.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.839+0000 7f428d217640 1 -- 172.21.15.19:0/1328775781 shutdown_connections 2023-11-20T06:42:35.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:35.839+0000 7f428d217640 1 -- 172.21.15.19:0/1328775781 wait complete. 2023-11-20T06:42:35.869 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-20T06:42:35.869 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-20T06:42:35.869 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-20T06:42:35.869 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:42:35.869 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-20T06:42:35.869 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-20T06:42:35.870 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-20T06:42:35.870 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:42:35.870 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-20T06:42:35.870 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-20T06:42:35.870 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-20T06:42:35.870 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:42:35.870 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-20T06:42:35.871 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-20T06:42:35.871 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-20T06:42:35.871 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:42:35.885 INFO:tasks.ceph.mds.b:Stopped 2023-11-20T06:42:35.886 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-20T06:42:35.887 INFO:tasks.ceph.mds.d:Stopped 2023-11-20T06:42:35.887 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-20T06:42:35.888 INFO:tasks.ceph.mds.a:Stopped 2023-11-20T06:42:35.888 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-20T06:42:35.889 INFO:tasks.ceph.mds.c:Stopped 2023-11-20T06:42:35.889 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-20T06:42:35.931 INFO:tasks.ceph.mds.b:Started 2023-11-20T06:42:35.931 DEBUG:teuthology.parallel:result is None 2023-11-20T06:42:35.934 INFO:tasks.ceph.mds.d:Started 2023-11-20T06:42:35.934 DEBUG:teuthology.parallel:result is None 2023-11-20T06:42:35.938 INFO:tasks.ceph.mds.a:Started 2023-11-20T06:42:35.938 DEBUG:teuthology.parallel:result is None 2023-11-20T06:42:35.940 INFO:tasks.ceph.mds.c:Started 2023-11-20T06:42:35.940 DEBUG:teuthology.parallel:result is None 2023-11-20T06:42:35.940 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-20T06:42:36.028 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2023-11-20T06:42:36.031 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2023-11-20T06:42:36.036 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2023-11-20T06:42:36.039 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2023-11-20T06:42:36.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.095+0000 7feefcad6640 1 Processor -- start 2023-11-20T06:42:36.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.095+0000 7feefcad6640 1 -- start start 2023-11-20T06:42:36.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.095+0000 7feefcad6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feef815d690 0x7feef815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:36.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.095+0000 7feefcad6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef815be60 con 0x7feef80b07f0 2023-11-20T06:42:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.095+0000 7feefcad6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef815c1f0 con 0x7feef8070c40 2023-11-20T06:42:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.095+0000 7feefcad6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef815b3b0 con 0x7feef815d690 2023-11-20T06:42:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.095+0000 7feef5d9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7feef80b07f0 0x7feef8162480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39126/0 (socket says 172.21.15.19:39126) 2023-11-20T06:42:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.095+0000 7feef5d9b640 1 -- 172.21.15.19:0/2314720649 learned_addr learned my addr 172.21.15.19:0/2314720649 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.095+0000 7feef6d9d640 1 --2- 172.21.15.19:0/2314720649 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feef815d690 0x7feef815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.095+0000 7feef559a640 1 -- 172.21.15.19:0/2314720649 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205429312 0 0) 0x7feef815be60 con 0x7feef80b07f0 2023-11-20T06:42:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.095+0000 7feef559a640 1 -- 172.21.15.19:0/2314720649 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feee0003530 con 0x7feef80b07f0 2023-11-20T06:42:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.095+0000 7feef559a640 1 -- 172.21.15.19:0/2314720649 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1175443941 0 0) 0x7feef815c1f0 con 0x7feef8070c40 2023-11-20T06:42:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.095+0000 7feef6d9d640 1 -- 172.21.15.19:0/2314720649 >> v1:172.21.15.190:6789/0 conn(0x7feef8070c40 legacy=0x7feef80b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.095+0000 7feef6d9d640 1 -- 172.21.15.19:0/2314720649 >> v1:172.21.15.19:6789/0 conn(0x7feef80b07f0 legacy=0x7feef8162480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.095+0000 7feef6d9d640 1 -- 172.21.15.19:0/2314720649 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef8071020 con 0x7feef815d690 2023-11-20T06:42:36.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.099+0000 7feef6d9d640 1 --2- 172.21.15.19:0/2314720649 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feef815d690 0x7feef815ae70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feef0009dc0 tx=0x7feef001c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37f7934bddf134ad server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:36.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.099+0000 7feef559a640 1 -- 172.21.15.19:0/2314720649 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef00a5910 con 0x7feef815d690 2023-11-20T06:42:36.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.099+0000 7feef559a640 1 -- 172.21.15.19:0/2314720649 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef00a5a70 con 0x7feef815d690 2023-11-20T06:42:36.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.099+0000 7feef559a640 1 -- 172.21.15.19:0/2314720649 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef00a5e00 con 0x7feef815d690 2023-11-20T06:42:36.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.099+0000 7feefcad6640 1 -- 172.21.15.19:0/2314720649 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feef815d690 msgr2=0x7feef815ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:36.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.099+0000 7feefcad6640 1 --2- 172.21.15.19:0/2314720649 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feef815d690 0x7feef815ae70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feef0009dc0 tx=0x7feef001c850 comp rx=0 tx=0).stop 2023-11-20T06:42:36.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.099+0000 7feefcad6640 1 -- 172.21.15.19:0/2314720649 shutdown_connections 2023-11-20T06:42:36.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.099+0000 7feefcad6640 1 --2- 172.21.15.19:0/2314720649 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feef815d690 0x7feef815ae70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:36.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.099+0000 7feefcad6640 1 -- 172.21.15.19:0/2314720649 >> 172.21.15.19:0/2314720649 conn(0x7feef806c190 msgr2=0x7feef806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:36.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.099+0000 7feefcad6640 1 -- 172.21.15.19:0/2314720649 shutdown_connections 2023-11-20T06:42:36.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.099+0000 7feefcad6640 1 -- 172.21.15.19:0/2314720649 wait complete. 2023-11-20T06:42:36.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feefcad6640 1 Processor -- start 2023-11-20T06:42:36.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feefcad6640 1 -- start start 2023-11-20T06:42:36.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feefcad6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feef8070c40 0x7feef80b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:36.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feefcad6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feef80b07f0 0x7feef8146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:36.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feefcad6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feef815d690 0x7feef80ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:36.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feefcad6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef8148e80 con 0x7feef815d690 2023-11-20T06:42:36.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feefcad6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef8149160 con 0x7feef8070c40 2023-11-20T06:42:36.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feefcad6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef8149440 con 0x7feef80b07f0 2023-11-20T06:42:36.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feef6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feef815d690 0x7feef80ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:36.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feef6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feef815d690 0x7feef80ae570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53506/0 (socket says 172.21.15.19:53506) 2023-11-20T06:42:36.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feef6d9d640 1 -- 172.21.15.19:0/575376952 learned_addr learned my addr 172.21.15.19:0/575376952 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:36.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feef659c640 1 --2- 172.21.15.19:0/575376952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feef8070c40 0x7feef80b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:36.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feef5d9b640 1 --2- 172.21.15.19:0/575376952 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feef80b07f0 0x7feef8146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:36.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feef6d9d640 1 -- 172.21.15.19:0/575376952 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feef80b07f0 msgr2=0x7feef8146e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:36.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feef6d9d640 1 --2- 172.21.15.19:0/575376952 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feef80b07f0 0x7feef8146e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:36.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feef6d9d640 1 -- 172.21.15.19:0/575376952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feef8070c40 msgr2=0x7feef80b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:36.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feef6d9d640 1 --2- 172.21.15.19:0/575376952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feef8070c40 0x7feef80b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:36.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feef6d9d640 1 -- 172.21.15.19:0/575376952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef0009a70 con 0x7feef815d690 2023-11-20T06:42:36.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feef6d9d640 1 --2- 172.21.15.19:0/575376952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feef815d690 0x7feef80ae570 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7feef00b0040 tx=0x7feef00195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:36.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feee6ffd640 1 -- 172.21.15.19:0/575376952 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0003ba0 con 0x7feef815d690 2023-11-20T06:42:36.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feee6ffd640 1 -- 172.21.15.19:0/575376952 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef0003d20 con 0x7feef815d690 2023-11-20T06:42:36.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feefcad6640 1 -- 172.21.15.19:0/575376952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef8149720 con 0x7feef815d690 2023-11-20T06:42:36.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feee6ffd640 1 -- 172.21.15.19:0/575376952 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef00ad890 con 0x7feef815d690 2023-11-20T06:42:36.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.103+0000 7feefcad6640 1 -- 172.21.15.19:0/575376952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef80b2ff0 con 0x7feef815d690 2023-11-20T06:42:36.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.107+0000 7feefcad6640 1 -- 172.21.15.19:0/575376952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef8074010 con 0x7feef815d690 2023-11-20T06:42:36.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.107+0000 7feee6ffd640 1 -- 172.21.15.19:0/575376952 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7feef00b4050 con 0x7feef815d690 2023-11-20T06:42:36.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.107+0000 7feee6ffd640 1 --2- 172.21.15.19:0/575376952 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feed80664a0 0x7feed8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:36.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.107+0000 7feee6ffd640 1 -- 172.21.15.19:0/575376952 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5263+0+0 (secure 0 0 0) 0x7feef011e380 con 0x7feef815d690 2023-11-20T06:42:36.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.107+0000 7feef659c640 1 --2- 172.21.15.19:0/575376952 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feed80664a0 0x7feed8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:36.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.111+0000 7feef659c640 1 --2- 172.21.15.19:0/575376952 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feed80664a0 0x7feed8068960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7feee8007fd0 tx=0x7feee8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:36.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.111+0000 7feee6ffd640 1 -- 172.21.15.19:0/575376952 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7feef00ebb00 con 0x7feef815d690 2023-11-20T06:42:36.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.279+0000 7feefcad6640 1 -- 172.21.15.19:0/575376952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7feef80cef90 con 0x7feef815d690 2023-11-20T06:42:36.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.851+0000 7feee6ffd640 1 -- 172.21.15.19:0/575376952 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7feef00ef120 con 0x7feef815d690 2023-11-20T06:42:36.857 INFO:teuthology.orchestra.run.smithi019.stderr: removed all blocklist entries 2023-11-20T06:42:36.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.855+0000 7feefcad6640 1 -- 172.21.15.19:0/575376952 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feed80664a0 msgr2=0x7feed8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:36.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.855+0000 7feefcad6640 1 --2- 172.21.15.19:0/575376952 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feed80664a0 0x7feed8068960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7feee8007fd0 tx=0x7feee8009040 comp rx=0 tx=0).stop 2023-11-20T06:42:36.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.855+0000 7feefcad6640 1 -- 172.21.15.19:0/575376952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feef815d690 msgr2=0x7feef80ae570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.855+0000 7feefcad6640 1 --2- 172.21.15.19:0/575376952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feef815d690 0x7feef80ae570 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7feef00b0040 tx=0x7feef00195f0 comp rx=0 tx=0).stop 2023-11-20T06:42:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.855+0000 7feefcad6640 1 -- 172.21.15.19:0/575376952 shutdown_connections 2023-11-20T06:42:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.855+0000 7feefcad6640 1 --2- 172.21.15.19:0/575376952 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feed80664a0 0x7feed8068960 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.855+0000 7feefcad6640 1 --2- 172.21.15.19:0/575376952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feef815d690 0x7feef80ae570 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.855+0000 7feefcad6640 1 --2- 172.21.15.19:0/575376952 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feef80b07f0 0x7feef8146e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.855+0000 7feefcad6640 1 --2- 172.21.15.19:0/575376952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feef8070c40 0x7feef80b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.855+0000 7feefcad6640 1 -- 172.21.15.19:0/575376952 >> 172.21.15.19:0/575376952 conn(0x7feef806c190 msgr2=0x7feef8150540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.855+0000 7feefcad6640 1 -- 172.21.15.19:0/575376952 shutdown_connections 2023-11-20T06:42:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:36.855+0000 7feefcad6640 1 -- 172.21.15.19:0/575376952 wait complete. 2023-11-20T06:42:36.886 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-20T06:42:37.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.027+0000 7fbbc4046640 1 Processor -- start 2023-11-20T06:42:37.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.027+0000 7fbbc4046640 1 -- start start 2023-11-20T06:42:37.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.027+0000 7fbbc4046640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbbbc0b2ad0 0x7fbbbc06b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:37.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.027+0000 7fbbc4046640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbbc06d000 con 0x7fbbbc15cf90 2023-11-20T06:42:37.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.027+0000 7fbbc4046640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbbc15d4e0 con 0x7fbbbc0ce310 2023-11-20T06:42:37.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.027+0000 7fbbc4046640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbbc160580 con 0x7fbbbc0b2ad0 2023-11-20T06:42:37.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.027+0000 7fbbc15e1640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbbbc15cf90 0x7fbbbc06c8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39130/0 (socket says 172.21.15.19:39130) 2023-11-20T06:42:37.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.027+0000 7fbbc15e1640 1 -- 172.21.15.19:0/3760771796 learned_addr learned my addr 172.21.15.19:0/3760771796 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:37.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.027+0000 7fbbc1de2640 1 --2- 172.21.15.19:0/3760771796 >> v2:172.21.15.190:3300/0 conn(0x7fbbbc0b2ad0 0x7fbbbc06b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:37.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.027+0000 7fbbc0de0640 1 -- 172.21.15.19:0/3760771796 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928401604 0 0) 0x7fbbbc06d000 con 0x7fbbbc15cf90 2023-11-20T06:42:37.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.027+0000 7fbbc0de0640 1 -- 172.21.15.19:0/3760771796 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbba8003530 con 0x7fbbbc15cf90 2023-11-20T06:42:37.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.031+0000 7fbbc1de2640 1 -- 172.21.15.19:0/3760771796 >> v1:172.21.15.190:6789/0 conn(0x7fbbbc0ce310 legacy=0x7fbbbc1609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:37.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.031+0000 7fbbc1de2640 1 -- 172.21.15.19:0/3760771796 >> v1:172.21.15.19:6789/0 conn(0x7fbbbc15cf90 legacy=0x7fbbbc06c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:37.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.031+0000 7fbbc1de2640 1 -- 172.21.15.19:0/3760771796 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbbc15d7c0 con 0x7fbbbc0b2ad0 2023-11-20T06:42:37.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.031+0000 7fbbc1de2640 1 --2- 172.21.15.19:0/3760771796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbbc0b2ad0 0x7fbbbc06b4b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80097f0 tx=0x7fbbb801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3efe5d485f796cf server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:37.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.031+0000 7fbbc0de0640 1 -- 172.21.15.19:0/3760771796 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80ad660 con 0x7fbbbc0b2ad0 2023-11-20T06:42:37.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.031+0000 7fbbc0de0640 1 -- 172.21.15.19:0/3760771796 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb80ad7c0 con 0x7fbbbc0b2ad0 2023-11-20T06:42:37.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.031+0000 7fbbc0de0640 1 -- 172.21.15.19:0/3760771796 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80adb50 con 0x7fbbbc0b2ad0 2023-11-20T06:42:37.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.031+0000 7fbbc4046640 1 -- 172.21.15.19:0/3760771796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbbc0b2ad0 msgr2=0x7fbbbc06b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:37.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.031+0000 7fbbc4046640 1 --2- 172.21.15.19:0/3760771796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbbc0b2ad0 0x7fbbbc06b4b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80097f0 tx=0x7fbbb801c450 comp rx=0 tx=0).stop 2023-11-20T06:42:37.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.031+0000 7fbbc4046640 1 -- 172.21.15.19:0/3760771796 shutdown_connections 2023-11-20T06:42:37.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.031+0000 7fbbc4046640 1 --2- 172.21.15.19:0/3760771796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbbc0b2ad0 0x7fbbbc06b4b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.031+0000 7fbbc4046640 1 -- 172.21.15.19:0/3760771796 >> 172.21.15.19:0/3760771796 conn(0x7fbbbc0cd1c0 msgr2=0x7fbbbc0cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:37.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc4046640 1 -- 172.21.15.19:0/3760771796 shutdown_connections 2023-11-20T06:42:37.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc4046640 1 -- 172.21.15.19:0/3760771796 wait complete. 2023-11-20T06:42:37.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc4046640 1 Processor -- start 2023-11-20T06:42:37.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc4046640 1 -- start start 2023-11-20T06:42:37.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc4046640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbbc0b2ad0 0x7fbbbc0c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:37.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc4046640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbbc0ce310 0x7fbbbc157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:37.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc4046640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbbc15cf90 0x7fbbbc0b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:37.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc4046640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbbc156ad0 con 0x7fbbbc0ce310 2023-11-20T06:42:37.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc4046640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbbc0b1f00 con 0x7fbbbc15cf90 2023-11-20T06:42:37.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc4046640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbbc0b21e0 con 0x7fbbbc0b2ad0 2023-11-20T06:42:37.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc15e1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbbc0ce310 0x7fbbbc157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:37.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc15e1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbbc0ce310 0x7fbbbc157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53520/0 (socket says 172.21.15.19:53520) 2023-11-20T06:42:37.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc15e1640 1 -- 172.21.15.19:0/755394137 learned_addr learned my addr 172.21.15.19:0/755394137 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:37.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc1de2640 1 --2- 172.21.15.19:0/755394137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbbc0b2ad0 0x7fbbbc0c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:37.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc25e3640 1 --2- 172.21.15.19:0/755394137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbbc15cf90 0x7fbbbc0b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc15e1640 1 -- 172.21.15.19:0/755394137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbbc0b2ad0 msgr2=0x7fbbbc0c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc15e1640 1 --2- 172.21.15.19:0/755394137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbbc0b2ad0 0x7fbbbc0c6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc15e1640 1 -- 172.21.15.19:0/755394137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbbc15cf90 msgr2=0x7fbbbc0b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc15e1640 1 --2- 172.21.15.19:0/755394137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbbc15cf90 0x7fbbbc0b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc15e1640 1 -- 172.21.15.19:0/755394137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb8009420 con 0x7fbbbc0ce310 2023-11-20T06:42:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.035+0000 7fbbc15e1640 1 --2- 172.21.15.19:0/755394137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbbc0ce310 0x7fbbbc157520 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00c420 tx=0x7fbbac00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.039+0000 7fbbb27fc640 1 -- 172.21.15.19:0/755394137 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac005cf0 con 0x7fbbbc0ce310 2023-11-20T06:42:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.039+0000 7fbbb27fc640 1 -- 172.21.15.19:0/755394137 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac005e50 con 0x7fbbbc0ce310 2023-11-20T06:42:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.039+0000 7fbbb27fc640 1 -- 172.21.15.19:0/755394137 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0072d0 con 0x7fbbbc0ce310 2023-11-20T06:42:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.039+0000 7fbbc4046640 1 -- 172.21.15.19:0/755394137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbbc156d20 con 0x7fbbbc0ce310 2023-11-20T06:42:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.039+0000 7fbbc4046640 1 -- 172.21.15.19:0/755394137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbbc153280 con 0x7fbbbc0ce310 2023-11-20T06:42:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.039+0000 7fbbc4046640 1 -- 172.21.15.19:0/755394137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbbc074010 con 0x7fbbbc0ce310 2023-11-20T06:42:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.039+0000 7fbbb27fc640 1 -- 172.21.15.19:0/755394137 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbbac007430 con 0x7fbbbc0ce310 2023-11-20T06:42:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.039+0000 7fbbb27fc640 1 --2- 172.21.15.19:0/755394137 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbba00664d0 0x7fbba0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.039+0000 7fbbb27fc640 1 -- 172.21.15.19:0/755394137 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fbbac083120 con 0x7fbbbc0ce310 2023-11-20T06:42:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.039+0000 7fbbc1de2640 1 --2- 172.21.15.19:0/755394137 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbba00664d0 0x7fbba0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:37.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.043+0000 7fbbc1de2640 1 --2- 172.21.15.19:0/755394137 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbba00664d0 0x7fbba0068990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80af000 tx=0x7fbbb80a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:37.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.043+0000 7fbbb27fc640 1 -- 172.21.15.19:0/755394137 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbbac050850 con 0x7fbbbc0ce310 2023-11-20T06:42:37.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.255+0000 7fbbc4046640 1 -- 172.21.15.19:0/755394137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbbbc0b23a0 con 0x7fbbbc0ce310 2023-11-20T06:42:37.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.255+0000 7fbbb27fc640 1 -- 172.21.15.19:0/755394137 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fbbbc0b23a0 con 0x7fbbbc0ce310 2023-11-20T06:42:37.262 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:37.262 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-20T06:42:37.262 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_dump": [ 2023-11-20T06:42:37.262 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.262 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.a", 2023-11-20T06:42:37.262 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBN/1plueJ2JxAA1X+0m4LIEBxejFKNsHBvuA==", 2023-11-20T06:42:37.262 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2023-11-20T06:42:37.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2023-11-20T06:42:37.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2023-11-20T06:42:37.263 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2023-11-20T06:42:37.263 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.263 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.263 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.263 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.b", 2023-11-20T06:42:37.263 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBN/1plUvpZNBAAH8Us2YdQ+wKZ6Zx3RepF0A==", 2023-11-20T06:42:37.263 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2023-11-20T06:42:37.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2023-11-20T06:42:37.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2023-11-20T06:42:37.264 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2023-11-20T06:42:37.264 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.264 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.264 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.264 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.c", 2023-11-20T06:42:37.264 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBN/1plCeb0LhAAVK2F02vjEZTukNnOvWqlPA==", 2023-11-20T06:42:37.264 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2023-11-20T06:42:37.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2023-11-20T06:42:37.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2023-11-20T06:42:37.264 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2023-11-20T06:42:37.264 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.265 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.265 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.265 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.d", 2023-11-20T06:42:37.265 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBO/1pl7jgOABAAHQ0Uw7cQcMqNXmqZmA76kw==", 2023-11-20T06:42:37.265 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2023-11-20T06:42:37.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2023-11-20T06:42:37.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2023-11-20T06:42:37.265 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2023-11-20T06:42:37.265 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.265 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.265 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.265 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.0", 2023-11-20T06:42:37.266 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBR/1plCymhIBAAWMlBu5HYWxv2RuFqtfKPnw==", 2023-11-20T06:42:37.266 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2023-11-20T06:42:37.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2023-11-20T06:42:37.266 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2023-11-20T06:42:37.266 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.266 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.266 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.266 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.1", 2023-11-20T06:42:37.266 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBU/1plnk3UJhAA+g1Q4vJdakeTDrYPrLcmig==", 2023-11-20T06:42:37.266 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2023-11-20T06:42:37.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2023-11-20T06:42:37.267 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2023-11-20T06:42:37.267 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.267 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.267 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.267 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.2", 2023-11-20T06:42:37.267 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBX/1pl6Q5JLRAA0rzlDYDhlwzhMvVk3YiWCQ==", 2023-11-20T06:42:37.267 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2023-11-20T06:42:37.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2023-11-20T06:42:37.267 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2023-11-20T06:42:37.267 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.268 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.268 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.268 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.3", 2023-11-20T06:42:37.268 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBa/1plSMFaMxAAKB8Dj4GGh0+yS2JJLHEf6A==", 2023-11-20T06:42:37.268 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2023-11-20T06:42:37.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2023-11-20T06:42:37.268 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2023-11-20T06:42:37.268 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.268 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.268 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.268 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.4", 2023-11-20T06:42:37.268 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBg/1plmDOAOxAAcjeT1uoNzSpk8v2TfRwkog==", 2023-11-20T06:42:37.269 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2023-11-20T06:42:37.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2023-11-20T06:42:37.269 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2023-11-20T06:42:37.269 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.269 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.269 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.269 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.5", 2023-11-20T06:42:37.269 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBk/1plVAhXBxAAyUwk8TFLwAQ4lDP+g+FDzQ==", 2023-11-20T06:42:37.269 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2023-11-20T06:42:37.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2023-11-20T06:42:37.270 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2023-11-20T06:42:37.270 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.270 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.270 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.270 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.6", 2023-11-20T06:42:37.270 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBn/1plow3PDxAAOPPnYvVKsDK1xR1bf0XGgg==", 2023-11-20T06:42:37.270 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2023-11-20T06:42:37.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2023-11-20T06:42:37.270 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2023-11-20T06:42:37.270 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.270 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.270 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.271 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.7", 2023-11-20T06:42:37.271 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBq/1plW+t6FxAAOY9kXfQfuLWck5NI4EOawg==", 2023-11-20T06:42:37.271 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2023-11-20T06:42:37.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2023-11-20T06:42:37.271 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2023-11-20T06:42:37.271 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.271 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.271 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.271 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.0", 2023-11-20T06:42:37.271 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBO/1plZE3cAxAAVTNRIC9TJrQlm6hYSU1RUQ==", 2023-11-20T06:42:37.271 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2023-11-20T06:42:37.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2023-11-20T06:42:37.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2023-11-20T06:42:37.272 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2023-11-20T06:42:37.272 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.272 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.272 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.272 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.1", 2023-11-20T06:42:37.272 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBO/1pl/ULKDRAAOW/ALrb8aYEzr1gginMraw==", 2023-11-20T06:42:37.272 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2023-11-20T06:42:37.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2023-11-20T06:42:37.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2023-11-20T06:42:37.272 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2023-11-20T06:42:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.2", 2023-11-20T06:42:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBO/1plHl/iCRAA5TXRL4Fg8jMssjCtWrGIhg==", 2023-11-20T06:42:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2023-11-20T06:42:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2023-11-20T06:42:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2023-11-20T06:42:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2023-11-20T06:42:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.274 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.3", 2023-11-20T06:42:37.274 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBO/1plOKnBExAAPBj7JsuOWsmXJq82KGBLNQ==", 2023-11-20T06:42:37.274 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2023-11-20T06:42:37.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2023-11-20T06:42:37.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2023-11-20T06:42:37.274 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2023-11-20T06:42:37.274 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.274 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.274 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.274 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.admin", 2023-11-20T06:42:37.274 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBN/1pl1ifFChAAX4N0xcd2fWQHjrGKfwK7Kw==", 2023-11-20T06:42:37.275 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2023-11-20T06:42:37.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2023-11-20T06:42:37.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2023-11-20T06:42:37.275 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2023-11-20T06:42:37.275 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.275 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.275 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-mds", 2023-11-20T06:42:37.275 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBw/1pl5nanGRAAT6bVmOEeAfUd/u91DDlmjA==", 2023-11-20T06:42:37.275 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-mds" 2023-11-20T06:42:37.275 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.276 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.276 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-mgr", 2023-11-20T06:42:37.276 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBw/1plwoenGRAAqrGouHG2/9dR2vE9/eyMxQ==", 2023-11-20T06:42:37.276 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-20T06:42:37.276 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.276 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.276 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-osd", 2023-11-20T06:42:37.276 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBw/1plNJWnGRAA6YXWUkTfjLLW34tLk7k7jg==", 2023-11-20T06:42:37.276 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-osd" 2023-11-20T06:42:37.277 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.277 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.277 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.277 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-rbd", 2023-11-20T06:42:37.277 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBw/1plEJ6nGRAA1QmOT+q+SMl1ShhMl7lQpA==", 2023-11-20T06:42:37.277 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.277 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-20T06:42:37.277 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.277 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.277 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.277 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-20T06:42:37.277 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBw/1pluqanGRAAU8APomVSjhnYcVwizMlf4w==", 2023-11-20T06:42:37.278 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.278 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-20T06:42:37.278 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.278 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.278 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.278 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-rgw", 2023-11-20T06:42:37.278 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBw/1plSa+nGRAASVW+ThS27+zbjuqkbqlhBg==", 2023-11-20T06:42:37.278 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.278 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-20T06:42:37.278 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.278 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.278 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.278 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.x", 2023-11-20T06:42:37.279 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBN/1pl3o4WIxAA/1d+cqWNjC8GwzVnwnoeuQ==", 2023-11-20T06:42:37.279 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.279 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2023-11-20T06:42:37.279 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2023-11-20T06:42:37.279 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2023-11-20T06:42:37.279 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.279 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:37.279 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:37.279 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.y", 2023-11-20T06:42:37.279 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBN/1plCGv2HhAAjXKC/5InCTajc8lLun1ZKw==", 2023-11-20T06:42:37.279 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2023-11-20T06:42:37.279 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2023-11-20T06:42:37.279 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2023-11-20T06:42:37.280 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2023-11-20T06:42:37.280 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.280 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:37.280 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-11-20T06:42:37.280 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-20T06:42:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.259+0000 7fbbc4046640 1 -- 172.21.15.19:0/755394137 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbba00664d0 msgr2=0x7fbba0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.259+0000 7fbbc4046640 1 --2- 172.21.15.19:0/755394137 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbba00664d0 0x7fbba0068990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80af000 tx=0x7fbbb80a7000 comp rx=0 tx=0).stop 2023-11-20T06:42:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.259+0000 7fbbc4046640 1 -- 172.21.15.19:0/755394137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbbc0ce310 msgr2=0x7fbbbc157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.259+0000 7fbbc4046640 1 --2- 172.21.15.19:0/755394137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbbc0ce310 0x7fbbbc157520 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00c420 tx=0x7fbbac00c8e0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.259+0000 7fbbc4046640 1 -- 172.21.15.19:0/755394137 shutdown_connections 2023-11-20T06:42:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.259+0000 7fbbc4046640 1 --2- 172.21.15.19:0/755394137 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbba00664d0 0x7fbba0068990 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.259+0000 7fbbc4046640 1 --2- 172.21.15.19:0/755394137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbbc15cf90 0x7fbbbc0b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.259+0000 7fbbc4046640 1 --2- 172.21.15.19:0/755394137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbbc0ce310 0x7fbbbc157520 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.259+0000 7fbbc4046640 1 --2- 172.21.15.19:0/755394137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbbc0b2ad0 0x7fbbbc0c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.259+0000 7fbbc4046640 1 -- 172.21.15.19:0/755394137 >> 172.21.15.19:0/755394137 conn(0x7fbbbc0cd1c0 msgr2=0x7fbbbc15ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.259+0000 7fbbc4046640 1 -- 172.21.15.19:0/755394137 shutdown_connections 2023-11-20T06:42:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.259+0000 7fbbc4046640 1 -- 172.21.15.19:0/755394137 wait complete. 2023-11-20T06:42:37.283 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-20T06:42:37.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.423+0000 7f6274ba1640 1 Processor -- start 2023-11-20T06:42:37.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.423+0000 7f6274ba1640 1 -- start start 2023-11-20T06:42:37.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.423+0000 7f6274ba1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62701597c0 0x7f62700ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:37.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.423+0000 7f6274ba1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f62700adc10 0x7f62700cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:37.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.423+0000 7f6274ba1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62700723d0 con 0x7f6270159ba0 2023-11-20T06:42:37.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.423+0000 7f6274ba1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62700717c0 con 0x7f62700adc10 2023-11-20T06:42:37.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.423+0000 7f6274ba1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6270071aa0 con 0x7f62701597c0 2023-11-20T06:42:37.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.423+0000 7f626ed9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f62700adc10 0x7f62700cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:37.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.423+0000 7f626e59c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62701597c0 0x7f62700ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:37.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.423+0000 7f626ed9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f62700adc10 0x7f62700cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:42378/0 (socket says 172.21.15.19:42378) 2023-11-20T06:42:37.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.423+0000 7f626ed9d640 1 -- 172.21.15.19:0/2564073121 learned_addr learned my addr 172.21.15.19:0/2564073121 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:37.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.423+0000 7f626ed9d640 1 -- 172.21.15.19:0/2564073121 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62701597c0 msgr2=0x7f62700ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:37.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.423+0000 7f626ed9d640 1 --2- 172.21.15.19:0/2564073121 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62701597c0 0x7f62700ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.423+0000 7f626ed9d640 1 -- 172.21.15.19:0/2564073121 >> v1:172.21.15.190:6789/0 conn(0x7f6270159ba0 legacy=0x7f62700cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:37.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.423+0000 7f626ed9d640 1 -- 172.21.15.19:0/2564073121 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6270071d80 con 0x7f62700adc10 2023-11-20T06:42:37.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.427+0000 7f626ed9d640 1 --2- 172.21.15.19:0/2564073121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62700adc10 0x7f62700cb520 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6268009e50 tx=0x7f626801ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c5b6b143a3a7af server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:37.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.427+0000 7f626dd9b640 1 -- 172.21.15.19:0/2564073121 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62680a5880 con 0x7f62700adc10 2023-11-20T06:42:37.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.427+0000 7f626dd9b640 1 -- 172.21.15.19:0/2564073121 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62680a59e0 con 0x7f62700adc10 2023-11-20T06:42:37.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.427+0000 7f626dd9b640 1 -- 172.21.15.19:0/2564073121 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62680a5d70 con 0x7f62700adc10 2023-11-20T06:42:37.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.427+0000 7f6274ba1640 1 -- 172.21.15.19:0/2564073121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62700adc10 msgr2=0x7f62700cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:37.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.427+0000 7f6274ba1640 1 --2- 172.21.15.19:0/2564073121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62700adc10 0x7f62700cb520 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6268009e50 tx=0x7f626801ca10 comp rx=0 tx=0).stop 2023-11-20T06:42:37.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.427+0000 7f6274ba1640 1 -- 172.21.15.19:0/2564073121 shutdown_connections 2023-11-20T06:42:37.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.427+0000 7f6274ba1640 1 --2- 172.21.15.19:0/2564073121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62700adc10 0x7f62700cb520 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.427+0000 7f6274ba1640 1 --2- 172.21.15.19:0/2564073121 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62701597c0 0x7f62700ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.427+0000 7f6274ba1640 1 -- 172.21.15.19:0/2564073121 >> 172.21.15.19:0/2564073121 conn(0x7f627006c190 msgr2=0x7f627006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:37.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.427+0000 7f6274ba1640 1 -- 172.21.15.19:0/2564073121 shutdown_connections 2023-11-20T06:42:37.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.427+0000 7f6274ba1640 1 -- 172.21.15.19:0/2564073121 wait complete. 2023-11-20T06:42:37.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f6274ba1640 1 Processor -- start 2023-11-20T06:42:37.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f6274ba1640 1 -- start start 2023-11-20T06:42:37.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f6274ba1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62700adc10 0x7f62701490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:37.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f6274ba1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62701597c0 0x7f6270149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:37.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f6274ba1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6270159ba0 0x7f6270156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:37.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f6274ba1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627015a370 con 0x7f6270159ba0 2023-11-20T06:42:37.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f6274ba1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627015ce60 con 0x7f62700adc10 2023-11-20T06:42:37.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f6274ba1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627015c8a0 con 0x7f62701597c0 2023-11-20T06:42:37.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f626ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6270159ba0 0x7f6270156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:37.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f626ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6270159ba0 0x7f6270156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53534/0 (socket says 172.21.15.19:53534) 2023-11-20T06:42:37.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f626ed9d640 1 -- 172.21.15.19:0/2606226472 learned_addr learned my addr 172.21.15.19:0/2606226472 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:37.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f6267fff640 1 --2- 172.21.15.19:0/2606226472 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62701597c0 0x7f6270149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:37.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f626e59c640 1 --2- 172.21.15.19:0/2606226472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62700adc10 0x7f62701490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:37.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f626ed9d640 1 -- 172.21.15.19:0/2606226472 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62701597c0 msgr2=0x7f6270149910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:37.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f626ed9d640 1 --2- 172.21.15.19:0/2606226472 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62701597c0 0x7f6270149910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f626ed9d640 1 -- 172.21.15.19:0/2606226472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62700adc10 msgr2=0x7f62701490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:37.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f626ed9d640 1 --2- 172.21.15.19:0/2606226472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62700adc10 0x7f62701490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f626ed9d640 1 -- 172.21.15.19:0/2606226472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6268009b30 con 0x7f6270159ba0 2023-11-20T06:42:37.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f626ed9d640 1 --2- 172.21.15.19:0/2606226472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6270159ba0 0x7f6270156dc0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f62680af040 tx=0x7f62680197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:37.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f6266ffd640 1 -- 172.21.15.19:0/2606226472 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62680b8670 con 0x7f6270159ba0 2023-11-20T06:42:37.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f6266ffd640 1 -- 172.21.15.19:0/2606226472 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62680b87d0 con 0x7f6270159ba0 2023-11-20T06:42:37.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f6266ffd640 1 -- 172.21.15.19:0/2606226472 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62680b8b60 con 0x7f6270159ba0 2023-11-20T06:42:37.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f6274ba1640 1 -- 172.21.15.19:0/2606226472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627015cb80 con 0x7f6270159ba0 2023-11-20T06:42:37.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.431+0000 7f6274ba1640 1 -- 172.21.15.19:0/2606226472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62700c5c60 con 0x7f6270159ba0 2023-11-20T06:42:37.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.435+0000 7f6274ba1640 1 -- 172.21.15.19:0/2606226472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6270074010 con 0x7f6270159ba0 2023-11-20T06:42:37.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.435+0000 7f6266ffd640 1 -- 172.21.15.19:0/2606226472 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f62680b8cc0 con 0x7f6270159ba0 2023-11-20T06:42:37.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.435+0000 7f6266ffd640 1 --2- 172.21.15.19:0/2606226472 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f62500664a0 0x7f6250068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:37.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.435+0000 7f6266ffd640 1 -- 172.21.15.19:0/2606226472 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f626811ef60 con 0x7f6270159ba0 2023-11-20T06:42:37.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.435+0000 7f626e59c640 1 --2- 172.21.15.19:0/2606226472 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f62500664a0 0x7f6250068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:37.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.435+0000 7f626e59c640 1 --2- 172.21.15.19:0/2606226472 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f62500664a0 0x7f6250068960 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6260009b60 tx=0x7f6260009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:37.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.439+0000 7f6266ffd640 1 -- 172.21.15.19:0/2606226472 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f62680ec690 con 0x7f6270159ba0 2023-11-20T06:42:37.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.655+0000 7f6274ba1640 1 -- 172.21.15.19:0/2606226472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f62700cd3f0 con 0x7f6270159ba0 2023-11-20T06:42:37.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.655+0000 7f6266ffd640 1 -- 172.21.15.19:0/2606226472 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f62680bc020 con 0x7f6270159ba0 2023-11-20T06:42:37.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.659+0000 7f6274ba1640 1 -- 172.21.15.19:0/2606226472 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f62500664a0 msgr2=0x7f6250068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:37.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.659+0000 7f6274ba1640 1 --2- 172.21.15.19:0/2606226472 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f62500664a0 0x7f6250068960 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6260009b60 tx=0x7f6260009190 comp rx=0 tx=0).stop 2023-11-20T06:42:37.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.659+0000 7f6274ba1640 1 -- 172.21.15.19:0/2606226472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6270159ba0 msgr2=0x7f6270156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:37.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.659+0000 7f6274ba1640 1 --2- 172.21.15.19:0/2606226472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6270159ba0 0x7f6270156dc0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f62680af040 tx=0x7f62680197b0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.659+0000 7f6274ba1640 1 -- 172.21.15.19:0/2606226472 shutdown_connections 2023-11-20T06:42:37.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.659+0000 7f6274ba1640 1 --2- 172.21.15.19:0/2606226472 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f62500664a0 0x7f6250068960 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.659+0000 7f6274ba1640 1 --2- 172.21.15.19:0/2606226472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6270159ba0 0x7f6270156dc0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.659+0000 7f6274ba1640 1 --2- 172.21.15.19:0/2606226472 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62701597c0 0x7f6270149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.659+0000 7f6274ba1640 1 --2- 172.21.15.19:0/2606226472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62700adc10 0x7f62701490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.659+0000 7f6274ba1640 1 -- 172.21.15.19:0/2606226472 >> 172.21.15.19:0/2606226472 conn(0x7f627006c190 msgr2=0x7f62700caca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:37.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.659+0000 7f6274ba1640 1 -- 172.21.15.19:0/2606226472 shutdown_connections 2023-11-20T06:42:37.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.659+0000 7f6274ba1640 1 -- 172.21.15.19:0/2606226472 wait complete. 2023-11-20T06:42:37.684 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-20T06:42:37.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.823+0000 7f6e42217640 1 Processor -- start 2023-11-20T06:42:37.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.823+0000 7f6e42217640 1 -- start start 2023-11-20T06:42:37.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.823+0000 7f6e42217640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e3c070c40 0x7f6e3c15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:37.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.823+0000 7f6e42217640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6e3c0b4020 0x7f6e3c0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:37.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.823+0000 7f6e42217640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6e3c0b0620 0x7f6e3c15c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:37.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.823+0000 7f6e42217640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e3c15b3b0 con 0x7f6e3c0b0620 2023-11-20T06:42:37.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.823+0000 7f6e42217640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e3c0b0a90 con 0x7f6e3c0b4020 2023-11-20T06:42:37.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.823+0000 7f6e42217640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c15be60 con 0x7f6e3c070c40 2023-11-20T06:42:37.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.823+0000 7f6e3bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6e3c0b0620 0x7f6e3c15c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:37.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.823+0000 7f6e3bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6e3c0b0620 0x7f6e3c15c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53550/0 (socket says 172.21.15.19:53550) 2023-11-20T06:42:37.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.823+0000 7f6e3bfff640 1 -- 172.21.15.19:0/1726305860 learned_addr learned my addr 172.21.15.19:0/1726305860 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:37.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.823+0000 7f6e3affd640 1 --2- 172.21.15.19:0/1726305860 >> v2:172.21.15.190:3300/0 conn(0x7f6e3c0b4020 0x7f6e3c0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:37.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.823+0000 7f6e3b7fe640 1 --2- 172.21.15.19:0/1726305860 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e3c070c40 0x7f6e3c15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:37.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.823+0000 7f6e3bfff640 1 -- 172.21.15.19:0/1726305860 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e3c070c40 msgr2=0x7f6e3c15ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:37.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.823+0000 7f6e3bfff640 1 --2- 172.21.15.19:0/1726305860 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e3c070c40 0x7f6e3c15ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.823+0000 7f6e3bfff640 1 -- 172.21.15.19:0/1726305860 >> v2:172.21.15.190:3300/0 conn(0x7f6e3c0b4020 msgr2=0x7f6e3c0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:37.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.823+0000 7f6e3bfff640 1 --2- 172.21.15.19:0/1726305860 >> v2:172.21.15.190:3300/0 conn(0x7f6e3c0b4020 0x7f6e3c0b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.823+0000 7f6e3bfff640 1 -- 172.21.15.19:0/1726305860 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c15c1f0 con 0x7f6e3c0b0620 2023-11-20T06:42:37.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.827+0000 7f6e3bfff640 1 --2- 172.21.15.19:0/1726305860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e3c0b0620 0x7f6e3c15c680 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0cc0f0 tx=0x7f6e3401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96817357bfa750c server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:37.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.827+0000 7f6e3a7fc640 1 -- 172.21.15.19:0/1726305860 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e340a57c0 con 0x7f6e3c0b0620 2023-11-20T06:42:37.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.827+0000 7f6e3a7fc640 1 -- 172.21.15.19:0/1726305860 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e340a5920 con 0x7f6e3c0b0620 2023-11-20T06:42:37.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.827+0000 7f6e3a7fc640 1 -- 172.21.15.19:0/1726305860 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e340a5cb0 con 0x7f6e3c0b0620 2023-11-20T06:42:37.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.827+0000 7f6e42217640 1 -- 172.21.15.19:0/1726305860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e3c0b0620 msgr2=0x7f6e3c15c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:37.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.827+0000 7f6e42217640 1 --2- 172.21.15.19:0/1726305860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e3c0b0620 0x7f6e3c15c680 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0cc0f0 tx=0x7f6e3401c940 comp rx=0 tx=0).stop 2023-11-20T06:42:37.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.827+0000 7f6e42217640 1 -- 172.21.15.19:0/1726305860 shutdown_connections 2023-11-20T06:42:37.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.827+0000 7f6e42217640 1 --2- 172.21.15.19:0/1726305860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e3c0b0620 0x7f6e3c15c680 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.827+0000 7f6e42217640 1 --2- 172.21.15.19:0/1726305860 >> v2:172.21.15.190:3300/0 conn(0x7f6e3c0b4020 0x7f6e3c0b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.827+0000 7f6e42217640 1 --2- 172.21.15.19:0/1726305860 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e3c070c40 0x7f6e3c15ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.827+0000 7f6e42217640 1 -- 172.21.15.19:0/1726305860 >> 172.21.15.19:0/1726305860 conn(0x7f6e3c06c190 msgr2=0x7f6e3c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:37.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.827+0000 7f6e42217640 1 -- 172.21.15.19:0/1726305860 shutdown_connections 2023-11-20T06:42:37.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.827+0000 7f6e42217640 1 -- 172.21.15.19:0/1726305860 wait complete. 2023-11-20T06:42:37.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e42217640 1 Processor -- start 2023-11-20T06:42:37.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e42217640 1 -- start start 2023-11-20T06:42:37.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e42217640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e3c070c40 0x7f6e3c0aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:37.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e42217640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e3c0b0620 0x7f6e3c0af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:37.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e42217640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e3c0b4020 0x7f6e3c0a79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:37.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e42217640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c0c25a0 con 0x7f6e3c0b0620 2023-11-20T06:42:37.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e42217640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c0a8dd0 con 0x7f6e3c070c40 2023-11-20T06:42:37.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e42217640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c0a90b0 con 0x7f6e3c0b4020 2023-11-20T06:42:37.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e3affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e3c0b0620 0x7f6e3c0af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:37.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e3affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e3c0b0620 0x7f6e3c0af1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53558/0 (socket says 172.21.15.19:53558) 2023-11-20T06:42:37.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e3affd640 1 -- 172.21.15.19:0/2091647821 learned_addr learned my addr 172.21.15.19:0/2091647821 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:37.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e3bfff640 1 --2- 172.21.15.19:0/2091647821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e3c0b4020 0x7f6e3c0a79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:37.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e3b7fe640 1 --2- 172.21.15.19:0/2091647821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e3c070c40 0x7f6e3c0aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:37.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e3affd640 1 -- 172.21.15.19:0/2091647821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e3c0b4020 msgr2=0x7f6e3c0a79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:37.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e3affd640 1 --2- 172.21.15.19:0/2091647821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e3c0b4020 0x7f6e3c0a79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e3affd640 1 -- 172.21.15.19:0/2091647821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e3c070c40 msgr2=0x7f6e3c0aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:37.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e3affd640 1 --2- 172.21.15.19:0/2091647821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e3c070c40 0x7f6e3c0aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:37.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e3affd640 1 -- 172.21.15.19:0/2091647821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e34009b30 con 0x7f6e3c0b0620 2023-11-20T06:42:37.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e3affd640 1 --2- 172.21.15.19:0/2091647821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e3c0b0620 0x7f6e3c0af1e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000e870 tx=0x7f6e3000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:37.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e23fff640 1 -- 172.21.15.19:0/2091647821 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30009510 con 0x7f6e3c0b0620 2023-11-20T06:42:37.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e23fff640 1 -- 172.21.15.19:0/2091647821 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3000eec0 con 0x7f6e3c0b0620 2023-11-20T06:42:37.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e23fff640 1 -- 172.21.15.19:0/2091647821 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3000cb40 con 0x7f6e3c0b0620 2023-11-20T06:42:37.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e42217640 1 -- 172.21.15.19:0/2091647821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e3c0a9390 con 0x7f6e3c0b0620 2023-11-20T06:42:37.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.831+0000 7f6e42217640 1 -- 172.21.15.19:0/2091647821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3c0a8940 con 0x7f6e3c0b0620 2023-11-20T06:42:37.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.835+0000 7f6e42217640 1 -- 172.21.15.19:0/2091647821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e3c0c2710 con 0x7f6e3c0b0620 2023-11-20T06:42:37.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.835+0000 7f6e23fff640 1 -- 172.21.15.19:0/2091647821 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6e3000cca0 con 0x7f6e3c0b0620 2023-11-20T06:42:37.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.835+0000 7f6e23fff640 1 --2- 172.21.15.19:0/2091647821 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6e280664a0 0x7f6e28068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:37.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.835+0000 7f6e23fff640 1 -- 172.21.15.19:0/2091647821 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6e30083d20 con 0x7f6e3c0b0620 2023-11-20T06:42:37.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.835+0000 7f6e3b7fe640 1 --2- 172.21.15.19:0/2091647821 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6e280664a0 0x7f6e28068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:37.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.835+0000 7f6e3b7fe640 1 --2- 172.21.15.19:0/2091647821 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6e280664a0 0x7f6e28068960 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009b60 tx=0x7f6e2c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:37.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:37.839+0000 7f6e23fff640 1 -- 172.21.15.19:0/2091647821 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6e300513c0 con 0x7f6e3c0b0620 2023-11-20T06:42:38.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.051+0000 7f6e42217640 1 -- 172.21.15.19:0/2091647821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f6e3c074010 con 0x7f6e3c0b0620 2023-11-20T06:42:38.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.059+0000 7f6e23fff640 1 -- 172.21.15.19:0/2091647821 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6e30059e60 con 0x7f6e3c0b0620 2023-11-20T06:42:38.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.059+0000 7f6e42217640 1 -- 172.21.15.19:0/2091647821 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6e280664a0 msgr2=0x7f6e28068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:38.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.059+0000 7f6e42217640 1 --2- 172.21.15.19:0/2091647821 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6e280664a0 0x7f6e28068960 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009b60 tx=0x7f6e2c009190 comp rx=0 tx=0).stop 2023-11-20T06:42:38.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.059+0000 7f6e42217640 1 -- 172.21.15.19:0/2091647821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e3c0b0620 msgr2=0x7f6e3c0af1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:38.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.059+0000 7f6e42217640 1 --2- 172.21.15.19:0/2091647821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e3c0b0620 0x7f6e3c0af1e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000e870 tx=0x7f6e3000ec70 comp rx=0 tx=0).stop 2023-11-20T06:42:38.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.059+0000 7f6e42217640 1 -- 172.21.15.19:0/2091647821 shutdown_connections 2023-11-20T06:42:38.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.059+0000 7f6e42217640 1 --2- 172.21.15.19:0/2091647821 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6e280664a0 0x7f6e28068960 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.059+0000 7f6e42217640 1 --2- 172.21.15.19:0/2091647821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e3c0b4020 0x7f6e3c0a79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.059+0000 7f6e42217640 1 --2- 172.21.15.19:0/2091647821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e3c0b0620 0x7f6e3c0af1e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.059+0000 7f6e42217640 1 --2- 172.21.15.19:0/2091647821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e3c070c40 0x7f6e3c0aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.059+0000 7f6e42217640 1 -- 172.21.15.19:0/2091647821 >> 172.21.15.19:0/2091647821 conn(0x7f6e3c06c190 msgr2=0x7f6e3c159940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:38.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.059+0000 7f6e42217640 1 -- 172.21.15.19:0/2091647821 shutdown_connections 2023-11-20T06:42:38.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.059+0000 7f6e42217640 1 -- 172.21.15.19:0/2091647821 wait complete. 2023-11-20T06:42:38.085 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-20T06:42:38.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.223+0000 7fe3f8ed6640 1 Processor -- start 2023-11-20T06:42:38.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.223+0000 7fe3f8ed6640 1 -- start start 2023-11-20T06:42:38.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.227+0000 7fe3f8ed6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3f415cb90 0x7fe3f40cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:38.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.227+0000 7fe3f8ed6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe3f40d15d0 0x7fe3f40c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:38.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.227+0000 7fe3f8ed6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f40ce770 con 0x7fe3f40d3010 2023-11-20T06:42:38.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.227+0000 7fe3f8ed6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f40d0600 con 0x7fe3f40d15d0 2023-11-20T06:42:38.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.227+0000 7fe3f8ed6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f40c6450 con 0x7fe3f415cb90 2023-11-20T06:42:38.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.227+0000 7fe3ebfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe3f40d3010 0x7fe3f40d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39138/0 (socket says 172.21.15.19:39138) 2023-11-20T06:42:38.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.227+0000 7fe3ebfff640 1 -- 172.21.15.19:0/2976363313 learned_addr learned my addr 172.21.15.19:0/2976363313 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:38.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.227+0000 7fe3f259c640 1 --2- 172.21.15.19:0/2976363313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3f415cb90 0x7fe3f40cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:38.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.227+0000 7fe3f2d9d640 1 --2- 172.21.15.19:0/2976363313 >> v2:172.21.15.190:3300/0 conn(0x7fe3f40d15d0 0x7fe3f40c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:38.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.227+0000 7fe3f1d9b640 1 -- 172.21.15.19:0/2976363313 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653683435 0 0) 0x7fe3f40ce770 con 0x7fe3f40d3010 2023-11-20T06:42:38.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.227+0000 7fe3f1d9b640 1 -- 172.21.15.19:0/2976363313 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3e0003530 con 0x7fe3f40d3010 2023-11-20T06:42:38.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.227+0000 7fe3f259c640 1 -- 172.21.15.19:0/2976363313 >> v2:172.21.15.190:3300/0 conn(0x7fe3f40d15d0 msgr2=0x7fe3f40c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:38.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.227+0000 7fe3f259c640 1 --2- 172.21.15.19:0/2976363313 >> v2:172.21.15.190:3300/0 conn(0x7fe3f40d15d0 0x7fe3f40c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.227+0000 7fe3f259c640 1 -- 172.21.15.19:0/2976363313 >> v1:172.21.15.19:6789/0 conn(0x7fe3f40d3010 legacy=0x7fe3f40d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:38.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.227+0000 7fe3f259c640 1 -- 172.21.15.19:0/2976363313 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f40d08a0 con 0x7fe3f415cb90 2023-11-20T06:42:38.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.231+0000 7fe3f259c640 1 --2- 172.21.15.19:0/2976363313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3f415cb90 0x7fe3f40cfb10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40097a0 tx=0x7fe3e401c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f152b3d693f2892d server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:38.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.231+0000 7fe3f1d9b640 1 -- 172.21.15.19:0/2976363313 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e40ac600 con 0x7fe3f415cb90 2023-11-20T06:42:38.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.231+0000 7fe3f1d9b640 1 -- 172.21.15.19:0/2976363313 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e40a8050 con 0x7fe3f415cb90 2023-11-20T06:42:38.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.231+0000 7fe3f1d9b640 1 -- 172.21.15.19:0/2976363313 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e40ac980 con 0x7fe3f415cb90 2023-11-20T06:42:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.231+0000 7fe3f8ed6640 1 -- 172.21.15.19:0/2976363313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3f415cb90 msgr2=0x7fe3f40cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.231+0000 7fe3f8ed6640 1 --2- 172.21.15.19:0/2976363313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3f415cb90 0x7fe3f40cfb10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40097a0 tx=0x7fe3e401c3a0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.231+0000 7fe3f8ed6640 1 -- 172.21.15.19:0/2976363313 shutdown_connections 2023-11-20T06:42:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.231+0000 7fe3f8ed6640 1 --2- 172.21.15.19:0/2976363313 >> v2:172.21.15.190:3300/0 conn(0x7fe3f40d15d0 0x7fe3f40c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.231+0000 7fe3f8ed6640 1 --2- 172.21.15.19:0/2976363313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3f415cb90 0x7fe3f40cfb10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.231+0000 7fe3f8ed6640 1 -- 172.21.15.19:0/2976363313 >> 172.21.15.19:0/2976363313 conn(0x7fe3f409bc50 msgr2=0x7fe3f40d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.231+0000 7fe3f8ed6640 1 -- 172.21.15.19:0/2976363313 shutdown_connections 2023-11-20T06:42:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.231+0000 7fe3f8ed6640 1 -- 172.21.15.19:0/2976363313 wait complete. 2023-11-20T06:42:38.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.231+0000 7fe3f8ed6640 1 Processor -- start 2023-11-20T06:42:38.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.231+0000 7fe3f8ed6640 1 -- start start 2023-11-20T06:42:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3f8ed6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3f40d15d0 0x7fe3f40cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3f8ed6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3f40d3010 0x7fe3f414e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3f8ed6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3f415cb90 0x7fe3f4153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3f8ed6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f40c9a70 con 0x7fe3f415cb90 2023-11-20T06:42:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3f8ed6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f40c9d50 con 0x7fe3f40d15d0 2023-11-20T06:42:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3f8ed6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f40ca030 con 0x7fe3f40d3010 2023-11-20T06:42:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3f2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3f415cb90 0x7fe3f4153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3f2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3f415cb90 0x7fe3f4153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53572/0 (socket says 172.21.15.19:53572) 2023-11-20T06:42:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3f2d9d640 1 -- 172.21.15.19:0/596282614 learned_addr learned my addr 172.21.15.19:0/596282614 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3ebfff640 1 --2- 172.21.15.19:0/596282614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3f40d3010 0x7fe3f414e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3f259c640 1 --2- 172.21.15.19:0/596282614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3f40d15d0 0x7fe3f40cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3f2d9d640 1 -- 172.21.15.19:0/596282614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3f40d3010 msgr2=0x7fe3f414e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:38.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3f2d9d640 1 --2- 172.21.15.19:0/596282614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3f40d3010 0x7fe3f414e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3f2d9d640 1 -- 172.21.15.19:0/596282614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3f40d15d0 msgr2=0x7fe3f40cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:38.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3f2d9d640 1 --2- 172.21.15.19:0/596282614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3f40d15d0 0x7fe3f40cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3f2d9d640 1 -- 172.21.15.19:0/596282614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e40093b0 con 0x7fe3f415cb90 2023-11-20T06:42:38.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3f2d9d640 1 --2- 172.21.15.19:0/596282614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3f415cb90 0x7fe3f4153dd0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00efc0 tx=0x7fe3ec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:38.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3eaffd640 1 -- 172.21.15.19:0/596282614 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec009ca0 con 0x7fe3f415cb90 2023-11-20T06:42:38.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3eaffd640 1 -- 172.21.15.19:0/596282614 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec00f040 con 0x7fe3f415cb90 2023-11-20T06:42:38.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3eaffd640 1 -- 172.21.15.19:0/596282614 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec0146c0 con 0x7fe3f415cb90 2023-11-20T06:42:38.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3f8ed6640 1 -- 172.21.15.19:0/596282614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f40ca310 con 0x7fe3f415cb90 2023-11-20T06:42:38.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3f8ed6640 1 -- 172.21.15.19:0/596282614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f4154310 con 0x7fe3f415cb90 2023-11-20T06:42:38.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.235+0000 7fe3f8ed6640 1 -- 172.21.15.19:0/596282614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f40ca500 con 0x7fe3f415cb90 2023-11-20T06:42:38.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.239+0000 7fe3eaffd640 1 -- 172.21.15.19:0/596282614 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe3ec014820 con 0x7fe3f415cb90 2023-11-20T06:42:38.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.239+0000 7fe3eaffd640 1 --2- 172.21.15.19:0/596282614 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe3d40664a0 0x7fe3d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:38.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.239+0000 7fe3eaffd640 1 -- 172.21.15.19:0/596282614 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe3ec084c50 con 0x7fe3f415cb90 2023-11-20T06:42:38.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.239+0000 7fe3f259c640 1 --2- 172.21.15.19:0/596282614 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe3d40664a0 0x7fe3d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:38.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.239+0000 7fe3f259c640 1 --2- 172.21.15.19:0/596282614 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe3d40664a0 0x7fe3d4068960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40ae000 tx=0x7fe3e40a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:38.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.243+0000 7fe3eaffd640 1 -- 172.21.15.19:0/596282614 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe3ec052240 con 0x7fe3f415cb90 2023-11-20T06:42:38.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.455+0000 7fe3f8ed6640 1 -- 172.21.15.19:0/596282614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fe3f40c9bb0 con 0x7fe3f415cb90 2023-11-20T06:42:38.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.459+0000 7fe3eaffd640 1 -- 172.21.15.19:0/596282614 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe3f40c9bb0 con 0x7fe3f415cb90 2023-11-20T06:42:38.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.459+0000 7fe3f8ed6640 1 -- 172.21.15.19:0/596282614 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe3d40664a0 msgr2=0x7fe3d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:38.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.459+0000 7fe3f8ed6640 1 --2- 172.21.15.19:0/596282614 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe3d40664a0 0x7fe3d4068960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40ae000 tx=0x7fe3e40a7000 comp rx=0 tx=0).stop 2023-11-20T06:42:38.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.459+0000 7fe3f8ed6640 1 -- 172.21.15.19:0/596282614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3f415cb90 msgr2=0x7fe3f4153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:38.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.459+0000 7fe3f8ed6640 1 --2- 172.21.15.19:0/596282614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3f415cb90 0x7fe3f4153dd0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00efc0 tx=0x7fe3ec00c490 comp rx=0 tx=0).stop 2023-11-20T06:42:38.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.459+0000 7fe3f8ed6640 1 -- 172.21.15.19:0/596282614 shutdown_connections 2023-11-20T06:42:38.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.459+0000 7fe3f8ed6640 1 --2- 172.21.15.19:0/596282614 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe3d40664a0 0x7fe3d4068960 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.459+0000 7fe3f8ed6640 1 --2- 172.21.15.19:0/596282614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3f415cb90 0x7fe3f4153dd0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.459+0000 7fe3f8ed6640 1 --2- 172.21.15.19:0/596282614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3f40d3010 0x7fe3f414e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.459+0000 7fe3f8ed6640 1 --2- 172.21.15.19:0/596282614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3f40d15d0 0x7fe3f40cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.459+0000 7fe3f8ed6640 1 -- 172.21.15.19:0/596282614 >> 172.21.15.19:0/596282614 conn(0x7fe3f409bc50 msgr2=0x7fe3f40d19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:38.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.459+0000 7fe3f8ed6640 1 -- 172.21.15.19:0/596282614 shutdown_connections 2023-11-20T06:42:38.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.459+0000 7fe3f8ed6640 1 -- 172.21.15.19:0/596282614 wait complete. 2023-11-20T06:42:38.486 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-20T06:42:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.623+0000 7f5ecd491640 1 Processor -- start 2023-11-20T06:42:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.623+0000 7f5ecd491640 1 -- start start 2023-11-20T06:42:38.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.627+0000 7f5ecd491640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5ec815ca50 0x7f5ec806c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:38.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.627+0000 7f5ecd491640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec80b21c0 0x7f5ec80b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:38.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.627+0000 7f5ecd491640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec81607e0 con 0x7f5ec815ce30 2023-11-20T06:42:38.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.627+0000 7f5ecd491640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec80cb4a0 con 0x7f5ec815ca50 2023-11-20T06:42:38.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.627+0000 7f5ecd491640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec80b2b30 con 0x7f5ec80b21c0 2023-11-20T06:42:38.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.627+0000 7f5ec6ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5ec815ca50 0x7f5ec806c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:38.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.627+0000 7f5ebffff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f5ec815ce30 0x7f5ec80cad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:45344/0 (socket says 172.21.15.19:45344) 2023-11-20T06:42:38.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.627+0000 7f5ebffff640 1 -- 172.21.15.19:0/3799246974 learned_addr learned my addr 172.21.15.19:0/3799246974 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:38.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.627+0000 7f5ec77fe640 1 --2- 172.21.15.19:0/3799246974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec80b21c0 0x7f5ec80b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:38.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.627+0000 7f5ec67fc640 1 -- 172.21.15.19:0/3799246974 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532706839 0 0) 0x7f5ec81607e0 con 0x7f5ec815ce30 2023-11-20T06:42:38.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.627+0000 7f5ec67fc640 1 -- 172.21.15.19:0/3799246974 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eb4003530 con 0x7f5ec815ce30 2023-11-20T06:42:38.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.627+0000 7f5ec77fe640 1 -- 172.21.15.19:0/3799246974 >> v2:172.21.15.190:3300/0 conn(0x7f5ec815ca50 msgr2=0x7f5ec806c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:38.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.627+0000 7f5ec77fe640 1 --2- 172.21.15.19:0/3799246974 >> v2:172.21.15.190:3300/0 conn(0x7f5ec815ca50 0x7f5ec806c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.627+0000 7f5ec77fe640 1 -- 172.21.15.19:0/3799246974 >> v1:172.21.15.190:6789/0 conn(0x7f5ec815ce30 legacy=0x7f5ec80cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:38.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.627+0000 7f5ec77fe640 1 -- 172.21.15.19:0/3799246974 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec80cf060 con 0x7f5ec80b21c0 2023-11-20T06:42:38.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.631+0000 7f5ec77fe640 1 --2- 172.21.15.19:0/3799246974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec80b21c0 0x7f5ec80b25f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009d90 tx=0x7f5ec001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90995e0f47797ed9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:38.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.631+0000 7f5ec67fc640 1 -- 172.21.15.19:0/3799246974 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec00a59e0 con 0x7f5ec80b21c0 2023-11-20T06:42:38.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.631+0000 7f5ec67fc640 1 -- 172.21.15.19:0/3799246974 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec00a5b40 con 0x7f5ec80b21c0 2023-11-20T06:42:38.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.631+0000 7f5ec67fc640 1 -- 172.21.15.19:0/3799246974 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec00ad440 con 0x7f5ec80b21c0 2023-11-20T06:42:38.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.631+0000 7f5ecd491640 1 -- 172.21.15.19:0/3799246974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec80b21c0 msgr2=0x7f5ec80b25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:38.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.631+0000 7f5ecd491640 1 --2- 172.21.15.19:0/3799246974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec80b21c0 0x7f5ec80b25f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009d90 tx=0x7f5ec001c920 comp rx=0 tx=0).stop 2023-11-20T06:42:38.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.631+0000 7f5ecd491640 1 -- 172.21.15.19:0/3799246974 shutdown_connections 2023-11-20T06:42:38.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.631+0000 7f5ecd491640 1 --2- 172.21.15.19:0/3799246974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec80b21c0 0x7f5ec80b25f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.631+0000 7f5ecd491640 1 --2- 172.21.15.19:0/3799246974 >> v2:172.21.15.190:3300/0 conn(0x7f5ec815ca50 0x7f5ec806c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.631+0000 7f5ecd491640 1 -- 172.21.15.19:0/3799246974 >> 172.21.15.19:0/3799246974 conn(0x7f5ec80cd1c0 msgr2=0x7f5ec80cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:38.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.631+0000 7f5ecd491640 1 -- 172.21.15.19:0/3799246974 shutdown_connections 2023-11-20T06:42:38.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.631+0000 7f5ecd491640 1 -- 172.21.15.19:0/3799246974 wait complete. 2023-11-20T06:42:38.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.631+0000 7f5ecd491640 1 Processor -- start 2023-11-20T06:42:38.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.631+0000 7f5ecd491640 1 -- start start 2023-11-20T06:42:38.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ecd491640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ec80b21c0 0x7f5ec8159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:38.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ecd491640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ec815ca50 0x7f5ec814bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:38.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ecd491640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec815ce30 0x7f5ec80c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:38.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ecd491640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec80ca020 con 0x7f5ec815ca50 2023-11-20T06:42:38.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ecd491640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec815a2a0 con 0x7f5ec80b21c0 2023-11-20T06:42:38.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ecd491640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec815c600 con 0x7f5ec815ce30 2023-11-20T06:42:38.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ebffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ec815ca50 0x7f5ec814bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:38.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ebffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ec815ca50 0x7f5ec814bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53584/0 (socket says 172.21.15.19:53584) 2023-11-20T06:42:38.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ebffff640 1 -- 172.21.15.19:0/3121269895 learned_addr learned my addr 172.21.15.19:0/3121269895 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:38.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ec6ffd640 1 --2- 172.21.15.19:0/3121269895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ec80b21c0 0x7f5ec8159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:38.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ec77fe640 1 --2- 172.21.15.19:0/3121269895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec815ce30 0x7f5ec80c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:38.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ebffff640 1 -- 172.21.15.19:0/3121269895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec815ce30 msgr2=0x7f5ec80c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:38.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ebffff640 1 --2- 172.21.15.19:0/3121269895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec815ce30 0x7f5ec80c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ebffff640 1 -- 172.21.15.19:0/3121269895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ec80b21c0 msgr2=0x7f5ec8159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:38.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ebffff640 1 --2- 172.21.15.19:0/3121269895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ec80b21c0 0x7f5ec8159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ebffff640 1 -- 172.21.15.19:0/3121269895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec0009a70 con 0x7f5ec815ca50 2023-11-20T06:42:38.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ebffff640 1 --2- 172.21.15.19:0/3121269895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ec815ca50 0x7f5ec814bd70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000c450 tx=0x7f5eb000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:38.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ebf7fe640 1 -- 172.21.15.19:0/3121269895 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0005cf0 con 0x7f5ec815ca50 2023-11-20T06:42:38.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ebf7fe640 1 -- 172.21.15.19:0/3121269895 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb0005e50 con 0x7f5ec815ca50 2023-11-20T06:42:38.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ebf7fe640 1 -- 172.21.15.19:0/3121269895 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0007270 con 0x7f5ec815ca50 2023-11-20T06:42:38.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ecd491640 1 -- 172.21.15.19:0/3121269895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec814c2b0 con 0x7f5ec815ca50 2023-11-20T06:42:38.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ecd491640 1 -- 172.21.15.19:0/3121269895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec80b4ca0 con 0x7f5ec815ca50 2023-11-20T06:42:38.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ecd491640 1 -- 172.21.15.19:0/3121269895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec8074010 con 0x7f5ec815ca50 2023-11-20T06:42:38.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.635+0000 7f5ebf7fe640 1 -- 172.21.15.19:0/3121269895 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5eb00073d0 con 0x7f5ec815ca50 2023-11-20T06:42:38.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.639+0000 7f5ebf7fe640 1 --2- 172.21.15.19:0/3121269895 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f5ea80664a0 0x7f5ea8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:38.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.639+0000 7f5ebf7fe640 1 -- 172.21.15.19:0/3121269895 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5eb00830a0 con 0x7f5ec815ca50 2023-11-20T06:42:38.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.639+0000 7f5ec6ffd640 1 --2- 172.21.15.19:0/3121269895 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f5ea80664a0 0x7f5ea8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:38.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.639+0000 7f5ec6ffd640 1 --2- 172.21.15.19:0/3121269895 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f5ea80664a0 0x7f5ea8068960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009b60 tx=0x7f5eb8009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:38.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.643+0000 7f5ebf7fe640 1 -- 172.21.15.19:0/3121269895 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5eb0050780 con 0x7f5ec815ca50 2023-11-20T06:42:38.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.859+0000 7f5ecd491640 1 -- 172.21.15.19:0/3121269895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f5ec80cddb0 con 0x7f5ec815ca50 2023-11-20T06:42:38.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.863+0000 7f5ebf7fe640 1 -- 172.21.15.19:0/3121269895 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5eb00170a0 con 0x7f5ec815ca50 2023-11-20T06:42:38.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.863+0000 7f5ecd491640 1 -- 172.21.15.19:0/3121269895 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f5ea80664a0 msgr2=0x7f5ea8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:38.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.863+0000 7f5ecd491640 1 --2- 172.21.15.19:0/3121269895 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f5ea80664a0 0x7f5ea8068960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009b60 tx=0x7f5eb8009190 comp rx=0 tx=0).stop 2023-11-20T06:42:38.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.863+0000 7f5ecd491640 1 -- 172.21.15.19:0/3121269895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ec815ca50 msgr2=0x7f5ec814bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:38.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.863+0000 7f5ecd491640 1 --2- 172.21.15.19:0/3121269895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ec815ca50 0x7f5ec814bd70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000c450 tx=0x7f5eb000c910 comp rx=0 tx=0).stop 2023-11-20T06:42:38.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.863+0000 7f5ecd491640 1 -- 172.21.15.19:0/3121269895 shutdown_connections 2023-11-20T06:42:38.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.863+0000 7f5ecd491640 1 --2- 172.21.15.19:0/3121269895 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f5ea80664a0 0x7f5ea8068960 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.863+0000 7f5ecd491640 1 --2- 172.21.15.19:0/3121269895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec815ce30 0x7f5ec80c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.863+0000 7f5ecd491640 1 --2- 172.21.15.19:0/3121269895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ec815ca50 0x7f5ec814bd70 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.863+0000 7f5ecd491640 1 --2- 172.21.15.19:0/3121269895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ec80b21c0 0x7f5ec8159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:38.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.863+0000 7f5ecd491640 1 -- 172.21.15.19:0/3121269895 >> 172.21.15.19:0/3121269895 conn(0x7f5ec80cd1c0 msgr2=0x7f5ec815ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:38.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.863+0000 7f5ecd491640 1 -- 172.21.15.19:0/3121269895 shutdown_connections 2023-11-20T06:42:38.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:38.863+0000 7f5ecd491640 1 -- 172.21.15.19:0/3121269895 wait complete. 2023-11-20T06:42:38.889 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-20T06:42:39.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.027+0000 7f40f6474640 1 Processor -- start 2023-11-20T06:42:39.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.027+0000 7f40f6474640 1 -- start start 2023-11-20T06:42:39.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.027+0000 7f40f6474640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40f015c980 0x7f40f006af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.027+0000 7f40f6474640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f40f015cd60 0x7f40f00b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.027+0000 7f40f6474640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f40f00d0d80 0x7f40f00d11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.027+0000 7f40f6474640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f00cd2b0 con 0x7f40f00d0d80 2023-11-20T06:42:39.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.027+0000 7f40f6474640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f00d3510 con 0x7f40f015cd60 2023-11-20T06:42:39.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.027+0000 7f40f6474640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f00d1710 con 0x7f40f015c980 2023-11-20T06:42:39.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.027+0000 7f40f5c73640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f40f00d0d80 0x7f40f00d11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.027+0000 7f40f5c73640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f40f00d0d80 0x7f40f00d11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53586/0 (socket says 172.21.15.19:53586) 2023-11-20T06:42:39.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.027+0000 7f40f5c73640 1 -- 172.21.15.19:0/1399104691 learned_addr learned my addr 172.21.15.19:0/1399104691 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:39.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.027+0000 7f40f5472640 1 --2- 172.21.15.19:0/1399104691 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40f015c980 0x7f40f006af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.027+0000 7f40f4c71640 1 --2- 172.21.15.19:0/1399104691 >> v2:172.21.15.190:3300/0 conn(0x7f40f015cd60 0x7f40f00b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.027+0000 7f40f5c73640 1 -- 172.21.15.19:0/1399104691 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40f015c980 msgr2=0x7f40f006af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:39.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.027+0000 7f40f5c73640 1 --2- 172.21.15.19:0/1399104691 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40f015c980 0x7f40f006af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.027+0000 7f40f5c73640 1 -- 172.21.15.19:0/1399104691 >> v2:172.21.15.190:3300/0 conn(0x7f40f015cd60 msgr2=0x7f40f00b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:39.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.027+0000 7f40f5c73640 1 --2- 172.21.15.19:0/1399104691 >> v2:172.21.15.190:3300/0 conn(0x7f40f015cd60 0x7f40f00b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.027+0000 7f40f5c73640 1 -- 172.21.15.19:0/1399104691 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f00d2f50 con 0x7f40f00d0d80 2023-11-20T06:42:39.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.027+0000 7f40f4c71640 1 --2- 172.21.15.19:0/1399104691 >> v2:172.21.15.190:3300/0 conn(0x7f40f015cd60 0x7f40f00b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:39.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.031+0000 7f40f5c73640 1 --2- 172.21.15.19:0/1399104691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40f00d0d80 0x7f40f00d11d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f40f008ca20 tx=0x7f40e801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff9c1020bf77b45 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:39.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.031+0000 7f40e7fff640 1 -- 172.21.15.19:0/1399104691 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e80a5760 con 0x7f40f00d0d80 2023-11-20T06:42:39.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.031+0000 7f40e7fff640 1 -- 172.21.15.19:0/1399104691 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e80a58c0 con 0x7f40f00d0d80 2023-11-20T06:42:39.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.031+0000 7f40e7fff640 1 -- 172.21.15.19:0/1399104691 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e80a5c50 con 0x7f40f00d0d80 2023-11-20T06:42:39.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.031+0000 7f40f6474640 1 -- 172.21.15.19:0/1399104691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40f00d0d80 msgr2=0x7f40f00d11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:39.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.031+0000 7f40f6474640 1 --2- 172.21.15.19:0/1399104691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40f00d0d80 0x7f40f00d11d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f40f008ca20 tx=0x7f40e801c9d0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.031+0000 7f40f6474640 1 -- 172.21.15.19:0/1399104691 shutdown_connections 2023-11-20T06:42:39.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.031+0000 7f40f6474640 1 --2- 172.21.15.19:0/1399104691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40f00d0d80 0x7f40f00d11d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.031+0000 7f40f6474640 1 --2- 172.21.15.19:0/1399104691 >> v2:172.21.15.190:3300/0 conn(0x7f40f015cd60 0x7f40f00b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.031+0000 7f40f6474640 1 --2- 172.21.15.19:0/1399104691 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40f015c980 0x7f40f006af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.031+0000 7f40f6474640 1 -- 172.21.15.19:0/1399104691 >> 172.21.15.19:0/1399104691 conn(0x7f40f009ba80 msgr2=0x7f40f00d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:39.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.031+0000 7f40f6474640 1 -- 172.21.15.19:0/1399104691 shutdown_connections 2023-11-20T06:42:39.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.031+0000 7f40f6474640 1 -- 172.21.15.19:0/1399104691 wait complete. 2023-11-20T06:42:39.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f6474640 1 Processor -- start 2023-11-20T06:42:39.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f6474640 1 -- start start 2023-11-20T06:42:39.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f6474640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40f00d0d80 0x7f40f00c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f6474640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40f015c980 0x7f40f0155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f6474640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40f015cd60 0x7f40f00c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f6474640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f00c91b0 con 0x7f40f015c980 2023-11-20T06:42:39.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f6474640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f00b66f0 con 0x7f40f00d0d80 2023-11-20T06:42:39.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f6474640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0155d50 con 0x7f40f015cd60 2023-11-20T06:42:39.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f4c71640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40f015c980 0x7f40f0155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f4c71640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40f015c980 0x7f40f0155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53598/0 (socket says 172.21.15.19:53598) 2023-11-20T06:42:39.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f4c71640 1 -- 172.21.15.19:0/3207390473 learned_addr learned my addr 172.21.15.19:0/3207390473 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:39.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f5c73640 1 --2- 172.21.15.19:0/3207390473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40f015cd60 0x7f40f00c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f5472640 1 --2- 172.21.15.19:0/3207390473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40f00d0d80 0x7f40f00c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f4c71640 1 -- 172.21.15.19:0/3207390473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40f015cd60 msgr2=0x7f40f00c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:39.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f4c71640 1 --2- 172.21.15.19:0/3207390473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40f015cd60 0x7f40f00c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f4c71640 1 -- 172.21.15.19:0/3207390473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40f00d0d80 msgr2=0x7f40f00c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:39.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f4c71640 1 --2- 172.21.15.19:0/3207390473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40f00d0d80 0x7f40f00c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f4c71640 1 -- 172.21.15.19:0/3207390473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e8009b30 con 0x7f40f015c980 2023-11-20T06:42:39.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f5c73640 1 --2- 172.21.15.19:0/3207390473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40f015cd60 0x7f40f00c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:39.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f5472640 1 --2- 172.21.15.19:0/3207390473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40f00d0d80 0x7f40f00c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:39.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f4c71640 1 --2- 172.21.15.19:0/3207390473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40f015c980 0x7f40f0155810 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f40e000d830 tx=0x7f40e000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:39.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40e5ffb640 1 -- 172.21.15.19:0/3207390473 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e00096c0 con 0x7f40f015c980 2023-11-20T06:42:39.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40e5ffb640 1 -- 172.21.15.19:0/3207390473 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e0009820 con 0x7f40f015c980 2023-11-20T06:42:39.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f6474640 1 -- 172.21.15.19:0/3207390473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f00c6790 con 0x7f40f015c980 2023-11-20T06:42:39.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40e5ffb640 1 -- 172.21.15.19:0/3207390473 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e0009bd0 con 0x7f40f015c980 2023-11-20T06:42:39.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.035+0000 7f40f6474640 1 -- 172.21.15.19:0/3207390473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f00c6fd0 con 0x7f40f015c980 2023-11-20T06:42:39.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.039+0000 7f40f6474640 1 -- 172.21.15.19:0/3207390473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f004e9c0 con 0x7f40f015c980 2023-11-20T06:42:39.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.039+0000 7f40e5ffb640 1 -- 172.21.15.19:0/3207390473 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f40e0009d30 con 0x7f40f015c980 2023-11-20T06:42:39.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.039+0000 7f40e5ffb640 1 --2- 172.21.15.19:0/3207390473 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f40d40664a0 0x7f40d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.039+0000 7f40e5ffb640 1 -- 172.21.15.19:0/3207390473 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f40e0084360 con 0x7f40f015c980 2023-11-20T06:42:39.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.039+0000 7f40f5472640 1 --2- 172.21.15.19:0/3207390473 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f40d40664a0 0x7f40d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.039+0000 7f40f5472640 1 --2- 172.21.15.19:0/3207390473 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f40d40664a0 0x7f40d4068960 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009a40 tx=0x7f40ec008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:39.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.043+0000 7f40e5ffb640 1 -- 172.21.15.19:0/3207390473 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f40e00519e0 con 0x7f40f015c980 2023-11-20T06:42:39.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.255+0000 7f40f6474640 1 -- 172.21.15.19:0/3207390473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f40f00d36b0 con 0x7f40f015c980 2023-11-20T06:42:39.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.259+0000 7f40e5ffb640 1 -- 172.21.15.19:0/3207390473 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f40e0055000 con 0x7f40f015c980 2023-11-20T06:42:39.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.263+0000 7f40f6474640 1 -- 172.21.15.19:0/3207390473 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f40d40664a0 msgr2=0x7f40d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:39.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.263+0000 7f40f6474640 1 --2- 172.21.15.19:0/3207390473 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f40d40664a0 0x7f40d4068960 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009a40 tx=0x7f40ec008040 comp rx=0 tx=0).stop 2023-11-20T06:42:39.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.263+0000 7f40f6474640 1 -- 172.21.15.19:0/3207390473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40f015c980 msgr2=0x7f40f0155810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:39.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.263+0000 7f40f6474640 1 --2- 172.21.15.19:0/3207390473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40f015c980 0x7f40f0155810 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f40e000d830 tx=0x7f40e000dcf0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.263+0000 7f40f6474640 1 -- 172.21.15.19:0/3207390473 shutdown_connections 2023-11-20T06:42:39.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.263+0000 7f40f6474640 1 --2- 172.21.15.19:0/3207390473 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f40d40664a0 0x7f40d4068960 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.263+0000 7f40f6474640 1 --2- 172.21.15.19:0/3207390473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40f015cd60 0x7f40f00c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.263+0000 7f40f6474640 1 --2- 172.21.15.19:0/3207390473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40f015c980 0x7f40f0155810 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.263+0000 7f40f6474640 1 --2- 172.21.15.19:0/3207390473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40f00d0d80 0x7f40f00c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.263+0000 7f40f6474640 1 -- 172.21.15.19:0/3207390473 >> 172.21.15.19:0/3207390473 conn(0x7f40f009ba80 msgr2=0x7f40f00afe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:39.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.263+0000 7f40f6474640 1 -- 172.21.15.19:0/3207390473 shutdown_connections 2023-11-20T06:42:39.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.263+0000 7f40f6474640 1 -- 172.21.15.19:0/3207390473 wait complete. 2023-11-20T06:42:39.287 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-20T06:42:39.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.423+0000 7f14ddec9640 1 Processor -- start 2023-11-20T06:42:39.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14ddec9640 1 -- start start 2023-11-20T06:42:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14ddec9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f14d80cf090 0x7f14d80cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14ddec9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14d80c6ad0 0x7f14d80c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14ddec9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d80c65f0 con 0x7f14d815ca70 2023-11-20T06:42:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14ddec9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d80cfa60 con 0x7f14d80cf090 2023-11-20T06:42:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14ddec9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80ce820 con 0x7f14d80c6ad0 2023-11-20T06:42:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d77fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f14d815ca70 0x7f14d80d3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39146/0 (socket says 172.21.15.19:39146) 2023-11-20T06:42:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d77fe640 1 -- 172.21.15.19:0/210228589 learned_addr learned my addr 172.21.15.19:0/210228589 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d7fff640 1 --2- 172.21.15.19:0/210228589 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14d80c6ad0 0x7f14d80c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d6ffd640 1 --2- 172.21.15.19:0/210228589 >> v2:172.21.15.190:3300/0 conn(0x7f14d80cf090 0x7f14d80cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d67fc640 1 -- 172.21.15.19:0/210228589 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644736037 0 0) 0x7f14d80c65f0 con 0x7f14d815ca70 2023-11-20T06:42:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d67fc640 1 -- 172.21.15.19:0/210228589 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14c0003530 con 0x7f14d815ca70 2023-11-20T06:42:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d67fc640 1 -- 172.21.15.19:0/210228589 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4205405402 0 0) 0x7f14c0003530 con 0x7f14d815ca70 2023-11-20T06:42:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d67fc640 1 -- 172.21.15.19:0/210228589 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14d80c6ad0 msgr2=0x7f14d80c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d67fc640 1 --2- 172.21.15.19:0/210228589 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14d80c6ad0 0x7f14d80c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d67fc640 1 -- 172.21.15.19:0/210228589 >> v2:172.21.15.190:3300/0 conn(0x7f14d80cf090 msgr2=0x7f14d80cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d67fc640 1 --2- 172.21.15.19:0/210228589 >> v2:172.21.15.190:3300/0 conn(0x7f14d80cf090 0x7f14d80cf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d67fc640 1 -- 172.21.15.19:0/210228589 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d80cdf80 con 0x7f14d815ca70 2023-11-20T06:42:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d67fc640 1 -- 172.21.15.19:0/210228589 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7f14c8001800 con 0x7f14d815ca70 2023-11-20T06:42:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d67fc640 1 -- 172.21.15.19:0/210228589 >> v1:172.21.15.19:6789/0 conn(0x7f14d815ca70 legacy=0x7f14d80d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d67fc640 1 --2- 172.21.15.19:0/210228589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14c0003980 0x7f14c0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d67fc640 1 --2- 172.21.15.19:0/210228589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14c00047d0 0x7f14c0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d67fc640 1 --2- 172.21.15.19:0/210228589 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14d80c6ad0 0x7f14c0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d67fc640 1 -- 172.21.15.19:0/210228589 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80cfa60 con 0x7f14c0003980 2023-11-20T06:42:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d67fc640 1 -- 172.21.15.19:0/210228589 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80ce820 con 0x7f14c00047d0 2023-11-20T06:42:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d67fc640 1 -- 172.21.15.19:0/210228589 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c000b990 con 0x7f14d80c6ad0 2023-11-20T06:42:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d77fe640 1 --2- 172.21.15.19:0/210228589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14c0003980 0x7f14c0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d6ffd640 1 --2- 172.21.15.19:0/210228589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14c00047d0 0x7f14c0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d7fff640 1 --2- 172.21.15.19:0/210228589 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14d80c6ad0 0x7f14c0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d77fe640 1 -- 172.21.15.19:0/210228589 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14d80c6ad0 msgr2=0x7f14c0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d77fe640 1 --2- 172.21.15.19:0/210228589 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14d80c6ad0 0x7f14c0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d77fe640 1 -- 172.21.15.19:0/210228589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14c00047d0 msgr2=0x7f14c0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d77fe640 1 --2- 172.21.15.19:0/210228589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14c00047d0 0x7f14c0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.427+0000 7f14d77fe640 1 -- 172.21.15.19:0/210228589 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c0003530 con 0x7f14c0003980 2023-11-20T06:42:39.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.431+0000 7f14d77fe640 1 --2- 172.21.15.19:0/210228589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14c0003980 0x7f14c0003da0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f14c800c240 tx=0x7f14c801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb4210438f79a5e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:39.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.431+0000 7f14d67fc640 1 -- 172.21.15.19:0/210228589 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c80070d0 con 0x7f14c0003980 2023-11-20T06:42:39.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.431+0000 7f14d67fc640 1 -- 172.21.15.19:0/210228589 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c8007230 con 0x7f14c0003980 2023-11-20T06:42:39.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.431+0000 7f14d67fc640 1 -- 172.21.15.19:0/210228589 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8007600 con 0x7f14c0003980 2023-11-20T06:42:39.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.431+0000 7f14ddec9640 1 -- 172.21.15.19:0/210228589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14c0003980 msgr2=0x7f14c0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:39.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.431+0000 7f14ddec9640 1 --2- 172.21.15.19:0/210228589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14c0003980 0x7f14c0003da0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f14c800c240 tx=0x7f14c801cc30 comp rx=0 tx=0).stop 2023-11-20T06:42:39.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.431+0000 7f14d7fff640 1 -- 172.21.15.19:0/210228589 reap_dead start 2023-11-20T06:42:39.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.431+0000 7f14ddec9640 1 -- 172.21.15.19:0/210228589 shutdown_connections 2023-11-20T06:42:39.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.431+0000 7f14ddec9640 1 -- 172.21.15.19:0/210228589 >> 172.21.15.19:0/210228589 conn(0x7f14d809bc50 msgr2=0x7f14d80d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:39.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.431+0000 7f14ddec9640 1 -- 172.21.15.19:0/210228589 shutdown_connections 2023-11-20T06:42:39.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.431+0000 7f14ddec9640 1 -- 172.21.15.19:0/210228589 wait complete. 2023-11-20T06:42:39.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14ddec9640 1 Processor -- start 2023-11-20T06:42:39.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14ddec9640 1 -- start start 2023-11-20T06:42:39.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14ddec9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14c0003980 0x7f14d815a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14ddec9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14d80cb7c0 0x7f14d80cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14ddec9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14d815f150 0x7f14d815f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14ddec9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80cc180 con 0x7f14d815f150 2023-11-20T06:42:39.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14ddec9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d81f92d0 con 0x7f14c0003980 2023-11-20T06:42:39.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14ddec9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d81f8510 con 0x7f14d80cb7c0 2023-11-20T06:42:39.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14d7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14d815f150 0x7f14d815f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14d77fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14c0003980 0x7f14d815a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14d7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14d815f150 0x7f14d815f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53624/0 (socket says 172.21.15.19:53624) 2023-11-20T06:42:39.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14d7fff640 1 -- 172.21.15.19:0/837486250 learned_addr learned my addr 172.21.15.19:0/837486250 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:39.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14d6ffd640 1 --2- 172.21.15.19:0/837486250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14d80cb7c0 0x7f14d80cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14d7fff640 1 -- 172.21.15.19:0/837486250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14d80cb7c0 msgr2=0x7f14d80cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:39.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14d7fff640 1 --2- 172.21.15.19:0/837486250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14d80cb7c0 0x7f14d80cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14d7fff640 1 -- 172.21.15.19:0/837486250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14c0003980 msgr2=0x7f14d815a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:39.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14d7fff640 1 --2- 172.21.15.19:0/837486250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14c0003980 0x7f14d815a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14d7fff640 1 -- 172.21.15.19:0/837486250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d80d38a0 con 0x7f14d815f150 2023-11-20T06:42:39.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14d77fe640 1 --2- 172.21.15.19:0/837486250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14c0003980 0x7f14d815a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:42:39.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14d7fff640 1 --2- 172.21.15.19:0/837486250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14d815f150 0x7f14d815f5d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f14d80b43c0 tx=0x7f14d000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:39.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14bffff640 1 -- 172.21.15.19:0/837486250 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d000e040 con 0x7f14d815f150 2023-11-20T06:42:39.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14bffff640 1 -- 172.21.15.19:0/837486250 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d000f040 con 0x7f14d815f150 2023-11-20T06:42:39.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14bffff640 1 -- 172.21.15.19:0/837486250 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0015430 con 0x7f14d815f150 2023-11-20T06:42:39.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14ddec9640 1 -- 172.21.15.19:0/837486250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d81f87f0 con 0x7f14d815f150 2023-11-20T06:42:39.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.435+0000 7f14ddec9640 1 -- 172.21.15.19:0/837486250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d81f8db0 con 0x7f14d815f150 2023-11-20T06:42:39.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.439+0000 7f14ddec9640 1 -- 172.21.15.19:0/837486250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d81f8fa0 con 0x7f14d815f150 2023-11-20T06:42:39.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.439+0000 7f14bffff640 1 -- 172.21.15.19:0/837486250 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f14d0015590 con 0x7f14d815f150 2023-11-20T06:42:39.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.439+0000 7f14bffff640 1 --2- 172.21.15.19:0/837486250 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f14c40664a0 0x7f14c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.439+0000 7f14bffff640 1 -- 172.21.15.19:0/837486250 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f14d0084380 con 0x7f14d815f150 2023-11-20T06:42:39.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.439+0000 7f14d77fe640 1 --2- 172.21.15.19:0/837486250 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f14c40664a0 0x7f14c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.439+0000 7f14d77fe640 1 --2- 172.21.15.19:0/837486250 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f14c40664a0 0x7f14c4068960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f14c80aa000 tx=0x7f14c80b0040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:39.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.443+0000 7f14bffff640 1 -- 172.21.15.19:0/837486250 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f14d0051970 con 0x7f14d815f150 2023-11-20T06:42:39.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.655+0000 7f14ddec9640 1 -- 172.21.15.19:0/837486250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f14d80d36a0 con 0x7f14d815f150 2023-11-20T06:42:39.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.659+0000 7f14bffff640 1 -- 172.21.15.19:0/837486250 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f14d0054f90 con 0x7f14d815f150 2023-11-20T06:42:39.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.659+0000 7f14ddec9640 1 -- 172.21.15.19:0/837486250 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f14c40664a0 msgr2=0x7f14c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:39.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.659+0000 7f14ddec9640 1 --2- 172.21.15.19:0/837486250 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f14c40664a0 0x7f14c4068960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f14c80aa000 tx=0x7f14c80b0040 comp rx=0 tx=0).stop 2023-11-20T06:42:39.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.659+0000 7f14ddec9640 1 -- 172.21.15.19:0/837486250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14d815f150 msgr2=0x7f14d815f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:39.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.659+0000 7f14ddec9640 1 --2- 172.21.15.19:0/837486250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14d815f150 0x7f14d815f5d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f14d80b43c0 tx=0x7f14d000f1b0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.659+0000 7f14ddec9640 1 -- 172.21.15.19:0/837486250 shutdown_connections 2023-11-20T06:42:39.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.659+0000 7f14ddec9640 1 --2- 172.21.15.19:0/837486250 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f14c40664a0 0x7f14c4068960 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.659+0000 7f14ddec9640 1 --2- 172.21.15.19:0/837486250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14d815f150 0x7f14d815f5d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.659+0000 7f14ddec9640 1 --2- 172.21.15.19:0/837486250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14d80cb7c0 0x7f14d80cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.659+0000 7f14ddec9640 1 --2- 172.21.15.19:0/837486250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14c0003980 0x7f14d815a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.659+0000 7f14ddec9640 1 -- 172.21.15.19:0/837486250 >> 172.21.15.19:0/837486250 conn(0x7f14d809bc50 msgr2=0x7f14d80b7720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:39.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.659+0000 7f14ddec9640 1 -- 172.21.15.19:0/837486250 shutdown_connections 2023-11-20T06:42:39.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.659+0000 7f14ddec9640 1 -- 172.21.15.19:0/837486250 wait complete. 2023-11-20T06:42:39.685 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:39.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f02722d6640 1 Processor -- start 2023-11-20T06:42:39.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f02722d6640 1 -- start start 2023-11-20T06:42:39.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f02722d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f026c1597c0 0x7f026c0ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f02722d6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f026c0adc10 0x7f026c0cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f02722d6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026c0723d0 con 0x7f026c159ba0 2023-11-20T06:42:39.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f02722d6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026c0717c0 con 0x7f026c0adc10 2023-11-20T06:42:39.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f02722d6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026c071aa0 con 0x7f026c1597c0 2023-11-20T06:42:39.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026b7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f026c159ba0 0x7f026c0cae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39162/0 (socket says 172.21.15.19:39162) 2023-11-20T06:42:39.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026b7fe640 1 -- 172.21.15.19:0/3551904285 learned_addr learned my addr 172.21.15.19:0/3551904285 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:39.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026bfff640 1 --2- 172.21.15.19:0/3551904285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f026c1597c0 0x7f026c0ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f0270873640 1 --2- 172.21.15.19:0/3551904285 >> v2:172.21.15.190:3300/0 conn(0x7f026c0adc10 0x7f026c0cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026affd640 1 -- 172.21.15.19:0/3551904285 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3311863951 0 0) 0x7f026c0723d0 con 0x7f026c159ba0 2023-11-20T06:42:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026affd640 1 -- 172.21.15.19:0/3551904285 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0254005740 con 0x7f026c159ba0 2023-11-20T06:42:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026affd640 1 -- 172.21.15.19:0/3551904285 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2404593204 0 0) 0x7f0254005740 con 0x7f026c159ba0 2023-11-20T06:42:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026affd640 1 -- 172.21.15.19:0/3551904285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f026c1597c0 msgr2=0x7f026c0ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026affd640 1 --2- 172.21.15.19:0/3551904285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f026c1597c0 0x7f026c0ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026affd640 1 -- 172.21.15.19:0/3551904285 >> v2:172.21.15.190:3300/0 conn(0x7f026c0adc10 msgr2=0x7f026c0cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026affd640 1 --2- 172.21.15.19:0/3551904285 >> v2:172.21.15.190:3300/0 conn(0x7f026c0adc10 0x7f026c0cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026affd640 1 -- 172.21.15.19:0/3551904285 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026c071d80 con 0x7f026c159ba0 2023-11-20T06:42:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026affd640 1 -- 172.21.15.19:0/3551904285 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7f0260001680 con 0x7f026c159ba0 2023-11-20T06:42:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026affd640 1 -- 172.21.15.19:0/3551904285 >> v1:172.21.15.19:6789/0 conn(0x7f026c159ba0 legacy=0x7f026c0cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026affd640 1 --2- 172.21.15.19:0/3551904285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0254005b90 0x7f0254005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026affd640 1 --2- 172.21.15.19:0/3551904285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f026c1597c0 0x7f02540069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026affd640 1 --2- 172.21.15.19:0/3551904285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0254006f20 0x7f02540073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026affd640 1 -- 172.21.15.19:0/3551904285 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c0717c0 con 0x7f0254006f20 2023-11-20T06:42:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026affd640 1 -- 172.21.15.19:0/3551904285 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c071aa0 con 0x7f0254005b90 2023-11-20T06:42:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026affd640 1 -- 172.21.15.19:0/3551904285 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025400dba0 con 0x7f026c1597c0 2023-11-20T06:42:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f0270873640 1 --2- 172.21.15.19:0/3551904285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0254006f20 0x7f02540073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026bfff640 1 --2- 172.21.15.19:0/3551904285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0254005b90 0x7f0254005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.823+0000 7f026b7fe640 1 --2- 172.21.15.19:0/3551904285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f026c1597c0 0x7f02540069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.827+0000 7f0270873640 1 -- 172.21.15.19:0/3551904285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f026c1597c0 msgr2=0x7f02540069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.827+0000 7f0270873640 1 --2- 172.21.15.19:0/3551904285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f026c1597c0 0x7f02540069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.827+0000 7f0270873640 1 -- 172.21.15.19:0/3551904285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0254005b90 msgr2=0x7f0254005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.827+0000 7f0270873640 1 --2- 172.21.15.19:0/3551904285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0254005b90 0x7f0254005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.827+0000 7f0270873640 1 -- 172.21.15.19:0/3551904285 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0254005740 con 0x7f0254006f20 2023-11-20T06:42:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.827+0000 7f026b7fe640 1 --2- 172.21.15.19:0/3551904285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f026c1597c0 0x7f02540069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:39.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.827+0000 7f0270873640 1 --2- 172.21.15.19:0/3551904285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0254006f20 0x7f02540073a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0264009fc0 tx=0x7f026401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae927890ea0bcd2c server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:39.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.827+0000 7f026affd640 1 -- 172.21.15.19:0/3551904285 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02640a5cb0 con 0x7f0254006f20 2023-11-20T06:42:39.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.827+0000 7f026affd640 1 -- 172.21.15.19:0/3551904285 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026400f040 con 0x7f0254006f20 2023-11-20T06:42:39.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.827+0000 7f026affd640 1 -- 172.21.15.19:0/3551904285 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02640ad680 con 0x7f0254006f20 2023-11-20T06:42:39.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.827+0000 7f02722d6640 1 -- 172.21.15.19:0/3551904285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0254006f20 msgr2=0x7f02540073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:39.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.827+0000 7f02722d6640 1 --2- 172.21.15.19:0/3551904285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0254006f20 0x7f02540073a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0264009fc0 tx=0x7f026401cca0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.827+0000 7f0270873640 1 -- 172.21.15.19:0/3551904285 reap_dead start 2023-11-20T06:42:39.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.827+0000 7f02722d6640 1 -- 172.21.15.19:0/3551904285 shutdown_connections 2023-11-20T06:42:39.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.827+0000 7f02722d6640 1 -- 172.21.15.19:0/3551904285 >> 172.21.15.19:0/3551904285 conn(0x7f026c06c190 msgr2=0x7f026c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:39.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.827+0000 7f02722d6640 1 -- 172.21.15.19:0/3551904285 shutdown_connections 2023-11-20T06:42:39.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.827+0000 7f02722d6640 1 -- 172.21.15.19:0/3551904285 wait complete. 2023-11-20T06:42:39.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f02722d6640 1 Processor -- start 2023-11-20T06:42:39.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f02722d6640 1 -- start start 2023-11-20T06:42:39.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f02722d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0254006f20 0x7f026c0c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f02722d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f026c0c87a0 0x7f026c1e4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f02722d6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f026c1e4880 0x7f026c1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f02722d6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c0c6b50 con 0x7f0254006f20 2023-11-20T06:42:39.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f02722d6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c154690 con 0x7f026c1e4880 2023-11-20T06:42:39.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f02722d6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026c1540d0 con 0x7f026c0c87a0 2023-11-20T06:42:39.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f026bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0254006f20 0x7f026c0c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f026bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0254006f20 0x7f026c0c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53628/0 (socket says 172.21.15.19:53628) 2023-11-20T06:42:39.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f026bfff640 1 -- 172.21.15.19:0/2972346880 learned_addr learned my addr 172.21.15.19:0/2972346880 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:39.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f0270873640 1 --2- 172.21.15.19:0/2972346880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f026c1e4880 0x7f026c1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f026b7fe640 1 --2- 172.21.15.19:0/2972346880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f026c0c87a0 0x7f026c1e4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f026bfff640 1 -- 172.21.15.19:0/2972346880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f026c0c87a0 msgr2=0x7f026c1e4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:39.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f026bfff640 1 --2- 172.21.15.19:0/2972346880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f026c0c87a0 0x7f026c1e4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f026bfff640 1 -- 172.21.15.19:0/2972346880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f026c1e4880 msgr2=0x7f026c1536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:39.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f026bfff640 1 --2- 172.21.15.19:0/2972346880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f026c1e4880 0x7f026c1536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:39.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f026bfff640 1 -- 172.21.15.19:0/2972346880 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026c1543b0 con 0x7f0254006f20 2023-11-20T06:42:39.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f026b7fe640 1 --2- 172.21.15.19:0/2972346880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f026c0c87a0 0x7f026c1e4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f026bfff640 1 --2- 172.21.15.19:0/2972346880 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0254006f20 0x7f026c0c9f80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f025c011960 tx=0x7f025c011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f0268ff9640 1 -- 172.21.15.19:0/2972346880 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c00faf0 con 0x7f0254006f20 2023-11-20T06:42:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f0268ff9640 1 -- 172.21.15.19:0/2972346880 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c00fc50 con 0x7f0254006f20 2023-11-20T06:42:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.831+0000 7f0268ff9640 1 -- 172.21.15.19:0/2972346880 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c014440 con 0x7f0254006f20 2023-11-20T06:42:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.835+0000 7f02722d6640 1 -- 172.21.15.19:0/2972346880 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026c0c6d80 con 0x7f0254006f20 2023-11-20T06:42:39.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.835+0000 7f02722d6640 1 -- 172.21.15.19:0/2972346880 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026c0ca4c0 con 0x7f0254006f20 2023-11-20T06:42:39.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.835+0000 7f02722d6640 1 -- 172.21.15.19:0/2972346880 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026c071450 con 0x7f0254006f20 2023-11-20T06:42:39.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.835+0000 7f0268ff9640 1 -- 172.21.15.19:0/2972346880 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f025c0145a0 con 0x7f0254006f20 2023-11-20T06:42:39.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.835+0000 7f0268ff9640 1 --2- 172.21.15.19:0/2972346880 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f02580664a0 0x7f0258068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:39.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.835+0000 7f0268ff9640 1 -- 172.21.15.19:0/2972346880 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f025c084470 con 0x7f0254006f20 2023-11-20T06:42:39.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.835+0000 7f026b7fe640 1 --2- 172.21.15.19:0/2972346880 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f02580664a0 0x7f0258068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:39.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.839+0000 7f026b7fe640 1 --2- 172.21.15.19:0/2972346880 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f02580664a0 0x7f0258068960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f026c0cc870 tx=0x7f0260009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:39.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.839+0000 7f0268ff9640 1 -- 172.21.15.19:0/2972346880 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f025c051af0 con 0x7f0254006f20 2023-11-20T06:42:40.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.999+0000 7f02722d6640 1 -- 172.21.15.19:0/2972346880 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f026c074010 con 0x7f0254006f20 2023-11-20T06:42:40.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.999+0000 7f0268ff9640 1 -- 172.21.15.19:0/2972346880 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13050 (secure 0 0 0) 0x7f025c055110 con 0x7f0254006f20 2023-11-20T06:42:40.004 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:40.004 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":35,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:42:36.865444+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:40.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.999+0000 7f02722d6640 1 -- 172.21.15.19:0/2972346880 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f02580664a0 msgr2=0x7f0258068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:40.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.999+0000 7f02722d6640 1 --2- 172.21.15.19:0/2972346880 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f02580664a0 0x7f0258068960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f026c0cc870 tx=0x7f0260009040 comp rx=0 tx=0).stop 2023-11-20T06:42:40.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.999+0000 7f02722d6640 1 -- 172.21.15.19:0/2972346880 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0254006f20 msgr2=0x7f026c0c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:40.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.999+0000 7f02722d6640 1 --2- 172.21.15.19:0/2972346880 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0254006f20 0x7f026c0c9f80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f025c011960 tx=0x7f025c011e20 comp rx=0 tx=0).stop 2023-11-20T06:42:40.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.999+0000 7f02722d6640 1 -- 172.21.15.19:0/2972346880 shutdown_connections 2023-11-20T06:42:40.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.999+0000 7f02722d6640 1 --2- 172.21.15.19:0/2972346880 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f02580664a0 0x7f0258068960 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.999+0000 7f02722d6640 1 --2- 172.21.15.19:0/2972346880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f026c1e4880 0x7f026c1536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.999+0000 7f02722d6640 1 --2- 172.21.15.19:0/2972346880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f026c0c87a0 0x7f026c1e4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.999+0000 7f02722d6640 1 --2- 172.21.15.19:0/2972346880 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0254006f20 0x7f026c0c9f80 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.999+0000 7f02722d6640 1 -- 172.21.15.19:0/2972346880 >> 172.21.15.19:0/2972346880 conn(0x7f026c06c190 msgr2=0x7f026c0c9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:40.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.999+0000 7f02722d6640 1 -- 172.21.15.19:0/2972346880 shutdown_connections 2023-11-20T06:42:40.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:39.999+0000 7f02722d6640 1 -- 172.21.15.19:0/2972346880 wait complete. 2023-11-20T06:42:40.026 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-20T06:42:40.026 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:42:40.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.167+0000 7fd624c91640 1 Processor -- start 2023-11-20T06:42:40.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.167+0000 7fd624c91640 1 -- start start 2023-11-20T06:42:40.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.167+0000 7fd624c91640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd62006d010 0x7fd6200c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:40.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.167+0000 7fd624c91640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62015ae30 con 0x7fd620069e90 2023-11-20T06:42:40.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.167+0000 7fd624c91640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6200ca510 con 0x7fd6200c26b0 2023-11-20T06:42:40.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.167+0000 7fd624c91640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6200cb090 con 0x7fd62006d010 2023-11-20T06:42:40.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.167+0000 7fd61e59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd620069e90 0x7fd62006a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39166/0 (socket says 172.21.15.19:39166) 2023-11-20T06:42:40.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.167+0000 7fd61e59c640 1 -- 172.21.15.19:0/2421034448 learned_addr learned my addr 172.21.15.19:0/2421034448 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:40.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.167+0000 7fd617fff640 1 --2- 172.21.15.19:0/2421034448 >> v2:172.21.15.190:3300/0 conn(0x7fd62006d010 0x7fd6200c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:40.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.167+0000 7fd61dd9b640 1 -- 172.21.15.19:0/2421034448 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621950072 0 0) 0x7fd62015ae30 con 0x7fd620069e90 2023-11-20T06:42:40.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.167+0000 7fd61dd9b640 1 -- 172.21.15.19:0/2421034448 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd60c003530 con 0x7fd620069e90 2023-11-20T06:42:40.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.167+0000 7fd617fff640 1 -- 172.21.15.19:0/2421034448 >> v1:172.21.15.190:6789/0 conn(0x7fd6200c26b0 legacy=0x7fd6200c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:40.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.167+0000 7fd617fff640 1 -- 172.21.15.19:0/2421034448 >> v1:172.21.15.19:6789/0 conn(0x7fd620069e90 legacy=0x7fd62006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:40.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.167+0000 7fd61dd9b640 1 -- 172.21.15.19:0/2421034448 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 336367249 0 0) 0x7fd60c003530 con 0x7fd620069e90 2023-11-20T06:42:40.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.167+0000 7fd617fff640 1 -- 172.21.15.19:0/2421034448 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6200ca7f0 con 0x7fd62006d010 2023-11-20T06:42:40.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.171+0000 7fd617fff640 1 --2- 172.21.15.19:0/2421034448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd62006d010 0x7fd6200c9ce0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd6080097c0 tx=0x7fd60801eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac066a3a02392069 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:40.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.171+0000 7fd61dd9b640 1 -- 172.21.15.19:0/2421034448 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd610001680 con 0x7fd62006d010 2023-11-20T06:42:40.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.171+0000 7fd61dd9b640 1 -- 172.21.15.19:0/2421034448 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6080a8610 con 0x7fd62006d010 2023-11-20T06:42:40.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.171+0000 7fd61dd9b640 1 -- 172.21.15.19:0/2421034448 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6080a89a0 con 0x7fd62006d010 2023-11-20T06:42:40.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.171+0000 7fd624c91640 1 -- 172.21.15.19:0/2421034448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd62006d010 msgr2=0x7fd6200c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:40.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.171+0000 7fd624c91640 1 --2- 172.21.15.19:0/2421034448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd62006d010 0x7fd6200c9ce0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd6080097c0 tx=0x7fd60801eb90 comp rx=0 tx=0).stop 2023-11-20T06:42:40.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.171+0000 7fd624c91640 1 -- 172.21.15.19:0/2421034448 shutdown_connections 2023-11-20T06:42:40.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.171+0000 7fd624c91640 1 --2- 172.21.15.19:0/2421034448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd62006d010 0x7fd6200c9ce0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.171+0000 7fd624c91640 1 -- 172.21.15.19:0/2421034448 >> 172.21.15.19:0/2421034448 conn(0x7fd6200b0da0 msgr2=0x7fd6200ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:40.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.171+0000 7fd624c91640 1 -- 172.21.15.19:0/2421034448 shutdown_connections 2023-11-20T06:42:40.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.171+0000 7fd624c91640 1 -- 172.21.15.19:0/2421034448 wait complete. 2023-11-20T06:42:40.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd624c91640 1 Processor -- start 2023-11-20T06:42:40.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd624c91640 1 -- start start 2023-11-20T06:42:40.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd624c91640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd620069e90 0x7fd620148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:40.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd624c91640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd62006d010 0x7fd6200c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:40.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd624c91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6200c26b0 0x7fd6200c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:40.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd624c91640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6200c61a0 con 0x7fd6200c26b0 2023-11-20T06:42:40.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd624c91640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6200c6480 con 0x7fd62006d010 2023-11-20T06:42:40.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd624c91640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6200c6760 con 0x7fd620069e90 2023-11-20T06:42:40.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd61ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6200c26b0 0x7fd6200c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:40.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd61ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6200c26b0 0x7fd6200c7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53640/0 (socket says 172.21.15.19:53640) 2023-11-20T06:42:40.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd61ed9d640 1 -- 172.21.15.19:0/3993242522 learned_addr learned my addr 172.21.15.19:0/3993242522 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:40.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd61e59c640 1 --2- 172.21.15.19:0/3993242522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd620069e90 0x7fd620148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:40.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd617fff640 1 --2- 172.21.15.19:0/3993242522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd62006d010 0x7fd6200c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:40.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd61ed9d640 1 -- 172.21.15.19:0/3993242522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd620069e90 msgr2=0x7fd620148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:40.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd61ed9d640 1 --2- 172.21.15.19:0/3993242522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd620069e90 0x7fd620148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd61ed9d640 1 -- 172.21.15.19:0/3993242522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd62006d010 msgr2=0x7fd6200c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:40.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd61ed9d640 1 --2- 172.21.15.19:0/3993242522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd62006d010 0x7fd6200c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd61ed9d640 1 -- 172.21.15.19:0/3993242522 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd608009420 con 0x7fd6200c26b0 2023-11-20T06:42:40.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd61ed9d640 1 --2- 172.21.15.19:0/3993242522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6200c26b0 0x7fd6200c7950 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd61800c730 tx=0x7fd61800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:40.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd616ffd640 1 -- 172.21.15.19:0/3993242522 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd618003b80 con 0x7fd6200c26b0 2023-11-20T06:42:40.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd616ffd640 1 -- 172.21.15.19:0/3993242522 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd618003ce0 con 0x7fd6200c26b0 2023-11-20T06:42:40.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd616ffd640 1 -- 172.21.15.19:0/3993242522 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61800aa30 con 0x7fd6200c26b0 2023-11-20T06:42:40.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.175+0000 7fd624c91640 1 -- 172.21.15.19:0/3993242522 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6200c6a40 con 0x7fd6200c26b0 2023-11-20T06:42:40.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.179+0000 7fd624c91640 1 -- 172.21.15.19:0/3993242522 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd620149060 con 0x7fd6200c26b0 2023-11-20T06:42:40.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.179+0000 7fd624c91640 1 -- 172.21.15.19:0/3993242522 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd62004e170 con 0x7fd6200c26b0 2023-11-20T06:42:40.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.179+0000 7fd616ffd640 1 -- 172.21.15.19:0/3993242522 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd61800ab90 con 0x7fd6200c26b0 2023-11-20T06:42:40.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.179+0000 7fd616ffd640 1 --2- 172.21.15.19:0/3993242522 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd6000664a0 0x7fd600068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:40.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.179+0000 7fd616ffd640 1 -- 172.21.15.19:0/3993242522 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd618083b30 con 0x7fd6200c26b0 2023-11-20T06:42:40.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.179+0000 7fd61e59c640 1 --2- 172.21.15.19:0/3993242522 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd6000664a0 0x7fd600068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:40.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.179+0000 7fd61e59c640 1 --2- 172.21.15.19:0/3993242522 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd6000664a0 0x7fd600068960 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd610000f70 tx=0x7fd610009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:40.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.183+0000 7fd616ffd640 1 -- 172.21.15.19:0/3993242522 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd618051120 con 0x7fd6200c26b0 2023-11-20T06:42:40.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.339+0000 7fd624c91640 1 -- 172.21.15.19:0/3993242522 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd6200c6ef0 con 0x7fd6200c26b0 2023-11-20T06:42:40.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.339+0000 7fd616ffd640 1 -- 172.21.15.19:0/3993242522 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd618054740 con 0x7fd6200c26b0 2023-11-20T06:42:40.346 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:42:40.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.343+0000 7fd624c91640 1 -- 172.21.15.19:0/3993242522 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd6000664a0 msgr2=0x7fd600068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:40.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.343+0000 7fd624c91640 1 --2- 172.21.15.19:0/3993242522 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd6000664a0 0x7fd600068960 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd610000f70 tx=0x7fd610009040 comp rx=0 tx=0).stop 2023-11-20T06:42:40.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.343+0000 7fd624c91640 1 -- 172.21.15.19:0/3993242522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6200c26b0 msgr2=0x7fd6200c7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:40.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.343+0000 7fd624c91640 1 --2- 172.21.15.19:0/3993242522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6200c26b0 0x7fd6200c7950 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd61800c730 tx=0x7fd61800cbf0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.343+0000 7fd624c91640 1 -- 172.21.15.19:0/3993242522 shutdown_connections 2023-11-20T06:42:40.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.343+0000 7fd624c91640 1 --2- 172.21.15.19:0/3993242522 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd6000664a0 0x7fd600068960 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.343+0000 7fd624c91640 1 --2- 172.21.15.19:0/3993242522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6200c26b0 0x7fd6200c7950 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.343+0000 7fd624c91640 1 --2- 172.21.15.19:0/3993242522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd62006d010 0x7fd6200c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.343+0000 7fd624c91640 1 --2- 172.21.15.19:0/3993242522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd620069e90 0x7fd620148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.343+0000 7fd624c91640 1 -- 172.21.15.19:0/3993242522 >> 172.21.15.19:0/3993242522 conn(0x7fd6200b0da0 msgr2=0x7fd6200c2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:40.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.343+0000 7fd624c91640 1 -- 172.21.15.19:0/3993242522 shutdown_connections 2023-11-20T06:42:40.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.343+0000 7fd624c91640 1 -- 172.21.15.19:0/3993242522 wait complete. 2023-11-20T06:42:40.368 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-20T06:42:40.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.503+0000 7fe6eb565640 1 Processor -- start 2023-11-20T06:42:40.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.503+0000 7fe6eb565640 1 -- start start 2023-11-20T06:42:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.507+0000 7fe6eb565640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe6e40cf090 0x7fe6e40cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.507+0000 7fe6eb565640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e40c6ad0 0x7fe6e40c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.507+0000 7fe6eb565640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e40c65f0 con 0x7fe6e415ca70 2023-11-20T06:42:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.507+0000 7fe6eb565640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e40cfa60 con 0x7fe6e40cf090 2023-11-20T06:42:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.507+0000 7fe6eb565640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40ce820 con 0x7fe6e40c6ad0 2023-11-20T06:42:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.507+0000 7fe6e8b00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe6e40cf090 0x7fe6e40cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.507+0000 7fe6e9b02640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e40c6ad0 0x7fe6e40c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.507+0000 7fe6e8b00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe6e40cf090 0x7fe6e40cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:42520/0 (socket says 172.21.15.19:42520) 2023-11-20T06:42:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.507+0000 7fe6e8b00640 1 -- 172.21.15.19:0/3458703723 learned_addr learned my addr 172.21.15.19:0/3458703723 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:40.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.507+0000 7fe6e9301640 1 --1- 172.21.15.19:0/3458703723 >> v1:172.21.15.190:6789/0 conn(0x7fe6e415ca70 0x7fe6e40d3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:45354/0 (socket says 172.21.15.19:45354) 2023-11-20T06:42:40.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.507+0000 7fe6e8b00640 1 -- 172.21.15.19:0/3458703723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e40c6ad0 msgr2=0x7fe6e40c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:40.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.507+0000 7fe6e8b00640 1 --2- 172.21.15.19:0/3458703723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e40c6ad0 0x7fe6e40c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.507+0000 7fe6e8b00640 1 -- 172.21.15.19:0/3458703723 >> v1:172.21.15.190:6789/0 conn(0x7fe6e415ca70 legacy=0x7fe6e40d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:40.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.507+0000 7fe6e8b00640 1 -- 172.21.15.19:0/3458703723 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e40cdf80 con 0x7fe6e40cf090 2023-11-20T06:42:40.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.511+0000 7fe6e8b00640 1 --2- 172.21.15.19:0/3458703723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6e40cf090 0x7fe6e40cf520 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009870 tx=0x7fe6d401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f356b20f343132b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:40.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.511+0000 7fe6dbfff640 1 -- 172.21.15.19:0/3458703723 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d40aa670 con 0x7fe6e40cf090 2023-11-20T06:42:40.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.511+0000 7fe6dbfff640 1 -- 172.21.15.19:0/3458703723 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d40aa7d0 con 0x7fe6e40cf090 2023-11-20T06:42:40.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.511+0000 7fe6dbfff640 1 -- 172.21.15.19:0/3458703723 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d40aab60 con 0x7fe6e40cf090 2023-11-20T06:42:40.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.511+0000 7fe6eb565640 1 -- 172.21.15.19:0/3458703723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6e40cf090 msgr2=0x7fe6e40cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.511+0000 7fe6eb565640 1 --2- 172.21.15.19:0/3458703723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6e40cf090 0x7fe6e40cf520 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009870 tx=0x7fe6d401c510 comp rx=0 tx=0).stop 2023-11-20T06:42:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.511+0000 7fe6eb565640 1 -- 172.21.15.19:0/3458703723 shutdown_connections 2023-11-20T06:42:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.511+0000 7fe6eb565640 1 --2- 172.21.15.19:0/3458703723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e40c6ad0 0x7fe6e40c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.511+0000 7fe6eb565640 1 --2- 172.21.15.19:0/3458703723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6e40cf090 0x7fe6e40cf520 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.511+0000 7fe6eb565640 1 -- 172.21.15.19:0/3458703723 >> 172.21.15.19:0/3458703723 conn(0x7fe6e409bc50 msgr2=0x7fe6e40d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.511+0000 7fe6eb565640 1 -- 172.21.15.19:0/3458703723 shutdown_connections 2023-11-20T06:42:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.511+0000 7fe6eb565640 1 -- 172.21.15.19:0/3458703723 wait complete. 2023-11-20T06:42:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.511+0000 7fe6eb565640 1 Processor -- start 2023-11-20T06:42:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.511+0000 7fe6eb565640 1 -- start start 2023-11-20T06:42:40.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6eb565640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6e40c6ad0 0x7fe6e40cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:40.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6eb565640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6e40cf090 0x7fe6e415b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:40.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6eb565640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e415ca70 0x7fe6e40b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:40.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6eb565640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40cb460 con 0x7fe6e40cf090 2023-11-20T06:42:40.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6eb565640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40cb740 con 0x7fe6e40c6ad0 2023-11-20T06:42:40.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6eb565640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40cba20 con 0x7fe6e415ca70 2023-11-20T06:42:40.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6e8b00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6e40cf090 0x7fe6e415b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:40.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6e8b00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6e40cf090 0x7fe6e415b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53650/0 (socket says 172.21.15.19:53650) 2023-11-20T06:42:40.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6e8b00640 1 -- 172.21.15.19:0/1038019109 learned_addr learned my addr 172.21.15.19:0/1038019109 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:40.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6e9301640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6e40c6ad0 0x7fe6e40cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:40.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6e9b02640 1 --2- 172.21.15.19:0/1038019109 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e415ca70 0x7fe6e40b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:40.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6e8b00640 1 -- 172.21.15.19:0/1038019109 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e415ca70 msgr2=0x7fe6e40b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6e8b00640 1 --2- 172.21.15.19:0/1038019109 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e415ca70 0x7fe6e40b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6e8b00640 1 -- 172.21.15.19:0/1038019109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6e40c6ad0 msgr2=0x7fe6e40cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6e8b00640 1 --2- 172.21.15.19:0/1038019109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6e40c6ad0 0x7fe6e40cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6e8b00640 1 -- 172.21.15.19:0/1038019109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d40094d0 con 0x7fe6e40cf090 2023-11-20T06:42:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6e9301640 1 --2- 172.21.15.19:0/1038019109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6e40c6ad0 0x7fe6e40cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:42:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6e8b00640 1 --2- 172.21.15.19:0/1038019109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6e40cf090 0x7fe6e415b100 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe6d401a140 tx=0x7fe6d401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6d9ffb640 1 -- 172.21.15.19:0/1038019109 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d40aa670 con 0x7fe6e40cf090 2023-11-20T06:42:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6d9ffb640 1 -- 172.21.15.19:0/1038019109 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d40b3800 con 0x7fe6e40cf090 2023-11-20T06:42:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6d9ffb640 1 -- 172.21.15.19:0/1038019109 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d40b3bb0 con 0x7fe6e40cf090 2023-11-20T06:42:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6eb565640 1 -- 172.21.15.19:0/1038019109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e40d38a0 con 0x7fe6e40cf090 2023-11-20T06:42:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6eb565640 1 -- 172.21.15.19:0/1038019109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e40cbfe0 con 0x7fe6e40cf090 2023-11-20T06:42:40.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.515+0000 7fe6eb565640 1 -- 172.21.15.19:0/1038019109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e40b3820 con 0x7fe6e40cf090 2023-11-20T06:42:40.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.519+0000 7fe6d9ffb640 1 -- 172.21.15.19:0/1038019109 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe6d40b3d10 con 0x7fe6e40cf090 2023-11-20T06:42:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.519+0000 7fe6d9ffb640 1 --2- 172.21.15.19:0/1038019109 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe6c80664a0 0x7fe6c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.519+0000 7fe6d9ffb640 1 -- 172.21.15.19:0/1038019109 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe6d411e470 con 0x7fe6e40cf090 2023-11-20T06:42:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.519+0000 7fe6e9301640 1 --2- 172.21.15.19:0/1038019109 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe6c80664a0 0x7fe6c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:40.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.519+0000 7fe6e9301640 1 --2- 172.21.15.19:0/1038019109 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe6c80664a0 0x7fe6c8068960 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0000fc0 tx=0x7fe6e0000f30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:40.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.523+0000 7fe6d9ffb640 1 -- 172.21.15.19:0/1038019109 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe6d40ebb10 con 0x7fe6e40cf090 2023-11-20T06:42:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.683+0000 7fe6eb565640 1 -- 172.21.15.19:0/1038019109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe6e40cbb60 con 0x7fe6e40cf090 2023-11-20T06:42:40.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.683+0000 7fe6d9ffb640 1 -- 172.21.15.19:0/1038019109 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe6e40cbb60 con 0x7fe6e40cf090 2023-11-20T06:42:40.688 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:40.688 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2023-11-20T06:42:40.688 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-20T06:42:40.688 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2023-11-20T06:42:40.688 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2023-11-20T06:42:40.688 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:40.689 INFO:teuthology.orchestra.run.smithi019.stdout:] 2023-11-20T06:42:40.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.683+0000 7fe6eb565640 1 -- 172.21.15.19:0/1038019109 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe6c80664a0 msgr2=0x7fe6c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:40.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.683+0000 7fe6eb565640 1 --2- 172.21.15.19:0/1038019109 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe6c80664a0 0x7fe6c8068960 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0000fc0 tx=0x7fe6e0000f30 comp rx=0 tx=0).stop 2023-11-20T06:42:40.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.683+0000 7fe6eb565640 1 -- 172.21.15.19:0/1038019109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6e40cf090 msgr2=0x7fe6e415b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:40.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.683+0000 7fe6eb565640 1 --2- 172.21.15.19:0/1038019109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6e40cf090 0x7fe6e415b100 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe6d401a140 tx=0x7fe6d401ad50 comp rx=0 tx=0).stop 2023-11-20T06:42:40.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.683+0000 7fe6eb565640 1 -- 172.21.15.19:0/1038019109 shutdown_connections 2023-11-20T06:42:40.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.683+0000 7fe6eb565640 1 --2- 172.21.15.19:0/1038019109 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe6c80664a0 0x7fe6c8068960 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.683+0000 7fe6eb565640 1 --2- 172.21.15.19:0/1038019109 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e415ca70 0x7fe6e40b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.683+0000 7fe6eb565640 1 --2- 172.21.15.19:0/1038019109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6e40cf090 0x7fe6e415b100 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.683+0000 7fe6eb565640 1 --2- 172.21.15.19:0/1038019109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6e40c6ad0 0x7fe6e40cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.683+0000 7fe6eb565640 1 -- 172.21.15.19:0/1038019109 >> 172.21.15.19:0/1038019109 conn(0x7fe6e409bc50 msgr2=0x7fe6e4155650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:40.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.683+0000 7fe6eb565640 1 -- 172.21.15.19:0/1038019109 shutdown_connections 2023-11-20T06:42:40.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.683+0000 7fe6eb565640 1 -- 172.21.15.19:0/1038019109 wait complete. 2023-11-20T06:42:40.709 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-20T06:42:40.709 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-20T06:42:40.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55c1ed6640 1 Processor -- start 2023-11-20T06:42:40.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55c1ed6640 1 -- start start 2023-11-20T06:42:40.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55c1ed6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f55bc1600e0 0x7f55bc0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:40.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55c1ed6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55bc0caf20 con 0x7f55bc0cfd50 2023-11-20T06:42:40.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55c1ed6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55bc0b3720 con 0x7f55bc0cd9c0 2023-11-20T06:42:40.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55c1ed6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55bc0d02a0 con 0x7f55bc1600e0 2023-11-20T06:42:40.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55baffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f55bc0cfd50 0x7f55bc0cd2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39180/0 (socket says 172.21.15.19:39180) 2023-11-20T06:42:40.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55baffd640 1 -- 172.21.15.19:0/371431493 learned_addr learned my addr 172.21.15.19:0/371431493 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:40.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55bb7fe640 1 --2- 172.21.15.19:0/371431493 >> v2:172.21.15.190:3300/0 conn(0x7f55bc1600e0 0x7f55bc0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:40.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55ba7fc640 1 -- 172.21.15.19:0/371431493 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649850129 0 0) 0x7f55bc0caf20 con 0x7f55bc0cfd50 2023-11-20T06:42:40.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55ba7fc640 1 -- 172.21.15.19:0/371431493 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55a4003530 con 0x7f55bc0cfd50 2023-11-20T06:42:40.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55ba7fc640 1 -- 172.21.15.19:0/371431493 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1910750804 0 0) 0x7f55a4003530 con 0x7f55bc0cfd50 2023-11-20T06:42:40.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55ba7fc640 1 -- 172.21.15.19:0/371431493 >> v2:172.21.15.190:3300/0 conn(0x7f55bc1600e0 msgr2=0x7f55bc0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:40.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55ba7fc640 1 --2- 172.21.15.19:0/371431493 >> v2:172.21.15.190:3300/0 conn(0x7f55bc1600e0 0x7f55bc0cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55ba7fc640 1 -- 172.21.15.19:0/371431493 >> v1:172.21.15.190:6789/0 conn(0x7f55bc0cd9c0 legacy=0x7f55bc0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:40.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55ba7fc640 1 -- 172.21.15.19:0/371431493 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55bc0cb170 con 0x7f55bc0cfd50 2023-11-20T06:42:40.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55ba7fc640 1 -- 172.21.15.19:0/371431493 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7f55b0001680 con 0x7f55bc0cfd50 2023-11-20T06:42:40.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55ba7fc640 1 -- 172.21.15.19:0/371431493 >> v1:172.21.15.19:6789/0 conn(0x7f55bc0cfd50 legacy=0x7f55bc0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:40.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55ba7fc640 1 --2- 172.21.15.19:0/371431493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a4003980 0x7f55a4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:40.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55ba7fc640 1 --2- 172.21.15.19:0/371431493 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55a40047d0 0x7f55a4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:40.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55ba7fc640 1 --2- 172.21.15.19:0/371431493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55a4005190 0x7f55a400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:40.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55ba7fc640 1 -- 172.21.15.19:0/371431493 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc0d02a0 con 0x7f55a4003980 2023-11-20T06:42:40.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55ba7fc640 1 -- 172.21.15.19:0/371431493 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a400c130 con 0x7f55a4005190 2023-11-20T06:42:40.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55ba7fc640 1 -- 172.21.15.19:0/371431493 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a400c2f0 con 0x7f55a40047d0 2023-11-20T06:42:40.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55bb7fe640 1 --2- 172.21.15.19:0/371431493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a4003980 0x7f55a4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:40.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.851+0000 7f55bbfff640 1 --2- 172.21.15.19:0/371431493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55a4005190 0x7f55a400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:40.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.855+0000 7f55baffd640 1 --2- 172.21.15.19:0/371431493 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55a40047d0 0x7f55a4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:40.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.855+0000 7f55bb7fe640 1 -- 172.21.15.19:0/371431493 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55a40047d0 msgr2=0x7f55a4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:40.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.855+0000 7f55bb7fe640 1 --2- 172.21.15.19:0/371431493 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55a40047d0 0x7f55a4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.855+0000 7f55bb7fe640 1 -- 172.21.15.19:0/371431493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55a4005190 msgr2=0x7f55a400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:40.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.855+0000 7f55bb7fe640 1 --2- 172.21.15.19:0/371431493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55a4005190 0x7f55a400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.855+0000 7f55bb7fe640 1 -- 172.21.15.19:0/371431493 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a4003530 con 0x7f55a4003980 2023-11-20T06:42:40.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.855+0000 7f55bbfff640 1 -- 172.21.15.19:0/371431493 reap_dead start 2023-11-20T06:42:40.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.855+0000 7f55bb7fe640 1 --2- 172.21.15.19:0/371431493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a4003980 0x7f55a4003da0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f55ac009ae0 tx=0x7f55ac01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb812f85ceac1c42 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:40.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.855+0000 7f55ba7fc640 1 -- 172.21.15.19:0/371431493 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0a6510 con 0x7f55a4003980 2023-11-20T06:42:40.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.855+0000 7f55ba7fc640 1 -- 172.21.15.19:0/371431493 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ac0a6670 con 0x7f55a4003980 2023-11-20T06:42:40.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.855+0000 7f55ba7fc640 1 -- 172.21.15.19:0/371431493 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0a6a20 con 0x7f55a4003980 2023-11-20T06:42:40.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.855+0000 7f55c1ed6640 1 -- 172.21.15.19:0/371431493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a4003980 msgr2=0x7f55a4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:40.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.855+0000 7f55c1ed6640 1 --2- 172.21.15.19:0/371431493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a4003980 0x7f55a4003da0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f55ac009ae0 tx=0x7f55ac01ca20 comp rx=0 tx=0).stop 2023-11-20T06:42:40.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.855+0000 7f55c1ed6640 1 -- 172.21.15.19:0/371431493 shutdown_connections 2023-11-20T06:42:40.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.855+0000 7f55c1ed6640 1 --2- 172.21.15.19:0/371431493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a4003980 0x7f55a4003da0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.859+0000 7f55c1ed6640 1 -- 172.21.15.19:0/371431493 >> 172.21.15.19:0/371431493 conn(0x7f55bc0d08d0 msgr2=0x7f55bc0d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:40.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.859+0000 7f55c1ed6640 1 -- 172.21.15.19:0/371431493 shutdown_connections 2023-11-20T06:42:40.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.859+0000 7f55c1ed6640 1 -- 172.21.15.19:0/371431493 wait complete. 2023-11-20T06:42:40.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.859+0000 7f55c1ed6640 1 Processor -- start 2023-11-20T06:42:40.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.859+0000 7f55c1ed6640 1 -- start start 2023-11-20T06:42:40.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55c1ed6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a4003980 0x7f55bc150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55c1ed6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55bc0c9a60 0x7f55bc1f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55c1ed6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55bc0c8620 0x7f55bc0c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55c1ed6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc0b5e30 con 0x7f55a4003980 2023-11-20T06:42:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55c1ed6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc0b5b50 con 0x7f55bc0c9a60 2023-11-20T06:42:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55c1ed6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc0c7b40 con 0x7f55bc0c8620 2023-11-20T06:42:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55bb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a4003980 0x7f55bc150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55bb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a4003980 0x7f55bc150bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53672/0 (socket says 172.21.15.19:53672) 2023-11-20T06:42:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55bb7fe640 1 -- 172.21.15.19:0/2276663298 learned_addr learned my addr 172.21.15.19:0/2276663298 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55baffd640 1 --2- 172.21.15.19:0/2276663298 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55bc0c9a60 0x7f55bc1f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55bbfff640 1 --2- 172.21.15.19:0/2276663298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55bc0c8620 0x7f55bc0c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55bb7fe640 1 -- 172.21.15.19:0/2276663298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55bc0c8620 msgr2=0x7f55bc0c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55bb7fe640 1 --2- 172.21.15.19:0/2276663298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55bc0c8620 0x7f55bc0c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55bb7fe640 1 -- 172.21.15.19:0/2276663298 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55bc0c9a60 msgr2=0x7f55bc1f4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55bb7fe640 1 --2- 172.21.15.19:0/2276663298 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55bc0c9a60 0x7f55bc1f4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55bb7fe640 1 -- 172.21.15.19:0/2276663298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55bc0c7e20 con 0x7f55a4003980 2023-11-20T06:42:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55bbfff640 1 --2- 172.21.15.19:0/2276663298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55bc0c8620 0x7f55bc0c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55bb7fe640 1 --2- 172.21.15.19:0/2276663298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a4003980 0x7f55bc150bf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0b0040 tx=0x7f55ac0197c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55a3fff640 1 -- 172.21.15.19:0/2276663298 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0a67e0 con 0x7f55a4003980 2023-11-20T06:42:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55c1ed6640 1 -- 172.21.15.19:0/2276663298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55bc0c8100 con 0x7f55a4003980 2023-11-20T06:42:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55a3fff640 1 -- 172.21.15.19:0/2276663298 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ac0a6940 con 0x7f55a4003980 2023-11-20T06:42:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55a3fff640 1 -- 172.21.15.19:0/2276663298 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0a6cb0 con 0x7f55a4003980 2023-11-20T06:42:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55c1ed6640 1 -- 172.21.15.19:0/2276663298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55bc0b57b0 con 0x7f55a4003980 2023-11-20T06:42:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55c1ed6640 1 -- 172.21.15.19:0/2276663298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55bc0c7980 con 0x7f55a4003980 2023-11-20T06:42:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.863+0000 7f55a3fff640 1 -- 172.21.15.19:0/2276663298 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f55ac006040 con 0x7f55a4003980 2023-11-20T06:42:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.867+0000 7f55a3fff640 1 --2- 172.21.15.19:0/2276663298 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f55a80664d0 0x7f55a8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.867+0000 7f55a3fff640 1 -- 172.21.15.19:0/2276663298 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f55ac0aa070 con 0x7f55a4003980 2023-11-20T06:42:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.867+0000 7f55baffd640 1 --2- 172.21.15.19:0/2276663298 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f55a80664d0 0x7f55a8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.867+0000 7f55baffd640 1 --2- 172.21.15.19:0/2276663298 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f55a80664d0 0x7f55a8068990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f55b0001ca0 tx=0x7f55b0007040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:40.871+0000 7f55a3fff640 1 -- 172.21.15.19:0/2276663298 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f55ac0eba70 con 0x7f55a4003980 2023-11-20T06:42:41.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:41.027+0000 7f55c1ed6640 1 -- 172.21.15.19:0/2276663298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f55bc04e170 con 0x7f55a4003980 2023-11-20T06:42:41.646 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T06:42:41.650 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T06:42:41.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:41.867+0000 7f55a3fff640 1 -- 172.21.15.19:0/2276663298 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7f55ac0ef090 con 0x7f55a4003980 2023-11-20T06:42:41.872 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2023-11-20T06:42:41.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:41.867+0000 7f55c1ed6640 1 -- 172.21.15.19:0/2276663298 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f55a80664d0 msgr2=0x7f55a8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:41.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:41.867+0000 7f55c1ed6640 1 --2- 172.21.15.19:0/2276663298 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f55a80664d0 0x7f55a8068990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f55b0001ca0 tx=0x7f55b0007040 comp rx=0 tx=0).stop 2023-11-20T06:42:41.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:41.867+0000 7f55c1ed6640 1 -- 172.21.15.19:0/2276663298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a4003980 msgr2=0x7f55bc150bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:41.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:41.867+0000 7f55c1ed6640 1 --2- 172.21.15.19:0/2276663298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a4003980 0x7f55bc150bf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0b0040 tx=0x7f55ac0197c0 comp rx=0 tx=0).stop 2023-11-20T06:42:41.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:41.867+0000 7f55c1ed6640 1 -- 172.21.15.19:0/2276663298 shutdown_connections 2023-11-20T06:42:41.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:41.867+0000 7f55c1ed6640 1 --2- 172.21.15.19:0/2276663298 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f55a80664d0 0x7f55a8068990 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:41.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:41.867+0000 7f55c1ed6640 1 --2- 172.21.15.19:0/2276663298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55bc0c8620 0x7f55bc0c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:41.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:41.867+0000 7f55c1ed6640 1 --2- 172.21.15.19:0/2276663298 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55bc0c9a60 0x7f55bc1f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:41.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:41.867+0000 7f55c1ed6640 1 --2- 172.21.15.19:0/2276663298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a4003980 0x7f55bc150bf0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:41.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:41.867+0000 7f55c1ed6640 1 -- 172.21.15.19:0/2276663298 >> 172.21.15.19:0/2276663298 conn(0x7f55bc0d08d0 msgr2=0x7f55bc0b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:41.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:41.871+0000 7f55c1ed6640 1 -- 172.21.15.19:0/2276663298 shutdown_connections 2023-11-20T06:42:41.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:41.871+0000 7f55c1ed6640 1 -- 172.21.15.19:0/2276663298 wait complete. 2023-11-20T06:42:41.902 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-20T06:42:42.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.087+0000 7f5604e46640 1 Processor -- start 2023-11-20T06:42:42.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.091+0000 7f5604e46640 1 -- start start 2023-11-20T06:42:42.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.091+0000 7f5604e46640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f56000b85d0 0x7f560015dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:42.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.091+0000 7f5604e46640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f56000b89b0 0x7f56000cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:42.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.091+0000 7f5604e46640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560015e1d0 con 0x7f56000d0130 2023-11-20T06:42:42.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.091+0000 7f5604e46640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56000d05c0 con 0x7f56000b89b0 2023-11-20T06:42:42.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.091+0000 7f5604e46640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5600161720 con 0x7f56000b85d0 2023-11-20T06:42:42.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.091+0000 7f55fdd9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f56000b89b0 0x7f56000cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:42.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.091+0000 7f55fdd9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f56000b89b0 0x7f56000cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36364/0 (socket says 172.21.15.19:36364) 2023-11-20T06:42:42.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.091+0000 7f55fdd9b640 1 -- 172.21.15.19:0/3422004980 learned_addr learned my addr 172.21.15.19:0/3422004980 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:42.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.091+0000 7f55fe59c640 1 --2- 172.21.15.19:0/3422004980 >> v2:172.21.15.190:3300/0 conn(0x7f56000b85d0 0x7f560015dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:42.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.091+0000 7f55fdd9b640 1 -- 172.21.15.19:0/3422004980 >> v2:172.21.15.190:3300/0 conn(0x7f56000b85d0 msgr2=0x7f560015dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:42.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.091+0000 7f55fdd9b640 1 --2- 172.21.15.19:0/3422004980 >> v2:172.21.15.190:3300/0 conn(0x7f56000b85d0 0x7f560015dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:42.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.091+0000 7f55fdd9b640 1 -- 172.21.15.19:0/3422004980 >> v1:172.21.15.190:6789/0 conn(0x7f56000d0130 legacy=0x7f56000d2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:42.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.091+0000 7f55fdd9b640 1 -- 172.21.15.19:0/3422004980 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5600160ba0 con 0x7f56000b89b0 2023-11-20T06:42:42.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.095+0000 7f55fdd9b640 1 --2- 172.21.15.19:0/3422004980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56000b89b0 0x7f56000cfbf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f56000b54b0 tx=0x7f55f401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1b6011b6146255 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:42.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.095+0000 7f55fd59a640 1 -- 172.21.15.19:0/3422004980 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f40aa5f0 con 0x7f56000b89b0 2023-11-20T06:42:42.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.095+0000 7f55fd59a640 1 -- 172.21.15.19:0/3422004980 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f40aa750 con 0x7f56000b89b0 2023-11-20T06:42:42.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.095+0000 7f55fd59a640 1 -- 172.21.15.19:0/3422004980 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f40aaae0 con 0x7f56000b89b0 2023-11-20T06:42:42.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.095+0000 7f5604e46640 1 -- 172.21.15.19:0/3422004980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56000b89b0 msgr2=0x7f56000cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:42.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.095+0000 7f5604e46640 1 --2- 172.21.15.19:0/3422004980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56000b89b0 0x7f56000cfbf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f56000b54b0 tx=0x7f55f401c490 comp rx=0 tx=0).stop 2023-11-20T06:42:42.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.095+0000 7f5604e46640 1 -- 172.21.15.19:0/3422004980 shutdown_connections 2023-11-20T06:42:42.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.095+0000 7f5604e46640 1 --2- 172.21.15.19:0/3422004980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56000b89b0 0x7f56000cfbf0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:42.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.095+0000 7f5604e46640 1 --2- 172.21.15.19:0/3422004980 >> v2:172.21.15.190:3300/0 conn(0x7f56000b85d0 0x7f560015dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:42.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.095+0000 7f5604e46640 1 -- 172.21.15.19:0/3422004980 >> 172.21.15.19:0/3422004980 conn(0x7f560006b750 msgr2=0x7f560006bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:42.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.095+0000 7f5604e46640 1 -- 172.21.15.19:0/3422004980 shutdown_connections 2023-11-20T06:42:42.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.095+0000 7f5604e46640 1 -- 172.21.15.19:0/3422004980 wait complete. 2023-11-20T06:42:42.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f5604e46640 1 Processor -- start 2023-11-20T06:42:42.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f5604e46640 1 -- start start 2023-11-20T06:42:42.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f5604e46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56000b85d0 0x7f56001505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f5604e46640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56000b89b0 0x7f5600150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f5604e46640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56000d0130 0x7f560013a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f5604e46640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5600156880 con 0x7f56000b89b0 2023-11-20T06:42:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f5604e46640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5600155c70 con 0x7f56000d0130 2023-11-20T06:42:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f5604e46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5600155f50 con 0x7f56000b85d0 2023-11-20T06:42:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f55fdd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56000b89b0 0x7f5600150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f55fdd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56000b89b0 0x7f5600150e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36374/0 (socket says 172.21.15.19:36374) 2023-11-20T06:42:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f55fdd9b640 1 -- 172.21.15.19:0/856082267 learned_addr learned my addr 172.21.15.19:0/856082267 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f55fed9d640 1 --2- 172.21.15.19:0/856082267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56000d0130 0x7f560013a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f55fe59c640 1 --2- 172.21.15.19:0/856082267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56000b85d0 0x7f56001505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:42.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f55fdd9b640 1 -- 172.21.15.19:0/856082267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56000b85d0 msgr2=0x7f56001505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:42.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f55fdd9b640 1 --2- 172.21.15.19:0/856082267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56000b85d0 0x7f56001505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:42.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f55fdd9b640 1 -- 172.21.15.19:0/856082267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56000d0130 msgr2=0x7f560013a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:42.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f55fdd9b640 1 --2- 172.21.15.19:0/856082267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56000d0130 0x7f560013a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:42.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f55fdd9b640 1 -- 172.21.15.19:0/856082267 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f40094d0 con 0x7f56000b89b0 2023-11-20T06:42:42.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f55fdd9b640 1 --2- 172.21.15.19:0/856082267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56000b89b0 0x7f5600150e10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f55f401a0c0 tx=0x7f55f401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:42.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f55eeffd640 1 -- 172.21.15.19:0/856082267 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f40aa5f0 con 0x7f56000b89b0 2023-11-20T06:42:42.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f55eeffd640 1 -- 172.21.15.19:0/856082267 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f40b3800 con 0x7f56000b89b0 2023-11-20T06:42:42.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f55eeffd640 1 -- 172.21.15.19:0/856082267 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f40b3bb0 con 0x7f56000b89b0 2023-11-20T06:42:42.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f5604e46640 1 -- 172.21.15.19:0/856082267 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5600156230 con 0x7f56000b89b0 2023-11-20T06:42:42.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f5604e46640 1 -- 172.21.15.19:0/856082267 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5600150b10 con 0x7f56000b89b0 2023-11-20T06:42:42.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.099+0000 7f5604e46640 1 -- 172.21.15.19:0/856082267 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560004e170 con 0x7f56000b89b0 2023-11-20T06:42:42.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.103+0000 7f55eeffd640 1 -- 172.21.15.19:0/856082267 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f55f40b3d10 con 0x7f56000b89b0 2023-11-20T06:42:42.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.103+0000 7f55eeffd640 1 --2- 172.21.15.19:0/856082267 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f55e00664a0 0x7f55e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:42.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.103+0000 7f55eeffd640 1 -- 172.21.15.19:0/856082267 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f55f40a7070 con 0x7f56000b89b0 2023-11-20T06:42:42.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.103+0000 7f55fe59c640 1 --2- 172.21.15.19:0/856082267 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f55e00664a0 0x7f55e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:42.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.103+0000 7f55fe59c640 1 --2- 172.21.15.19:0/856082267 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f55e00664a0 0x7f55e0068960 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f55f0007a60 tx=0x7f55f0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:42.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.107+0000 7f55eeffd640 1 -- 172.21.15.19:0/856082267 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f55f40eb880 con 0x7f56000b89b0 2023-11-20T06:42:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.267+0000 7f5604e46640 1 -- 172.21.15.19:0/856082267 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f56000d0900 con 0x7f56000b89b0 2023-11-20T06:42:42.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.875+0000 7f55eeffd640 1 -- 172.21.15.19:0/856082267 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7f55f40eeea0 con 0x7f56000b89b0 2023-11-20T06:42:42.880 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2023-11-20T06:42:42.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.879+0000 7f5604e46640 1 -- 172.21.15.19:0/856082267 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f55e00664a0 msgr2=0x7f55e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:42.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.879+0000 7f5604e46640 1 --2- 172.21.15.19:0/856082267 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f55e00664a0 0x7f55e0068960 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f55f0007a60 tx=0x7f55f0008040 comp rx=0 tx=0).stop 2023-11-20T06:42:42.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.879+0000 7f5604e46640 1 -- 172.21.15.19:0/856082267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56000b89b0 msgr2=0x7f5600150e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:42.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.879+0000 7f5604e46640 1 --2- 172.21.15.19:0/856082267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56000b89b0 0x7f5600150e10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f55f401a0c0 tx=0x7f55f401acd0 comp rx=0 tx=0).stop 2023-11-20T06:42:42.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.879+0000 7f5604e46640 1 -- 172.21.15.19:0/856082267 shutdown_connections 2023-11-20T06:42:42.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.879+0000 7f5604e46640 1 --2- 172.21.15.19:0/856082267 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f55e00664a0 0x7f55e0068960 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:42.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.879+0000 7f5604e46640 1 --2- 172.21.15.19:0/856082267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56000d0130 0x7f560013a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:42.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.879+0000 7f5604e46640 1 --2- 172.21.15.19:0/856082267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56000b89b0 0x7f5600150e10 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:42.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.879+0000 7f5604e46640 1 --2- 172.21.15.19:0/856082267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56000b85d0 0x7f56001505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:42.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.879+0000 7f5604e46640 1 -- 172.21.15.19:0/856082267 >> 172.21.15.19:0/856082267 conn(0x7f560006b750 msgr2=0x7f5600071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:42.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.879+0000 7f5604e46640 1 -- 172.21.15.19:0/856082267 shutdown_connections 2023-11-20T06:42:42.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:42.879+0000 7f5604e46640 1 -- 172.21.15.19:0/856082267 wait complete. 2023-11-20T06:42:42.926 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-20T06:42:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.067+0000 7fca94e17640 1 Processor -- start 2023-11-20T06:42:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.067+0000 7fca94e17640 1 -- start start 2023-11-20T06:42:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.071+0000 7fca94e17640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fca90159900 0x7fca9006e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.071+0000 7fca94e17640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca9006a5a0 0x7fca900c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.071+0000 7fca94e17640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca900b4390 con 0x7fca900b3f00 2023-11-20T06:42:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.071+0000 7fca94e17640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca900cd740 con 0x7fca90159900 2023-11-20T06:42:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.071+0000 7fca94e17640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca900b4600 con 0x7fca9006a5a0 2023-11-20T06:42:43.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.071+0000 7fca8ed9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca9006a5a0 0x7fca900c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:43.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.071+0000 7fca8e59c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fca90159900 0x7fca9006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:43.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.071+0000 7fca8ed9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca9006a5a0 0x7fca900c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:52822/0 (socket says 172.21.15.19:52822) 2023-11-20T06:42:43.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.071+0000 7fca8ed9d640 1 -- 172.21.15.19:0/3433085630 learned_addr learned my addr 172.21.15.19:0/3433085630 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:43.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.071+0000 7fca8e59c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fca90159900 0x7fca9006e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:49430/0 (socket says 172.21.15.19:49430) 2023-11-20T06:42:43.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.071+0000 7fca8ed9d640 1 -- 172.21.15.19:0/3433085630 >> v2:172.21.15.190:3300/0 conn(0x7fca90159900 msgr2=0x7fca9006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:43.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.071+0000 7fca8ed9d640 1 --2- 172.21.15.19:0/3433085630 >> v2:172.21.15.190:3300/0 conn(0x7fca90159900 0x7fca9006e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:43.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.071+0000 7fca8ed9d640 1 -- 172.21.15.19:0/3433085630 >> v1:172.21.15.190:6789/0 conn(0x7fca900b3f00 legacy=0x7fca90069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:43.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.071+0000 7fca8ed9d640 1 -- 172.21.15.19:0/3433085630 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca900c8dd0 con 0x7fca9006a5a0 2023-11-20T06:42:43.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.075+0000 7fca8ed9d640 1 --2- 172.21.15.19:0/3433085630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca9006a5a0 0x7fca900c9b90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fca88009e50 tx=0x7fca8801ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff9d3e61da6406a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:43.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.075+0000 7fca8dd9b640 1 -- 172.21.15.19:0/3433085630 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880a7ac0 con 0x7fca9006a5a0 2023-11-20T06:42:43.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.075+0000 7fca8dd9b640 1 -- 172.21.15.19:0/3433085630 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca880a7c20 con 0x7fca9006a5a0 2023-11-20T06:42:43.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.075+0000 7fca8dd9b640 1 -- 172.21.15.19:0/3433085630 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880af3f0 con 0x7fca9006a5a0 2023-11-20T06:42:43.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.075+0000 7fca94e17640 1 -- 172.21.15.19:0/3433085630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca9006a5a0 msgr2=0x7fca900c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:43.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.075+0000 7fca94e17640 1 --2- 172.21.15.19:0/3433085630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca9006a5a0 0x7fca900c9b90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fca88009e50 tx=0x7fca8801ebf0 comp rx=0 tx=0).stop 2023-11-20T06:42:43.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.075+0000 7fca94e17640 1 -- 172.21.15.19:0/3433085630 shutdown_connections 2023-11-20T06:42:43.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.075+0000 7fca94e17640 1 --2- 172.21.15.19:0/3433085630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca9006a5a0 0x7fca900c9b90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:43.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.075+0000 7fca94e17640 1 --2- 172.21.15.19:0/3433085630 >> v2:172.21.15.190:3300/0 conn(0x7fca90159900 0x7fca9006e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:43.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.075+0000 7fca94e17640 1 -- 172.21.15.19:0/3433085630 >> 172.21.15.19:0/3433085630 conn(0x7fca900b0da0 msgr2=0x7fca900ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:43.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.075+0000 7fca94e17640 1 -- 172.21.15.19:0/3433085630 shutdown_connections 2023-11-20T06:42:43.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.075+0000 7fca94e17640 1 -- 172.21.15.19:0/3433085630 wait complete. 2023-11-20T06:42:43.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.075+0000 7fca94e17640 1 Processor -- start 2023-11-20T06:42:43.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.075+0000 7fca94e17640 1 -- start start 2023-11-20T06:42:43.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca94e17640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca9006a5a0 0x7fca90155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:43.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca94e17640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca900b3f00 0x7fca900c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:43.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca94e17640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca90159900 0x7fca900ac430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:43.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca94e17640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca901f5bf0 con 0x7fca9006a5a0 2023-11-20T06:42:43.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca94e17640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca901f4d60 con 0x7fca900b3f00 2023-11-20T06:42:43.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca94e17640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca901f4f70 con 0x7fca90159900 2023-11-20T06:42:43.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca8e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca9006a5a0 0x7fca90155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:43.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca8e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca9006a5a0 0x7fca90155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36390/0 (socket says 172.21.15.19:36390) 2023-11-20T06:42:43.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca8e59c640 1 -- 172.21.15.19:0/1358022796 learned_addr learned my addr 172.21.15.19:0/1358022796 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:43.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca8ed9d640 1 --2- 172.21.15.19:0/1358022796 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca90159900 0x7fca900ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:43.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca87fff640 1 --2- 172.21.15.19:0/1358022796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca900b3f00 0x7fca900c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:43.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca8e59c640 1 -- 172.21.15.19:0/1358022796 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca90159900 msgr2=0x7fca900ac430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:43.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca8e59c640 1 --2- 172.21.15.19:0/1358022796 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca90159900 0x7fca900ac430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:43.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca8e59c640 1 -- 172.21.15.19:0/1358022796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca900b3f00 msgr2=0x7fca900c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:43.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca8e59c640 1 --2- 172.21.15.19:0/1358022796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca900b3f00 0x7fca900c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:43.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca8e59c640 1 -- 172.21.15.19:0/1358022796 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca88009b30 con 0x7fca9006a5a0 2023-11-20T06:42:43.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca8e59c640 1 --2- 172.21.15.19:0/1358022796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca9006a5a0 0x7fca90155b30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fca8000e870 tx=0x7fca8000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:43.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca86ffd640 1 -- 172.21.15.19:0/1358022796 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80009510 con 0x7fca9006a5a0 2023-11-20T06:42:43.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca86ffd640 1 -- 172.21.15.19:0/1358022796 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8000eec0 con 0x7fca9006a5a0 2023-11-20T06:42:43.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca86ffd640 1 -- 172.21.15.19:0/1358022796 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8000cb40 con 0x7fca9006a5a0 2023-11-20T06:42:43.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca94e17640 1 -- 172.21.15.19:0/1358022796 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca901f5250 con 0x7fca9006a5a0 2023-11-20T06:42:43.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca94e17640 1 -- 172.21.15.19:0/1358022796 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca901f5810 con 0x7fca9006a5a0 2023-11-20T06:42:43.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.079+0000 7fca94e17640 1 -- 172.21.15.19:0/1358022796 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca901563c0 con 0x7fca9006a5a0 2023-11-20T06:42:43.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.083+0000 7fca86ffd640 1 -- 172.21.15.19:0/1358022796 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fca8000cca0 con 0x7fca9006a5a0 2023-11-20T06:42:43.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.083+0000 7fca86ffd640 1 --2- 172.21.15.19:0/1358022796 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fca700664a0 0x7fca70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:43.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.083+0000 7fca86ffd640 1 -- 172.21.15.19:0/1358022796 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fca800846e0 con 0x7fca9006a5a0 2023-11-20T06:42:43.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.083+0000 7fca87fff640 1 --2- 172.21.15.19:0/1358022796 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fca700664a0 0x7fca70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:43.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.083+0000 7fca87fff640 1 --2- 172.21.15.19:0/1358022796 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fca700664a0 0x7fca70068960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fca900c5970 tx=0x7fca78009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:43.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.087+0000 7fca86ffd640 1 -- 172.21.15.19:0/1358022796 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fca80051c10 con 0x7fca9006a5a0 2023-11-20T06:42:43.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:43.275+0000 7fca94e17640 1 -- 172.21.15.19:0/1358022796 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fca9004e170 con 0x7fca9006a5a0 2023-11-20T06:42:44.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.235+0000 7fca86ffd640 1 -- 172.21.15.19:0/1358022796 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7fca80055230 con 0x7fca9006a5a0 2023-11-20T06:42:44.241 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 5 and data pool 6 2023-11-20T06:42:44.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.239+0000 7fca94e17640 1 -- 172.21.15.19:0/1358022796 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fca700664a0 msgr2=0x7fca70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:44.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.239+0000 7fca94e17640 1 --2- 172.21.15.19:0/1358022796 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fca700664a0 0x7fca70068960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fca900c5970 tx=0x7fca78009040 comp rx=0 tx=0).stop 2023-11-20T06:42:44.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.239+0000 7fca94e17640 1 -- 172.21.15.19:0/1358022796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca9006a5a0 msgr2=0x7fca90155b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:44.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.239+0000 7fca94e17640 1 --2- 172.21.15.19:0/1358022796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca9006a5a0 0x7fca90155b30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fca8000e870 tx=0x7fca8000ec70 comp rx=0 tx=0).stop 2023-11-20T06:42:44.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.239+0000 7fca94e17640 1 -- 172.21.15.19:0/1358022796 shutdown_connections 2023-11-20T06:42:44.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.239+0000 7fca94e17640 1 --2- 172.21.15.19:0/1358022796 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fca700664a0 0x7fca70068960 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.239+0000 7fca94e17640 1 --2- 172.21.15.19:0/1358022796 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca90159900 0x7fca900ac430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.239+0000 7fca94e17640 1 --2- 172.21.15.19:0/1358022796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca900b3f00 0x7fca900c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.239+0000 7fca94e17640 1 --2- 172.21.15.19:0/1358022796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca9006a5a0 0x7fca90155b30 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.239+0000 7fca94e17640 1 -- 172.21.15.19:0/1358022796 >> 172.21.15.19:0/1358022796 conn(0x7fca900b0da0 msgr2=0x7fca90070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:44.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.239+0000 7fca94e17640 1 -- 172.21.15.19:0/1358022796 shutdown_connections 2023-11-20T06:42:44.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.239+0000 7fca94e17640 1 -- 172.21.15.19:0/1358022796 wait complete. 2023-11-20T06:42:44.274 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:44.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.415+0000 7fbd1c654640 1 Processor -- start 2023-11-20T06:42:44.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.415+0000 7fbd1c654640 1 -- start start 2023-11-20T06:42:44.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.415+0000 7fbd1c654640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd141597c0 0x7fbd140ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:44.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.415+0000 7fbd1c654640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbd14159ba0 0x7fbd140cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:44.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.415+0000 7fbd1c654640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbd140adc10 0x7fbd140cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:44.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.415+0000 7fbd1c654640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd140723d0 con 0x7fbd14159ba0 2023-11-20T06:42:44.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.415+0000 7fbd1c654640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd140717c0 con 0x7fbd140adc10 2023-11-20T06:42:44.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.415+0000 7fbd1c654640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd14071aa0 con 0x7fbd141597c0 2023-11-20T06:42:44.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.415+0000 7fbd19bef640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbd14159ba0 0x7fbd140cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:44.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.415+0000 7fbd19bef640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbd14159ba0 0x7fbd140cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36406/0 (socket says 172.21.15.19:36406) 2023-11-20T06:42:44.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.415+0000 7fbd19bef640 1 -- 172.21.15.19:0/4111484324 learned_addr learned my addr 172.21.15.19:0/4111484324 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:44.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.419+0000 7fbd1a3f0640 1 --2- 172.21.15.19:0/4111484324 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd141597c0 0x7fbd140ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:44.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.419+0000 7fbd1abf1640 1 --2- 172.21.15.19:0/4111484324 >> v2:172.21.15.190:3300/0 conn(0x7fbd140adc10 0x7fbd140cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:44.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.419+0000 7fbd19bef640 1 -- 172.21.15.19:0/4111484324 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd141597c0 msgr2=0x7fbd140ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:44.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.419+0000 7fbd19bef640 1 --2- 172.21.15.19:0/4111484324 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd141597c0 0x7fbd140ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.419+0000 7fbd19bef640 1 -- 172.21.15.19:0/4111484324 >> v2:172.21.15.190:3300/0 conn(0x7fbd140adc10 msgr2=0x7fbd140cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:44.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.419+0000 7fbd19bef640 1 --2- 172.21.15.19:0/4111484324 >> v2:172.21.15.190:3300/0 conn(0x7fbd140adc10 0x7fbd140cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.419+0000 7fbd19bef640 1 -- 172.21.15.19:0/4111484324 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd14071d80 con 0x7fbd14159ba0 2023-11-20T06:42:44.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.419+0000 7fbd19bef640 1 --2- 172.21.15.19:0/4111484324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd14159ba0 0x7fbd140cae10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbd1406e330 tx=0x7fbd0401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1d1c96f20df246 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:44.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.419+0000 7fbd193ee640 1 -- 172.21.15.19:0/4111484324 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd040a7bd0 con 0x7fbd14159ba0 2023-11-20T06:42:44.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.419+0000 7fbd193ee640 1 -- 172.21.15.19:0/4111484324 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd040a7d30 con 0x7fbd14159ba0 2023-11-20T06:42:44.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.419+0000 7fbd193ee640 1 -- 172.21.15.19:0/4111484324 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd040a7ea0 con 0x7fbd14159ba0 2023-11-20T06:42:44.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1c654640 1 -- 172.21.15.19:0/4111484324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd14159ba0 msgr2=0x7fbd140cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:44.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1c654640 1 --2- 172.21.15.19:0/4111484324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd14159ba0 0x7fbd140cae10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbd1406e330 tx=0x7fbd0401eba0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1c654640 1 -- 172.21.15.19:0/4111484324 shutdown_connections 2023-11-20T06:42:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1c654640 1 --2- 172.21.15.19:0/4111484324 >> v2:172.21.15.190:3300/0 conn(0x7fbd140adc10 0x7fbd140cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1c654640 1 --2- 172.21.15.19:0/4111484324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd14159ba0 0x7fbd140cae10 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1c654640 1 --2- 172.21.15.19:0/4111484324 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd141597c0 0x7fbd140ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1c654640 1 -- 172.21.15.19:0/4111484324 >> 172.21.15.19:0/4111484324 conn(0x7fbd1406c190 msgr2=0x7fbd1406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1c654640 1 -- 172.21.15.19:0/4111484324 shutdown_connections 2023-11-20T06:42:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1c654640 1 -- 172.21.15.19:0/4111484324 wait complete. 2023-11-20T06:42:44.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1c654640 1 Processor -- start 2023-11-20T06:42:44.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1c654640 1 -- start start 2023-11-20T06:42:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1c654640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd140adc10 0x7fbd14157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1c654640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd141597c0 0x7fbd14163b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1c654640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd14159ba0 0x7fbd141470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1c654640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd14158420 con 0x7fbd14159ba0 2023-11-20T06:42:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1c654640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd14162a80 con 0x7fbd141597c0 2023-11-20T06:42:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1c654640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd14162d60 con 0x7fbd140adc10 2023-11-20T06:42:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1abf1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd14159ba0 0x7fbd141470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1abf1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd14159ba0 0x7fbd141470a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36408/0 (socket says 172.21.15.19:36408) 2023-11-20T06:42:44.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1abf1640 1 -- 172.21.15.19:0/2644732241 learned_addr learned my addr 172.21.15.19:0/2644732241 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:44.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1a3f0640 1 --2- 172.21.15.19:0/2644732241 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd140adc10 0x7fbd14157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:44.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd19bef640 1 --2- 172.21.15.19:0/2644732241 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd141597c0 0x7fbd14163b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:44.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1abf1640 1 -- 172.21.15.19:0/2644732241 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd140adc10 msgr2=0x7fbd14157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:44.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1abf1640 1 --2- 172.21.15.19:0/2644732241 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd140adc10 0x7fbd14157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1abf1640 1 -- 172.21.15.19:0/2644732241 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd141597c0 msgr2=0x7fbd14163b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:44.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1abf1640 1 --2- 172.21.15.19:0/2644732241 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd141597c0 0x7fbd14163b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1abf1640 1 -- 172.21.15.19:0/2644732241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0400b770 con 0x7fbd14159ba0 2023-11-20T06:42:44.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd1a3f0640 1 --2- 172.21.15.19:0/2644732241 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd140adc10 0x7fbd14157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:44.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.423+0000 7fbd19bef640 1 --2- 172.21.15.19:0/2644732241 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd141597c0 0x7fbd14163b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:44.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.427+0000 7fbd1abf1640 1 --2- 172.21.15.19:0/2644732241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd14159ba0 0x7fbd141470a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c007d10 tx=0x7fbd0c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:44.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.427+0000 7fbd0affd640 1 -- 172.21.15.19:0/2644732241 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c014420 con 0x7fbd14159ba0 2023-11-20T06:42:44.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.427+0000 7fbd0affd640 1 -- 172.21.15.19:0/2644732241 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c0145a0 con 0x7fbd14159ba0 2023-11-20T06:42:44.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.427+0000 7fbd0affd640 1 -- 172.21.15.19:0/2644732241 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c014950 con 0x7fbd14159ba0 2023-11-20T06:42:44.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.427+0000 7fbd1c654640 1 -- 172.21.15.19:0/2644732241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd14163040 con 0x7fbd14159ba0 2023-11-20T06:42:44.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.427+0000 7fbd1c654640 1 -- 172.21.15.19:0/2644732241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd14163600 con 0x7fbd14159ba0 2023-11-20T06:42:44.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.427+0000 7fbd1c654640 1 -- 172.21.15.19:0/2644732241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd14074010 con 0x7fbd14159ba0 2023-11-20T06:42:44.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.427+0000 7fbd0affd640 1 -- 172.21.15.19:0/2644732241 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbd0c014ab0 con 0x7fbd14159ba0 2023-11-20T06:42:44.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.427+0000 7fbd0affd640 1 --2- 172.21.15.19:0/2644732241 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbcf80664d0 0x7fbcf8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:44.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.427+0000 7fbd0affd640 1 -- 172.21.15.19:0/2644732241 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbd0c084840 con 0x7fbd14159ba0 2023-11-20T06:42:44.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.427+0000 7fbd1a3f0640 1 --2- 172.21.15.19:0/2644732241 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbcf80664d0 0x7fbcf8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:44.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.431+0000 7fbd1a3f0640 1 --2- 172.21.15.19:0/2644732241 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbcf80664d0 0x7fbcf8068990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbd140cd3c0 tx=0x7fbd10008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:44.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.431+0000 7fbd0affd640 1 -- 172.21.15.19:0/2644732241 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbd0c051b80 con 0x7fbd14159ba0 2023-11-20T06:42:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.595+0000 7fbd1c654640 1 -- 172.21.15.19:0/2644732241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd140c4fc0 con 0x7fbd14159ba0 2023-11-20T06:42:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.595+0000 7fbd0affd640 1 -- 172.21.15.19:0/2644732241 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16775 (secure 0 0 0) 0x7fbd0c0551a0 con 0x7fbd14159ba0 2023-11-20T06:42:44.603 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:44.603 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":38,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:42:43.280540+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:42:41.076502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-20T06:42:42.316293+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:44.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.599+0000 7fbd1c654640 1 -- 172.21.15.19:0/2644732241 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbcf80664d0 msgr2=0x7fbcf8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:44.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.599+0000 7fbd1c654640 1 --2- 172.21.15.19:0/2644732241 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbcf80664d0 0x7fbcf8068990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbd140cd3c0 tx=0x7fbd10008040 comp rx=0 tx=0).stop 2023-11-20T06:42:44.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.599+0000 7fbd1c654640 1 -- 172.21.15.19:0/2644732241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd14159ba0 msgr2=0x7fbd141470a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:44.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.599+0000 7fbd1c654640 1 --2- 172.21.15.19:0/2644732241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd14159ba0 0x7fbd141470a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c007d10 tx=0x7fbd0c00e4b0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.599+0000 7fbd1c654640 1 -- 172.21.15.19:0/2644732241 shutdown_connections 2023-11-20T06:42:44.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.599+0000 7fbd1c654640 1 --2- 172.21.15.19:0/2644732241 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbcf80664d0 0x7fbcf8068990 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.599+0000 7fbd1c654640 1 --2- 172.21.15.19:0/2644732241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd14159ba0 0x7fbd141470a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.599+0000 7fbd1c654640 1 --2- 172.21.15.19:0/2644732241 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd141597c0 0x7fbd14163b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.599+0000 7fbd1c654640 1 --2- 172.21.15.19:0/2644732241 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd140adc10 0x7fbd14157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.599+0000 7fbd1c654640 1 -- 172.21.15.19:0/2644732241 >> 172.21.15.19:0/2644732241 conn(0x7fbd1406c190 msgr2=0x7fbd140cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:44.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.599+0000 7fbd1c654640 1 -- 172.21.15.19:0/2644732241 shutdown_connections 2023-11-20T06:42:44.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.599+0000 7fbd1c654640 1 -- 172.21.15.19:0/2644732241 wait complete. 2023-11-20T06:42:44.624 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:44.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.763+0000 7f714b33e640 1 Processor -- start 2023-11-20T06:42:44.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.763+0000 7f714b33e640 1 -- start start 2023-11-20T06:42:44.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.763+0000 7f714b33e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f714415cb90 0x7f71440cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:44.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.763+0000 7f714b33e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71440d3010 0x7f71440d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:44.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.763+0000 7f714b33e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f71440d1400 0x7f71440cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:44.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.763+0000 7f714b33e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71440d1890 con 0x7f714415cb90 2023-11-20T06:42:44.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.763+0000 7f714b33e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71440ce770 con 0x7f71440d1400 2023-11-20T06:42:44.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.763+0000 7f714b33e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71440d0600 con 0x7f71440d3010 2023-11-20T06:42:44.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.763+0000 7f71490da640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f714415cb90 0x7f71440cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:44.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.763+0000 7f71490da640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f714415cb90 0x7f71440cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36410/0 (socket says 172.21.15.19:36410) 2023-11-20T06:42:44.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.763+0000 7f71490da640 1 -- 172.21.15.19:0/850072537 learned_addr learned my addr 172.21.15.19:0/850072537 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:44.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.763+0000 7f71498db640 1 --2- 172.21.15.19:0/850072537 >> v2:172.21.15.190:3300/0 conn(0x7f71440d1400 0x7f71440cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:44.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.763+0000 7f71488d9640 1 --2- 172.21.15.19:0/850072537 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71440d3010 0x7f71440d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:44.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.767+0000 7f71490da640 1 -- 172.21.15.19:0/850072537 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71440d3010 msgr2=0x7f71440d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:44.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.767+0000 7f71490da640 1 --2- 172.21.15.19:0/850072537 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71440d3010 0x7f71440d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.767+0000 7f71490da640 1 -- 172.21.15.19:0/850072537 >> v2:172.21.15.190:3300/0 conn(0x7f71440d1400 msgr2=0x7f71440cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:44.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.767+0000 7f71490da640 1 --2- 172.21.15.19:0/850072537 >> v2:172.21.15.190:3300/0 conn(0x7f71440d1400 0x7f71440cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.767+0000 7f71490da640 1 -- 172.21.15.19:0/850072537 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71440c6450 con 0x7f714415cb90 2023-11-20T06:42:44.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.767+0000 7f71488d9640 1 --2- 172.21.15.19:0/850072537 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71440d3010 0x7f71440d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:44.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.767+0000 7f71498db640 1 --2- 172.21.15.19:0/850072537 >> v2:172.21.15.190:3300/0 conn(0x7f71440d1400 0x7f71440cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:44.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.767+0000 7f71490da640 1 --2- 172.21.15.19:0/850072537 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714415cb90 0x7f71440cfb10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f71440725c0 tx=0x7f714001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b45a830475899c server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:44.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.767+0000 7f713bfff640 1 -- 172.21.15.19:0/850072537 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400ab600 con 0x7f714415cb90 2023-11-20T06:42:44.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.767+0000 7f713bfff640 1 -- 172.21.15.19:0/850072537 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71400ab760 con 0x7f714415cb90 2023-11-20T06:42:44.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.767+0000 7f713bfff640 1 -- 172.21.15.19:0/850072537 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400abaf0 con 0x7f714415cb90 2023-11-20T06:42:44.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.767+0000 7f714b33e640 1 -- 172.21.15.19:0/850072537 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714415cb90 msgr2=0x7f71440cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:44.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.767+0000 7f714b33e640 1 --2- 172.21.15.19:0/850072537 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714415cb90 0x7f71440cfb10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f71440725c0 tx=0x7f714001c440 comp rx=0 tx=0).stop 2023-11-20T06:42:44.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.767+0000 7f714b33e640 1 -- 172.21.15.19:0/850072537 shutdown_connections 2023-11-20T06:42:44.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.767+0000 7f714b33e640 1 --2- 172.21.15.19:0/850072537 >> v2:172.21.15.190:3300/0 conn(0x7f71440d1400 0x7f71440cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.767+0000 7f714b33e640 1 --2- 172.21.15.19:0/850072537 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71440d3010 0x7f71440d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.767+0000 7f714b33e640 1 --2- 172.21.15.19:0/850072537 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714415cb90 0x7f71440cfb10 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.767+0000 7f714b33e640 1 -- 172.21.15.19:0/850072537 >> 172.21.15.19:0/850072537 conn(0x7f714409bc50 msgr2=0x7f71440d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:44.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.767+0000 7f714b33e640 1 -- 172.21.15.19:0/850072537 shutdown_connections 2023-11-20T06:42:44.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.771+0000 7f714b33e640 1 -- 172.21.15.19:0/850072537 wait complete. 2023-11-20T06:42:44.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.771+0000 7f714b33e640 1 Processor -- start 2023-11-20T06:42:44.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.771+0000 7f714b33e640 1 -- start start 2023-11-20T06:42:44.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.771+0000 7f714b33e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71440d1400 0x7f714414a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:44.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.771+0000 7f714b33e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71440d3010 0x7f71440b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:44.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.771+0000 7f714b33e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f714415cb90 0x7f7144149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:44.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.771+0000 7f714b33e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714414b990 con 0x7f71440d3010 2023-11-20T06:42:44.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.771+0000 7f714b33e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714414ad10 con 0x7f714415cb90 2023-11-20T06:42:44.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.771+0000 7f714b33e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714414aff0 con 0x7f71440d1400 2023-11-20T06:42:44.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.771+0000 7f71488d9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71440d3010 0x7f71440b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:44.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.771+0000 7f71488d9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71440d3010 0x7f71440b3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36416/0 (socket says 172.21.15.19:36416) 2023-11-20T06:42:44.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.771+0000 7f71488d9640 1 -- 172.21.15.19:0/3121214974 learned_addr learned my addr 172.21.15.19:0/3121214974 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:44.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.771+0000 7f71490da640 1 --2- 172.21.15.19:0/3121214974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71440d1400 0x7f714414a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:44.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.771+0000 7f71498db640 1 --2- 172.21.15.19:0/3121214974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f714415cb90 0x7f7144149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:44.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.771+0000 7f71488d9640 1 -- 172.21.15.19:0/3121214974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71440d1400 msgr2=0x7f714414a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:44.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.771+0000 7f71488d9640 1 --2- 172.21.15.19:0/3121214974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71440d1400 0x7f714414a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.771+0000 7f71488d9640 1 -- 172.21.15.19:0/3121214974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f714415cb90 msgr2=0x7f7144149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:44.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.771+0000 7f71488d9640 1 --2- 172.21.15.19:0/3121214974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f714415cb90 0x7f7144149e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.771+0000 7f71488d9640 1 -- 172.21.15.19:0/3121214974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7140009480 con 0x7f71440d3010 2023-11-20T06:42:44.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.771+0000 7f71488d9640 1 --2- 172.21.15.19:0/3121214974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71440d3010 0x7f71440b3d50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f713400c7c0 tx=0x7f713400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:44.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.775+0000 7f7139ffb640 1 -- 172.21.15.19:0/3121214974 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134007a30 con 0x7f71440d3010 2023-11-20T06:42:44.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.775+0000 7f7139ffb640 1 -- 172.21.15.19:0/3121214974 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7134007b90 con 0x7f71440d3010 2023-11-20T06:42:44.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.775+0000 7f714b33e640 1 -- 172.21.15.19:0/3121214974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714414b2d0 con 0x7f71440d3010 2023-11-20T06:42:44.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.775+0000 7f7139ffb640 1 -- 172.21.15.19:0/3121214974 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713400ce70 con 0x7f71440d3010 2023-11-20T06:42:44.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.775+0000 7f714b33e640 1 -- 172.21.15.19:0/3121214974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714414a340 con 0x7f71440d3010 2023-11-20T06:42:44.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.775+0000 7f714b33e640 1 -- 172.21.15.19:0/3121214974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7144074010 con 0x7f71440d3010 2023-11-20T06:42:44.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.775+0000 7f7139ffb640 1 -- 172.21.15.19:0/3121214974 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f71340113f0 con 0x7f71440d3010 2023-11-20T06:42:44.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.775+0000 7f7139ffb640 1 --2- 172.21.15.19:0/3121214974 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f71280664a0 0x7f7128068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:44.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.775+0000 7f7139ffb640 1 -- 172.21.15.19:0/3121214974 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7134084380 con 0x7f71440d3010 2023-11-20T06:42:44.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.775+0000 7f71490da640 1 --2- 172.21.15.19:0/3121214974 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f71280664a0 0x7f7128068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:44.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.779+0000 7f71490da640 1 --2- 172.21.15.19:0/3121214974 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f71280664a0 0x7f7128068960 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f71400af000 tx=0x7f71400a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:44.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.779+0000 7f7139ffb640 1 -- 172.21.15.19:0/3121214974 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f71340516d0 con 0x7f71440d3010 2023-11-20T06:42:44.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.947+0000 7f714b33e640 1 -- 172.21.15.19:0/3121214974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7144073000 con 0x7f71440d3010 2023-11-20T06:42:44.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.947+0000 7f7139ffb640 1 -- 172.21.15.19:0/3121214974 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16762 (secure 0 0 0) 0x7f713405b030 con 0x7f71440d3010 2023-11-20T06:42:44.952 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:44.952 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":39,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:42:44.883106+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:42:41.076502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-20T06:42:42.316293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:44.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.947+0000 7f714b33e640 1 -- 172.21.15.19:0/3121214974 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f71280664a0 msgr2=0x7f7128068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:44.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.947+0000 7f714b33e640 1 --2- 172.21.15.19:0/3121214974 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f71280664a0 0x7f7128068960 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f71400af000 tx=0x7f71400a7000 comp rx=0 tx=0).stop 2023-11-20T06:42:44.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.947+0000 7f714b33e640 1 -- 172.21.15.19:0/3121214974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71440d3010 msgr2=0x7f71440b3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:44.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.947+0000 7f714b33e640 1 --2- 172.21.15.19:0/3121214974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71440d3010 0x7f71440b3d50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f713400c7c0 tx=0x7f713400cc80 comp rx=0 tx=0).stop 2023-11-20T06:42:44.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.947+0000 7f714b33e640 1 -- 172.21.15.19:0/3121214974 shutdown_connections 2023-11-20T06:42:44.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.947+0000 7f714b33e640 1 --2- 172.21.15.19:0/3121214974 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f71280664a0 0x7f7128068960 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.947+0000 7f714b33e640 1 --2- 172.21.15.19:0/3121214974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f714415cb90 0x7f7144149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.947+0000 7f714b33e640 1 --2- 172.21.15.19:0/3121214974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71440d3010 0x7f71440b3d50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.947+0000 7f714b33e640 1 --2- 172.21.15.19:0/3121214974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71440d1400 0x7f714414a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:44.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.947+0000 7f714b33e640 1 -- 172.21.15.19:0/3121214974 >> 172.21.15.19:0/3121214974 conn(0x7f714409bc50 msgr2=0x7f71440c82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:44.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.947+0000 7f714b33e640 1 -- 172.21.15.19:0/3121214974 shutdown_connections 2023-11-20T06:42:44.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:44.947+0000 7f714b33e640 1 -- 172.21.15.19:0/3121214974 wait complete. 2023-11-20T06:42:44.974 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-20T06:42:45.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.115+0000 7fb1d759e640 1 Processor -- start 2023-11-20T06:42:45.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.115+0000 7fb1d759e640 1 -- start start 2023-11-20T06:42:45.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.115+0000 7fb1d759e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb1d8154dc0 0x7fb1d806d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:45.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.115+0000 7fb1d759e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb1d815ba40 0x7fb1d80ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:45.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.115+0000 7fb1d759e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d80cf110 con 0x7fb1d80cecd0 2023-11-20T06:42:45.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.115+0000 7fb1d759e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d81551a0 con 0x7fb1d815ba40 2023-11-20T06:42:45.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.115+0000 7fb1d759e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d806dbb0 con 0x7fb1d8154dc0 2023-11-20T06:42:45.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.115+0000 7fb1cffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb1d815ba40 0x7fb1d80ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:45.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.115+0000 7fb1cffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb1d815ba40 0x7fb1d80ce790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36432/0 (socket says 172.21.15.19:36432) 2023-11-20T06:42:45.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.115+0000 7fb1cffff640 1 -- 172.21.15.19:0/4245905050 learned_addr learned my addr 172.21.15.19:0/4245905050 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:45.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.119+0000 7fb1d659c640 1 --2- 172.21.15.19:0/4245905050 >> v2:172.21.15.190:3300/0 conn(0x7fb1d8154dc0 0x7fb1d806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:45.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.119+0000 7fb1cffff640 1 -- 172.21.15.19:0/4245905050 >> v2:172.21.15.190:3300/0 conn(0x7fb1d8154dc0 msgr2=0x7fb1d806d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:45.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.119+0000 7fb1cffff640 1 --2- 172.21.15.19:0/4245905050 >> v2:172.21.15.190:3300/0 conn(0x7fb1d8154dc0 0x7fb1d806d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:45.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.119+0000 7fb1cffff640 1 -- 172.21.15.19:0/4245905050 >> v1:172.21.15.190:6789/0 conn(0x7fb1d80cecd0 legacy=0x7fb1d815e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:45.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.119+0000 7fb1cffff640 1 -- 172.21.15.19:0/4245905050 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d806de90 con 0x7fb1d815ba40 2023-11-20T06:42:45.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.119+0000 7fb1cffff640 1 --2- 172.21.15.19:0/4245905050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1d815ba40 0x7fb1d80ce790 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb1d809c330 tx=0x7fb1c001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728a53ff64f9c417 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:45.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.119+0000 7fb1d5d9b640 1 -- 172.21.15.19:0/4245905050 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00ab600 con 0x7fb1d815ba40 2023-11-20T06:42:45.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.119+0000 7fb1d5d9b640 1 -- 172.21.15.19:0/4245905050 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c00ab760 con 0x7fb1d815ba40 2023-11-20T06:42:45.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.119+0000 7fb1d5d9b640 1 -- 172.21.15.19:0/4245905050 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00abaf0 con 0x7fb1d815ba40 2023-11-20T06:42:45.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.119+0000 7fb1d759e640 1 -- 172.21.15.19:0/4245905050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1d815ba40 msgr2=0x7fb1d80ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:45.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.119+0000 7fb1d759e640 1 --2- 172.21.15.19:0/4245905050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1d815ba40 0x7fb1d80ce790 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb1d809c330 tx=0x7fb1c001c400 comp rx=0 tx=0).stop 2023-11-20T06:42:45.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.119+0000 7fb1d759e640 1 -- 172.21.15.19:0/4245905050 shutdown_connections 2023-11-20T06:42:45.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.119+0000 7fb1d759e640 1 --2- 172.21.15.19:0/4245905050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1d815ba40 0x7fb1d80ce790 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:45.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.119+0000 7fb1d759e640 1 --2- 172.21.15.19:0/4245905050 >> v2:172.21.15.190:3300/0 conn(0x7fb1d8154dc0 0x7fb1d806d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:45.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.119+0000 7fb1d759e640 1 -- 172.21.15.19:0/4245905050 >> 172.21.15.19:0/4245905050 conn(0x7fb1d806a290 msgr2=0x7fb1d806a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:45.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1d759e640 1 -- 172.21.15.19:0/4245905050 shutdown_connections 2023-11-20T06:42:45.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1d759e640 1 -- 172.21.15.19:0/4245905050 wait complete. 2023-11-20T06:42:45.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1d759e640 1 Processor -- start 2023-11-20T06:42:45.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1d759e640 1 -- start start 2023-11-20T06:42:45.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1d759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1d80cecd0 0x7fb1d8097ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:45.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1d759e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1d8154dc0 0x7fb1d80cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:45.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1d759e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1d815ba40 0x7fb1d8096e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:45.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1d759e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d815d4c0 con 0x7fb1d80cecd0 2023-11-20T06:42:45.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1d759e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d815d9f0 con 0x7fb1d8154dc0 2023-11-20T06:42:45.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1d759e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d815d710 con 0x7fb1d815ba40 2023-11-20T06:42:45.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1d659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1d80cecd0 0x7fb1d8097ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:45.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1d659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1d80cecd0 0x7fb1d8097ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36440/0 (socket says 172.21.15.19:36440) 2023-11-20T06:42:45.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1d659c640 1 -- 172.21.15.19:0/579661870 learned_addr learned my addr 172.21.15.19:0/579661870 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:45.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1cffff640 1 --2- 172.21.15.19:0/579661870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1d8154dc0 0x7fb1d80cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:45.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1d6d9d640 1 --2- 172.21.15.19:0/579661870 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1d815ba40 0x7fb1d8096e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:45.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1d659c640 1 -- 172.21.15.19:0/579661870 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1d815ba40 msgr2=0x7fb1d8096e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:45.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1d659c640 1 --2- 172.21.15.19:0/579661870 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1d815ba40 0x7fb1d8096e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:45.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1d659c640 1 -- 172.21.15.19:0/579661870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1d8154dc0 msgr2=0x7fb1d80cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:45.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1d659c640 1 --2- 172.21.15.19:0/579661870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1d8154dc0 0x7fb1d80cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:45.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1d659c640 1 -- 172.21.15.19:0/579661870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c00094d0 con 0x7fb1d80cecd0 2023-11-20T06:42:45.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.123+0000 7fb1d659c640 1 --2- 172.21.15.19:0/579661870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1d80cecd0 0x7fb1d8097ad0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800d800 tx=0x7fb1c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:45.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.127+0000 7fb1ceffd640 1 -- 172.21.15.19:0/579661870 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c800b6c0 con 0x7fb1d80cecd0 2023-11-20T06:42:45.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.127+0000 7fb1ceffd640 1 -- 172.21.15.19:0/579661870 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c800b820 con 0x7fb1d80cecd0 2023-11-20T06:42:45.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.127+0000 7fb1ceffd640 1 -- 172.21.15.19:0/579661870 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c800bb90 con 0x7fb1d80cecd0 2023-11-20T06:42:45.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.127+0000 7fb1d759e640 1 -- 172.21.15.19:0/579661870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d80cad20 con 0x7fb1d80cecd0 2023-11-20T06:42:45.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.127+0000 7fb1d759e640 1 -- 172.21.15.19:0/579661870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d80cb2e0 con 0x7fb1d80cecd0 2023-11-20T06:42:45.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.127+0000 7fb1d759e640 1 -- 172.21.15.19:0/579661870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d814ef50 con 0x7fb1d80cecd0 2023-11-20T06:42:45.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.127+0000 7fb1ceffd640 1 -- 172.21.15.19:0/579661870 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb1c800bcf0 con 0x7fb1d80cecd0 2023-11-20T06:42:45.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.127+0000 7fb1ceffd640 1 --2- 172.21.15.19:0/579661870 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb1b80664a0 0x7fb1b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:45.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.127+0000 7fb1ceffd640 1 -- 172.21.15.19:0/579661870 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb1c8084460 con 0x7fb1d80cecd0 2023-11-20T06:42:45.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.127+0000 7fb1cffff640 1 --2- 172.21.15.19:0/579661870 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb1b80664a0 0x7fb1b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:45.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.131+0000 7fb1cffff640 1 --2- 172.21.15.19:0/579661870 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb1b80664a0 0x7fb1b8068960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00af000 tx=0x7fb1c00a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:45.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.131+0000 7fb1ceffd640 1 -- 172.21.15.19:0/579661870 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb1c80517b0 con 0x7fb1d80cecd0 2023-11-20T06:42:45.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:45.327+0000 7fb1d759e640 1 -- 172.21.15.19:0/579661870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb1d804e9c0 con 0x7fb1d80cecd0 2023-11-20T06:42:46.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.251+0000 7fb1ceffd640 1 -- 172.21.15.19:0/579661870 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb1c8054dd0 con 0x7fb1d80cecd0 2023-11-20T06:42:46.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.251+0000 7fb1d759e640 1 -- 172.21.15.19:0/579661870 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb1b80664a0 msgr2=0x7fb1b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:46.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.251+0000 7fb1d759e640 1 --2- 172.21.15.19:0/579661870 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb1b80664a0 0x7fb1b8068960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00af000 tx=0x7fb1c00a7000 comp rx=0 tx=0).stop 2023-11-20T06:42:46.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.251+0000 7fb1d759e640 1 -- 172.21.15.19:0/579661870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1d80cecd0 msgr2=0x7fb1d8097ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:46.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.251+0000 7fb1d759e640 1 --2- 172.21.15.19:0/579661870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1d80cecd0 0x7fb1d8097ad0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800d800 tx=0x7fb1c800dcc0 comp rx=0 tx=0).stop 2023-11-20T06:42:46.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.251+0000 7fb1d759e640 1 -- 172.21.15.19:0/579661870 shutdown_connections 2023-11-20T06:42:46.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.251+0000 7fb1d759e640 1 --2- 172.21.15.19:0/579661870 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fb1b80664a0 0x7fb1b8068960 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:46.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.251+0000 7fb1d759e640 1 --2- 172.21.15.19:0/579661870 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1d815ba40 0x7fb1d8096e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:46.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.251+0000 7fb1d759e640 1 --2- 172.21.15.19:0/579661870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1d8154dc0 0x7fb1d80cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:46.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.251+0000 7fb1d759e640 1 --2- 172.21.15.19:0/579661870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1d80cecd0 0x7fb1d8097ad0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:46.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.251+0000 7fb1d759e640 1 -- 172.21.15.19:0/579661870 >> 172.21.15.19:0/579661870 conn(0x7fb1d806a290 msgr2=0x7fb1d815be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:46.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.251+0000 7fb1d759e640 1 -- 172.21.15.19:0/579661870 shutdown_connections 2023-11-20T06:42:46.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.251+0000 7fb1d759e640 1 -- 172.21.15.19:0/579661870 wait complete. 2023-11-20T06:42:46.288 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-20T06:42:46.288 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-20T06:42:46.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.435+0000 7f83a7980640 1 Processor -- start 2023-11-20T06:42:46.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.435+0000 7f83a7980640 1 -- start start 2023-11-20T06:42:46.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.435+0000 7f83a7980640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f83a00cb040 0x7f83a00ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:46.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.435+0000 7f83a7980640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a00cc330 con 0x7f83a00cebd0 2023-11-20T06:42:46.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.435+0000 7f83a7980640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a00cb4d0 con 0x7f83a015cc60 2023-11-20T06:42:46.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.435+0000 7f83a7980640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a00cefe0 con 0x7f83a00cb040 2023-11-20T06:42:46.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.435+0000 7f83a5f1d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f83a00cebd0 0x7f83a00cc990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59270/0 (socket says 172.21.15.19:59270) 2023-11-20T06:42:46.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.435+0000 7f83a5f1d640 1 -- 172.21.15.19:0/1531946306 learned_addr learned my addr 172.21.15.19:0/1531946306 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:46.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.435+0000 7f83a4f1b640 1 --2- 172.21.15.19:0/1531946306 >> v2:172.21.15.190:3300/0 conn(0x7f83a00cb040 0x7f83a00ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:46.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.435+0000 7f8397fff640 1 -- 172.21.15.19:0/1531946306 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695021653 0 0) 0x7f83a00cc330 con 0x7f83a00cebd0 2023-11-20T06:42:46.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.435+0000 7f8397fff640 1 -- 172.21.15.19:0/1531946306 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f838c003530 con 0x7f83a00cebd0 2023-11-20T06:42:46.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.435+0000 7f83a4f1b640 1 -- 172.21.15.19:0/1531946306 >> v1:172.21.15.190:6789/0 conn(0x7f83a015cc60 legacy=0x7f83a0161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:46.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.435+0000 7f83a4f1b640 1 -- 172.21.15.19:0/1531946306 >> v1:172.21.15.19:6789/0 conn(0x7f83a00cebd0 legacy=0x7f83a00cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:46.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.435+0000 7f83a4f1b640 1 -- 172.21.15.19:0/1531946306 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a00cb720 con 0x7f83a00cb040 2023-11-20T06:42:46.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.439+0000 7f83a4f1b640 1 --2- 172.21.15.19:0/1531946306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83a00cb040 0x7f83a00ce690 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f83900097c0 tx=0x7f839001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c4a8e0a743e25dc server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:46.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.439+0000 7f8397fff640 1 -- 172.21.15.19:0/1531946306 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83900ab650 con 0x7f83a00cb040 2023-11-20T06:42:46.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.439+0000 7f8397fff640 1 -- 172.21.15.19:0/1531946306 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83900ab7b0 con 0x7f83a00cb040 2023-11-20T06:42:46.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.439+0000 7f8397fff640 1 -- 172.21.15.19:0/1531946306 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83900abb40 con 0x7f83a00cb040 2023-11-20T06:42:46.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.439+0000 7f83a7980640 1 -- 172.21.15.19:0/1531946306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83a00cb040 msgr2=0x7f83a00ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:46.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.439+0000 7f83a7980640 1 --2- 172.21.15.19:0/1531946306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83a00cb040 0x7f83a00ce690 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f83900097c0 tx=0x7f839001c450 comp rx=0 tx=0).stop 2023-11-20T06:42:46.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.439+0000 7f83a7980640 1 -- 172.21.15.19:0/1531946306 shutdown_connections 2023-11-20T06:42:46.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.439+0000 7f83a7980640 1 --2- 172.21.15.19:0/1531946306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83a00cb040 0x7f83a00ce690 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:46.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.439+0000 7f83a7980640 1 -- 172.21.15.19:0/1531946306 >> 172.21.15.19:0/1531946306 conn(0x7f83a006e570 msgr2=0x7f83a006e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:46.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.439+0000 7f83a7980640 1 -- 172.21.15.19:0/1531946306 shutdown_connections 2023-11-20T06:42:46.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.439+0000 7f83a7980640 1 -- 172.21.15.19:0/1531946306 wait complete. 2023-11-20T06:42:46.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a7980640 1 Processor -- start 2023-11-20T06:42:46.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a7980640 1 -- start start 2023-11-20T06:42:46.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a7980640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a00cb040 0x7f83a00c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:46.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a7980640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83a00cebd0 0x7f83a00ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:46.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a7980640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83a015cc60 0x7f83a0159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:46.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a7980640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a00c8330 con 0x7f83a00cb040 2023-11-20T06:42:46.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a7980640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a00b4460 con 0x7f83a015cc60 2023-11-20T06:42:46.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a7980640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a00b4a20 con 0x7f83a00cebd0 2023-11-20T06:42:46.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a571c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a00cb040 0x7f83a00c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:46.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a571c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a00cb040 0x7f83a00c7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36454/0 (socket says 172.21.15.19:36454) 2023-11-20T06:42:46.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a571c640 1 -- 172.21.15.19:0/1233874844 learned_addr learned my addr 172.21.15.19:0/1233874844 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:46.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a5f1d640 1 --2- 172.21.15.19:0/1233874844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83a015cc60 0x7f83a0159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:46.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a4f1b640 1 --2- 172.21.15.19:0/1233874844 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83a00cebd0 0x7f83a00ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:46.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a571c640 1 -- 172.21.15.19:0/1233874844 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83a00cebd0 msgr2=0x7f83a00ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:46.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a571c640 1 --2- 172.21.15.19:0/1233874844 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83a00cebd0 0x7f83a00ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:46.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a571c640 1 -- 172.21.15.19:0/1233874844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83a015cc60 msgr2=0x7f83a0159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:46.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a571c640 1 --2- 172.21.15.19:0/1233874844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83a015cc60 0x7f83a0159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:46.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a571c640 1 -- 172.21.15.19:0/1233874844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8390009420 con 0x7f83a00cb040 2023-11-20T06:42:46.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a5f1d640 1 --2- 172.21.15.19:0/1233874844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83a015cc60 0x7f83a0159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:46.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a4f1b640 1 --2- 172.21.15.19:0/1233874844 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83a00cebd0 0x7f83a00ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:46.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a571c640 1 --2- 172.21.15.19:0/1233874844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a00cb040 0x7f83a00c7980 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f839c00c3f0 tx=0x7f839c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:46.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f8395ffb640 1 -- 172.21.15.19:0/1233874844 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c0052d0 con 0x7f83a00cb040 2023-11-20T06:42:46.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f8395ffb640 1 -- 172.21.15.19:0/1233874844 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839c005430 con 0x7f83a00cb040 2023-11-20T06:42:46.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f8395ffb640 1 -- 172.21.15.19:0/1233874844 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c003840 con 0x7f83a00cb040 2023-11-20T06:42:46.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a7980640 1 -- 172.21.15.19:0/1233874844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a00c8580 con 0x7f83a00cb040 2023-11-20T06:42:46.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.443+0000 7f83a7980640 1 -- 172.21.15.19:0/1233874844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a00b46b0 con 0x7f83a00cb040 2023-11-20T06:42:46.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.447+0000 7f83a7980640 1 -- 172.21.15.19:0/1233874844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a004e170 con 0x7f83a00cb040 2023-11-20T06:42:46.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.447+0000 7f8395ffb640 1 -- 172.21.15.19:0/1233874844 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f839c0039a0 con 0x7f83a00cb040 2023-11-20T06:42:46.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.447+0000 7f8395ffb640 1 --2- 172.21.15.19:0/1233874844 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f83840664d0 0x7f8384068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:46.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.447+0000 7f8395ffb640 1 -- 172.21.15.19:0/1233874844 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f839c083540 con 0x7f83a00cb040 2023-11-20T06:42:46.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.447+0000 7f83a4f1b640 1 --2- 172.21.15.19:0/1233874844 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f83840664d0 0x7f8384068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:46.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.451+0000 7f83a4f1b640 1 --2- 172.21.15.19:0/1233874844 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f83840664d0 0x7f8384068990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f83900af000 tx=0x7f8390008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:46.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.451+0000 7f8395ffb640 1 -- 172.21.15.19:0/1233874844 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f839c050870 con 0x7f83a00cb040 2023-11-20T06:42:46.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:46.643+0000 7f83a7980640 1 -- 172.21.15.19:0/1233874844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f83a0160990 con 0x7f83a00cb040 2023-11-20T06:42:47.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.251+0000 7f8395ffb640 1 -- 172.21.15.19:0/1233874844 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f839c053e90 con 0x7f83a00cb040 2023-11-20T06:42:47.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.255+0000 7f83a7980640 1 -- 172.21.15.19:0/1233874844 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f83840664d0 msgr2=0x7f8384068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:47.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.255+0000 7f83a7980640 1 --2- 172.21.15.19:0/1233874844 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f83840664d0 0x7f8384068990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f83900af000 tx=0x7f8390008040 comp rx=0 tx=0).stop 2023-11-20T06:42:47.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.255+0000 7f83a7980640 1 -- 172.21.15.19:0/1233874844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a00cb040 msgr2=0x7f83a00c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:47.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.255+0000 7f83a7980640 1 --2- 172.21.15.19:0/1233874844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a00cb040 0x7f83a00c7980 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f839c00c3f0 tx=0x7f839c00c8b0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.255+0000 7f83a7980640 1 -- 172.21.15.19:0/1233874844 shutdown_connections 2023-11-20T06:42:47.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.255+0000 7f83a7980640 1 --2- 172.21.15.19:0/1233874844 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f83840664d0 0x7f8384068990 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.255+0000 7f83a7980640 1 --2- 172.21.15.19:0/1233874844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83a015cc60 0x7f83a0159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.255+0000 7f83a7980640 1 --2- 172.21.15.19:0/1233874844 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83a00cebd0 0x7f83a00ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.255+0000 7f83a7980640 1 --2- 172.21.15.19:0/1233874844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a00cb040 0x7f83a00c7980 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.255+0000 7f83a7980640 1 -- 172.21.15.19:0/1233874844 >> 172.21.15.19:0/1233874844 conn(0x7f83a006e570 msgr2=0x7f83a015d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:47.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.255+0000 7f83a7980640 1 -- 172.21.15.19:0/1233874844 shutdown_connections 2023-11-20T06:42:47.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.255+0000 7f83a7980640 1 -- 172.21.15.19:0/1233874844 wait complete. 2023-11-20T06:42:47.283 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-20T06:42:47.283 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T06:42:47.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.427+0000 7f4a9ff0f640 1 Processor -- start 2023-11-20T06:42:47.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.427+0000 7f4a9ff0f640 1 -- start start 2023-11-20T06:42:47.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.427+0000 7f4a9ff0f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a98070c40 0x7f4a9815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:47.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.427+0000 7f4a9ff0f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4a980b07f0 0x7f4a98164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:47.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.427+0000 7f4a9ff0f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a9815be60 con 0x7f4a980b4020 2023-11-20T06:42:47.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.427+0000 7f4a9ff0f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9815b3b0 con 0x7f4a980b07f0 2023-11-20T06:42:47.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.427+0000 7f4a9ff0f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9815c1f0 con 0x7f4a98070c40 2023-11-20T06:42:47.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.427+0000 7f4a9e4ac640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4a980b07f0 0x7f4a98164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:47.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.427+0000 7f4a9e4ac640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4a980b07f0 0x7f4a98164490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36466/0 (socket says 172.21.15.19:36466) 2023-11-20T06:42:47.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.427+0000 7f4a9e4ac640 1 -- 172.21.15.19:0/1787031363 learned_addr learned my addr 172.21.15.19:0/1787031363 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:47.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.427+0000 7f4a9dcab640 1 --2- 172.21.15.19:0/1787031363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a98070c40 0x7f4a9815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:47.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.427+0000 7f4a9e4ac640 1 -- 172.21.15.19:0/1787031363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a98070c40 msgr2=0x7f4a9815ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:47.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.427+0000 7f4a9e4ac640 1 --2- 172.21.15.19:0/1787031363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a98070c40 0x7f4a9815ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.427+0000 7f4a9e4ac640 1 -- 172.21.15.19:0/1787031363 >> v1:172.21.15.190:6789/0 conn(0x7f4a980b4020 legacy=0x7f4a980b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:47.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.427+0000 7f4a9e4ac640 1 -- 172.21.15.19:0/1787031363 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a98071020 con 0x7f4a980b07f0 2023-11-20T06:42:47.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.427+0000 7f4a9dcab640 1 --2- 172.21.15.19:0/1787031363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a98070c40 0x7f4a9815ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:47.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.431+0000 7f4a9e4ac640 1 --2- 172.21.15.19:0/1787031363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a980b07f0 0x7f4a98164490 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4a90009e50 tx=0x7f4a9001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8185ec84fc2e89 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:47.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.431+0000 7f4a9cca9640 1 -- 172.21.15.19:0/1787031363 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a900a5840 con 0x7f4a980b07f0 2023-11-20T06:42:47.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.431+0000 7f4a9cca9640 1 -- 172.21.15.19:0/1787031363 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a900a59a0 con 0x7f4a980b07f0 2023-11-20T06:42:47.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.431+0000 7f4a9cca9640 1 -- 172.21.15.19:0/1787031363 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a900a5d30 con 0x7f4a980b07f0 2023-11-20T06:42:47.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.431+0000 7f4a9ff0f640 1 -- 172.21.15.19:0/1787031363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a980b07f0 msgr2=0x7f4a98164490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:47.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.431+0000 7f4a9ff0f640 1 --2- 172.21.15.19:0/1787031363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a980b07f0 0x7f4a98164490 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4a90009e50 tx=0x7f4a9001c980 comp rx=0 tx=0).stop 2023-11-20T06:42:47.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.431+0000 7f4a9ff0f640 1 -- 172.21.15.19:0/1787031363 shutdown_connections 2023-11-20T06:42:47.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.431+0000 7f4a9ff0f640 1 --2- 172.21.15.19:0/1787031363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a980b07f0 0x7f4a98164490 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.431+0000 7f4a9ff0f640 1 --2- 172.21.15.19:0/1787031363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a98070c40 0x7f4a9815ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.431+0000 7f4a9ff0f640 1 -- 172.21.15.19:0/1787031363 >> 172.21.15.19:0/1787031363 conn(0x7f4a9806c190 msgr2=0x7f4a9806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:47.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.431+0000 7f4a9ff0f640 1 -- 172.21.15.19:0/1787031363 shutdown_connections 2023-11-20T06:42:47.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.431+0000 7f4a9ff0f640 1 -- 172.21.15.19:0/1787031363 wait complete. 2023-11-20T06:42:47.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9ff0f640 1 Processor -- start 2023-11-20T06:42:47.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9ff0f640 1 -- start start 2023-11-20T06:42:47.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9ff0f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a98070c40 0x7f4a98154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:47.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9ff0f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a980b07f0 0x7f4a9814b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:47.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9ff0f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a980b4020 0x7f4a98153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:47.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9ff0f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a98153080 con 0x7f4a980b4020 2023-11-20T06:42:47.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9ff0f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a98151040 con 0x7f4a98070c40 2023-11-20T06:42:47.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9ff0f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a98151320 con 0x7f4a980b07f0 2023-11-20T06:42:47.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9e4ac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a980b4020 0x7f4a98153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:47.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9e4ac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a980b4020 0x7f4a98153510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36478/0 (socket says 172.21.15.19:36478) 2023-11-20T06:42:47.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9e4ac640 1 -- 172.21.15.19:0/2793948687 learned_addr learned my addr 172.21.15.19:0/2793948687 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:47.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9dcab640 1 --2- 172.21.15.19:0/2793948687 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a98070c40 0x7f4a98154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:47.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9d4aa640 1 --2- 172.21.15.19:0/2793948687 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a980b07f0 0x7f4a9814b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:47.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9e4ac640 1 -- 172.21.15.19:0/2793948687 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a980b07f0 msgr2=0x7f4a9814b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:47.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9e4ac640 1 --2- 172.21.15.19:0/2793948687 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a980b07f0 0x7f4a9814b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9e4ac640 1 -- 172.21.15.19:0/2793948687 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a98070c40 msgr2=0x7f4a98154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:47.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9e4ac640 1 --2- 172.21.15.19:0/2793948687 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a98070c40 0x7f4a98154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9e4ac640 1 -- 172.21.15.19:0/2793948687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a90009b30 con 0x7f4a980b4020 2023-11-20T06:42:47.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9e4ac640 1 --2- 172.21.15.19:0/2793948687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a980b4020 0x7f4a98153510 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4a900af040 tx=0x7f4a90019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:47.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a8e7fc640 1 -- 172.21.15.19:0/2793948687 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a900b8670 con 0x7f4a980b4020 2023-11-20T06:42:47.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a8e7fc640 1 -- 172.21.15.19:0/2793948687 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a900b87d0 con 0x7f4a980b4020 2023-11-20T06:42:47.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a8e7fc640 1 -- 172.21.15.19:0/2793948687 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a900b8b80 con 0x7f4a980b4020 2023-11-20T06:42:47.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9ff0f640 1 -- 172.21.15.19:0/2793948687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a98152a30 con 0x7f4a980b4020 2023-11-20T06:42:47.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9ff0f640 1 -- 172.21.15.19:0/2793948687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a98150cc0 con 0x7f4a980b4020 2023-11-20T06:42:47.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.435+0000 7f4a9ff0f640 1 -- 172.21.15.19:0/2793948687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a9814f030 con 0x7f4a980b4020 2023-11-20T06:42:47.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.439+0000 7f4a8e7fc640 1 -- 172.21.15.19:0/2793948687 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4a900b8ce0 con 0x7f4a980b4020 2023-11-20T06:42:47.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.439+0000 7f4a8e7fc640 1 --2- 172.21.15.19:0/2793948687 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4a7c0664a0 0x7f4a7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:47.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.439+0000 7f4a8e7fc640 1 -- 172.21.15.19:0/2793948687 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4a9011f460 con 0x7f4a980b4020 2023-11-20T06:42:47.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.439+0000 7f4a9dcab640 1 --2- 172.21.15.19:0/2793948687 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4a7c0664a0 0x7f4a7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:47.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.439+0000 7f4a9dcab640 1 --2- 172.21.15.19:0/2793948687 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4a7c0664a0 0x7f4a7c068960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4a94006e90 tx=0x7f4a94008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:47.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.443+0000 7f4a8e7fc640 1 -- 172.21.15.19:0/2793948687 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4a900ec7b0 con 0x7f4a980b4020 2023-11-20T06:42:47.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.631+0000 7f4a9ff0f640 1 -- 172.21.15.19:0/2793948687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a98074010 con 0x7f4a980b4020 2023-11-20T06:42:47.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.635+0000 7f4a8e7fc640 1 -- 172.21.15.19:0/2793948687 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f4a900efdd0 con 0x7f4a980b4020 2023-11-20T06:42:47.639 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:47.640 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3692171038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3692171038},{"type":"v1","addr":"172.21.15.190:6835","nonce":3692171038}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2633535615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":2633535615},{"type":"v1","addr":"172.21.15.190:6837","nonce":2633535615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/1822146855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1822146855},{"type":"v1","addr":"172.21.15.19:6833","nonce":1822146855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T06:42:43.280879+0000","modified":"2023-11-20T06:42:46.648235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/203468016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":203468016},{"type":"v1","addr":"172.21.15.19:6835","nonce":203468016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-20T06:42:47.640 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 18 2023-11-20T06:42:47.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.635+0000 7f4a9ff0f640 1 -- 172.21.15.19:0/2793948687 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4a7c0664a0 msgr2=0x7f4a7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:47.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.635+0000 7f4a9ff0f640 1 --2- 172.21.15.19:0/2793948687 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4a7c0664a0 0x7f4a7c068960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4a94006e90 tx=0x7f4a94008040 comp rx=0 tx=0).stop 2023-11-20T06:42:47.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.635+0000 7f4a9ff0f640 1 -- 172.21.15.19:0/2793948687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a980b4020 msgr2=0x7f4a98153510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:47.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.635+0000 7f4a9ff0f640 1 --2- 172.21.15.19:0/2793948687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a980b4020 0x7f4a98153510 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4a900af040 tx=0x7f4a90019720 comp rx=0 tx=0).stop 2023-11-20T06:42:47.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.635+0000 7f4a9ff0f640 1 -- 172.21.15.19:0/2793948687 shutdown_connections 2023-11-20T06:42:47.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.635+0000 7f4a9ff0f640 1 --2- 172.21.15.19:0/2793948687 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4a7c0664a0 0x7f4a7c068960 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.635+0000 7f4a9ff0f640 1 --2- 172.21.15.19:0/2793948687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a980b4020 0x7f4a98153510 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.635+0000 7f4a9ff0f640 1 --2- 172.21.15.19:0/2793948687 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a980b07f0 0x7f4a9814b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.635+0000 7f4a9ff0f640 1 --2- 172.21.15.19:0/2793948687 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a98070c40 0x7f4a98154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.635+0000 7f4a9ff0f640 1 -- 172.21.15.19:0/2793948687 >> 172.21.15.19:0/2793948687 conn(0x7f4a9806c190 msgr2=0x7f4a9814e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:47.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.635+0000 7f4a9ff0f640 1 -- 172.21.15.19:0/2793948687 shutdown_connections 2023-11-20T06:42:47.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.635+0000 7f4a9ff0f640 1 -- 172.21.15.19:0/2793948687 wait complete. 2023-11-20T06:42:47.661 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:47.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.799+0000 7fa7aaaea640 1 Processor -- start 2023-11-20T06:42:47.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.799+0000 7fa7aaaea640 1 -- start start 2023-11-20T06:42:47.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.799+0000 7fa7aaaea640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa7a415cb90 0x7fa7a40cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:47.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.799+0000 7fa7aaaea640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa7a40d15d0 0x7fa7a40c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:47.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.799+0000 7fa7aaaea640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a40ce770 con 0x7fa7a40d3010 2023-11-20T06:42:47.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.799+0000 7fa7aaaea640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a40d0600 con 0x7fa7a415cb90 2023-11-20T06:42:47.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.799+0000 7fa7aaaea640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a40c6450 con 0x7fa7a40d15d0 2023-11-20T06:42:47.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.799+0000 7fa7a8886640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa7a415cb90 0x7fa7a40cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:47.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.799+0000 7fa7a8886640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa7a415cb90 0x7fa7a40cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36480/0 (socket says 172.21.15.19:36480) 2023-11-20T06:42:47.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.799+0000 7fa7a3fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa7a40d3010 0x7fa7a40d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59272/0 (socket says 172.21.15.19:59272) 2023-11-20T06:42:47.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.799+0000 7fa7a8886640 1 -- 172.21.15.19:0/2271880606 learned_addr learned my addr 172.21.15.19:0/2271880606 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:47.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.799+0000 7fa7a9087640 1 --2- 172.21.15.19:0/2271880606 >> v2:172.21.15.190:3300/0 conn(0x7fa7a40d15d0 0x7fa7a40c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:47.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.799+0000 7fa7a8886640 1 -- 172.21.15.19:0/2271880606 >> v2:172.21.15.190:3300/0 conn(0x7fa7a40d15d0 msgr2=0x7fa7a40c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:47.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.799+0000 7fa7a8886640 1 --2- 172.21.15.19:0/2271880606 >> v2:172.21.15.190:3300/0 conn(0x7fa7a40d15d0 0x7fa7a40c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.799+0000 7fa7a8886640 1 -- 172.21.15.19:0/2271880606 >> v1:172.21.15.19:6789/0 conn(0x7fa7a40d3010 legacy=0x7fa7a40d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:47.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.799+0000 7fa7a8886640 1 -- 172.21.15.19:0/2271880606 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a40d08a0 con 0x7fa7a415cb90 2023-11-20T06:42:47.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.799+0000 7fa7a37fe640 1 -- 172.21.15.19:0/2271880606 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239881562 0 0) 0x7fa7a40ce770 con 0x7fa7a40d3010 2023-11-20T06:42:47.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.803+0000 7fa7a8886640 1 --2- 172.21.15.19:0/2271880606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a415cb90 0x7fa7a40cfb10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa7a40ccee0 tx=0x7fa79801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f274d05ddf91b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:47.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.803+0000 7fa7a37fe640 1 -- 172.21.15.19:0/2271880606 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7980ab640 con 0x7fa7a415cb90 2023-11-20T06:42:47.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.803+0000 7fa7a37fe640 1 -- 172.21.15.19:0/2271880606 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7980a7070 con 0x7fa7a415cb90 2023-11-20T06:42:47.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.803+0000 7fa7a37fe640 1 -- 172.21.15.19:0/2271880606 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7980ab9c0 con 0x7fa7a415cb90 2023-11-20T06:42:47.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.803+0000 7fa7aaaea640 1 -- 172.21.15.19:0/2271880606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a415cb90 msgr2=0x7fa7a40cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:47.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.803+0000 7fa7aaaea640 1 --2- 172.21.15.19:0/2271880606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a415cb90 0x7fa7a40cfb10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa7a40ccee0 tx=0x7fa79801c440 comp rx=0 tx=0).stop 2023-11-20T06:42:47.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.803+0000 7fa7aaaea640 1 -- 172.21.15.19:0/2271880606 shutdown_connections 2023-11-20T06:42:47.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.803+0000 7fa7aaaea640 1 --2- 172.21.15.19:0/2271880606 >> v2:172.21.15.190:3300/0 conn(0x7fa7a40d15d0 0x7fa7a40c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.803+0000 7fa7aaaea640 1 --2- 172.21.15.19:0/2271880606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a415cb90 0x7fa7a40cfb10 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.803+0000 7fa7aaaea640 1 -- 172.21.15.19:0/2271880606 >> 172.21.15.19:0/2271880606 conn(0x7fa7a409bc50 msgr2=0x7fa7a40d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:47.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.803+0000 7fa7aaaea640 1 -- 172.21.15.19:0/2271880606 shutdown_connections 2023-11-20T06:42:47.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.803+0000 7fa7aaaea640 1 -- 172.21.15.19:0/2271880606 wait complete. 2023-11-20T06:42:47.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7aaaea640 1 Processor -- start 2023-11-20T06:42:47.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7aaaea640 1 -- start start 2023-11-20T06:42:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7aaaea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a40d15d0 0x7fa7a41539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7aaaea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7a40d3010 0x7fa7a40b7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7aaaea640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7a415cb90 0x7fa7a40b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7aaaea640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a415af40 con 0x7fa7a40d15d0 2023-11-20T06:42:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7aaaea640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a415a330 con 0x7fa7a415cb90 2023-11-20T06:42:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7aaaea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a415a610 con 0x7fa7a40d3010 2023-11-20T06:42:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7a8886640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a40d15d0 0x7fa7a41539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7a8886640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a40d15d0 0x7fa7a41539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36496/0 (socket says 172.21.15.19:36496) 2023-11-20T06:42:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7a8886640 1 -- 172.21.15.19:0/1662295577 learned_addr learned my addr 172.21.15.19:0/1662295577 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7a3fff640 1 --2- 172.21.15.19:0/1662295577 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7a40d3010 0x7fa7a40b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:47.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7a9087640 1 --2- 172.21.15.19:0/1662295577 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7a415cb90 0x7fa7a40b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:47.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7a8886640 1 -- 172.21.15.19:0/1662295577 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7a40d3010 msgr2=0x7fa7a40b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:47.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7a8886640 1 --2- 172.21.15.19:0/1662295577 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7a40d3010 0x7fa7a40b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7a8886640 1 -- 172.21.15.19:0/1662295577 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7a415cb90 msgr2=0x7fa7a40b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:47.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7a8886640 1 --2- 172.21.15.19:0/1662295577 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7a415cb90 0x7fa7a40b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7a8886640 1 -- 172.21.15.19:0/1662295577 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa798009480 con 0x7fa7a40d15d0 2023-11-20T06:42:47.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7a8886640 1 --2- 172.21.15.19:0/1662295577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a40d15d0 0x7fa7a41539e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa798019050 tx=0x7fa7980191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:47.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7a17fa640 1 -- 172.21.15.19:0/1662295577 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7980039e0 con 0x7fa7a40d15d0 2023-11-20T06:42:47.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7a17fa640 1 -- 172.21.15.19:0/1662295577 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa798003b60 con 0x7fa7a40d15d0 2023-11-20T06:42:47.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7aaaea640 1 -- 172.21.15.19:0/1662295577 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a415a8f0 con 0x7fa7a40d15d0 2023-11-20T06:42:47.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7a17fa640 1 -- 172.21.15.19:0/1662295577 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7980ab440 con 0x7fa7a40d15d0 2023-11-20T06:42:47.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.807+0000 7fa7aaaea640 1 -- 172.21.15.19:0/1662295577 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a4159fc0 con 0x7fa7a40d15d0 2023-11-20T06:42:47.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.811+0000 7fa7aaaea640 1 -- 172.21.15.19:0/1662295577 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a40caa10 con 0x7fa7a40d15d0 2023-11-20T06:42:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.811+0000 7fa7a17fa640 1 -- 172.21.15.19:0/1662295577 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa7980ab5a0 con 0x7fa7a40d15d0 2023-11-20T06:42:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.811+0000 7fa7a17fa640 1 --2- 172.21.15.19:0/1662295577 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa7880664a0 0x7fa788068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.811+0000 7fa7a17fa640 1 -- 172.21.15.19:0/1662295577 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa79811e6c0 con 0x7fa7a40d15d0 2023-11-20T06:42:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.811+0000 7fa7a3fff640 1 --2- 172.21.15.19:0/1662295577 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa7880664a0 0x7fa788068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.811+0000 7fa7a3fff640 1 --2- 172.21.15.19:0/1662295577 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa7880664a0 0x7fa788068960 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa7a41f7e40 tx=0x7fa790007b80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:47.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.815+0000 7fa7a17fa640 1 -- 172.21.15.19:0/1662295577 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa7a40caa10 con 0x7fa7a40d15d0 2023-11-20T06:42:47.866 INFO:tasks.ceph.mds.a.smithi019.stderr:2023-11-20T06:42:47.859+0000 7f51d9f4a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-20T06:42:47.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.975+0000 7fa7aaaea640 1 -- 172.21.15.19:0/1662295577 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7a40caa10 con 0x7fa7a40d15d0 2023-11-20T06:42:47.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.979+0000 7fa7a17fa640 1 -- 172.21.15.19:0/1662295577 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16762 (secure 0 0 0) 0x7fa7a40caa10 con 0x7fa7a40d15d0 2023-11-20T06:42:47.984 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:47.984 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":39,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:42:44.883106+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:42:41.076502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-20T06:42:42.316293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:47.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.979+0000 7fa7aaaea640 1 -- 172.21.15.19:0/1662295577 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa7880664a0 msgr2=0x7fa788068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:47.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.979+0000 7fa7aaaea640 1 --2- 172.21.15.19:0/1662295577 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa7880664a0 0x7fa788068960 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa7a41f7e40 tx=0x7fa790007b80 comp rx=0 tx=0).stop 2023-11-20T06:42:47.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.979+0000 7fa7aaaea640 1 -- 172.21.15.19:0/1662295577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a40d15d0 msgr2=0x7fa7a41539e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.979+0000 7fa7aaaea640 1 --2- 172.21.15.19:0/1662295577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a40d15d0 0x7fa7a41539e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa798019050 tx=0x7fa7980191e0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.979+0000 7fa7aaaea640 1 -- 172.21.15.19:0/1662295577 shutdown_connections 2023-11-20T06:42:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.979+0000 7fa7aaaea640 1 --2- 172.21.15.19:0/1662295577 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa7880664a0 0x7fa788068960 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.979+0000 7fa7aaaea640 1 --2- 172.21.15.19:0/1662295577 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7a415cb90 0x7fa7a40b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.979+0000 7fa7aaaea640 1 --2- 172.21.15.19:0/1662295577 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7a40d3010 0x7fa7a40b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.979+0000 7fa7aaaea640 1 --2- 172.21.15.19:0/1662295577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a40d15d0 0x7fa7a41539e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.979+0000 7fa7aaaea640 1 -- 172.21.15.19:0/1662295577 >> 172.21.15.19:0/1662295577 conn(0x7fa7a409bc50 msgr2=0x7fa7a406c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.979+0000 7fa7aaaea640 1 -- 172.21.15.19:0/1662295577 shutdown_connections 2023-11-20T06:42:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:47.979+0000 7fa7aaaea640 1 -- 172.21.15.19:0/1662295577 wait complete. 2023-11-20T06:42:48.005 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-20T06:42:48.005 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T06:42:48.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.143+0000 7f643d3f8640 1 Processor -- start 2023-11-20T06:42:48.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.143+0000 7f643d3f8640 1 -- start start 2023-11-20T06:42:48.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.143+0000 7f643d3f8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f643815ca70 0x7f64380d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:48.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.143+0000 7f643d3f8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f64380d3550 0x7f64380cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:48.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.143+0000 7f643d3f8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64380cfa00 con 0x7f64380cf5d0 2023-11-20T06:42:48.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.143+0000 7f643d3f8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64380ce820 con 0x7f643815ca70 2023-11-20T06:42:48.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.143+0000 7f643d3f8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64380c65f0 con 0x7f64380d3550 2023-11-20T06:42:48.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.143+0000 7f6436ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f643815ca70 0x7f64380d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:48.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.143+0000 7f6436ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f643815ca70 0x7f64380d3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36498/0 (socket says 172.21.15.19:36498) 2023-11-20T06:42:48.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.143+0000 7f64377fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f64380cf5d0 0x7f64380d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59276/0 (socket says 172.21.15.19:59276) 2023-11-20T06:42:48.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.143+0000 7f6436ffd640 1 -- 172.21.15.19:0/1697661992 learned_addr learned my addr 172.21.15.19:0/1697661992 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:48.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.143+0000 7f642ffff640 1 --2- 172.21.15.19:0/1697661992 >> v2:172.21.15.190:3300/0 conn(0x7f64380d3550 0x7f64380cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:48.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.143+0000 7f6436ffd640 1 -- 172.21.15.19:0/1697661992 >> v2:172.21.15.190:3300/0 conn(0x7f64380d3550 msgr2=0x7f64380cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:48.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.143+0000 7f6436ffd640 1 --2- 172.21.15.19:0/1697661992 >> v2:172.21.15.190:3300/0 conn(0x7f64380d3550 0x7f64380cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.143+0000 7f6436ffd640 1 -- 172.21.15.19:0/1697661992 >> v1:172.21.15.19:6789/0 conn(0x7f64380cf5d0 legacy=0x7f64380d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:48.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.143+0000 7f6436ffd640 1 -- 172.21.15.19:0/1697661992 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64380cdf80 con 0x7f643815ca70 2023-11-20T06:42:48.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.143+0000 7f64367fc640 1 -- 172.21.15.19:0/1697661992 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964659502 0 0) 0x7f64380cfa00 con 0x7f64380cf5d0 2023-11-20T06:42:48.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.147+0000 7f6436ffd640 1 --2- 172.21.15.19:0/1697661992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f643815ca70 0x7f64380d3010 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f64380b54f0 tx=0x7f642801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ec42951c60d994 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:48.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.147+0000 7f64367fc640 1 -- 172.21.15.19:0/1697661992 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64280aa430 con 0x7f643815ca70 2023-11-20T06:42:48.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.147+0000 7f64367fc640 1 -- 172.21.15.19:0/1697661992 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64280aa590 con 0x7f643815ca70 2023-11-20T06:42:48.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.147+0000 7f64367fc640 1 -- 172.21.15.19:0/1697661992 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64280aa920 con 0x7f643815ca70 2023-11-20T06:42:48.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.147+0000 7f643d3f8640 1 -- 172.21.15.19:0/1697661992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f643815ca70 msgr2=0x7f64380d3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:48.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.147+0000 7f643d3f8640 1 --2- 172.21.15.19:0/1697661992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f643815ca70 0x7f64380d3010 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f64380b54f0 tx=0x7f642801c4d0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.147+0000 7f643d3f8640 1 -- 172.21.15.19:0/1697661992 shutdown_connections 2023-11-20T06:42:48.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.147+0000 7f643d3f8640 1 --2- 172.21.15.19:0/1697661992 >> v2:172.21.15.190:3300/0 conn(0x7f64380d3550 0x7f64380cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.147+0000 7f643d3f8640 1 --2- 172.21.15.19:0/1697661992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f643815ca70 0x7f64380d3010 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.147+0000 7f643d3f8640 1 -- 172.21.15.19:0/1697661992 >> 172.21.15.19:0/1697661992 conn(0x7f643809bc50 msgr2=0x7f64380d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:48.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.147+0000 7f643d3f8640 1 -- 172.21.15.19:0/1697661992 shutdown_connections 2023-11-20T06:42:48.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.147+0000 7f643d3f8640 1 -- 172.21.15.19:0/1697661992 wait complete. 2023-11-20T06:42:48.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f643d3f8640 1 Processor -- start 2023-11-20T06:42:48.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f643d3f8640 1 -- start start 2023-11-20T06:42:48.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f643d3f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64380cf5d0 0x7f64380d2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:48.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f643d3f8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64380d3550 0x7f64380d2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:48.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f643d3f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f643815ca70 0x7f6438155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:48.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f643d3f8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643815bf90 con 0x7f64380cf5d0 2023-11-20T06:42:48.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f643d3f8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6438160090 con 0x7f64380d3550 2023-11-20T06:42:48.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f643d3f8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64380c9db0 con 0x7f643815ca70 2023-11-20T06:42:48.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f6436ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64380cf5d0 0x7f64380d2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:48.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f6436ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64380cf5d0 0x7f64380d2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36500/0 (socket says 172.21.15.19:36500) 2023-11-20T06:42:48.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f6436ffd640 1 -- 172.21.15.19:0/3624558556 learned_addr learned my addr 172.21.15.19:0/3624558556 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:48.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f642ffff640 1 --2- 172.21.15.19:0/3624558556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64380d3550 0x7f64380d2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:48.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f64377fe640 1 --2- 172.21.15.19:0/3624558556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f643815ca70 0x7f6438155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:48.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f6436ffd640 1 -- 172.21.15.19:0/3624558556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f643815ca70 msgr2=0x7f6438155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:48.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f6436ffd640 1 --2- 172.21.15.19:0/3624558556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f643815ca70 0x7f6438155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f6436ffd640 1 -- 172.21.15.19:0/3624558556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64380d3550 msgr2=0x7f64380d2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:48.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f6436ffd640 1 --2- 172.21.15.19:0/3624558556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64380d3550 0x7f64380d2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f6436ffd640 1 -- 172.21.15.19:0/3624558556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6428009480 con 0x7f64380cf5d0 2023-11-20T06:42:48.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f64377fe640 1 --2- 172.21.15.19:0/3624558556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f643815ca70 0x7f6438155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:48.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f6436ffd640 1 --2- 172.21.15.19:0/3624558556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64380cf5d0 0x7f64380d2810 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f642801a100 tx=0x7f6428019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:48.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f642f7fe640 1 -- 172.21.15.19:0/3624558556 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6428005ba0 con 0x7f64380cf5d0 2023-11-20T06:42:48.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f642f7fe640 1 -- 172.21.15.19:0/3624558556 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6428005d00 con 0x7f64380cf5d0 2023-11-20T06:42:48.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f643d3f8640 1 -- 172.21.15.19:0/3624558556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64380ca090 con 0x7f64380cf5d0 2023-11-20T06:42:48.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f642f7fe640 1 -- 172.21.15.19:0/3624558556 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64280aab10 con 0x7f64380cf5d0 2023-11-20T06:42:48.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f643d3f8640 1 -- 172.21.15.19:0/3624558556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643815fd20 con 0x7f64380cf5d0 2023-11-20T06:42:48.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.151+0000 7f643d3f8640 1 -- 172.21.15.19:0/3624558556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64380b6920 con 0x7f64380cf5d0 2023-11-20T06:42:48.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.155+0000 7f642f7fe640 1 -- 172.21.15.19:0/3624558556 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f64280aac70 con 0x7f64380cf5d0 2023-11-20T06:42:48.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.155+0000 7f642f7fe640 1 --2- 172.21.15.19:0/3624558556 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f64180664a0 0x7f6418068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:48.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.155+0000 7f642f7fe640 1 -- 172.21.15.19:0/3624558556 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f642811dc90 con 0x7f64380cf5d0 2023-11-20T06:42:48.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.155+0000 7f642ffff640 1 --2- 172.21.15.19:0/3624558556 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f64180664a0 0x7f6418068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:48.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.155+0000 7f642ffff640 1 --2- 172.21.15.19:0/3624558556 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f64180664a0 0x7f6418068960 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f643815c590 tx=0x7f6420009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:48.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.159+0000 7f642f7fe640 1 -- 172.21.15.19:0/3624558556 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f64280eaf30 con 0x7f64380cf5d0 2023-11-20T06:42:48.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.315+0000 7f643d3f8640 1 -- 172.21.15.19:0/3624558556 --> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f64380cfde0 con 0x7f64180664a0 2023-11-20T06:42:48.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.327+0000 7f642f7fe640 1 -- 172.21.15.19:0/3624558556 <== mgr.4109 v2:172.21.15.190:6832/142426253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289064 (secure 0 0 0) 0x7f6420011a30 con 0x7f64180664a0 2023-11-20T06:42:48.331 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:48.333 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-20T06:42:48.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.327+0000 7f643d3f8640 1 -- 172.21.15.19:0/3624558556 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f64180664a0 msgr2=0x7f6418068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:48.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.327+0000 7f643d3f8640 1 --2- 172.21.15.19:0/3624558556 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f64180664a0 0x7f6418068960 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f643815c590 tx=0x7f6420009190 comp rx=0 tx=0).stop 2023-11-20T06:42:48.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.327+0000 7f643d3f8640 1 -- 172.21.15.19:0/3624558556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64380cf5d0 msgr2=0x7f64380d2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:48.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.327+0000 7f643d3f8640 1 --2- 172.21.15.19:0/3624558556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64380cf5d0 0x7f64380d2810 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f642801a100 tx=0x7f6428019270 comp rx=0 tx=0).stop 2023-11-20T06:42:48.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.327+0000 7f643d3f8640 1 -- 172.21.15.19:0/3624558556 shutdown_connections 2023-11-20T06:42:48.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.327+0000 7f643d3f8640 1 --2- 172.21.15.19:0/3624558556 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f64180664a0 0x7f6418068960 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.327+0000 7f643d3f8640 1 --2- 172.21.15.19:0/3624558556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f643815ca70 0x7f6438155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.327+0000 7f643d3f8640 1 --2- 172.21.15.19:0/3624558556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64380d3550 0x7f64380d2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.327+0000 7f643d3f8640 1 --2- 172.21.15.19:0/3624558556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64380cf5d0 0x7f64380d2810 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.327+0000 7f643d3f8640 1 -- 172.21.15.19:0/3624558556 >> 172.21.15.19:0/3624558556 conn(0x7f643809bc50 msgr2=0x7f64380ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:48.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.327+0000 7f643d3f8640 1 -- 172.21.15.19:0/3624558556 shutdown_connections 2023-11-20T06:42:48.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.327+0000 7f643d3f8640 1 -- 172.21.15.19:0/3624558556 wait complete. 2023-11-20T06:42:48.351 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2023-11-20T06:42:47.505663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220856,"kb_used_data":4692,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753864,"statfs":{"total":773094113280,"available":772867956736,"internally_reserved":0,"allocated":4804608,"data_stored":2727985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.632287"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896572+0000","last_change":"2023-11-20T06:42:43.899739+0000","last_active":"2023-11-20T06:42:44.896572+0000","last_peered":"2023-11-20T06:42:44.896572+0000","last_clean":"2023-11-20T06:42:44.896572+0000","last_became_active":"2023-11-20T06:42:43.899446+0000","last_became_peered":"2023-11-20T06:42:43.899446+0000","last_unstale":"2023-11-20T06:42:44.896572+0000","last_undegraded":"2023-11-20T06:42:44.896572+0000","last_fullsized":"2023-11-20T06:42:44.896572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:10:47.221064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896199+0000","last_change":"2023-11-20T06:42:43.903037+0000","last_active":"2023-11-20T06:42:44.896199+0000","last_peered":"2023-11-20T06:42:44.896199+0000","last_clean":"2023-11-20T06:42:44.896199+0000","last_became_active":"2023-11-20T06:42:43.902713+0000","last_became_peered":"2023-11-20T06:42:43.902713+0000","last_unstale":"2023-11-20T06:42:44.896199+0000","last_undegraded":"2023-11-20T06:42:44.896199+0000","last_fullsized":"2023-11-20T06:42:44.896199+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:38:13.367906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266263+0000","last_change":"2023-11-20T06:42:43.899149+0000","last_active":"2023-11-20T06:42:46.266263+0000","last_peered":"2023-11-20T06:42:46.266263+0000","last_clean":"2023-11-20T06:42:46.266263+0000","last_became_active":"2023-11-20T06:42:43.898185+0000","last_became_peered":"2023-11-20T06:42:43.898185+0000","last_unstale":"2023-11-20T06:42:46.266263+0000","last_undegraded":"2023-11-20T06:42:46.266263+0000","last_fullsized":"2023-11-20T06:42:46.266263+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:40:18.592085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.048865+0000","last_change":"2023-11-20T06:42:43.911439+0000","last_active":"2023-11-20T06:42:46.048865+0000","last_peered":"2023-11-20T06:42:46.048865+0000","last_clean":"2023-11-20T06:42:46.048865+0000","last_became_active":"2023-11-20T06:42:43.911010+0000","last_became_peered":"2023-11-20T06:42:43.911010+0000","last_unstale":"2023-11-20T06:42:46.048865+0000","last_undegraded":"2023-11-20T06:42:46.048865+0000","last_fullsized":"2023-11-20T06:42:46.048865+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:52:29.897605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.048757+0000","last_change":"2023-11-20T06:42:43.913372+0000","last_active":"2023-11-20T06:42:46.048757+0000","last_peered":"2023-11-20T06:42:46.048757+0000","last_clean":"2023-11-20T06:42:46.048757+0000","last_became_active":"2023-11-20T06:42:43.913042+0000","last_became_peered":"2023-11-20T06:42:43.913042+0000","last_unstale":"2023-11-20T06:42:46.048757+0000","last_undegraded":"2023-11-20T06:42:46.048757+0000","last_fullsized":"2023-11-20T06:42:46.048757+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:54:21.979729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:45.049261+0000","last_change":"2023-11-20T06:42:43.908009+0000","last_active":"2023-11-20T06:42:45.049261+0000","last_peered":"2023-11-20T06:42:45.049261+0000","last_clean":"2023-11-20T06:42:45.049261+0000","last_became_active":"2023-11-20T06:42:43.907700+0000","last_became_peered":"2023-11-20T06:42:43.907700+0000","last_unstale":"2023-11-20T06:42:45.049261+0000","last_undegraded":"2023-11-20T06:42:45.049261+0000","last_fullsized":"2023-11-20T06:42:45.049261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:12:50.200023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.052745+0000","last_change":"2023-11-20T06:42:43.907752+0000","last_active":"2023-11-20T06:42:46.052745+0000","last_peered":"2023-11-20T06:42:46.052745+0000","last_clean":"2023-11-20T06:42:46.052745+0000","last_became_active":"2023-11-20T06:42:43.907411+0000","last_became_peered":"2023-11-20T06:42:43.907411+0000","last_unstale":"2023-11-20T06:42:46.052745+0000","last_undegraded":"2023-11-20T06:42:46.052745+0000","last_fullsized":"2023-11-20T06:42:46.052745+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:22:13.710252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.895949+0000","last_change":"2023-11-20T06:42:43.895698+0000","last_active":"2023-11-20T06:42:44.895949+0000","last_peered":"2023-11-20T06:42:44.895949+0000","last_clean":"2023-11-20T06:42:44.895949+0000","last_became_active":"2023-11-20T06:42:43.895370+0000","last_became_peered":"2023-11-20T06:42:43.895370+0000","last_unstale":"2023-11-20T06:42:44.895949+0000","last_undegraded":"2023-11-20T06:42:44.895949+0000","last_fullsized":"2023-11-20T06:42:44.895949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:24:23.684617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266424+0000","last_change":"2023-11-20T06:42:43.906248+0000","last_active":"2023-11-20T06:42:46.266424+0000","last_peered":"2023-11-20T06:42:46.266424+0000","last_clean":"2023-11-20T06:42:46.266424+0000","last_became_active":"2023-11-20T06:42:43.905974+0000","last_became_peered":"2023-11-20T06:42:43.905974+0000","last_unstale":"2023-11-20T06:42:46.266424+0000","last_undegraded":"2023-11-20T06:42:46.266424+0000","last_fullsized":"2023-11-20T06:42:46.266424+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:22:13.710252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.052918+0000","last_change":"2023-11-20T06:42:43.909094+0000","last_active":"2023-11-20T06:42:46.052918+0000","last_peered":"2023-11-20T06:42:46.052918+0000","last_clean":"2023-11-20T06:42:46.052918+0000","last_became_active":"2023-11-20T06:42:43.908374+0000","last_became_peered":"2023-11-20T06:42:43.908374+0000","last_unstale":"2023-11-20T06:42:46.052918+0000","last_undegraded":"2023-11-20T06:42:46.052918+0000","last_fullsized":"2023-11-20T06:42:46.052918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:39:11.687117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.053087+0000","last_change":"2023-11-20T06:42:43.911322+0000","last_active":"2023-11-20T06:42:46.053087+0000","last_peered":"2023-11-20T06:42:46.053087+0000","last_clean":"2023-11-20T06:42:46.053087+0000","last_became_active":"2023-11-20T06:42:43.910907+0000","last_became_peered":"2023-11-20T06:42:43.910907+0000","last_unstale":"2023-11-20T06:42:46.053087+0000","last_undegraded":"2023-11-20T06:42:46.053087+0000","last_fullsized":"2023-11-20T06:42:46.053087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:34:18.136432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266231+0000","last_change":"2023-11-20T06:42:43.898749+0000","last_active":"2023-11-20T06:42:46.266231+0000","last_peered":"2023-11-20T06:42:46.266231+0000","last_clean":"2023-11-20T06:42:46.266231+0000","last_became_active":"2023-11-20T06:42:43.898129+0000","last_became_peered":"2023-11-20T06:42:43.898129+0000","last_unstale":"2023-11-20T06:42:46.266231+0000","last_undegraded":"2023-11-20T06:42:46.266231+0000","last_fullsized":"2023-11-20T06:42:46.266231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:15:16.369236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.052966+0000","last_change":"2023-11-20T06:42:43.913291+0000","last_active":"2023-11-20T06:42:46.052966+0000","last_peered":"2023-11-20T06:42:46.052966+0000","last_clean":"2023-11-20T06:42:46.052966+0000","last_became_active":"2023-11-20T06:42:43.912970+0000","last_became_peered":"2023-11-20T06:42:43.912970+0000","last_unstale":"2023-11-20T06:42:46.052966+0000","last_undegraded":"2023-11-20T06:42:46.052966+0000","last_fullsized":"2023-11-20T06:42:46.052966+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:51:57.699597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.897174+0000","last_change":"2023-11-20T06:42:43.923012+0000","last_active":"2023-11-20T06:42:44.897174+0000","last_peered":"2023-11-20T06:42:44.897174+0000","last_clean":"2023-11-20T06:42:44.897174+0000","last_became_active":"2023-11-20T06:42:43.922664+0000","last_became_peered":"2023-11-20T06:42:43.922664+0000","last_unstale":"2023-11-20T06:42:44.897174+0000","last_undegraded":"2023-11-20T06:42:44.897174+0000","last_fullsized":"2023-11-20T06:42:44.897174+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:22:50.879248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.052865+0000","last_change":"2023-11-20T06:42:43.907530+0000","last_active":"2023-11-20T06:42:46.052865+0000","last_peered":"2023-11-20T06:42:46.052865+0000","last_clean":"2023-11-20T06:42:46.052865+0000","last_became_active":"2023-11-20T06:42:43.907168+0000","last_became_peered":"2023-11-20T06:42:43.907168+0000","last_unstale":"2023-11-20T06:42:46.052865+0000","last_undegraded":"2023-11-20T06:42:46.052865+0000","last_fullsized":"2023-11-20T06:42:46.052865+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:05:28.834466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266614+0000","last_change":"2023-11-20T06:42:43.907215+0000","last_active":"2023-11-20T06:42:46.266614+0000","last_peered":"2023-11-20T06:42:46.266614+0000","last_clean":"2023-11-20T06:42:46.266614+0000","last_became_active":"2023-11-20T06:42:43.906717+0000","last_became_peered":"2023-11-20T06:42:43.906717+0000","last_unstale":"2023-11-20T06:42:46.266614+0000","last_undegraded":"2023-11-20T06:42:46.266614+0000","last_fullsized":"2023-11-20T06:42:46.266614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:01:57.467854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266915+0000","last_change":"2023-11-20T06:42:43.911615+0000","last_active":"2023-11-20T06:42:46.266915+0000","last_peered":"2023-11-20T06:42:46.266915+0000","last_clean":"2023-11-20T06:42:46.266915+0000","last_became_active":"2023-11-20T06:42:43.910452+0000","last_became_peered":"2023-11-20T06:42:43.910452+0000","last_unstale":"2023-11-20T06:42:46.266915+0000","last_undegraded":"2023-11-20T06:42:46.266915+0000","last_fullsized":"2023-11-20T06:42:46.266915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:05:28.834466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.898320+0000","last_change":"2023-11-20T06:42:43.924145+0000","last_active":"2023-11-20T06:42:44.898320+0000","last_peered":"2023-11-20T06:42:44.898320+0000","last_clean":"2023-11-20T06:42:44.898320+0000","last_became_active":"2023-11-20T06:42:43.923266+0000","last_became_peered":"2023-11-20T06:42:43.923266+0000","last_unstale":"2023-11-20T06:42:44.898320+0000","last_undegraded":"2023-11-20T06:42:44.898320+0000","last_fullsized":"2023-11-20T06:42:44.898320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:09:57.584368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.049074+0000","last_change":"2023-11-20T06:42:43.911011+0000","last_active":"2023-11-20T06:42:46.049074+0000","last_peered":"2023-11-20T06:42:46.049074+0000","last_clean":"2023-11-20T06:42:46.049074+0000","last_became_active":"2023-11-20T06:42:43.910681+0000","last_became_peered":"2023-11-20T06:42:43.910681+0000","last_unstale":"2023-11-20T06:42:46.049074+0000","last_undegraded":"2023-11-20T06:42:46.049074+0000","last_fullsized":"2023-11-20T06:42:46.049074+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:29:56.859736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.897965+0000","last_change":"2023-11-20T06:42:43.916923+0000","last_active":"2023-11-20T06:42:44.897965+0000","last_peered":"2023-11-20T06:42:44.897965+0000","last_clean":"2023-11-20T06:42:44.897965+0000","last_became_active":"2023-11-20T06:42:43.914671+0000","last_became_peered":"2023-11-20T06:42:43.914671+0000","last_unstale":"2023-11-20T06:42:44.897965+0000","last_undegraded":"2023-11-20T06:42:44.897965+0000","last_fullsized":"2023-11-20T06:42:44.897965+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:14:07.641117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.052900+0000","last_change":"2023-11-20T06:42:43.913144+0000","last_active":"2023-11-20T06:42:46.052900+0000","last_peered":"2023-11-20T06:42:46.052900+0000","last_clean":"2023-11-20T06:42:46.052900+0000","last_became_active":"2023-11-20T06:42:43.910774+0000","last_became_peered":"2023-11-20T06:42:43.910774+0000","last_unstale":"2023-11-20T06:42:46.052900+0000","last_undegraded":"2023-11-20T06:42:46.052900+0000","last_fullsized":"2023-11-20T06:42:46.052900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:01:23.985762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.897481+0000","last_change":"2023-11-20T06:42:43.910277+0000","last_active":"2023-11-20T06:42:44.897481+0000","last_peered":"2023-11-20T06:42:44.897481+0000","last_clean":"2023-11-20T06:42:44.897481+0000","last_became_active":"2023-11-20T06:42:43.909559+0000","last_became_peered":"2023-11-20T06:42:43.909559+0000","last_unstale":"2023-11-20T06:42:44.897481+0000","last_undegraded":"2023-11-20T06:42:44.897481+0000","last_fullsized":"2023-11-20T06:42:44.897481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:01:57.467854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266711+0000","last_change":"2023-11-20T06:42:43.916557+0000","last_active":"2023-11-20T06:42:46.266711+0000","last_peered":"2023-11-20T06:42:46.266711+0000","last_clean":"2023-11-20T06:42:46.266711+0000","last_became_active":"2023-11-20T06:42:43.915880+0000","last_became_peered":"2023-11-20T06:42:43.915880+0000","last_unstale":"2023-11-20T06:42:46.266711+0000","last_undegraded":"2023-11-20T06:42:46.266711+0000","last_fullsized":"2023-11-20T06:42:46.266711+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:40:18.592085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.048623+0000","last_change":"2023-11-20T06:42:43.906240+0000","last_active":"2023-11-20T06:42:46.048623+0000","last_peered":"2023-11-20T06:42:46.048623+0000","last_clean":"2023-11-20T06:42:46.048623+0000","last_became_active":"2023-11-20T06:42:43.905963+0000","last_became_peered":"2023-11-20T06:42:43.905963+0000","last_unstale":"2023-11-20T06:42:46.048623+0000","last_undegraded":"2023-11-20T06:42:46.048623+0000","last_fullsized":"2023-11-20T06:42:46.048623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:49:40.213232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.898202+0000","last_change":"2023-11-20T06:42:43.917955+0000","last_active":"2023-11-20T06:42:44.898202+0000","last_peered":"2023-11-20T06:42:44.898202+0000","last_clean":"2023-11-20T06:42:44.898202+0000","last_became_active":"2023-11-20T06:42:43.917703+0000","last_became_peered":"2023-11-20T06:42:43.917703+0000","last_unstale":"2023-11-20T06:42:44.898202+0000","last_undegraded":"2023-11-20T06:42:44.898202+0000","last_fullsized":"2023-11-20T06:42:44.898202+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:59:43.157480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:45.049622+0000","last_change":"2023-11-20T06:42:43.918361+0000","last_active":"2023-11-20T06:42:45.049622+0000","last_peered":"2023-11-20T06:42:45.049622+0000","last_clean":"2023-11-20T06:42:45.049622+0000","last_became_active":"2023-11-20T06:42:43.918047+0000","last_became_peered":"2023-11-20T06:42:43.918047+0000","last_unstale":"2023-11-20T06:42:45.049622+0000","last_undegraded":"2023-11-20T06:42:45.049622+0000","last_fullsized":"2023-11-20T06:42:45.049622+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:15:16.369236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.898451+0000","last_change":"2023-11-20T06:42:43.919455+0000","last_active":"2023-11-20T06:42:44.898451+0000","last_peered":"2023-11-20T06:42:44.898451+0000","last_clean":"2023-11-20T06:42:44.898451+0000","last_became_active":"2023-11-20T06:42:43.918905+0000","last_became_peered":"2023-11-20T06:42:43.918905+0000","last_unstale":"2023-11-20T06:42:44.898451+0000","last_undegraded":"2023-11-20T06:42:44.898451+0000","last_fullsized":"2023-11-20T06:42:44.898451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:50:13.628784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.053311+0000","last_change":"2023-11-20T06:42:43.909106+0000","last_active":"2023-11-20T06:42:46.053311+0000","last_peered":"2023-11-20T06:42:46.053311+0000","last_clean":"2023-11-20T06:42:46.053311+0000","last_became_active":"2023-11-20T06:42:43.908803+0000","last_became_peered":"2023-11-20T06:42:43.908803+0000","last_unstale":"2023-11-20T06:42:46.053311+0000","last_undegraded":"2023-11-20T06:42:46.053311+0000","last_fullsized":"2023-11-20T06:42:46.053311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:11:38.361542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.897879+0000","last_change":"2023-11-20T06:42:43.920369+0000","last_active":"2023-11-20T06:42:44.897879+0000","last_peered":"2023-11-20T06:42:44.897879+0000","last_clean":"2023-11-20T06:42:44.897879+0000","last_became_active":"2023-11-20T06:42:43.915559+0000","last_became_peered":"2023-11-20T06:42:43.915559+0000","last_unstale":"2023-11-20T06:42:44.897879+0000","last_undegraded":"2023-11-20T06:42:44.897879+0000","last_fullsized":"2023-11-20T06:42:44.897879+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:17:40.119323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.897977+0000","last_change":"2023-11-20T06:42:43.917467+0000","last_active":"2023-11-20T06:42:44.897977+0000","last_peered":"2023-11-20T06:42:44.897977+0000","last_clean":"2023-11-20T06:42:44.897977+0000","last_became_active":"2023-11-20T06:42:43.917161+0000","last_became_peered":"2023-11-20T06:42:43.917161+0000","last_unstale":"2023-11-20T06:42:44.897977+0000","last_undegraded":"2023-11-20T06:42:44.897977+0000","last_fullsized":"2023-11-20T06:42:44.897977+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:41:54.452233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266803+0000","last_change":"2023-11-20T06:42:43.916746+0000","last_active":"2023-11-20T06:42:46.266803+0000","last_peered":"2023-11-20T06:42:46.266803+0000","last_clean":"2023-11-20T06:42:46.266803+0000","last_became_active":"2023-11-20T06:42:43.916265+0000","last_became_peered":"2023-11-20T06:42:43.916265+0000","last_unstale":"2023-11-20T06:42:46.266803+0000","last_undegraded":"2023-11-20T06:42:46.266803+0000","last_fullsized":"2023-11-20T06:42:46.266803+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:51:57.699597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:45.049266+0000","last_change":"2023-11-20T06:42:43.901899+0000","last_active":"2023-11-20T06:42:45.049266+0000","last_peered":"2023-11-20T06:42:45.049266+0000","last_clean":"2023-11-20T06:42:45.049266+0000","last_became_active":"2023-11-20T06:42:43.901641+0000","last_became_peered":"2023-11-20T06:42:43.901641+0000","last_unstale":"2023-11-20T06:42:45.049266+0000","last_undegraded":"2023-11-20T06:42:45.049266+0000","last_fullsized":"2023-11-20T06:42:45.049266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:22:50.879248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266765+0000","last_change":"2023-11-20T06:42:43.910215+0000","last_active":"2023-11-20T06:42:46.266765+0000","last_peered":"2023-11-20T06:42:46.266765+0000","last_clean":"2023-11-20T06:42:46.266765+0000","last_became_active":"2023-11-20T06:42:43.909843+0000","last_became_peered":"2023-11-20T06:42:43.909843+0000","last_unstale":"2023-11-20T06:42:46.266765+0000","last_undegraded":"2023-11-20T06:42:46.266765+0000","last_fullsized":"2023-11-20T06:42:46.266765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:22:13.710252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.898285+0000","last_change":"2023-11-20T06:42:42.902894+0000","last_active":"2023-11-20T06:42:44.898285+0000","last_peered":"2023-11-20T06:42:44.898285+0000","last_clean":"2023-11-20T06:42:44.898285+0000","last_became_active":"2023-11-20T06:42:42.902560+0000","last_became_peered":"2023-11-20T06:42:42.902560+0000","last_unstale":"2023-11-20T06:42:44.898285+0000","last_undegraded":"2023-11-20T06:42:44.898285+0000","last_fullsized":"2023-11-20T06:42:44.898285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:40:09.020401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:45.049634+0000","last_change":"2023-11-20T06:42:43.910962+0000","last_active":"2023-11-20T06:42:45.049634+0000","last_peered":"2023-11-20T06:42:45.049634+0000","last_clean":"2023-11-20T06:42:45.049634+0000","last_became_active":"2023-11-20T06:42:43.909361+0000","last_became_peered":"2023-11-20T06:42:43.909361+0000","last_unstale":"2023-11-20T06:42:45.049634+0000","last_undegraded":"2023-11-20T06:42:45.049634+0000","last_fullsized":"2023-11-20T06:42:45.049634+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:40:18.592085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266240+0000","last_change":"2023-11-20T06:42:42.909344+0000","last_active":"2023-11-20T06:42:46.266240+0000","last_peered":"2023-11-20T06:42:46.266240+0000","last_clean":"2023-11-20T06:42:46.266240+0000","last_became_active":"2023-11-20T06:42:42.909031+0000","last_became_peered":"2023-11-20T06:42:42.909031+0000","last_unstale":"2023-11-20T06:42:46.266240+0000","last_undegraded":"2023-11-20T06:42:46.266240+0000","last_fullsized":"2023-11-20T06:42:46.266240+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:50:12.621018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.898389+0000","last_change":"2023-11-20T06:42:43.924343+0000","last_active":"2023-11-20T06:42:44.898389+0000","last_peered":"2023-11-20T06:42:44.898389+0000","last_clean":"2023-11-20T06:42:44.898389+0000","last_became_active":"2023-11-20T06:42:43.924102+0000","last_became_peered":"2023-11-20T06:42:43.924102+0000","last_unstale":"2023-11-20T06:42:44.898389+0000","last_undegraded":"2023-11-20T06:42:44.898389+0000","last_fullsized":"2023-11-20T06:42:44.898389+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:41.809097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:45.049646+0000","last_change":"2023-11-20T06:42:42.903336+0000","last_active":"2023-11-20T06:42:45.049646+0000","last_peered":"2023-11-20T06:42:45.049646+0000","last_clean":"2023-11-20T06:42:45.049646+0000","last_became_active":"2023-11-20T06:42:42.903028+0000","last_became_peered":"2023-11-20T06:42:42.903028+0000","last_unstale":"2023-11-20T06:42:45.049646+0000","last_undegraded":"2023-11-20T06:42:45.049646+0000","last_fullsized":"2023-11-20T06:42:45.049646+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:09:13.000923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896479+0000","last_change":"2023-11-20T06:42:43.919741+0000","last_active":"2023-11-20T06:42:44.896479+0000","last_peered":"2023-11-20T06:42:44.896479+0000","last_clean":"2023-11-20T06:42:44.896479+0000","last_became_active":"2023-11-20T06:42:43.919429+0000","last_became_peered":"2023-11-20T06:42:43.919429+0000","last_unstale":"2023-11-20T06:42:44.896479+0000","last_undegraded":"2023-11-20T06:42:44.896479+0000","last_fullsized":"2023-11-20T06:42:44.896479+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:51:41.671459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.897881+0000","last_change":"2023-11-20T06:42:42.906826+0000","last_active":"2023-11-20T06:42:44.897881+0000","last_peered":"2023-11-20T06:42:44.897881+0000","last_clean":"2023-11-20T06:42:44.897881+0000","last_became_active":"2023-11-20T06:42:42.906160+0000","last_became_peered":"2023-11-20T06:42:42.906160+0000","last_unstale":"2023-11-20T06:42:44.897881+0000","last_undegraded":"2023-11-20T06:42:44.897881+0000","last_fullsized":"2023-11-20T06:42:44.897881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:00:03.880351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.265812+0000","last_change":"2023-11-20T06:42:43.910516+0000","last_active":"2023-11-20T06:42:46.265812+0000","last_peered":"2023-11-20T06:42:46.265812+0000","last_clean":"2023-11-20T06:42:46.265812+0000","last_became_active":"2023-11-20T06:42:43.910217+0000","last_became_peered":"2023-11-20T06:42:43.910217+0000","last_unstale":"2023-11-20T06:42:46.265812+0000","last_undegraded":"2023-11-20T06:42:46.265812+0000","last_fullsized":"2023-11-20T06:42:46.265812+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:12:50.200023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.053109+0000","last_change":"2023-11-20T06:42:42.905115+0000","last_active":"2023-11-20T06:42:46.053109+0000","last_peered":"2023-11-20T06:42:46.053109+0000","last_clean":"2023-11-20T06:42:46.053109+0000","last_became_active":"2023-11-20T06:42:42.904830+0000","last_became_peered":"2023-11-20T06:42:42.904830+0000","last_unstale":"2023-11-20T06:42:46.053109+0000","last_undegraded":"2023-11-20T06:42:46.053109+0000","last_fullsized":"2023-11-20T06:42:46.053109+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:22:49.871482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.052921+0000","last_change":"2023-11-20T06:42:43.896538+0000","last_active":"2023-11-20T06:42:46.052921+0000","last_peered":"2023-11-20T06:42:46.052921+0000","last_clean":"2023-11-20T06:42:46.052921+0000","last_became_active":"2023-11-20T06:42:43.896156+0000","last_became_peered":"2023-11-20T06:42:43.896156+0000","last_unstale":"2023-11-20T06:42:46.052921+0000","last_undegraded":"2023-11-20T06:42:46.052921+0000","last_fullsized":"2023-11-20T06:42:46.052921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:34:15.327764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266615+0000","last_change":"2023-11-20T06:42:42.909774+0000","last_active":"2023-11-20T06:42:46.266615+0000","last_peered":"2023-11-20T06:42:46.266615+0000","last_clean":"2023-11-20T06:42:46.266615+0000","last_became_active":"2023-11-20T06:42:42.909365+0000","last_became_peered":"2023-11-20T06:42:42.909365+0000","last_unstale":"2023-11-20T06:42:46.266615+0000","last_undegraded":"2023-11-20T06:42:46.266615+0000","last_fullsized":"2023-11-20T06:42:46.266615+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:50:12.621018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.897497+0000","last_change":"2023-11-20T06:42:43.912627+0000","last_active":"2023-11-20T06:42:44.897497+0000","last_peered":"2023-11-20T06:42:44.897497+0000","last_clean":"2023-11-20T06:42:44.897497+0000","last_became_active":"2023-11-20T06:42:43.912355+0000","last_became_peered":"2023-11-20T06:42:43.912355+0000","last_unstale":"2023-11-20T06:42:44.897497+0000","last_undegraded":"2023-11-20T06:42:44.897497+0000","last_fullsized":"2023-11-20T06:42:44.897497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:15:16.369236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:45.049264+0000","last_change":"2023-11-20T06:42:42.912698+0000","last_active":"2023-11-20T06:42:45.049264+0000","last_peered":"2023-11-20T06:42:45.049264+0000","last_clean":"2023-11-20T06:42:45.049264+0000","last_became_active":"2023-11-20T06:42:42.912409+0000","last_became_peered":"2023-11-20T06:42:42.912409+0000","last_unstale":"2023-11-20T06:42:45.049264+0000","last_undegraded":"2023-11-20T06:42:45.049264+0000","last_fullsized":"2023-11-20T06:42:45.049264+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:17:39.111557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896379+0000","last_change":"2023-11-20T06:42:43.912269+0000","last_active":"2023-11-20T06:42:44.896379+0000","last_peered":"2023-11-20T06:42:44.896379+0000","last_clean":"2023-11-20T06:42:44.896379+0000","last_became_active":"2023-11-20T06:42:43.911939+0000","last_became_peered":"2023-11-20T06:42:43.911939+0000","last_unstale":"2023-11-20T06:42:44.896379+0000","last_undegraded":"2023-11-20T06:42:44.896379+0000","last_fullsized":"2023-11-20T06:42:44.896379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:06:12.965023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.897108+0000","last_change":"2023-11-20T06:42:42.900227+0000","last_active":"2023-11-20T06:42:44.897108+0000","last_peered":"2023-11-20T06:42:44.897108+0000","last_clean":"2023-11-20T06:42:44.897108+0000","last_became_active":"2023-11-20T06:42:42.899712+0000","last_became_peered":"2023-11-20T06:42:42.899712+0000","last_unstale":"2023-11-20T06:42:44.897108+0000","last_undegraded":"2023-11-20T06:42:44.897108+0000","last_fullsized":"2023-11-20T06:42:44.897108+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:40:09.020401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.048867+0000","last_change":"2023-11-20T06:42:43.911258+0000","last_active":"2023-11-20T06:42:46.048867+0000","last_peered":"2023-11-20T06:42:46.048867+0000","last_clean":"2023-11-20T06:42:46.048867+0000","last_became_active":"2023-11-20T06:42:43.910634+0000","last_became_peered":"2023-11-20T06:42:43.910634+0000","last_unstale":"2023-11-20T06:42:46.048867+0000","last_undegraded":"2023-11-20T06:42:46.048867+0000","last_fullsized":"2023-11-20T06:42:46.048867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:21:53.147727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896524+0000","last_change":"2023-11-20T06:42:42.907903+0000","last_active":"2023-11-20T06:42:44.896524+0000","last_peered":"2023-11-20T06:42:44.896524+0000","last_clean":"2023-11-20T06:42:44.896524+0000","last_became_active":"2023-11-20T06:42:42.905727+0000","last_became_peered":"2023-11-20T06:42:42.905727+0000","last_unstale":"2023-11-20T06:42:44.896524+0000","last_undegraded":"2023-11-20T06:42:44.896524+0000","last_fullsized":"2023-11-20T06:42:44.896524+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:05:27.826700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266982+0000","last_change":"2023-11-20T06:42:43.918550+0000","last_active":"2023-11-20T06:42:46.266982+0000","last_peered":"2023-11-20T06:42:46.266982+0000","last_clean":"2023-11-20T06:42:46.266982+0000","last_became_active":"2023-11-20T06:42:43.918240+0000","last_became_peered":"2023-11-20T06:42:43.918240+0000","last_unstale":"2023-11-20T06:42:46.266982+0000","last_undegraded":"2023-11-20T06:42:46.266982+0000","last_fullsized":"2023-11-20T06:42:46.266982+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:01:23.985762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.053238+0000","last_change":"2023-11-20T06:42:42.907104+0000","last_active":"2023-11-20T06:42:46.053238+0000","last_peered":"2023-11-20T06:42:46.053238+0000","last_clean":"2023-11-20T06:42:46.053238+0000","last_became_active":"2023-11-20T06:42:42.906574+0000","last_became_peered":"2023-11-20T06:42:42.906574+0000","last_unstale":"2023-11-20T06:42:46.053238+0000","last_undegraded":"2023-11-20T06:42:46.053238+0000","last_fullsized":"2023-11-20T06:42:46.053238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:01:56.460088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266412+0000","last_change":"2023-11-20T06:42:43.908534+0000","last_active":"2023-11-20T06:42:46.266412+0000","last_peered":"2023-11-20T06:42:46.266412+0000","last_clean":"2023-11-20T06:42:46.266412+0000","last_became_active":"2023-11-20T06:42:43.908268+0000","last_became_peered":"2023-11-20T06:42:43.908268+0000","last_unstale":"2023-11-20T06:42:46.266412+0000","last_undegraded":"2023-11-20T06:42:46.266412+0000","last_fullsized":"2023-11-20T06:42:46.266412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:41.809097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.053225+0000","last_change":"2023-11-20T06:42:42.905278+0000","last_active":"2023-11-20T06:42:46.053225+0000","last_peered":"2023-11-20T06:42:46.053225+0000","last_clean":"2023-11-20T06:42:46.053225+0000","last_became_active":"2023-11-20T06:42:42.904162+0000","last_became_peered":"2023-11-20T06:42:42.904162+0000","last_unstale":"2023-11-20T06:42:46.053225+0000","last_undegraded":"2023-11-20T06:42:46.053225+0000","last_fullsized":"2023-11-20T06:42:46.053225+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:36:57.847833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.898470+0000","last_change":"2023-11-20T06:42:43.909725+0000","last_active":"2023-11-20T06:42:44.898470+0000","last_peered":"2023-11-20T06:42:44.898470+0000","last_clean":"2023-11-20T06:42:44.898470+0000","last_became_active":"2023-11-20T06:42:43.909404+0000","last_became_peered":"2023-11-20T06:42:43.909404+0000","last_unstale":"2023-11-20T06:42:44.898470+0000","last_undegraded":"2023-11-20T06:42:44.898470+0000","last_fullsized":"2023-11-20T06:42:44.898470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:22:13.710252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896341+0000","last_change":"2023-11-20T06:42:42.901285+0000","last_active":"2023-11-20T06:42:44.896341+0000","last_peered":"2023-11-20T06:42:44.896341+0000","last_clean":"2023-11-20T06:42:44.896341+0000","last_became_active":"2023-11-20T06:42:42.901007+0000","last_became_peered":"2023-11-20T06:42:42.901007+0000","last_unstale":"2023-11-20T06:42:44.896341+0000","last_undegraded":"2023-11-20T06:42:44.896341+0000","last_fullsized":"2023-11-20T06:42:44.896341+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:39:10.679351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.265845+0000","last_change":"2023-11-20T06:42:43.906703+0000","last_active":"2023-11-20T06:42:46.265845+0000","last_peered":"2023-11-20T06:42:46.265845+0000","last_clean":"2023-11-20T06:42:46.265845+0000","last_became_active":"2023-11-20T06:42:43.906256+0000","last_became_peered":"2023-11-20T06:42:43.906256+0000","last_unstale":"2023-11-20T06:42:46.265845+0000","last_undegraded":"2023-11-20T06:42:46.265845+0000","last_fullsized":"2023-11-20T06:42:46.265845+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:22:50.879248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896301+0000","last_change":"2023-11-20T06:42:42.904413+0000","last_active":"2023-11-20T06:42:44.896301+0000","last_peered":"2023-11-20T06:42:44.896301+0000","last_clean":"2023-11-20T06:42:44.896301+0000","last_became_active":"2023-11-20T06:42:42.904078+0000","last_became_peered":"2023-11-20T06:42:42.904078+0000","last_unstale":"2023-11-20T06:42:44.896301+0000","last_undegraded":"2023-11-20T06:42:44.896301+0000","last_fullsized":"2023-11-20T06:42:44.896301+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:22:12.702486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896049+0000","last_change":"2023-11-20T06:42:43.902115+0000","last_active":"2023-11-20T06:42:44.896049+0000","last_peered":"2023-11-20T06:42:44.896049+0000","last_clean":"2023-11-20T06:42:44.896049+0000","last_became_active":"2023-11-20T06:42:43.901831+0000","last_became_peered":"2023-11-20T06:42:43.901831+0000","last_unstale":"2023-11-20T06:42:44.896049+0000","last_undegraded":"2023-11-20T06:42:44.896049+0000","last_fullsized":"2023-11-20T06:42:44.896049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:34:18.136432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:45.049344+0000","last_change":"2023-11-20T06:42:42.912708+0000","last_active":"2023-11-20T06:42:45.049344+0000","last_peered":"2023-11-20T06:42:45.049344+0000","last_clean":"2023-11-20T06:42:45.049344+0000","last_became_active":"2023-11-20T06:42:42.912396+0000","last_became_peered":"2023-11-20T06:42:42.912396+0000","last_unstale":"2023-11-20T06:42:45.049344+0000","last_undegraded":"2023-11-20T06:42:45.049344+0000","last_fullsized":"2023-11-20T06:42:45.049344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:41:53.444467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266680+0000","last_change":"2023-11-20T06:42:43.907149+0000","last_active":"2023-11-20T06:42:46.266680+0000","last_peered":"2023-11-20T06:42:46.266680+0000","last_clean":"2023-11-20T06:42:46.266680+0000","last_became_active":"2023-11-20T06:42:43.906781+0000","last_became_peered":"2023-11-20T06:42:43.906781+0000","last_unstale":"2023-11-20T06:42:46.266680+0000","last_undegraded":"2023-11-20T06:42:46.266680+0000","last_fullsized":"2023-11-20T06:42:46.266680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:15:16.369236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.898132+0000","last_change":"2023-11-20T06:42:42.901762+0000","last_active":"2023-11-20T06:42:44.898132+0000","last_peered":"2023-11-20T06:42:44.898132+0000","last_clean":"2023-11-20T06:42:44.898132+0000","last_became_active":"2023-11-20T06:42:42.901399+0000","last_became_peered":"2023-11-20T06:42:42.901399+0000","last_unstale":"2023-11-20T06:42:44.898132+0000","last_undegraded":"2023-11-20T06:42:44.898132+0000","last_fullsized":"2023-11-20T06:42:44.898132+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:37:16.467932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896250+0000","last_change":"2023-11-20T06:42:43.901538+0000","last_active":"2023-11-20T06:42:44.896250+0000","last_peered":"2023-11-20T06:42:44.896250+0000","last_clean":"2023-11-20T06:42:44.896250+0000","last_became_active":"2023-11-20T06:42:43.901261+0000","last_became_peered":"2023-11-20T06:42:43.901261+0000","last_unstale":"2023-11-20T06:42:44.896250+0000","last_undegraded":"2023-11-20T06:42:44.896250+0000","last_fullsized":"2023-11-20T06:42:44.896250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:48:42.488613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266479+0000","last_change":"2023-11-20T06:42:42.903367+0000","last_active":"2023-11-20T06:42:46.266479+0000","last_peered":"2023-11-20T06:42:46.266479+0000","last_clean":"2023-11-20T06:42:46.266479+0000","last_became_active":"2023-11-20T06:42:42.903051+0000","last_became_peered":"2023-11-20T06:42:42.903051+0000","last_unstale":"2023-11-20T06:42:46.266479+0000","last_undegraded":"2023-11-20T06:42:46.266479+0000","last_fullsized":"2023-11-20T06:42:46.266479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:59:42.149714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896248+0000","last_change":"2023-11-20T06:42:43.916441+0000","last_active":"2023-11-20T06:42:44.896248+0000","last_peered":"2023-11-20T06:42:44.896248+0000","last_clean":"2023-11-20T06:42:44.896248+0000","last_became_active":"2023-11-20T06:42:43.916151+0000","last_became_peered":"2023-11-20T06:42:43.916151+0000","last_unstale":"2023-11-20T06:42:44.896248+0000","last_undegraded":"2023-11-20T06:42:44.896248+0000","last_fullsized":"2023-11-20T06:42:44.896248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:54:14.515508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.053346+0000","last_change":"2023-11-20T06:42:42.904635+0000","last_active":"2023-11-20T06:42:46.053346+0000","last_peered":"2023-11-20T06:42:46.053346+0000","last_clean":"2023-11-20T06:42:46.053346+0000","last_became_active":"2023-11-20T06:42:42.904355+0000","last_became_peered":"2023-11-20T06:42:42.904355+0000","last_unstale":"2023-11-20T06:42:46.053346+0000","last_undegraded":"2023-11-20T06:42:46.053346+0000","last_fullsized":"2023-11-20T06:42:46.053346+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:15:15.361470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.053183+0000","last_change":"2023-11-20T06:42:43.911340+0000","last_active":"2023-11-20T06:42:46.053183+0000","last_peered":"2023-11-20T06:42:46.053183+0000","last_clean":"2023-11-20T06:42:46.053183+0000","last_became_active":"2023-11-20T06:42:43.910978+0000","last_became_peered":"2023-11-20T06:42:43.910978+0000","last_unstale":"2023-11-20T06:42:46.053183+0000","last_undegraded":"2023-11-20T06:42:46.053183+0000","last_fullsized":"2023-11-20T06:42:46.053183+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:35:14.101013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.898407+0000","last_change":"2023-11-20T06:42:42.899797+0000","last_active":"2023-11-20T06:42:44.898407+0000","last_peered":"2023-11-20T06:42:44.898407+0000","last_clean":"2023-11-20T06:42:44.898407+0000","last_became_active":"2023-11-20T06:42:42.899495+0000","last_became_peered":"2023-11-20T06:42:42.899495+0000","last_unstale":"2023-11-20T06:42:44.898407+0000","last_undegraded":"2023-11-20T06:42:44.898407+0000","last_fullsized":"2023-11-20T06:42:44.898407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:09:13.000923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.898193+0000","last_change":"2023-11-20T06:42:43.913515+0000","last_active":"2023-11-20T06:42:44.898193+0000","last_peered":"2023-11-20T06:42:44.898193+0000","last_clean":"2023-11-20T06:42:44.898193+0000","last_became_active":"2023-11-20T06:42:43.913236+0000","last_became_peered":"2023-11-20T06:42:43.913236+0000","last_unstale":"2023-11-20T06:42:44.898193+0000","last_undegraded":"2023-11-20T06:42:44.898193+0000","last_fullsized":"2023-11-20T06:42:44.898193+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:40:18.592085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.049087+0000","last_change":"2023-11-20T06:42:42.899044+0000","last_active":"2023-11-20T06:42:46.049087+0000","last_peered":"2023-11-20T06:42:46.049087+0000","last_clean":"2023-11-20T06:42:46.049087+0000","last_became_active":"2023-11-20T06:42:42.898775+0000","last_became_peered":"2023-11-20T06:42:42.898775+0000","last_unstale":"2023-11-20T06:42:46.049087+0000","last_undegraded":"2023-11-20T06:42:46.049087+0000","last_fullsized":"2023-11-20T06:42:46.049087+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:38:31.807722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.049185+0000","last_change":"2023-11-20T06:42:43.900806+0000","last_active":"2023-11-20T06:42:46.049185+0000","last_peered":"2023-11-20T06:42:46.049185+0000","last_clean":"2023-11-20T06:42:46.049185+0000","last_became_active":"2023-11-20T06:42:43.900386+0000","last_became_peered":"2023-11-20T06:42:43.900386+0000","last_unstale":"2023-11-20T06:42:46.049185+0000","last_undegraded":"2023-11-20T06:42:46.049185+0000","last_fullsized":"2023-11-20T06:42:46.049185+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:11:29.365535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:45.049439+0000","last_change":"2023-11-20T06:42:42.903558+0000","last_active":"2023-11-20T06:42:45.049439+0000","last_peered":"2023-11-20T06:42:45.049439+0000","last_clean":"2023-11-20T06:42:45.049439+0000","last_became_active":"2023-11-20T06:42:42.903293+0000","last_became_peered":"2023-11-20T06:42:42.903293+0000","last_unstale":"2023-11-20T06:42:45.049439+0000","last_undegraded":"2023-11-20T06:42:45.049439+0000","last_fullsized":"2023-11-20T06:42:45.049439+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:40:09.020401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266748+0000","last_change":"2023-11-20T06:42:43.914110+0000","last_active":"2023-11-20T06:42:46.266748+0000","last_peered":"2023-11-20T06:42:46.266748+0000","last_clean":"2023-11-20T06:42:46.266748+0000","last_became_active":"2023-11-20T06:42:43.909920+0000","last_became_peered":"2023-11-20T06:42:43.909920+0000","last_unstale":"2023-11-20T06:42:46.266748+0000","last_undegraded":"2023-11-20T06:42:46.266748+0000","last_fullsized":"2023-11-20T06:42:46.266748+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:41.809097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.048782+0000","last_change":"2023-11-20T06:42:42.905039+0000","last_active":"2023-11-20T06:42:46.048782+0000","last_peered":"2023-11-20T06:42:46.048782+0000","last_clean":"2023-11-20T06:42:46.048782+0000","last_became_active":"2023-11-20T06:42:42.904766+0000","last_became_peered":"2023-11-20T06:42:42.904766+0000","last_unstale":"2023-11-20T06:42:46.048782+0000","last_undegraded":"2023-11-20T06:42:46.048782+0000","last_fullsized":"2023-11-20T06:42:46.048782+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:51:01.041001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.265970+0000","last_change":"2023-11-20T06:42:43.909975+0000","last_active":"2023-11-20T06:42:46.265970+0000","last_peered":"2023-11-20T06:42:46.265970+0000","last_clean":"2023-11-20T06:42:46.265970+0000","last_became_active":"2023-11-20T06:42:43.909670+0000","last_became_peered":"2023-11-20T06:42:43.909670+0000","last_unstale":"2023-11-20T06:42:46.265970+0000","last_undegraded":"2023-11-20T06:42:46.265970+0000","last_fullsized":"2023-11-20T06:42:46.265970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:01:57.467854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.048717+0000","last_change":"2023-11-20T06:42:42.898340+0000","last_active":"2023-11-20T06:42:46.048717+0000","last_peered":"2023-11-20T06:42:46.048717+0000","last_clean":"2023-11-20T06:42:46.048717+0000","last_became_active":"2023-11-20T06:42:42.898041+0000","last_became_peered":"2023-11-20T06:42:42.898041+0000","last_unstale":"2023-11-20T06:42:46.048717+0000","last_undegraded":"2023-11-20T06:42:46.048717+0000","last_fullsized":"2023-11-20T06:42:46.048717+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:24:44.902607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.053031+0000","last_change":"2023-11-20T06:42:43.920307+0000","last_active":"2023-11-20T06:42:46.053031+0000","last_peered":"2023-11-20T06:42:46.053031+0000","last_clean":"2023-11-20T06:42:46.053031+0000","last_became_active":"2023-11-20T06:42:43.919982+0000","last_became_peered":"2023-11-20T06:42:43.919982+0000","last_unstale":"2023-11-20T06:42:46.053031+0000","last_undegraded":"2023-11-20T06:42:46.053031+0000","last_fullsized":"2023-11-20T06:42:46.053031+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:24:23.684617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266863+0000","last_change":"2023-11-20T06:42:42.911534+0000","last_active":"2023-11-20T06:42:46.266863+0000","last_peered":"2023-11-20T06:42:46.266863+0000","last_clean":"2023-11-20T06:42:46.266863+0000","last_became_active":"2023-11-20T06:42:42.911194+0000","last_became_peered":"2023-11-20T06:42:42.911194+0000","last_unstale":"2023-11-20T06:42:46.266863+0000","last_undegraded":"2023-11-20T06:42:46.266863+0000","last_fullsized":"2023-11-20T06:42:46.266863+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:04:46.596902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896129+0000","last_change":"2023-11-20T06:42:43.911850+0000","last_active":"2023-11-20T06:42:44.896129+0000","last_peered":"2023-11-20T06:42:44.896129+0000","last_clean":"2023-11-20T06:42:44.896129+0000","last_became_active":"2023-11-20T06:42:43.911440+0000","last_became_peered":"2023-11-20T06:42:43.911440+0000","last_unstale":"2023-11-20T06:42:44.896129+0000","last_undegraded":"2023-11-20T06:42:44.896129+0000","last_fullsized":"2023-11-20T06:42:44.896129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:35:14.101013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.048563+0000","last_change":"2023-11-20T06:42:42.902573+0000","last_active":"2023-11-20T06:42:46.048563+0000","last_peered":"2023-11-20T06:42:46.048563+0000","last_clean":"2023-11-20T06:42:46.048563+0000","last_became_active":"2023-11-20T06:42:42.902263+0000","last_became_peered":"2023-11-20T06:42:42.902263+0000","last_unstale":"2023-11-20T06:42:46.048563+0000","last_undegraded":"2023-11-20T06:42:46.048563+0000","last_fullsized":"2023-11-20T06:42:46.048563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:35:07.354458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:45.049499+0000","last_change":"2023-11-20T06:42:43.900556+0000","last_active":"2023-11-20T06:42:45.049499+0000","last_peered":"2023-11-20T06:42:45.049499+0000","last_clean":"2023-11-20T06:42:45.049499+0000","last_became_active":"2023-11-20T06:42:43.900318+0000","last_became_peered":"2023-11-20T06:42:43.900318+0000","last_unstale":"2023-11-20T06:42:45.049499+0000","last_undegraded":"2023-11-20T06:42:45.049499+0000","last_fullsized":"2023-11-20T06:42:45.049499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:01:57.467854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.053445+0000","last_change":"2023-11-20T06:42:42.904340+0000","last_active":"2023-11-20T06:42:46.053445+0000","last_peered":"2023-11-20T06:42:46.053445+0000","last_clean":"2023-11-20T06:42:46.053445+0000","last_became_active":"2023-11-20T06:42:42.904023+0000","last_became_peered":"2023-11-20T06:42:42.904023+0000","last_unstale":"2023-11-20T06:42:46.053445+0000","last_undegraded":"2023-11-20T06:42:46.053445+0000","last_fullsized":"2023-11-20T06:42:46.053445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:40:17.584319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.267034+0000","last_change":"2023-11-20T06:42:43.918357+0000","last_active":"2023-11-20T06:42:46.267034+0000","last_peered":"2023-11-20T06:42:46.267034+0000","last_clean":"2023-11-20T06:42:46.267034+0000","last_became_active":"2023-11-20T06:42:43.918011+0000","last_became_peered":"2023-11-20T06:42:43.918011+0000","last_unstale":"2023-11-20T06:42:46.267034+0000","last_undegraded":"2023-11-20T06:42:46.267034+0000","last_fullsized":"2023-11-20T06:42:46.267034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:34:15.327764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.051364+0000","last_change":"2023-11-20T06:42:42.897130+0000","last_active":"2023-11-20T06:42:46.051364+0000","last_peered":"2023-11-20T06:42:46.051364+0000","last_clean":"2023-11-20T06:42:46.051364+0000","last_became_active":"2023-11-20T06:42:42.896861+0000","last_became_peered":"2023-11-20T06:42:42.896861+0000","last_unstale":"2023-11-20T06:42:46.051364+0000","last_undegraded":"2023-11-20T06:42:46.051364+0000","last_fullsized":"2023-11-20T06:42:46.051364+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:52:12.715680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896248+0000","last_change":"2023-11-20T06:42:43.913996+0000","last_active":"2023-11-20T06:42:44.896248+0000","last_peered":"2023-11-20T06:42:44.896248+0000","last_clean":"2023-11-20T06:42:44.896248+0000","last_became_active":"2023-11-20T06:42:43.913702+0000","last_became_peered":"2023-11-20T06:42:43.913702+0000","last_unstale":"2023-11-20T06:42:44.896248+0000","last_undegraded":"2023-11-20T06:42:44.896248+0000","last_fullsized":"2023-11-20T06:42:44.896248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:11:38.361542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266323+0000","last_change":"2023-11-20T06:42:42.904666+0000","last_active":"2023-11-20T06:42:46.266323+0000","last_peered":"2023-11-20T06:42:46.266323+0000","last_clean":"2023-11-20T06:42:46.266323+0000","last_became_active":"2023-11-20T06:42:42.904399+0000","last_became_peered":"2023-11-20T06:42:42.904399+0000","last_unstale":"2023-11-20T06:42:46.266323+0000","last_undegraded":"2023-11-20T06:42:46.266323+0000","last_fullsized":"2023-11-20T06:42:46.266323+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:09:56.576602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.265969+0000","last_change":"2023-11-20T06:42:43.901983+0000","last_active":"2023-11-20T06:42:46.265969+0000","last_peered":"2023-11-20T06:42:46.265969+0000","last_clean":"2023-11-20T06:42:46.265969+0000","last_became_active":"2023-11-20T06:42:43.898706+0000","last_became_peered":"2023-11-20T06:42:43.898706+0000","last_unstale":"2023-11-20T06:42:46.265969+0000","last_undegraded":"2023-11-20T06:42:46.265969+0000","last_fullsized":"2023-11-20T06:42:46.265969+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:36:58.855599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266325+0000","last_change":"2023-11-20T06:42:42.903417+0000","last_active":"2023-11-20T06:42:46.266325+0000","last_peered":"2023-11-20T06:42:46.266325+0000","last_clean":"2023-11-20T06:42:46.266325+0000","last_became_active":"2023-11-20T06:42:42.902364+0000","last_became_peered":"2023-11-20T06:42:42.902364+0000","last_unstale":"2023-11-20T06:42:46.266325+0000","last_undegraded":"2023-11-20T06:42:46.266325+0000","last_fullsized":"2023-11-20T06:42:46.266325+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:09:13.000923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:45.049278+0000","last_change":"2023-11-20T06:42:43.913788+0000","last_active":"2023-11-20T06:42:45.049278+0000","last_peered":"2023-11-20T06:42:45.049278+0000","last_clean":"2023-11-20T06:42:45.049278+0000","last_became_active":"2023-11-20T06:42:43.913413+0000","last_became_peered":"2023-11-20T06:42:43.913413+0000","last_unstale":"2023-11-20T06:42:45.049278+0000","last_undegraded":"2023-11-20T06:42:45.049278+0000","last_fullsized":"2023-11-20T06:42:45.049278+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:36:58.855599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.898063+0000","last_change":"2023-11-20T06:42:42.906300+0000","last_active":"2023-11-20T06:42:44.898063+0000","last_peered":"2023-11-20T06:42:44.898063+0000","last_clean":"2023-11-20T06:42:44.898063+0000","last_became_active":"2023-11-20T06:42:42.905557+0000","last_became_peered":"2023-11-20T06:42:42.905557+0000","last_unstale":"2023-11-20T06:42:44.898063+0000","last_undegraded":"2023-11-20T06:42:44.898063+0000","last_fullsized":"2023-11-20T06:42:44.898063+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:53:10.985177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.897369+0000","last_change":"2023-11-20T06:42:43.917026+0000","last_active":"2023-11-20T06:42:44.897369+0000","last_peered":"2023-11-20T06:42:44.897369+0000","last_clean":"2023-11-20T06:42:44.897369+0000","last_became_active":"2023-11-20T06:42:43.916671+0000","last_became_peered":"2023-11-20T06:42:43.916671+0000","last_unstale":"2023-11-20T06:42:44.897369+0000","last_undegraded":"2023-11-20T06:42:44.897369+0000","last_fullsized":"2023-11-20T06:42:44.897369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:36:58.855599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.897193+0000","last_change":"2023-11-20T06:42:42.907872+0000","last_active":"2023-11-20T06:42:44.897193+0000","last_peered":"2023-11-20T06:42:44.897193+0000","last_clean":"2023-11-20T06:42:44.897193+0000","last_became_active":"2023-11-20T06:42:42.907570+0000","last_became_peered":"2023-11-20T06:42:42.907570+0000","last_unstale":"2023-11-20T06:42:44.897193+0000","last_undegraded":"2023-11-20T06:42:44.897193+0000","last_fullsized":"2023-11-20T06:42:44.897193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:17:39.111557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.267026+0000","last_change":"2023-11-20T06:42:43.918452+0000","last_active":"2023-11-20T06:42:46.267026+0000","last_peered":"2023-11-20T06:42:46.267026+0000","last_clean":"2023-11-20T06:42:46.267026+0000","last_became_active":"2023-11-20T06:42:43.918099+0000","last_became_peered":"2023-11-20T06:42:43.918099+0000","last_unstale":"2023-11-20T06:42:46.267026+0000","last_undegraded":"2023-11-20T06:42:46.267026+0000","last_fullsized":"2023-11-20T06:42:46.267026+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:39:11.687117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.895973+0000","last_change":"2023-11-20T06:42:42.905882+0000","last_active":"2023-11-20T06:42:44.895973+0000","last_peered":"2023-11-20T06:42:44.895973+0000","last_clean":"2023-11-20T06:42:44.895973+0000","last_became_active":"2023-11-20T06:42:42.904844+0000","last_became_peered":"2023-11-20T06:42:42.904844+0000","last_unstale":"2023-11-20T06:42:44.895973+0000","last_undegraded":"2023-11-20T06:42:44.895973+0000","last_fullsized":"2023-11-20T06:42:44.895973+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:51:56.691831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.053309+0000","last_change":"2023-11-20T06:42:43.906735+0000","last_active":"2023-11-20T06:42:46.053309+0000","last_peered":"2023-11-20T06:42:46.053309+0000","last_clean":"2023-11-20T06:42:46.053309+0000","last_became_active":"2023-11-20T06:42:43.906416+0000","last_became_peered":"2023-11-20T06:42:43.906416+0000","last_unstale":"2023-11-20T06:42:46.053309+0000","last_undegraded":"2023-11-20T06:42:46.053309+0000","last_fullsized":"2023-11-20T06:42:46.053309+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:38:13.367906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266945+0000","last_change":"2023-11-20T06:42:42.911467+0000","last_active":"2023-11-20T06:42:46.266945+0000","last_peered":"2023-11-20T06:42:46.266945+0000","last_clean":"2023-11-20T06:42:46.266945+0000","last_became_active":"2023-11-20T06:42:42.911054+0000","last_became_peered":"2023-11-20T06:42:42.911054+0000","last_unstale":"2023-11-20T06:42:46.266945+0000","last_undegraded":"2023-11-20T06:42:46.266945+0000","last_fullsized":"2023-11-20T06:42:46.266945+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:09:13.000923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T06:42:43.900956+0000","last_change":"2023-11-20T06:41:03.783345+0000","last_active":"2023-11-20T06:42:43.900956+0000","last_peered":"2023-11-20T06:42:43.900956+0000","last_clean":"2023-11-20T06:42:43.900956+0000","last_became_active":"2023-11-20T06:41:03.782257+0000","last_became_peered":"2023-11-20T06:41:03.782257+0000","last_unstale":"2023-11-20T06:42:43.900956+0000","last_undegraded":"2023-11-20T06:42:43.900956+0000","last_fullsized":"2023-11-20T06:42:43.900956+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:01.979090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:01.979090+0000","last_clean_scrub_stamp":"2023-11-20T06:41:01.979090+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:20:41.084382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":781671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.505},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.73599999999999999}]},{"osd":1,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.64900000000000002}]},{"osd":2,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.624},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.61199999999999999}]},{"osd":3,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":2,"5min":2,"15min":2},"last":0.67800000000000005}]},{"osd":4,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.41799999999999998}]},{"osd":5,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.59899999999999998}]},{"osd":6,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.55100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":196823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":0.80800000000000005}]},{"osd":1,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.70299999999999996}]},{"osd":2,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.64900000000000002}]},{"osd":3,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.745},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":4.3029999999999999,"5min":4.3029999999999999,"15min":4.3029999999999999},"last":0.623}]},{"osd":4,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.439},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.77900000000000003}]},{"osd":7,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.72599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":446464,"data_stored":189733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":4.7450000000000001,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.69299999999999995}]},{"osd":1,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.748},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.65700000000000003}]},{"osd":2,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":0.71299999999999997}]},{"osd":3,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":8.9250000000000007,"5min":8.9250000000000007,"15min":8.9250000000000007},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":8.891,"5min":8.891,"15min":8.891},"last":0.58099999999999996}]},{"osd":4,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.47799999999999998}]},{"osd":6,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.67300000000000004}]},{"osd":7,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.63900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":196845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.71899999999999997}]},{"osd":1,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":4.8710000000000004,"5min":4.8710000000000004,"15min":4.8710000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.76800000000000002}]},{"osd":2,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":4.8499999999999996,"5min":4.8499999999999996,"15min":4.8499999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.61699999999999999}]},{"osd":3,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.83299999999999996}]},{"osd":6,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.79400000000000004}]},{"osd":7,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.73899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":197887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":3.714,"5min":3.714,"15min":3.714},"last":0.373},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56299999999999994}]},{"osd":1,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":3.8330000000000002,"5min":3.8330000000000002,"15min":3.8330000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.7629999999999999,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":0.58499999999999996}]},{"osd":2,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.0709999999999997,"5min":4.0709999999999997,"15min":4.0709999999999997},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.52900000000000003}]},{"osd":4,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.9169999999999998,"5min":3.9169999999999998,"15min":3.9169999999999998},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.2069999999999999,"5min":4.2069999999999999,"15min":4.2069999999999999},"last":0.80900000000000005}]},{"osd":5,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.879},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.752}]},{"osd":6,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":4.3659999999999997,"5min":4.3659999999999997,"15min":4.3659999999999997},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.86199999999999999}]},{"osd":7,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":3.9700000000000002,"5min":3.9700000000000002,"15min":3.9700000000000002},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":0.89900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":442368,"data_stored":189691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.55100000000000005}]},{"osd":1,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.47299999999999998}]},{"osd":3,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.51800000000000002}]},{"osd":4,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.752},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.86099999999999999}]},{"osd":5,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.88},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.84299999999999997}]},{"osd":6,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.77300000000000002}]},{"osd":7,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.82399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":196331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.44}]},{"osd":2,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.47799999999999998}]},{"osd":3,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.46100000000000002}]},{"osd":4,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.78400000000000003}]},{"osd":5,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.64800000000000002}]},{"osd":6,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.76100000000000001}]},{"osd":7,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.70499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1032192,"data_stored":779004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.32900000000000001}]},{"osd":2,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.625,"5min":2.625,"15min":2.625},"last":0.307},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.439}]},{"osd":3,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.6669999999999998,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":0.51100000000000001}]},{"osd":4,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.82899999999999996}]},{"osd":5,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":3.0550000000000002,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.74099999999999999}]},{"osd":6,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.76000000000000001}]},{"osd":7,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.71399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T06:42:48.357 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T06:42:48.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.535+0000 7fbdde846640 1 Processor -- start 2023-11-20T06:42:48.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.535+0000 7fbdde846640 1 -- start start 2023-11-20T06:42:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.535+0000 7fbdde846640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbdd815a880 0x7fbdd815dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.535+0000 7fbdde846640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdd80b00e0 0x7fbdd80b0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.535+0000 7fbdde846640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd80b0a80 con 0x7fbdd8160680 2023-11-20T06:42:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.535+0000 7fbdde846640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd815e000 con 0x7fbdd815a880 2023-11-20T06:42:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.535+0000 7fbdde846640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd80cb1d0 con 0x7fbdd80b00e0 2023-11-20T06:42:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.535+0000 7fbdd7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbdd815a880 0x7fbdd815dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.535+0000 7fbdd7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbdd815a880 0x7fbdd815dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36504/0 (socket says 172.21.15.19:36504) 2023-11-20T06:42:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.535+0000 7fbdd7fff640 1 -- 172.21.15.19:0/2778148807 learned_addr learned my addr 172.21.15.19:0/2778148807 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.539+0000 7fbdd77fe640 1 --2- 172.21.15.19:0/2778148807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdd80b00e0 0x7fbdd80b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.539+0000 7fbdd7fff640 1 -- 172.21.15.19:0/2778148807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdd80b00e0 msgr2=0x7fbdd80b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.539+0000 7fbdd7fff640 1 --2- 172.21.15.19:0/2778148807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdd80b00e0 0x7fbdd80b0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.539+0000 7fbdd7fff640 1 -- 172.21.15.19:0/2778148807 >> v1:172.21.15.190:6789/0 conn(0x7fbdd8160680 legacy=0x7fbdd8160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.539+0000 7fbdd7fff640 1 -- 172.21.15.19:0/2778148807 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd80cb4b0 con 0x7fbdd815a880 2023-11-20T06:42:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.539+0000 7fbdd77fe640 1 --2- 172.21.15.19:0/2778148807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdd80b00e0 0x7fbdd80b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:48.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.539+0000 7fbdd7fff640 1 --2- 172.21.15.19:0/2778148807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd815a880 0x7fbdd815dac0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009870 tx=0x7fbdc801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909c2b83b76b3e63 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:48.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.539+0000 7fbdd6ffd640 1 -- 172.21.15.19:0/2778148807 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc80a7070 con 0x7fbdd815a880 2023-11-20T06:42:48.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.539+0000 7fbdd6ffd640 1 -- 172.21.15.19:0/2778148807 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc80ab430 con 0x7fbdd815a880 2023-11-20T06:42:48.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.539+0000 7fbdd6ffd640 1 -- 172.21.15.19:0/2778148807 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc80ab7c0 con 0x7fbdd815a880 2023-11-20T06:42:48.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdde846640 1 -- 172.21.15.19:0/2778148807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd815a880 msgr2=0x7fbdd815dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:48.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdde846640 1 --2- 172.21.15.19:0/2778148807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd815a880 0x7fbdd815dac0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009870 tx=0x7fbdc801c540 comp rx=0 tx=0).stop 2023-11-20T06:42:48.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdde846640 1 -- 172.21.15.19:0/2778148807 shutdown_connections 2023-11-20T06:42:48.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdde846640 1 --2- 172.21.15.19:0/2778148807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdd80b00e0 0x7fbdd80b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdde846640 1 --2- 172.21.15.19:0/2778148807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd815a880 0x7fbdd815dac0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdde846640 1 -- 172.21.15.19:0/2778148807 >> 172.21.15.19:0/2778148807 conn(0x7fbdd806c190 msgr2=0x7fbdd806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:48.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdde846640 1 -- 172.21.15.19:0/2778148807 shutdown_connections 2023-11-20T06:42:48.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdde846640 1 -- 172.21.15.19:0/2778148807 wait complete. 2023-11-20T06:42:48.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdde846640 1 Processor -- start 2023-11-20T06:42:48.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdde846640 1 -- start start 2023-11-20T06:42:48.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdde846640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdd80b00e0 0x7fbdd8159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:48.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdde846640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd815a880 0x7fbdd815f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:48.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdde846640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbdd8160680 0x7fbdd8157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:48.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdde846640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd81585e0 con 0x7fbdd815a880 2023-11-20T06:42:48.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdde846640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd81588c0 con 0x7fbdd8160680 2023-11-20T06:42:48.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdde846640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd8158ba0 con 0x7fbdd80b00e0 2023-11-20T06:42:48.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdd77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd815a880 0x7fbdd815f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:48.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdd77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd815a880 0x7fbdd815f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36518/0 (socket says 172.21.15.19:36518) 2023-11-20T06:42:48.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdd77fe640 1 -- 172.21.15.19:0/3952460133 learned_addr learned my addr 172.21.15.19:0/3952460133 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:48.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdd7fff640 1 --2- 172.21.15.19:0/3952460133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdd80b00e0 0x7fbdd8159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:48.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbddcde3640 1 --2- 172.21.15.19:0/3952460133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbdd8160680 0x7fbdd8157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:48.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdd77fe640 1 -- 172.21.15.19:0/3952460133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdd80b00e0 msgr2=0x7fbdd8159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:48.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdd77fe640 1 --2- 172.21.15.19:0/3952460133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdd80b00e0 0x7fbdd8159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdd77fe640 1 -- 172.21.15.19:0/3952460133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbdd8160680 msgr2=0x7fbdd8157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:48.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.543+0000 7fbdd77fe640 1 --2- 172.21.15.19:0/3952460133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbdd8160680 0x7fbdd8157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.547+0000 7fbdd77fe640 1 -- 172.21.15.19:0/3952460133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc80094d0 con 0x7fbdd815a880 2023-11-20T06:42:48.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.547+0000 7fbdd77fe640 1 --2- 172.21.15.19:0/3952460133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd815a880 0x7fbdd815f3f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00d800 tx=0x7fbdcc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:48.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.547+0000 7fbdd4ff9640 1 -- 172.21.15.19:0/3952460133 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc0096c0 con 0x7fbdd815a880 2023-11-20T06:42:48.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.547+0000 7fbdd4ff9640 1 -- 172.21.15.19:0/3952460133 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc009820 con 0x7fbdd815a880 2023-11-20T06:42:48.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.547+0000 7fbdd4ff9640 1 -- 172.21.15.19:0/3952460133 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc009bd0 con 0x7fbdd815a880 2023-11-20T06:42:48.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.547+0000 7fbdde846640 1 -- 172.21.15.19:0/3952460133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd8158e80 con 0x7fbdd815a880 2023-11-20T06:42:48.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.547+0000 7fbdde846640 1 -- 172.21.15.19:0/3952460133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd80c67d0 con 0x7fbdd815a880 2023-11-20T06:42:48.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.547+0000 7fbdde846640 1 -- 172.21.15.19:0/3952460133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd80cad80 con 0x7fbdd815a880 2023-11-20T06:42:48.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.547+0000 7fbdd4ff9640 1 -- 172.21.15.19:0/3952460133 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbdcc009d30 con 0x7fbdd815a880 2023-11-20T06:42:48.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.547+0000 7fbdd4ff9640 1 --2- 172.21.15.19:0/3952460133 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbdc40664a0 0x7fbdc4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:48.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.547+0000 7fbdd4ff9640 1 -- 172.21.15.19:0/3952460133 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbdcc0845a0 con 0x7fbdd815a880 2023-11-20T06:42:48.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.551+0000 7fbdd7fff640 1 --2- 172.21.15.19:0/3952460133 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbdc40664a0 0x7fbdc4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:48.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.551+0000 7fbdd7fff640 1 --2- 172.21.15.19:0/3952460133 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbdc40664a0 0x7fbdc4068960 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80af000 tx=0x7fbdc8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:48.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.551+0000 7fbdd4ff9640 1 -- 172.21.15.19:0/3952460133 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbdcc051980 con 0x7fbdd815a880 2023-11-20T06:42:48.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.707+0000 7fbdde846640 1 -- 172.21.15.19:0/3952460133 --> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbdd80c90a0 con 0x7fbdc40664a0 2023-11-20T06:42:48.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.715+0000 7fbdd4ff9640 1 -- 172.21.15.19:0/3952460133 <== mgr.4109 v2:172.21.15.190:6832/142426253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289064 (secure 0 0 0) 0x7fbdc80bc090 con 0x7fbdc40664a0 2023-11-20T06:42:48.723 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:48.725 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-20T06:42:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.719+0000 7fbdde846640 1 -- 172.21.15.19:0/3952460133 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbdc40664a0 msgr2=0x7fbdc4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.719+0000 7fbdde846640 1 --2- 172.21.15.19:0/3952460133 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbdc40664a0 0x7fbdc4068960 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80af000 tx=0x7fbdc8008040 comp rx=0 tx=0).stop 2023-11-20T06:42:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.719+0000 7fbdde846640 1 -- 172.21.15.19:0/3952460133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd815a880 msgr2=0x7fbdd815f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.719+0000 7fbdde846640 1 --2- 172.21.15.19:0/3952460133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd815a880 0x7fbdd815f3f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00d800 tx=0x7fbdcc00dcc0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.719+0000 7fbdde846640 1 -- 172.21.15.19:0/3952460133 shutdown_connections 2023-11-20T06:42:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.719+0000 7fbdde846640 1 --2- 172.21.15.19:0/3952460133 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fbdc40664a0 0x7fbdc4068960 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.719+0000 7fbdde846640 1 --2- 172.21.15.19:0/3952460133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbdd8160680 0x7fbdd8157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.719+0000 7fbdde846640 1 --2- 172.21.15.19:0/3952460133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd815a880 0x7fbdd815f3f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.719+0000 7fbdde846640 1 --2- 172.21.15.19:0/3952460133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdd80b00e0 0x7fbdd8159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.719+0000 7fbdde846640 1 -- 172.21.15.19:0/3952460133 >> 172.21.15.19:0/3952460133 conn(0x7fbdd806c190 msgr2=0x7fbdd80715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:48.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.719+0000 7fbdde846640 1 -- 172.21.15.19:0/3952460133 shutdown_connections 2023-11-20T06:42:48.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.719+0000 7fbdde846640 1 -- 172.21.15.19:0/3952460133 wait complete. 2023-11-20T06:42:48.743 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2023-11-20T06:42:47.505663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220856,"kb_used_data":4692,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753864,"statfs":{"total":773094113280,"available":772867956736,"internally_reserved":0,"allocated":4804608,"data_stored":2727985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.632287"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896572+0000","last_change":"2023-11-20T06:42:43.899739+0000","last_active":"2023-11-20T06:42:44.896572+0000","last_peered":"2023-11-20T06:42:44.896572+0000","last_clean":"2023-11-20T06:42:44.896572+0000","last_became_active":"2023-11-20T06:42:43.899446+0000","last_became_peered":"2023-11-20T06:42:43.899446+0000","last_unstale":"2023-11-20T06:42:44.896572+0000","last_undegraded":"2023-11-20T06:42:44.896572+0000","last_fullsized":"2023-11-20T06:42:44.896572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:10:47.221064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896199+0000","last_change":"2023-11-20T06:42:43.903037+0000","last_active":"2023-11-20T06:42:44.896199+0000","last_peered":"2023-11-20T06:42:44.896199+0000","last_clean":"2023-11-20T06:42:44.896199+0000","last_became_active":"2023-11-20T06:42:43.902713+0000","last_became_peered":"2023-11-20T06:42:43.902713+0000","last_unstale":"2023-11-20T06:42:44.896199+0000","last_undegraded":"2023-11-20T06:42:44.896199+0000","last_fullsized":"2023-11-20T06:42:44.896199+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:38:13.367906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266263+0000","last_change":"2023-11-20T06:42:43.899149+0000","last_active":"2023-11-20T06:42:46.266263+0000","last_peered":"2023-11-20T06:42:46.266263+0000","last_clean":"2023-11-20T06:42:46.266263+0000","last_became_active":"2023-11-20T06:42:43.898185+0000","last_became_peered":"2023-11-20T06:42:43.898185+0000","last_unstale":"2023-11-20T06:42:46.266263+0000","last_undegraded":"2023-11-20T06:42:46.266263+0000","last_fullsized":"2023-11-20T06:42:46.266263+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:40:18.592085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.048865+0000","last_change":"2023-11-20T06:42:43.911439+0000","last_active":"2023-11-20T06:42:46.048865+0000","last_peered":"2023-11-20T06:42:46.048865+0000","last_clean":"2023-11-20T06:42:46.048865+0000","last_became_active":"2023-11-20T06:42:43.911010+0000","last_became_peered":"2023-11-20T06:42:43.911010+0000","last_unstale":"2023-11-20T06:42:46.048865+0000","last_undegraded":"2023-11-20T06:42:46.048865+0000","last_fullsized":"2023-11-20T06:42:46.048865+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:52:29.897605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.048757+0000","last_change":"2023-11-20T06:42:43.913372+0000","last_active":"2023-11-20T06:42:46.048757+0000","last_peered":"2023-11-20T06:42:46.048757+0000","last_clean":"2023-11-20T06:42:46.048757+0000","last_became_active":"2023-11-20T06:42:43.913042+0000","last_became_peered":"2023-11-20T06:42:43.913042+0000","last_unstale":"2023-11-20T06:42:46.048757+0000","last_undegraded":"2023-11-20T06:42:46.048757+0000","last_fullsized":"2023-11-20T06:42:46.048757+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:54:21.979729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:45.049261+0000","last_change":"2023-11-20T06:42:43.908009+0000","last_active":"2023-11-20T06:42:45.049261+0000","last_peered":"2023-11-20T06:42:45.049261+0000","last_clean":"2023-11-20T06:42:45.049261+0000","last_became_active":"2023-11-20T06:42:43.907700+0000","last_became_peered":"2023-11-20T06:42:43.907700+0000","last_unstale":"2023-11-20T06:42:45.049261+0000","last_undegraded":"2023-11-20T06:42:45.049261+0000","last_fullsized":"2023-11-20T06:42:45.049261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:12:50.200023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.052745+0000","last_change":"2023-11-20T06:42:43.907752+0000","last_active":"2023-11-20T06:42:46.052745+0000","last_peered":"2023-11-20T06:42:46.052745+0000","last_clean":"2023-11-20T06:42:46.052745+0000","last_became_active":"2023-11-20T06:42:43.907411+0000","last_became_peered":"2023-11-20T06:42:43.907411+0000","last_unstale":"2023-11-20T06:42:46.052745+0000","last_undegraded":"2023-11-20T06:42:46.052745+0000","last_fullsized":"2023-11-20T06:42:46.052745+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:22:13.710252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.895949+0000","last_change":"2023-11-20T06:42:43.895698+0000","last_active":"2023-11-20T06:42:44.895949+0000","last_peered":"2023-11-20T06:42:44.895949+0000","last_clean":"2023-11-20T06:42:44.895949+0000","last_became_active":"2023-11-20T06:42:43.895370+0000","last_became_peered":"2023-11-20T06:42:43.895370+0000","last_unstale":"2023-11-20T06:42:44.895949+0000","last_undegraded":"2023-11-20T06:42:44.895949+0000","last_fullsized":"2023-11-20T06:42:44.895949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:24:23.684617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266424+0000","last_change":"2023-11-20T06:42:43.906248+0000","last_active":"2023-11-20T06:42:46.266424+0000","last_peered":"2023-11-20T06:42:46.266424+0000","last_clean":"2023-11-20T06:42:46.266424+0000","last_became_active":"2023-11-20T06:42:43.905974+0000","last_became_peered":"2023-11-20T06:42:43.905974+0000","last_unstale":"2023-11-20T06:42:46.266424+0000","last_undegraded":"2023-11-20T06:42:46.266424+0000","last_fullsized":"2023-11-20T06:42:46.266424+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:22:13.710252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.052918+0000","last_change":"2023-11-20T06:42:43.909094+0000","last_active":"2023-11-20T06:42:46.052918+0000","last_peered":"2023-11-20T06:42:46.052918+0000","last_clean":"2023-11-20T06:42:46.052918+0000","last_became_active":"2023-11-20T06:42:43.908374+0000","last_became_peered":"2023-11-20T06:42:43.908374+0000","last_unstale":"2023-11-20T06:42:46.052918+0000","last_undegraded":"2023-11-20T06:42:46.052918+0000","last_fullsized":"2023-11-20T06:42:46.052918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:39:11.687117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.053087+0000","last_change":"2023-11-20T06:42:43.911322+0000","last_active":"2023-11-20T06:42:46.053087+0000","last_peered":"2023-11-20T06:42:46.053087+0000","last_clean":"2023-11-20T06:42:46.053087+0000","last_became_active":"2023-11-20T06:42:43.910907+0000","last_became_peered":"2023-11-20T06:42:43.910907+0000","last_unstale":"2023-11-20T06:42:46.053087+0000","last_undegraded":"2023-11-20T06:42:46.053087+0000","last_fullsized":"2023-11-20T06:42:46.053087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:34:18.136432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266231+0000","last_change":"2023-11-20T06:42:43.898749+0000","last_active":"2023-11-20T06:42:46.266231+0000","last_peered":"2023-11-20T06:42:46.266231+0000","last_clean":"2023-11-20T06:42:46.266231+0000","last_became_active":"2023-11-20T06:42:43.898129+0000","last_became_peered":"2023-11-20T06:42:43.898129+0000","last_unstale":"2023-11-20T06:42:46.266231+0000","last_undegraded":"2023-11-20T06:42:46.266231+0000","last_fullsized":"2023-11-20T06:42:46.266231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:15:16.369236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.052966+0000","last_change":"2023-11-20T06:42:43.913291+0000","last_active":"2023-11-20T06:42:46.052966+0000","last_peered":"2023-11-20T06:42:46.052966+0000","last_clean":"2023-11-20T06:42:46.052966+0000","last_became_active":"2023-11-20T06:42:43.912970+0000","last_became_peered":"2023-11-20T06:42:43.912970+0000","last_unstale":"2023-11-20T06:42:46.052966+0000","last_undegraded":"2023-11-20T06:42:46.052966+0000","last_fullsized":"2023-11-20T06:42:46.052966+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:51:57.699597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.897174+0000","last_change":"2023-11-20T06:42:43.923012+0000","last_active":"2023-11-20T06:42:44.897174+0000","last_peered":"2023-11-20T06:42:44.897174+0000","last_clean":"2023-11-20T06:42:44.897174+0000","last_became_active":"2023-11-20T06:42:43.922664+0000","last_became_peered":"2023-11-20T06:42:43.922664+0000","last_unstale":"2023-11-20T06:42:44.897174+0000","last_undegraded":"2023-11-20T06:42:44.897174+0000","last_fullsized":"2023-11-20T06:42:44.897174+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:22:50.879248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.052865+0000","last_change":"2023-11-20T06:42:43.907530+0000","last_active":"2023-11-20T06:42:46.052865+0000","last_peered":"2023-11-20T06:42:46.052865+0000","last_clean":"2023-11-20T06:42:46.052865+0000","last_became_active":"2023-11-20T06:42:43.907168+0000","last_became_peered":"2023-11-20T06:42:43.907168+0000","last_unstale":"2023-11-20T06:42:46.052865+0000","last_undegraded":"2023-11-20T06:42:46.052865+0000","last_fullsized":"2023-11-20T06:42:46.052865+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:05:28.834466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266614+0000","last_change":"2023-11-20T06:42:43.907215+0000","last_active":"2023-11-20T06:42:46.266614+0000","last_peered":"2023-11-20T06:42:46.266614+0000","last_clean":"2023-11-20T06:42:46.266614+0000","last_became_active":"2023-11-20T06:42:43.906717+0000","last_became_peered":"2023-11-20T06:42:43.906717+0000","last_unstale":"2023-11-20T06:42:46.266614+0000","last_undegraded":"2023-11-20T06:42:46.266614+0000","last_fullsized":"2023-11-20T06:42:46.266614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:01:57.467854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266915+0000","last_change":"2023-11-20T06:42:43.911615+0000","last_active":"2023-11-20T06:42:46.266915+0000","last_peered":"2023-11-20T06:42:46.266915+0000","last_clean":"2023-11-20T06:42:46.266915+0000","last_became_active":"2023-11-20T06:42:43.910452+0000","last_became_peered":"2023-11-20T06:42:43.910452+0000","last_unstale":"2023-11-20T06:42:46.266915+0000","last_undegraded":"2023-11-20T06:42:46.266915+0000","last_fullsized":"2023-11-20T06:42:46.266915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:05:28.834466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.898320+0000","last_change":"2023-11-20T06:42:43.924145+0000","last_active":"2023-11-20T06:42:44.898320+0000","last_peered":"2023-11-20T06:42:44.898320+0000","last_clean":"2023-11-20T06:42:44.898320+0000","last_became_active":"2023-11-20T06:42:43.923266+0000","last_became_peered":"2023-11-20T06:42:43.923266+0000","last_unstale":"2023-11-20T06:42:44.898320+0000","last_undegraded":"2023-11-20T06:42:44.898320+0000","last_fullsized":"2023-11-20T06:42:44.898320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:09:57.584368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.049074+0000","last_change":"2023-11-20T06:42:43.911011+0000","last_active":"2023-11-20T06:42:46.049074+0000","last_peered":"2023-11-20T06:42:46.049074+0000","last_clean":"2023-11-20T06:42:46.049074+0000","last_became_active":"2023-11-20T06:42:43.910681+0000","last_became_peered":"2023-11-20T06:42:43.910681+0000","last_unstale":"2023-11-20T06:42:46.049074+0000","last_undegraded":"2023-11-20T06:42:46.049074+0000","last_fullsized":"2023-11-20T06:42:46.049074+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:29:56.859736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.897965+0000","last_change":"2023-11-20T06:42:43.916923+0000","last_active":"2023-11-20T06:42:44.897965+0000","last_peered":"2023-11-20T06:42:44.897965+0000","last_clean":"2023-11-20T06:42:44.897965+0000","last_became_active":"2023-11-20T06:42:43.914671+0000","last_became_peered":"2023-11-20T06:42:43.914671+0000","last_unstale":"2023-11-20T06:42:44.897965+0000","last_undegraded":"2023-11-20T06:42:44.897965+0000","last_fullsized":"2023-11-20T06:42:44.897965+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:14:07.641117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.052900+0000","last_change":"2023-11-20T06:42:43.913144+0000","last_active":"2023-11-20T06:42:46.052900+0000","last_peered":"2023-11-20T06:42:46.052900+0000","last_clean":"2023-11-20T06:42:46.052900+0000","last_became_active":"2023-11-20T06:42:43.910774+0000","last_became_peered":"2023-11-20T06:42:43.910774+0000","last_unstale":"2023-11-20T06:42:46.052900+0000","last_undegraded":"2023-11-20T06:42:46.052900+0000","last_fullsized":"2023-11-20T06:42:46.052900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:01:23.985762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.897481+0000","last_change":"2023-11-20T06:42:43.910277+0000","last_active":"2023-11-20T06:42:44.897481+0000","last_peered":"2023-11-20T06:42:44.897481+0000","last_clean":"2023-11-20T06:42:44.897481+0000","last_became_active":"2023-11-20T06:42:43.909559+0000","last_became_peered":"2023-11-20T06:42:43.909559+0000","last_unstale":"2023-11-20T06:42:44.897481+0000","last_undegraded":"2023-11-20T06:42:44.897481+0000","last_fullsized":"2023-11-20T06:42:44.897481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:01:57.467854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266711+0000","last_change":"2023-11-20T06:42:43.916557+0000","last_active":"2023-11-20T06:42:46.266711+0000","last_peered":"2023-11-20T06:42:46.266711+0000","last_clean":"2023-11-20T06:42:46.266711+0000","last_became_active":"2023-11-20T06:42:43.915880+0000","last_became_peered":"2023-11-20T06:42:43.915880+0000","last_unstale":"2023-11-20T06:42:46.266711+0000","last_undegraded":"2023-11-20T06:42:46.266711+0000","last_fullsized":"2023-11-20T06:42:46.266711+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:40:18.592085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.048623+0000","last_change":"2023-11-20T06:42:43.906240+0000","last_active":"2023-11-20T06:42:46.048623+0000","last_peered":"2023-11-20T06:42:46.048623+0000","last_clean":"2023-11-20T06:42:46.048623+0000","last_became_active":"2023-11-20T06:42:43.905963+0000","last_became_peered":"2023-11-20T06:42:43.905963+0000","last_unstale":"2023-11-20T06:42:46.048623+0000","last_undegraded":"2023-11-20T06:42:46.048623+0000","last_fullsized":"2023-11-20T06:42:46.048623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:49:40.213232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.898202+0000","last_change":"2023-11-20T06:42:43.917955+0000","last_active":"2023-11-20T06:42:44.898202+0000","last_peered":"2023-11-20T06:42:44.898202+0000","last_clean":"2023-11-20T06:42:44.898202+0000","last_became_active":"2023-11-20T06:42:43.917703+0000","last_became_peered":"2023-11-20T06:42:43.917703+0000","last_unstale":"2023-11-20T06:42:44.898202+0000","last_undegraded":"2023-11-20T06:42:44.898202+0000","last_fullsized":"2023-11-20T06:42:44.898202+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:59:43.157480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:45.049622+0000","last_change":"2023-11-20T06:42:43.918361+0000","last_active":"2023-11-20T06:42:45.049622+0000","last_peered":"2023-11-20T06:42:45.049622+0000","last_clean":"2023-11-20T06:42:45.049622+0000","last_became_active":"2023-11-20T06:42:43.918047+0000","last_became_peered":"2023-11-20T06:42:43.918047+0000","last_unstale":"2023-11-20T06:42:45.049622+0000","last_undegraded":"2023-11-20T06:42:45.049622+0000","last_fullsized":"2023-11-20T06:42:45.049622+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:15:16.369236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.898451+0000","last_change":"2023-11-20T06:42:43.919455+0000","last_active":"2023-11-20T06:42:44.898451+0000","last_peered":"2023-11-20T06:42:44.898451+0000","last_clean":"2023-11-20T06:42:44.898451+0000","last_became_active":"2023-11-20T06:42:43.918905+0000","last_became_peered":"2023-11-20T06:42:43.918905+0000","last_unstale":"2023-11-20T06:42:44.898451+0000","last_undegraded":"2023-11-20T06:42:44.898451+0000","last_fullsized":"2023-11-20T06:42:44.898451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:50:13.628784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.053311+0000","last_change":"2023-11-20T06:42:43.909106+0000","last_active":"2023-11-20T06:42:46.053311+0000","last_peered":"2023-11-20T06:42:46.053311+0000","last_clean":"2023-11-20T06:42:46.053311+0000","last_became_active":"2023-11-20T06:42:43.908803+0000","last_became_peered":"2023-11-20T06:42:43.908803+0000","last_unstale":"2023-11-20T06:42:46.053311+0000","last_undegraded":"2023-11-20T06:42:46.053311+0000","last_fullsized":"2023-11-20T06:42:46.053311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:11:38.361542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.897879+0000","last_change":"2023-11-20T06:42:43.920369+0000","last_active":"2023-11-20T06:42:44.897879+0000","last_peered":"2023-11-20T06:42:44.897879+0000","last_clean":"2023-11-20T06:42:44.897879+0000","last_became_active":"2023-11-20T06:42:43.915559+0000","last_became_peered":"2023-11-20T06:42:43.915559+0000","last_unstale":"2023-11-20T06:42:44.897879+0000","last_undegraded":"2023-11-20T06:42:44.897879+0000","last_fullsized":"2023-11-20T06:42:44.897879+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:17:40.119323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.897977+0000","last_change":"2023-11-20T06:42:43.917467+0000","last_active":"2023-11-20T06:42:44.897977+0000","last_peered":"2023-11-20T06:42:44.897977+0000","last_clean":"2023-11-20T06:42:44.897977+0000","last_became_active":"2023-11-20T06:42:43.917161+0000","last_became_peered":"2023-11-20T06:42:43.917161+0000","last_unstale":"2023-11-20T06:42:44.897977+0000","last_undegraded":"2023-11-20T06:42:44.897977+0000","last_fullsized":"2023-11-20T06:42:44.897977+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:41:54.452233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266803+0000","last_change":"2023-11-20T06:42:43.916746+0000","last_active":"2023-11-20T06:42:46.266803+0000","last_peered":"2023-11-20T06:42:46.266803+0000","last_clean":"2023-11-20T06:42:46.266803+0000","last_became_active":"2023-11-20T06:42:43.916265+0000","last_became_peered":"2023-11-20T06:42:43.916265+0000","last_unstale":"2023-11-20T06:42:46.266803+0000","last_undegraded":"2023-11-20T06:42:46.266803+0000","last_fullsized":"2023-11-20T06:42:46.266803+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:51:57.699597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:45.049266+0000","last_change":"2023-11-20T06:42:43.901899+0000","last_active":"2023-11-20T06:42:45.049266+0000","last_peered":"2023-11-20T06:42:45.049266+0000","last_clean":"2023-11-20T06:42:45.049266+0000","last_became_active":"2023-11-20T06:42:43.901641+0000","last_became_peered":"2023-11-20T06:42:43.901641+0000","last_unstale":"2023-11-20T06:42:45.049266+0000","last_undegraded":"2023-11-20T06:42:45.049266+0000","last_fullsized":"2023-11-20T06:42:45.049266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:22:50.879248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266765+0000","last_change":"2023-11-20T06:42:43.910215+0000","last_active":"2023-11-20T06:42:46.266765+0000","last_peered":"2023-11-20T06:42:46.266765+0000","last_clean":"2023-11-20T06:42:46.266765+0000","last_became_active":"2023-11-20T06:42:43.909843+0000","last_became_peered":"2023-11-20T06:42:43.909843+0000","last_unstale":"2023-11-20T06:42:46.266765+0000","last_undegraded":"2023-11-20T06:42:46.266765+0000","last_fullsized":"2023-11-20T06:42:46.266765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:22:13.710252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.898285+0000","last_change":"2023-11-20T06:42:42.902894+0000","last_active":"2023-11-20T06:42:44.898285+0000","last_peered":"2023-11-20T06:42:44.898285+0000","last_clean":"2023-11-20T06:42:44.898285+0000","last_became_active":"2023-11-20T06:42:42.902560+0000","last_became_peered":"2023-11-20T06:42:42.902560+0000","last_unstale":"2023-11-20T06:42:44.898285+0000","last_undegraded":"2023-11-20T06:42:44.898285+0000","last_fullsized":"2023-11-20T06:42:44.898285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:40:09.020401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:45.049634+0000","last_change":"2023-11-20T06:42:43.910962+0000","last_active":"2023-11-20T06:42:45.049634+0000","last_peered":"2023-11-20T06:42:45.049634+0000","last_clean":"2023-11-20T06:42:45.049634+0000","last_became_active":"2023-11-20T06:42:43.909361+0000","last_became_peered":"2023-11-20T06:42:43.909361+0000","last_unstale":"2023-11-20T06:42:45.049634+0000","last_undegraded":"2023-11-20T06:42:45.049634+0000","last_fullsized":"2023-11-20T06:42:45.049634+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:40:18.592085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266240+0000","last_change":"2023-11-20T06:42:42.909344+0000","last_active":"2023-11-20T06:42:46.266240+0000","last_peered":"2023-11-20T06:42:46.266240+0000","last_clean":"2023-11-20T06:42:46.266240+0000","last_became_active":"2023-11-20T06:42:42.909031+0000","last_became_peered":"2023-11-20T06:42:42.909031+0000","last_unstale":"2023-11-20T06:42:46.266240+0000","last_undegraded":"2023-11-20T06:42:46.266240+0000","last_fullsized":"2023-11-20T06:42:46.266240+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:50:12.621018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.898389+0000","last_change":"2023-11-20T06:42:43.924343+0000","last_active":"2023-11-20T06:42:44.898389+0000","last_peered":"2023-11-20T06:42:44.898389+0000","last_clean":"2023-11-20T06:42:44.898389+0000","last_became_active":"2023-11-20T06:42:43.924102+0000","last_became_peered":"2023-11-20T06:42:43.924102+0000","last_unstale":"2023-11-20T06:42:44.898389+0000","last_undegraded":"2023-11-20T06:42:44.898389+0000","last_fullsized":"2023-11-20T06:42:44.898389+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:41.809097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:45.049646+0000","last_change":"2023-11-20T06:42:42.903336+0000","last_active":"2023-11-20T06:42:45.049646+0000","last_peered":"2023-11-20T06:42:45.049646+0000","last_clean":"2023-11-20T06:42:45.049646+0000","last_became_active":"2023-11-20T06:42:42.903028+0000","last_became_peered":"2023-11-20T06:42:42.903028+0000","last_unstale":"2023-11-20T06:42:45.049646+0000","last_undegraded":"2023-11-20T06:42:45.049646+0000","last_fullsized":"2023-11-20T06:42:45.049646+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:09:13.000923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896479+0000","last_change":"2023-11-20T06:42:43.919741+0000","last_active":"2023-11-20T06:42:44.896479+0000","last_peered":"2023-11-20T06:42:44.896479+0000","last_clean":"2023-11-20T06:42:44.896479+0000","last_became_active":"2023-11-20T06:42:43.919429+0000","last_became_peered":"2023-11-20T06:42:43.919429+0000","last_unstale":"2023-11-20T06:42:44.896479+0000","last_undegraded":"2023-11-20T06:42:44.896479+0000","last_fullsized":"2023-11-20T06:42:44.896479+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:51:41.671459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.897881+0000","last_change":"2023-11-20T06:42:42.906826+0000","last_active":"2023-11-20T06:42:44.897881+0000","last_peered":"2023-11-20T06:42:44.897881+0000","last_clean":"2023-11-20T06:42:44.897881+0000","last_became_active":"2023-11-20T06:42:42.906160+0000","last_became_peered":"2023-11-20T06:42:42.906160+0000","last_unstale":"2023-11-20T06:42:44.897881+0000","last_undegraded":"2023-11-20T06:42:44.897881+0000","last_fullsized":"2023-11-20T06:42:44.897881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:00:03.880351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.265812+0000","last_change":"2023-11-20T06:42:43.910516+0000","last_active":"2023-11-20T06:42:46.265812+0000","last_peered":"2023-11-20T06:42:46.265812+0000","last_clean":"2023-11-20T06:42:46.265812+0000","last_became_active":"2023-11-20T06:42:43.910217+0000","last_became_peered":"2023-11-20T06:42:43.910217+0000","last_unstale":"2023-11-20T06:42:46.265812+0000","last_undegraded":"2023-11-20T06:42:46.265812+0000","last_fullsized":"2023-11-20T06:42:46.265812+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:12:50.200023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.053109+0000","last_change":"2023-11-20T06:42:42.905115+0000","last_active":"2023-11-20T06:42:46.053109+0000","last_peered":"2023-11-20T06:42:46.053109+0000","last_clean":"2023-11-20T06:42:46.053109+0000","last_became_active":"2023-11-20T06:42:42.904830+0000","last_became_peered":"2023-11-20T06:42:42.904830+0000","last_unstale":"2023-11-20T06:42:46.053109+0000","last_undegraded":"2023-11-20T06:42:46.053109+0000","last_fullsized":"2023-11-20T06:42:46.053109+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:22:49.871482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.052921+0000","last_change":"2023-11-20T06:42:43.896538+0000","last_active":"2023-11-20T06:42:46.052921+0000","last_peered":"2023-11-20T06:42:46.052921+0000","last_clean":"2023-11-20T06:42:46.052921+0000","last_became_active":"2023-11-20T06:42:43.896156+0000","last_became_peered":"2023-11-20T06:42:43.896156+0000","last_unstale":"2023-11-20T06:42:46.052921+0000","last_undegraded":"2023-11-20T06:42:46.052921+0000","last_fullsized":"2023-11-20T06:42:46.052921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:34:15.327764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266615+0000","last_change":"2023-11-20T06:42:42.909774+0000","last_active":"2023-11-20T06:42:46.266615+0000","last_peered":"2023-11-20T06:42:46.266615+0000","last_clean":"2023-11-20T06:42:46.266615+0000","last_became_active":"2023-11-20T06:42:42.909365+0000","last_became_peered":"2023-11-20T06:42:42.909365+0000","last_unstale":"2023-11-20T06:42:46.266615+0000","last_undegraded":"2023-11-20T06:42:46.266615+0000","last_fullsized":"2023-11-20T06:42:46.266615+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:50:12.621018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.897497+0000","last_change":"2023-11-20T06:42:43.912627+0000","last_active":"2023-11-20T06:42:44.897497+0000","last_peered":"2023-11-20T06:42:44.897497+0000","last_clean":"2023-11-20T06:42:44.897497+0000","last_became_active":"2023-11-20T06:42:43.912355+0000","last_became_peered":"2023-11-20T06:42:43.912355+0000","last_unstale":"2023-11-20T06:42:44.897497+0000","last_undegraded":"2023-11-20T06:42:44.897497+0000","last_fullsized":"2023-11-20T06:42:44.897497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:15:16.369236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:45.049264+0000","last_change":"2023-11-20T06:42:42.912698+0000","last_active":"2023-11-20T06:42:45.049264+0000","last_peered":"2023-11-20T06:42:45.049264+0000","last_clean":"2023-11-20T06:42:45.049264+0000","last_became_active":"2023-11-20T06:42:42.912409+0000","last_became_peered":"2023-11-20T06:42:42.912409+0000","last_unstale":"2023-11-20T06:42:45.049264+0000","last_undegraded":"2023-11-20T06:42:45.049264+0000","last_fullsized":"2023-11-20T06:42:45.049264+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:17:39.111557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896379+0000","last_change":"2023-11-20T06:42:43.912269+0000","last_active":"2023-11-20T06:42:44.896379+0000","last_peered":"2023-11-20T06:42:44.896379+0000","last_clean":"2023-11-20T06:42:44.896379+0000","last_became_active":"2023-11-20T06:42:43.911939+0000","last_became_peered":"2023-11-20T06:42:43.911939+0000","last_unstale":"2023-11-20T06:42:44.896379+0000","last_undegraded":"2023-11-20T06:42:44.896379+0000","last_fullsized":"2023-11-20T06:42:44.896379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:06:12.965023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.897108+0000","last_change":"2023-11-20T06:42:42.900227+0000","last_active":"2023-11-20T06:42:44.897108+0000","last_peered":"2023-11-20T06:42:44.897108+0000","last_clean":"2023-11-20T06:42:44.897108+0000","last_became_active":"2023-11-20T06:42:42.899712+0000","last_became_peered":"2023-11-20T06:42:42.899712+0000","last_unstale":"2023-11-20T06:42:44.897108+0000","last_undegraded":"2023-11-20T06:42:44.897108+0000","last_fullsized":"2023-11-20T06:42:44.897108+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:40:09.020401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.048867+0000","last_change":"2023-11-20T06:42:43.911258+0000","last_active":"2023-11-20T06:42:46.048867+0000","last_peered":"2023-11-20T06:42:46.048867+0000","last_clean":"2023-11-20T06:42:46.048867+0000","last_became_active":"2023-11-20T06:42:43.910634+0000","last_became_peered":"2023-11-20T06:42:43.910634+0000","last_unstale":"2023-11-20T06:42:46.048867+0000","last_undegraded":"2023-11-20T06:42:46.048867+0000","last_fullsized":"2023-11-20T06:42:46.048867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:21:53.147727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896524+0000","last_change":"2023-11-20T06:42:42.907903+0000","last_active":"2023-11-20T06:42:44.896524+0000","last_peered":"2023-11-20T06:42:44.896524+0000","last_clean":"2023-11-20T06:42:44.896524+0000","last_became_active":"2023-11-20T06:42:42.905727+0000","last_became_peered":"2023-11-20T06:42:42.905727+0000","last_unstale":"2023-11-20T06:42:44.896524+0000","last_undegraded":"2023-11-20T06:42:44.896524+0000","last_fullsized":"2023-11-20T06:42:44.896524+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:05:27.826700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266982+0000","last_change":"2023-11-20T06:42:43.918550+0000","last_active":"2023-11-20T06:42:46.266982+0000","last_peered":"2023-11-20T06:42:46.266982+0000","last_clean":"2023-11-20T06:42:46.266982+0000","last_became_active":"2023-11-20T06:42:43.918240+0000","last_became_peered":"2023-11-20T06:42:43.918240+0000","last_unstale":"2023-11-20T06:42:46.266982+0000","last_undegraded":"2023-11-20T06:42:46.266982+0000","last_fullsized":"2023-11-20T06:42:46.266982+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:01:23.985762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.053238+0000","last_change":"2023-11-20T06:42:42.907104+0000","last_active":"2023-11-20T06:42:46.053238+0000","last_peered":"2023-11-20T06:42:46.053238+0000","last_clean":"2023-11-20T06:42:46.053238+0000","last_became_active":"2023-11-20T06:42:42.906574+0000","last_became_peered":"2023-11-20T06:42:42.906574+0000","last_unstale":"2023-11-20T06:42:46.053238+0000","last_undegraded":"2023-11-20T06:42:46.053238+0000","last_fullsized":"2023-11-20T06:42:46.053238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:01:56.460088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266412+0000","last_change":"2023-11-20T06:42:43.908534+0000","last_active":"2023-11-20T06:42:46.266412+0000","last_peered":"2023-11-20T06:42:46.266412+0000","last_clean":"2023-11-20T06:42:46.266412+0000","last_became_active":"2023-11-20T06:42:43.908268+0000","last_became_peered":"2023-11-20T06:42:43.908268+0000","last_unstale":"2023-11-20T06:42:46.266412+0000","last_undegraded":"2023-11-20T06:42:46.266412+0000","last_fullsized":"2023-11-20T06:42:46.266412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:41.809097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.053225+0000","last_change":"2023-11-20T06:42:42.905278+0000","last_active":"2023-11-20T06:42:46.053225+0000","last_peered":"2023-11-20T06:42:46.053225+0000","last_clean":"2023-11-20T06:42:46.053225+0000","last_became_active":"2023-11-20T06:42:42.904162+0000","last_became_peered":"2023-11-20T06:42:42.904162+0000","last_unstale":"2023-11-20T06:42:46.053225+0000","last_undegraded":"2023-11-20T06:42:46.053225+0000","last_fullsized":"2023-11-20T06:42:46.053225+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:36:57.847833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.898470+0000","last_change":"2023-11-20T06:42:43.909725+0000","last_active":"2023-11-20T06:42:44.898470+0000","last_peered":"2023-11-20T06:42:44.898470+0000","last_clean":"2023-11-20T06:42:44.898470+0000","last_became_active":"2023-11-20T06:42:43.909404+0000","last_became_peered":"2023-11-20T06:42:43.909404+0000","last_unstale":"2023-11-20T06:42:44.898470+0000","last_undegraded":"2023-11-20T06:42:44.898470+0000","last_fullsized":"2023-11-20T06:42:44.898470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:22:13.710252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896341+0000","last_change":"2023-11-20T06:42:42.901285+0000","last_active":"2023-11-20T06:42:44.896341+0000","last_peered":"2023-11-20T06:42:44.896341+0000","last_clean":"2023-11-20T06:42:44.896341+0000","last_became_active":"2023-11-20T06:42:42.901007+0000","last_became_peered":"2023-11-20T06:42:42.901007+0000","last_unstale":"2023-11-20T06:42:44.896341+0000","last_undegraded":"2023-11-20T06:42:44.896341+0000","last_fullsized":"2023-11-20T06:42:44.896341+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:39:10.679351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.265845+0000","last_change":"2023-11-20T06:42:43.906703+0000","last_active":"2023-11-20T06:42:46.265845+0000","last_peered":"2023-11-20T06:42:46.265845+0000","last_clean":"2023-11-20T06:42:46.265845+0000","last_became_active":"2023-11-20T06:42:43.906256+0000","last_became_peered":"2023-11-20T06:42:43.906256+0000","last_unstale":"2023-11-20T06:42:46.265845+0000","last_undegraded":"2023-11-20T06:42:46.265845+0000","last_fullsized":"2023-11-20T06:42:46.265845+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:22:50.879248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896301+0000","last_change":"2023-11-20T06:42:42.904413+0000","last_active":"2023-11-20T06:42:44.896301+0000","last_peered":"2023-11-20T06:42:44.896301+0000","last_clean":"2023-11-20T06:42:44.896301+0000","last_became_active":"2023-11-20T06:42:42.904078+0000","last_became_peered":"2023-11-20T06:42:42.904078+0000","last_unstale":"2023-11-20T06:42:44.896301+0000","last_undegraded":"2023-11-20T06:42:44.896301+0000","last_fullsized":"2023-11-20T06:42:44.896301+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:22:12.702486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896049+0000","last_change":"2023-11-20T06:42:43.902115+0000","last_active":"2023-11-20T06:42:44.896049+0000","last_peered":"2023-11-20T06:42:44.896049+0000","last_clean":"2023-11-20T06:42:44.896049+0000","last_became_active":"2023-11-20T06:42:43.901831+0000","last_became_peered":"2023-11-20T06:42:43.901831+0000","last_unstale":"2023-11-20T06:42:44.896049+0000","last_undegraded":"2023-11-20T06:42:44.896049+0000","last_fullsized":"2023-11-20T06:42:44.896049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:34:18.136432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:45.049344+0000","last_change":"2023-11-20T06:42:42.912708+0000","last_active":"2023-11-20T06:42:45.049344+0000","last_peered":"2023-11-20T06:42:45.049344+0000","last_clean":"2023-11-20T06:42:45.049344+0000","last_became_active":"2023-11-20T06:42:42.912396+0000","last_became_peered":"2023-11-20T06:42:42.912396+0000","last_unstale":"2023-11-20T06:42:45.049344+0000","last_undegraded":"2023-11-20T06:42:45.049344+0000","last_fullsized":"2023-11-20T06:42:45.049344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:41:53.444467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266680+0000","last_change":"2023-11-20T06:42:43.907149+0000","last_active":"2023-11-20T06:42:46.266680+0000","last_peered":"2023-11-20T06:42:46.266680+0000","last_clean":"2023-11-20T06:42:46.266680+0000","last_became_active":"2023-11-20T06:42:43.906781+0000","last_became_peered":"2023-11-20T06:42:43.906781+0000","last_unstale":"2023-11-20T06:42:46.266680+0000","last_undegraded":"2023-11-20T06:42:46.266680+0000","last_fullsized":"2023-11-20T06:42:46.266680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:15:16.369236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.898132+0000","last_change":"2023-11-20T06:42:42.901762+0000","last_active":"2023-11-20T06:42:44.898132+0000","last_peered":"2023-11-20T06:42:44.898132+0000","last_clean":"2023-11-20T06:42:44.898132+0000","last_became_active":"2023-11-20T06:42:42.901399+0000","last_became_peered":"2023-11-20T06:42:42.901399+0000","last_unstale":"2023-11-20T06:42:44.898132+0000","last_undegraded":"2023-11-20T06:42:44.898132+0000","last_fullsized":"2023-11-20T06:42:44.898132+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:37:16.467932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896250+0000","last_change":"2023-11-20T06:42:43.901538+0000","last_active":"2023-11-20T06:42:44.896250+0000","last_peered":"2023-11-20T06:42:44.896250+0000","last_clean":"2023-11-20T06:42:44.896250+0000","last_became_active":"2023-11-20T06:42:43.901261+0000","last_became_peered":"2023-11-20T06:42:43.901261+0000","last_unstale":"2023-11-20T06:42:44.896250+0000","last_undegraded":"2023-11-20T06:42:44.896250+0000","last_fullsized":"2023-11-20T06:42:44.896250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T06:48:42.488613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266479+0000","last_change":"2023-11-20T06:42:42.903367+0000","last_active":"2023-11-20T06:42:46.266479+0000","last_peered":"2023-11-20T06:42:46.266479+0000","last_clean":"2023-11-20T06:42:46.266479+0000","last_became_active":"2023-11-20T06:42:42.903051+0000","last_became_peered":"2023-11-20T06:42:42.903051+0000","last_unstale":"2023-11-20T06:42:46.266479+0000","last_undegraded":"2023-11-20T06:42:46.266479+0000","last_fullsized":"2023-11-20T06:42:46.266479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:59:42.149714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896248+0000","last_change":"2023-11-20T06:42:43.916441+0000","last_active":"2023-11-20T06:42:44.896248+0000","last_peered":"2023-11-20T06:42:44.896248+0000","last_clean":"2023-11-20T06:42:44.896248+0000","last_became_active":"2023-11-20T06:42:43.916151+0000","last_became_peered":"2023-11-20T06:42:43.916151+0000","last_unstale":"2023-11-20T06:42:44.896248+0000","last_undegraded":"2023-11-20T06:42:44.896248+0000","last_fullsized":"2023-11-20T06:42:44.896248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:54:14.515508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.053346+0000","last_change":"2023-11-20T06:42:42.904635+0000","last_active":"2023-11-20T06:42:46.053346+0000","last_peered":"2023-11-20T06:42:46.053346+0000","last_clean":"2023-11-20T06:42:46.053346+0000","last_became_active":"2023-11-20T06:42:42.904355+0000","last_became_peered":"2023-11-20T06:42:42.904355+0000","last_unstale":"2023-11-20T06:42:46.053346+0000","last_undegraded":"2023-11-20T06:42:46.053346+0000","last_fullsized":"2023-11-20T06:42:46.053346+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:15:15.361470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.053183+0000","last_change":"2023-11-20T06:42:43.911340+0000","last_active":"2023-11-20T06:42:46.053183+0000","last_peered":"2023-11-20T06:42:46.053183+0000","last_clean":"2023-11-20T06:42:46.053183+0000","last_became_active":"2023-11-20T06:42:43.910978+0000","last_became_peered":"2023-11-20T06:42:43.910978+0000","last_unstale":"2023-11-20T06:42:46.053183+0000","last_undegraded":"2023-11-20T06:42:46.053183+0000","last_fullsized":"2023-11-20T06:42:46.053183+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:35:14.101013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.898407+0000","last_change":"2023-11-20T06:42:42.899797+0000","last_active":"2023-11-20T06:42:44.898407+0000","last_peered":"2023-11-20T06:42:44.898407+0000","last_clean":"2023-11-20T06:42:44.898407+0000","last_became_active":"2023-11-20T06:42:42.899495+0000","last_became_peered":"2023-11-20T06:42:42.899495+0000","last_unstale":"2023-11-20T06:42:44.898407+0000","last_undegraded":"2023-11-20T06:42:44.898407+0000","last_fullsized":"2023-11-20T06:42:44.898407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:09:13.000923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.898193+0000","last_change":"2023-11-20T06:42:43.913515+0000","last_active":"2023-11-20T06:42:44.898193+0000","last_peered":"2023-11-20T06:42:44.898193+0000","last_clean":"2023-11-20T06:42:44.898193+0000","last_became_active":"2023-11-20T06:42:43.913236+0000","last_became_peered":"2023-11-20T06:42:43.913236+0000","last_unstale":"2023-11-20T06:42:44.898193+0000","last_undegraded":"2023-11-20T06:42:44.898193+0000","last_fullsized":"2023-11-20T06:42:44.898193+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:40:18.592085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.049087+0000","last_change":"2023-11-20T06:42:42.899044+0000","last_active":"2023-11-20T06:42:46.049087+0000","last_peered":"2023-11-20T06:42:46.049087+0000","last_clean":"2023-11-20T06:42:46.049087+0000","last_became_active":"2023-11-20T06:42:42.898775+0000","last_became_peered":"2023-11-20T06:42:42.898775+0000","last_unstale":"2023-11-20T06:42:46.049087+0000","last_undegraded":"2023-11-20T06:42:46.049087+0000","last_fullsized":"2023-11-20T06:42:46.049087+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:38:31.807722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.049185+0000","last_change":"2023-11-20T06:42:43.900806+0000","last_active":"2023-11-20T06:42:46.049185+0000","last_peered":"2023-11-20T06:42:46.049185+0000","last_clean":"2023-11-20T06:42:46.049185+0000","last_became_active":"2023-11-20T06:42:43.900386+0000","last_became_peered":"2023-11-20T06:42:43.900386+0000","last_unstale":"2023-11-20T06:42:46.049185+0000","last_undegraded":"2023-11-20T06:42:46.049185+0000","last_fullsized":"2023-11-20T06:42:46.049185+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:11:29.365535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:45.049439+0000","last_change":"2023-11-20T06:42:42.903558+0000","last_active":"2023-11-20T06:42:45.049439+0000","last_peered":"2023-11-20T06:42:45.049439+0000","last_clean":"2023-11-20T06:42:45.049439+0000","last_became_active":"2023-11-20T06:42:42.903293+0000","last_became_peered":"2023-11-20T06:42:42.903293+0000","last_unstale":"2023-11-20T06:42:45.049439+0000","last_undegraded":"2023-11-20T06:42:45.049439+0000","last_fullsized":"2023-11-20T06:42:45.049439+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:40:09.020401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266748+0000","last_change":"2023-11-20T06:42:43.914110+0000","last_active":"2023-11-20T06:42:46.266748+0000","last_peered":"2023-11-20T06:42:46.266748+0000","last_clean":"2023-11-20T06:42:46.266748+0000","last_became_active":"2023-11-20T06:42:43.909920+0000","last_became_peered":"2023-11-20T06:42:43.909920+0000","last_unstale":"2023-11-20T06:42:46.266748+0000","last_undegraded":"2023-11-20T06:42:46.266748+0000","last_fullsized":"2023-11-20T06:42:46.266748+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:41.809097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.048782+0000","last_change":"2023-11-20T06:42:42.905039+0000","last_active":"2023-11-20T06:42:46.048782+0000","last_peered":"2023-11-20T06:42:46.048782+0000","last_clean":"2023-11-20T06:42:46.048782+0000","last_became_active":"2023-11-20T06:42:42.904766+0000","last_became_peered":"2023-11-20T06:42:42.904766+0000","last_unstale":"2023-11-20T06:42:46.048782+0000","last_undegraded":"2023-11-20T06:42:46.048782+0000","last_fullsized":"2023-11-20T06:42:46.048782+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:51:01.041001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.265970+0000","last_change":"2023-11-20T06:42:43.909975+0000","last_active":"2023-11-20T06:42:46.265970+0000","last_peered":"2023-11-20T06:42:46.265970+0000","last_clean":"2023-11-20T06:42:46.265970+0000","last_became_active":"2023-11-20T06:42:43.909670+0000","last_became_peered":"2023-11-20T06:42:43.909670+0000","last_unstale":"2023-11-20T06:42:46.265970+0000","last_undegraded":"2023-11-20T06:42:46.265970+0000","last_fullsized":"2023-11-20T06:42:46.265970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:01:57.467854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.048717+0000","last_change":"2023-11-20T06:42:42.898340+0000","last_active":"2023-11-20T06:42:46.048717+0000","last_peered":"2023-11-20T06:42:46.048717+0000","last_clean":"2023-11-20T06:42:46.048717+0000","last_became_active":"2023-11-20T06:42:42.898041+0000","last_became_peered":"2023-11-20T06:42:42.898041+0000","last_unstale":"2023-11-20T06:42:46.048717+0000","last_undegraded":"2023-11-20T06:42:46.048717+0000","last_fullsized":"2023-11-20T06:42:46.048717+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:24:44.902607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.053031+0000","last_change":"2023-11-20T06:42:43.920307+0000","last_active":"2023-11-20T06:42:46.053031+0000","last_peered":"2023-11-20T06:42:46.053031+0000","last_clean":"2023-11-20T06:42:46.053031+0000","last_became_active":"2023-11-20T06:42:43.919982+0000","last_became_peered":"2023-11-20T06:42:43.919982+0000","last_unstale":"2023-11-20T06:42:46.053031+0000","last_undegraded":"2023-11-20T06:42:46.053031+0000","last_fullsized":"2023-11-20T06:42:46.053031+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:24:23.684617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266863+0000","last_change":"2023-11-20T06:42:42.911534+0000","last_active":"2023-11-20T06:42:46.266863+0000","last_peered":"2023-11-20T06:42:46.266863+0000","last_clean":"2023-11-20T06:42:46.266863+0000","last_became_active":"2023-11-20T06:42:42.911194+0000","last_became_peered":"2023-11-20T06:42:42.911194+0000","last_unstale":"2023-11-20T06:42:46.266863+0000","last_undegraded":"2023-11-20T06:42:46.266863+0000","last_fullsized":"2023-11-20T06:42:46.266863+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:04:46.596902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896129+0000","last_change":"2023-11-20T06:42:43.911850+0000","last_active":"2023-11-20T06:42:44.896129+0000","last_peered":"2023-11-20T06:42:44.896129+0000","last_clean":"2023-11-20T06:42:44.896129+0000","last_became_active":"2023-11-20T06:42:43.911440+0000","last_became_peered":"2023-11-20T06:42:43.911440+0000","last_unstale":"2023-11-20T06:42:44.896129+0000","last_undegraded":"2023-11-20T06:42:44.896129+0000","last_fullsized":"2023-11-20T06:42:44.896129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:35:14.101013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.048563+0000","last_change":"2023-11-20T06:42:42.902573+0000","last_active":"2023-11-20T06:42:46.048563+0000","last_peered":"2023-11-20T06:42:46.048563+0000","last_clean":"2023-11-20T06:42:46.048563+0000","last_became_active":"2023-11-20T06:42:42.902263+0000","last_became_peered":"2023-11-20T06:42:42.902263+0000","last_unstale":"2023-11-20T06:42:46.048563+0000","last_undegraded":"2023-11-20T06:42:46.048563+0000","last_fullsized":"2023-11-20T06:42:46.048563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:35:07.354458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:45.049499+0000","last_change":"2023-11-20T06:42:43.900556+0000","last_active":"2023-11-20T06:42:45.049499+0000","last_peered":"2023-11-20T06:42:45.049499+0000","last_clean":"2023-11-20T06:42:45.049499+0000","last_became_active":"2023-11-20T06:42:43.900318+0000","last_became_peered":"2023-11-20T06:42:43.900318+0000","last_unstale":"2023-11-20T06:42:45.049499+0000","last_undegraded":"2023-11-20T06:42:45.049499+0000","last_fullsized":"2023-11-20T06:42:45.049499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:01:57.467854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.053445+0000","last_change":"2023-11-20T06:42:42.904340+0000","last_active":"2023-11-20T06:42:46.053445+0000","last_peered":"2023-11-20T06:42:46.053445+0000","last_clean":"2023-11-20T06:42:46.053445+0000","last_became_active":"2023-11-20T06:42:42.904023+0000","last_became_peered":"2023-11-20T06:42:42.904023+0000","last_unstale":"2023-11-20T06:42:46.053445+0000","last_undegraded":"2023-11-20T06:42:46.053445+0000","last_fullsized":"2023-11-20T06:42:46.053445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:40:17.584319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.267034+0000","last_change":"2023-11-20T06:42:43.918357+0000","last_active":"2023-11-20T06:42:46.267034+0000","last_peered":"2023-11-20T06:42:46.267034+0000","last_clean":"2023-11-20T06:42:46.267034+0000","last_became_active":"2023-11-20T06:42:43.918011+0000","last_became_peered":"2023-11-20T06:42:43.918011+0000","last_unstale":"2023-11-20T06:42:46.267034+0000","last_undegraded":"2023-11-20T06:42:46.267034+0000","last_fullsized":"2023-11-20T06:42:46.267034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:34:15.327764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.051364+0000","last_change":"2023-11-20T06:42:42.897130+0000","last_active":"2023-11-20T06:42:46.051364+0000","last_peered":"2023-11-20T06:42:46.051364+0000","last_clean":"2023-11-20T06:42:46.051364+0000","last_became_active":"2023-11-20T06:42:42.896861+0000","last_became_peered":"2023-11-20T06:42:42.896861+0000","last_unstale":"2023-11-20T06:42:46.051364+0000","last_undegraded":"2023-11-20T06:42:46.051364+0000","last_fullsized":"2023-11-20T06:42:46.051364+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:52:12.715680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.896248+0000","last_change":"2023-11-20T06:42:43.913996+0000","last_active":"2023-11-20T06:42:44.896248+0000","last_peered":"2023-11-20T06:42:44.896248+0000","last_clean":"2023-11-20T06:42:44.896248+0000","last_became_active":"2023-11-20T06:42:43.913702+0000","last_became_peered":"2023-11-20T06:42:43.913702+0000","last_unstale":"2023-11-20T06:42:44.896248+0000","last_undegraded":"2023-11-20T06:42:44.896248+0000","last_fullsized":"2023-11-20T06:42:44.896248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:11:38.361542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266323+0000","last_change":"2023-11-20T06:42:42.904666+0000","last_active":"2023-11-20T06:42:46.266323+0000","last_peered":"2023-11-20T06:42:46.266323+0000","last_clean":"2023-11-20T06:42:46.266323+0000","last_became_active":"2023-11-20T06:42:42.904399+0000","last_became_peered":"2023-11-20T06:42:42.904399+0000","last_unstale":"2023-11-20T06:42:46.266323+0000","last_undegraded":"2023-11-20T06:42:46.266323+0000","last_fullsized":"2023-11-20T06:42:46.266323+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:09:56.576602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.265969+0000","last_change":"2023-11-20T06:42:43.901983+0000","last_active":"2023-11-20T06:42:46.265969+0000","last_peered":"2023-11-20T06:42:46.265969+0000","last_clean":"2023-11-20T06:42:46.265969+0000","last_became_active":"2023-11-20T06:42:43.898706+0000","last_became_peered":"2023-11-20T06:42:43.898706+0000","last_unstale":"2023-11-20T06:42:46.265969+0000","last_undegraded":"2023-11-20T06:42:46.265969+0000","last_fullsized":"2023-11-20T06:42:46.265969+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:36:58.855599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266325+0000","last_change":"2023-11-20T06:42:42.903417+0000","last_active":"2023-11-20T06:42:46.266325+0000","last_peered":"2023-11-20T06:42:46.266325+0000","last_clean":"2023-11-20T06:42:46.266325+0000","last_became_active":"2023-11-20T06:42:42.902364+0000","last_became_peered":"2023-11-20T06:42:42.902364+0000","last_unstale":"2023-11-20T06:42:46.266325+0000","last_undegraded":"2023-11-20T06:42:46.266325+0000","last_fullsized":"2023-11-20T06:42:46.266325+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:09:13.000923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:45.049278+0000","last_change":"2023-11-20T06:42:43.913788+0000","last_active":"2023-11-20T06:42:45.049278+0000","last_peered":"2023-11-20T06:42:45.049278+0000","last_clean":"2023-11-20T06:42:45.049278+0000","last_became_active":"2023-11-20T06:42:43.913413+0000","last_became_peered":"2023-11-20T06:42:43.913413+0000","last_unstale":"2023-11-20T06:42:45.049278+0000","last_undegraded":"2023-11-20T06:42:45.049278+0000","last_fullsized":"2023-11-20T06:42:45.049278+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:36:58.855599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.898063+0000","last_change":"2023-11-20T06:42:42.906300+0000","last_active":"2023-11-20T06:42:44.898063+0000","last_peered":"2023-11-20T06:42:44.898063+0000","last_clean":"2023-11-20T06:42:44.898063+0000","last_became_active":"2023-11-20T06:42:42.905557+0000","last_became_peered":"2023-11-20T06:42:42.905557+0000","last_unstale":"2023-11-20T06:42:44.898063+0000","last_undegraded":"2023-11-20T06:42:44.898063+0000","last_fullsized":"2023-11-20T06:42:44.898063+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:53:10.985177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.897369+0000","last_change":"2023-11-20T06:42:43.917026+0000","last_active":"2023-11-20T06:42:44.897369+0000","last_peered":"2023-11-20T06:42:44.897369+0000","last_clean":"2023-11-20T06:42:44.897369+0000","last_became_active":"2023-11-20T06:42:43.916671+0000","last_became_peered":"2023-11-20T06:42:43.916671+0000","last_unstale":"2023-11-20T06:42:44.897369+0000","last_undegraded":"2023-11-20T06:42:44.897369+0000","last_fullsized":"2023-11-20T06:42:44.897369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:36:58.855599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.897193+0000","last_change":"2023-11-20T06:42:42.907872+0000","last_active":"2023-11-20T06:42:44.897193+0000","last_peered":"2023-11-20T06:42:44.897193+0000","last_clean":"2023-11-20T06:42:44.897193+0000","last_became_active":"2023-11-20T06:42:42.907570+0000","last_became_peered":"2023-11-20T06:42:42.907570+0000","last_unstale":"2023-11-20T06:42:44.897193+0000","last_undegraded":"2023-11-20T06:42:44.897193+0000","last_fullsized":"2023-11-20T06:42:44.897193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:17:39.111557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.267026+0000","last_change":"2023-11-20T06:42:43.918452+0000","last_active":"2023-11-20T06:42:46.267026+0000","last_peered":"2023-11-20T06:42:46.267026+0000","last_clean":"2023-11-20T06:42:46.267026+0000","last_became_active":"2023-11-20T06:42:43.918099+0000","last_became_peered":"2023-11-20T06:42:43.918099+0000","last_unstale":"2023-11-20T06:42:46.267026+0000","last_undegraded":"2023-11-20T06:42:46.267026+0000","last_fullsized":"2023-11-20T06:42:46.267026+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:39:11.687117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:44.895973+0000","last_change":"2023-11-20T06:42:42.905882+0000","last_active":"2023-11-20T06:42:44.895973+0000","last_peered":"2023-11-20T06:42:44.895973+0000","last_clean":"2023-11-20T06:42:44.895973+0000","last_became_active":"2023-11-20T06:42:42.904844+0000","last_became_peered":"2023-11-20T06:42:42.904844+0000","last_unstale":"2023-11-20T06:42:44.895973+0000","last_undegraded":"2023-11-20T06:42:44.895973+0000","last_fullsized":"2023-11-20T06:42:44.895973+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:51:56.691831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.053309+0000","last_change":"2023-11-20T06:42:43.906735+0000","last_active":"2023-11-20T06:42:46.053309+0000","last_peered":"2023-11-20T06:42:46.053309+0000","last_clean":"2023-11-20T06:42:46.053309+0000","last_became_active":"2023-11-20T06:42:43.906416+0000","last_became_peered":"2023-11-20T06:42:43.906416+0000","last_unstale":"2023-11-20T06:42:46.053309+0000","last_undegraded":"2023-11-20T06:42:46.053309+0000","last_fullsized":"2023-11-20T06:42:46.053309+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:42.872217+0000","last_clean_scrub_stamp":"2023-11-20T06:42:42.872217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:38:13.367906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-20T06:42:46.266945+0000","last_change":"2023-11-20T06:42:42.911467+0000","last_active":"2023-11-20T06:42:46.266945+0000","last_peered":"2023-11-20T06:42:46.266945+0000","last_clean":"2023-11-20T06:42:46.266945+0000","last_became_active":"2023-11-20T06:42:42.911054+0000","last_became_peered":"2023-11-20T06:42:42.911054+0000","last_unstale":"2023-11-20T06:42:46.266945+0000","last_undegraded":"2023-11-20T06:42:46.266945+0000","last_fullsized":"2023-11-20T06:42:46.266945+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:42:41.864451+0000","last_clean_scrub_stamp":"2023-11-20T06:42:41.864451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:09:13.000923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T06:42:43.900956+0000","last_change":"2023-11-20T06:41:03.783345+0000","last_active":"2023-11-20T06:42:43.900956+0000","last_peered":"2023-11-20T06:42:43.900956+0000","last_clean":"2023-11-20T06:42:43.900956+0000","last_became_active":"2023-11-20T06:41:03.782257+0000","last_became_peered":"2023-11-20T06:41:03.782257+0000","last_unstale":"2023-11-20T06:42:43.900956+0000","last_undegraded":"2023-11-20T06:42:43.900956+0000","last_fullsized":"2023-11-20T06:42:43.900956+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:01.979090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:01.979090+0000","last_clean_scrub_stamp":"2023-11-20T06:41:01.979090+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:20:41.084382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":781671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.505},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.73599999999999999}]},{"osd":1,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.64900000000000002}]},{"osd":2,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.624},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.61199999999999999}]},{"osd":3,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":2,"5min":2,"15min":2},"last":0.67800000000000005}]},{"osd":4,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.41799999999999998}]},{"osd":5,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.59899999999999998}]},{"osd":6,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.55100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":196823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":0.80800000000000005}]},{"osd":1,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.70299999999999996}]},{"osd":2,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.64900000000000002}]},{"osd":3,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.745},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":4.3029999999999999,"5min":4.3029999999999999,"15min":4.3029999999999999},"last":0.623}]},{"osd":4,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.439},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.77900000000000003}]},{"osd":7,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.72599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":446464,"data_stored":189733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":4.7450000000000001,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.69299999999999995}]},{"osd":1,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.748},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.65700000000000003}]},{"osd":2,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":0.71299999999999997}]},{"osd":3,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":8.9250000000000007,"5min":8.9250000000000007,"15min":8.9250000000000007},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":8.891,"5min":8.891,"15min":8.891},"last":0.58099999999999996}]},{"osd":4,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.47799999999999998}]},{"osd":6,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.67300000000000004}]},{"osd":7,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.63900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":196845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.71899999999999997}]},{"osd":1,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":4.8710000000000004,"5min":4.8710000000000004,"15min":4.8710000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.76800000000000002}]},{"osd":2,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":4.8499999999999996,"5min":4.8499999999999996,"15min":4.8499999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.61699999999999999}]},{"osd":3,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.83299999999999996}]},{"osd":6,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.79400000000000004}]},{"osd":7,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.73899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":197887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":3.714,"5min":3.714,"15min":3.714},"last":0.373},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56299999999999994}]},{"osd":1,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":3.8330000000000002,"5min":3.8330000000000002,"15min":3.8330000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.7629999999999999,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":0.58499999999999996}]},{"osd":2,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.0709999999999997,"5min":4.0709999999999997,"15min":4.0709999999999997},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.52900000000000003}]},{"osd":4,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.9169999999999998,"5min":3.9169999999999998,"15min":3.9169999999999998},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.2069999999999999,"5min":4.2069999999999999,"15min":4.2069999999999999},"last":0.80900000000000005}]},{"osd":5,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.879},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.752}]},{"osd":6,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":4.3659999999999997,"5min":4.3659999999999997,"15min":4.3659999999999997},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.86199999999999999}]},{"osd":7,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":3.9700000000000002,"5min":3.9700000000000002,"15min":3.9700000000000002},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":0.89900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":442368,"data_stored":189691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.55100000000000005}]},{"osd":1,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.47299999999999998}]},{"osd":3,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.51800000000000002}]},{"osd":4,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.752},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.86099999999999999}]},{"osd":5,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.88},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.84299999999999997}]},{"osd":6,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.77300000000000002}]},{"osd":7,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.82399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":196331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.44}]},{"osd":2,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.47799999999999998}]},{"osd":3,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.46100000000000002}]},{"osd":4,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.78400000000000003}]},{"osd":5,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.64800000000000002}]},{"osd":6,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.76100000000000001}]},{"osd":7,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.70499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1032192,"data_stored":779004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.32900000000000001}]},{"osd":2,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.625,"5min":2.625,"15min":2.625},"last":0.307},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.439}]},{"osd":3,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.6669999999999998,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":0.51100000000000001}]},{"osd":4,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.82899999999999996}]},{"osd":5,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":3.0550000000000002,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.74099999999999999}]},{"osd":6,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.76000000000000001}]},{"osd":7,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.71399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T06:42:48.748 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-20T06:42:48.748 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-20T06:42:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.935+0000 7f6c3c594640 1 Processor -- start 2023-11-20T06:42:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.935+0000 7f6c3c594640 1 -- start start 2023-11-20T06:42:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.935+0000 7f6c3c594640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6c3415ade0 0x7f6c3406c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.935+0000 7f6c3c594640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6c3406cba0 0x7f6c34069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.935+0000 7f6c3c594640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c3415e5e0 con 0x7f6c3406dbd0 2023-11-20T06:42:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.935+0000 7f6c3c594640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c3415b570 con 0x7f6c3415ade0 2023-11-20T06:42:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.935+0000 7f6c3c594640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c3415b850 con 0x7f6c3406cba0 2023-11-20T06:42:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.935+0000 7f6c39b2f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6c3415ade0 0x7f6c3406c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.935+0000 7f6c39b2f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6c3415ade0 0x7f6c3406c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36528/0 (socket says 172.21.15.19:36528) 2023-11-20T06:42:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.935+0000 7f6c39b2f640 1 -- 172.21.15.19:0/3527944060 learned_addr learned my addr 172.21.15.19:0/3527944060 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.935+0000 7f6c3ab31640 1 --2- 172.21.15.19:0/3527944060 >> v2:172.21.15.190:3300/0 conn(0x7f6c3406cba0 0x7f6c34069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.935+0000 7f6c39b2f640 1 -- 172.21.15.19:0/3527944060 >> v2:172.21.15.190:3300/0 conn(0x7f6c3406cba0 msgr2=0x7f6c34069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.935+0000 7f6c39b2f640 1 --2- 172.21.15.19:0/3527944060 >> v2:172.21.15.190:3300/0 conn(0x7f6c3406cba0 0x7f6c34069e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.935+0000 7f6c39b2f640 1 -- 172.21.15.19:0/3527944060 >> v1:172.21.15.19:6789/0 conn(0x7f6c3406dbd0 legacy=0x7f6c340c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:48.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.935+0000 7f6c39b2f640 1 -- 172.21.15.19:0/3527944060 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3415bb30 con 0x7f6c3415ade0 2023-11-20T06:42:48.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.939+0000 7f6c39b2f640 1 --2- 172.21.15.19:0/3527944060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c3415ade0 0x7f6c3406c660 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6c3406e7e0 tx=0x7f6c2401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7e450805d5d8cc server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:48.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.939+0000 7f6c3932e640 1 -- 172.21.15.19:0/3527944060 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24004230 con 0x7f6c3415ade0 2023-11-20T06:42:48.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.939+0000 7f6c3932e640 1 -- 172.21.15.19:0/3527944060 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c240a7050 con 0x7f6c3415ade0 2023-11-20T06:42:48.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.939+0000 7f6c3932e640 1 -- 172.21.15.19:0/3527944060 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24003620 con 0x7f6c3415ade0 2023-11-20T06:42:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.939+0000 7f6c3c594640 1 -- 172.21.15.19:0/3527944060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c3415ade0 msgr2=0x7f6c3406c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.939+0000 7f6c3c594640 1 --2- 172.21.15.19:0/3527944060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c3415ade0 0x7f6c3406c660 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6c3406e7e0 tx=0x7f6c2401c440 comp rx=0 tx=0).stop 2023-11-20T06:42:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.939+0000 7f6c3c594640 1 -- 172.21.15.19:0/3527944060 shutdown_connections 2023-11-20T06:42:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.939+0000 7f6c3c594640 1 --2- 172.21.15.19:0/3527944060 >> v2:172.21.15.190:3300/0 conn(0x7f6c3406cba0 0x7f6c34069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.939+0000 7f6c3c594640 1 --2- 172.21.15.19:0/3527944060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c3415ade0 0x7f6c3406c660 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.939+0000 7f6c3c594640 1 -- 172.21.15.19:0/3527944060 >> 172.21.15.19:0/3527944060 conn(0x7f6c340b0d10 msgr2=0x7f6c340ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.939+0000 7f6c3c594640 1 -- 172.21.15.19:0/3527944060 shutdown_connections 2023-11-20T06:42:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.939+0000 7f6c3c594640 1 -- 172.21.15.19:0/3527944060 wait complete. 2023-11-20T06:42:48.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3c594640 1 Processor -- start 2023-11-20T06:42:48.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3c594640 1 -- start start 2023-11-20T06:42:48.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3c594640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c3406cba0 0x7f6c341498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:48.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3c594640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c3406dbd0 0x7f6c340adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:48.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3c594640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c3415ade0 0x7f6c34152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:48.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3c594640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340b01a0 con 0x7f6c3415ade0 2023-11-20T06:42:48.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3c594640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340af6d0 con 0x7f6c3406dbd0 2023-11-20T06:42:48.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3c594640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340aba90 con 0x7f6c3406cba0 2023-11-20T06:42:48.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3ab31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c3415ade0 0x7f6c34152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:48.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3ab31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c3415ade0 0x7f6c34152790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36538/0 (socket says 172.21.15.19:36538) 2023-11-20T06:42:48.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3ab31640 1 -- 172.21.15.19:0/3454703564 learned_addr learned my addr 172.21.15.19:0/3454703564 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:48.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3a330640 1 --2- 172.21.15.19:0/3454703564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c3406cba0 0x7f6c341498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:48.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c39b2f640 1 --2- 172.21.15.19:0/3454703564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c3406dbd0 0x7f6c340adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:48.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3ab31640 1 -- 172.21.15.19:0/3454703564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c3406cba0 msgr2=0x7f6c341498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:48.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3ab31640 1 --2- 172.21.15.19:0/3454703564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c3406cba0 0x7f6c341498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3ab31640 1 -- 172.21.15.19:0/3454703564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c3406dbd0 msgr2=0x7f6c340adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:48.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3ab31640 1 --2- 172.21.15.19:0/3454703564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c3406dbd0 0x7f6c340adaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:48.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3ab31640 1 -- 172.21.15.19:0/3454703564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c240094d0 con 0x7f6c3415ade0 2023-11-20T06:42:48.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3ab31640 1 --2- 172.21.15.19:0/3454703564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c3415ade0 0x7f6c34152790 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c007e70 tx=0x7f6c2c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:48.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c2affd640 1 -- 172.21.15.19:0/3454703564 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c014620 con 0x7f6c3415ade0 2023-11-20T06:42:48.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c2affd640 1 -- 172.21.15.19:0/3454703564 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c0147a0 con 0x7f6c3415ade0 2023-11-20T06:42:48.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c2affd640 1 -- 172.21.15.19:0/3454703564 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c014b50 con 0x7f6c3415ade0 2023-11-20T06:42:48.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3c594640 1 -- 172.21.15.19:0/3454703564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c340af900 con 0x7f6c3415ade0 2023-11-20T06:42:48.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3c594640 1 -- 172.21.15.19:0/3454703564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c340afec0 con 0x7f6c3415ade0 2023-11-20T06:42:48.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.943+0000 7f6c3c594640 1 -- 172.21.15.19:0/3454703564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c340ab860 con 0x7f6c3415ade0 2023-11-20T06:42:48.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.947+0000 7f6c2affd640 1 -- 172.21.15.19:0/3454703564 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6c2c014cb0 con 0x7f6c3415ade0 2023-11-20T06:42:48.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.947+0000 7f6c2affd640 1 --2- 172.21.15.19:0/3454703564 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6c180664d0 0x7f6c18068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:48.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.947+0000 7f6c2affd640 1 -- 172.21.15.19:0/3454703564 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6c2c084880 con 0x7f6c3415ade0 2023-11-20T06:42:48.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.947+0000 7f6c3a330640 1 --2- 172.21.15.19:0/3454703564 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6c180664d0 0x7f6c18068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:48.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.947+0000 7f6c3a330640 1 --2- 172.21.15.19:0/3454703564 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6c180664d0 0x7f6c18068990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6c30007fd0 tx=0x7f6c30009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:48.951+0000 7f6c2affd640 1 -- 172.21.15.19:0/3454703564 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6c340ab860 con 0x7f6c3415ade0 2023-11-20T06:42:49.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.167+0000 7f6c3c594640 1 -- 172.21.15.19:0/3454703564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6c340abc00 con 0x7f6c3415ade0 2023-11-20T06:42:49.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.171+0000 7f6c2affd640 1 -- 172.21.15.19:0/3454703564 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f6c2c055660 con 0x7f6c3415ade0 2023-11-20T06:42:49.177 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2023-11-20T06:42:49.177 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBO/1plZE3cAxAAVTNRIC9TJrQlm6hYSU1RUQ== 2023-11-20T06:42:49.177 INFO:teuthology.orchestra.run.smithi019.stdout: caps mds = "allow" 2023-11-20T06:42:49.177 INFO:teuthology.orchestra.run.smithi019.stdout: caps mon = "allow r" 2023-11-20T06:42:49.177 INFO:teuthology.orchestra.run.smithi019.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-20T06:42:49.177 INFO:teuthology.orchestra.run.smithi019.stderr:updated caps for client.0 2023-11-20T06:42:49.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.175+0000 7f6c3c594640 1 -- 172.21.15.19:0/3454703564 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6c180664d0 msgr2=0x7f6c18068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:49.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.175+0000 7f6c3c594640 1 --2- 172.21.15.19:0/3454703564 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6c180664d0 0x7f6c18068990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6c30007fd0 tx=0x7f6c30009040 comp rx=0 tx=0).stop 2023-11-20T06:42:49.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.175+0000 7f6c3c594640 1 -- 172.21.15.19:0/3454703564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c3415ade0 msgr2=0x7f6c34152790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:49.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.175+0000 7f6c3c594640 1 --2- 172.21.15.19:0/3454703564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c3415ade0 0x7f6c34152790 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c007e70 tx=0x7f6c2c00e4b0 comp rx=0 tx=0).stop 2023-11-20T06:42:49.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.175+0000 7f6c3c594640 1 -- 172.21.15.19:0/3454703564 shutdown_connections 2023-11-20T06:42:49.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.175+0000 7f6c3c594640 1 --2- 172.21.15.19:0/3454703564 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f6c180664d0 0x7f6c18068990 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:49.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.175+0000 7f6c3c594640 1 --2- 172.21.15.19:0/3454703564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c3415ade0 0x7f6c34152790 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:49.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.175+0000 7f6c3c594640 1 --2- 172.21.15.19:0/3454703564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c3406dbd0 0x7f6c340adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:49.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.175+0000 7f6c3c594640 1 --2- 172.21.15.19:0/3454703564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c3406cba0 0x7f6c341498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:49.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.175+0000 7f6c3c594640 1 -- 172.21.15.19:0/3454703564 >> 172.21.15.19:0/3454703564 conn(0x7f6c340b0d10 msgr2=0x7f6c34154300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:49.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.175+0000 7f6c3c594640 1 -- 172.21.15.19:0/3454703564 shutdown_connections 2023-11-20T06:42:49.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.175+0000 7f6c3c594640 1 -- 172.21.15.19:0/3454703564 wait complete. 2023-11-20T06:42:49.199 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T06:42:49.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd6553d3640 1 Processor -- start 2023-11-20T06:42:49.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd6553d3640 1 -- start start 2023-11-20T06:42:49.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd6553d3640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd65015cb90 0x7fd6500cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:49.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd6553d3640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6500ce770 con 0x7fd6500d15d0 2023-11-20T06:42:49.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd6553d3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6500d0600 con 0x7fd6500d3010 2023-11-20T06:42:49.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd6553d3640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6500c6450 con 0x7fd65015cb90 2023-11-20T06:42:49.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64f7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd6500d15d0 0x7fd6500c6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59284/0 (socket says 172.21.15.19:59284) 2023-11-20T06:42:49.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64f7fe640 1 -- 172.21.15.19:0/3649716684 learned_addr learned my addr 172.21.15.19:0/3649716684 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:49.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64effd640 1 --2- 172.21.15.19:0/3649716684 >> v2:172.21.15.190:3300/0 conn(0x7fd65015cb90 0x7fd6500cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:49.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64e7fc640 1 -- 172.21.15.19:0/3649716684 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305893242 0 0) 0x7fd6500ce770 con 0x7fd6500d15d0 2023-11-20T06:42:49.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64e7fc640 1 -- 172.21.15.19:0/3649716684 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd63c003530 con 0x7fd6500d15d0 2023-11-20T06:42:49.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64e7fc640 1 -- 172.21.15.19:0/3649716684 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 974949422 0 0) 0x7fd63c003530 con 0x7fd6500d15d0 2023-11-20T06:42:49.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64e7fc640 1 -- 172.21.15.19:0/3649716684 >> v2:172.21.15.190:3300/0 conn(0x7fd65015cb90 msgr2=0x7fd6500cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:49.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64e7fc640 1 --2- 172.21.15.19:0/3649716684 >> v2:172.21.15.190:3300/0 conn(0x7fd65015cb90 0x7fd6500cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:49.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64e7fc640 1 -- 172.21.15.19:0/3649716684 >> v1:172.21.15.190:6789/0 conn(0x7fd6500d3010 legacy=0x7fd6500d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:49.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64e7fc640 1 -- 172.21.15.19:0/3649716684 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6500d08a0 con 0x7fd6500d15d0 2023-11-20T06:42:49.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64e7fc640 1 -- 172.21.15.19:0/3649716684 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7fd648001a20 con 0x7fd6500d15d0 2023-11-20T06:42:49.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64e7fc640 1 -- 172.21.15.19:0/3649716684 >> v1:172.21.15.19:6789/0 conn(0x7fd6500d15d0 legacy=0x7fd6500c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:49.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64e7fc640 1 --2- 172.21.15.19:0/3649716684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd63c003980 0x7fd63c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:49.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64e7fc640 1 --2- 172.21.15.19:0/3649716684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd63c0047d0 0x7fd63c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:49.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64e7fc640 1 --2- 172.21.15.19:0/3649716684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd63c005190 0x7fd63c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:49.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64e7fc640 1 -- 172.21.15.19:0/3649716684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6500c6450 con 0x7fd63c003980 2023-11-20T06:42:49.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64e7fc640 1 -- 172.21.15.19:0/3649716684 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c00c130 con 0x7fd63c005190 2023-11-20T06:42:49.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64e7fc640 1 -- 172.21.15.19:0/3649716684 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c00c2f0 con 0x7fd63c0047d0 2023-11-20T06:42:49.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64effd640 1 --2- 172.21.15.19:0/3649716684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd63c003980 0x7fd63c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:49.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64f7fe640 1 --2- 172.21.15.19:0/3649716684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd63c005190 0x7fd63c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:49.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd647fff640 1 --2- 172.21.15.19:0/3649716684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd63c0047d0 0x7fd63c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:49.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64effd640 1 -- 172.21.15.19:0/3649716684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd63c0047d0 msgr2=0x7fd63c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:49.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64effd640 1 --2- 172.21.15.19:0/3649716684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd63c0047d0 0x7fd63c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:49.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64effd640 1 -- 172.21.15.19:0/3649716684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd63c005190 msgr2=0x7fd63c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:49.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64effd640 1 --2- 172.21.15.19:0/3649716684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd63c005190 0x7fd63c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:49.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64effd640 1 -- 172.21.15.19:0/3649716684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c003530 con 0x7fd63c003980 2023-11-20T06:42:49.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64f7fe640 1 --2- 172.21.15.19:0/3649716684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd63c005190 0x7fd63c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:49.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.339+0000 7fd64f7fe640 1 -- 172.21.15.19:0/3649716684 reap_dead start 2023-11-20T06:42:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.343+0000 7fd64effd640 1 --2- 172.21.15.19:0/3649716684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd63c003980 0x7fd63c003da0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd640009ac0 tx=0x7fd64001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b3244379595ecd server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.343+0000 7fd64e7fc640 1 -- 172.21.15.19:0/3649716684 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6400059a0 con 0x7fd63c003980 2023-11-20T06:42:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.343+0000 7fd64e7fc640 1 -- 172.21.15.19:0/3649716684 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd640005b00 con 0x7fd63c003980 2023-11-20T06:42:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.343+0000 7fd64e7fc640 1 -- 172.21.15.19:0/3649716684 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640006030 con 0x7fd63c003980 2023-11-20T06:42:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.343+0000 7fd6553d3640 1 -- 172.21.15.19:0/3649716684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd63c003980 msgr2=0x7fd63c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.343+0000 7fd6553d3640 1 --2- 172.21.15.19:0/3649716684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd63c003980 0x7fd63c003da0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd640009ac0 tx=0x7fd64001ca00 comp rx=0 tx=0).stop 2023-11-20T06:42:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.343+0000 7fd6553d3640 1 -- 172.21.15.19:0/3649716684 shutdown_connections 2023-11-20T06:42:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.343+0000 7fd6553d3640 1 --2- 172.21.15.19:0/3649716684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd63c003980 0x7fd63c003da0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.343+0000 7fd6553d3640 1 -- 172.21.15.19:0/3649716684 >> 172.21.15.19:0/3649716684 conn(0x7fd65009bc50 msgr2=0x7fd6500d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.343+0000 7fd6553d3640 1 -- 172.21.15.19:0/3649716684 shutdown_connections 2023-11-20T06:42:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.343+0000 7fd6553d3640 1 -- 172.21.15.19:0/3649716684 wait complete. 2023-11-20T06:42:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd6553d3640 1 Processor -- start 2023-11-20T06:42:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd6553d3640 1 -- start start 2023-11-20T06:42:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd6553d3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd63c003980 0x7fd6501e94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd6553d3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd65006c500 0x7fd650159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:49.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd6553d3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd65015a460 0x7fd6501eb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:49.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd6553d3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6501e9a90 con 0x7fd65015a460 2023-11-20T06:42:49.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd6553d3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6501e9d70 con 0x7fd65006c500 2023-11-20T06:42:49.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd6553d3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6501ea050 con 0x7fd63c003980 2023-11-20T06:42:49.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd64f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd65015a460 0x7fd6501eb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:49.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd64f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd65015a460 0x7fd6501eb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36556/0 (socket says 172.21.15.19:36556) 2023-11-20T06:42:49.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd64f7fe640 1 -- 172.21.15.19:0/1289195505 learned_addr learned my addr 172.21.15.19:0/1289195505 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:49.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd647fff640 1 --2- 172.21.15.19:0/1289195505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd65006c500 0x7fd650159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:49.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd64effd640 1 --2- 172.21.15.19:0/1289195505 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd63c003980 0x7fd6501e94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:49.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd64f7fe640 1 -- 172.21.15.19:0/1289195505 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd63c003980 msgr2=0x7fd6501e94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:49.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd64f7fe640 1 --2- 172.21.15.19:0/1289195505 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd63c003980 0x7fd6501e94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:49.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd64f7fe640 1 -- 172.21.15.19:0/1289195505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd65006c500 msgr2=0x7fd650159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:49.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd64f7fe640 1 --2- 172.21.15.19:0/1289195505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd65006c500 0x7fd650159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:49.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd64f7fe640 1 -- 172.21.15.19:0/1289195505 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6501ea330 con 0x7fd65015a460 2023-11-20T06:42:49.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd64effd640 1 --2- 172.21.15.19:0/1289195505 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd63c003980 0x7fd6501e94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:49.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd64f7fe640 1 --2- 172.21.15.19:0/1289195505 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd65015a460 0x7fd6501eb1c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd6500c9420 tx=0x7fd64800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:49.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd6477fe640 1 -- 172.21.15.19:0/1289195505 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64800eb90 con 0x7fd65015a460 2023-11-20T06:42:49.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd6477fe640 1 -- 172.21.15.19:0/1289195505 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64800ecf0 con 0x7fd65015a460 2023-11-20T06:42:49.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd6477fe640 1 -- 172.21.15.19:0/1289195505 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648013660 con 0x7fd65015a460 2023-11-20T06:42:49.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd6553d3640 1 -- 172.21.15.19:0/1289195505 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65006c960 con 0x7fd65015a460 2023-11-20T06:42:49.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.347+0000 7fd6553d3640 1 -- 172.21.15.19:0/1289195505 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6501eb8d0 con 0x7fd65015a460 2023-11-20T06:42:49.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.351+0000 7fd6553d3640 1 -- 172.21.15.19:0/1289195505 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6501584e0 con 0x7fd65015a460 2023-11-20T06:42:49.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.351+0000 7fd6477fe640 1 -- 172.21.15.19:0/1289195505 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd6480137c0 con 0x7fd65015a460 2023-11-20T06:42:49.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.351+0000 7fd6477fe640 1 --2- 172.21.15.19:0/1289195505 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd6300664a0 0x7fd630068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:49.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.351+0000 7fd6477fe640 1 -- 172.21.15.19:0/1289195505 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd6480843e0 con 0x7fd65015a460 2023-11-20T06:42:49.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.351+0000 7fd64effd640 1 --2- 172.21.15.19:0/1289195505 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd6300664a0 0x7fd630068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:49.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.351+0000 7fd64effd640 1 --2- 172.21.15.19:0/1289195505 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd6300664a0 0x7fd630068960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd6400ae000 tx=0x7fd6400b0040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:49.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.355+0000 7fd6477fe640 1 -- 172.21.15.19:0/1289195505 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd6501584e0 con 0x7fd65015a460 2023-11-20T06:42:49.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.543+0000 7fd6553d3640 1 -- 172.21.15.19:0/1289195505 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6501584e0 con 0x7fd65015a460 2023-11-20T06:42:49.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.543+0000 7fd6477fe640 1 -- 172.21.15.19:0/1289195505 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4916 (secure 0 0 0) 0x7fd6501584e0 con 0x7fd65015a460 2023-11-20T06:42:49.550 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:49.550 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3692171038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3692171038},{"type":"v1","addr":"172.21.15.190:6835","nonce":3692171038}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2633535615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":2633535615},{"type":"v1","addr":"172.21.15.190:6837","nonce":2633535615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/1822146855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1822146855},{"type":"v1","addr":"172.21.15.19:6833","nonce":1822146855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T06:42:43.280879+0000","modified":"2023-11-20T06:42:46.648235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/203468016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":203468016},{"type":"v1","addr":"172.21.15.19:6835","nonce":203468016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-20T06:42:49.551 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 18 2023-11-20T06:42:49.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.547+0000 7fd6553d3640 1 -- 172.21.15.19:0/1289195505 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd6300664a0 msgr2=0x7fd630068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:49.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.547+0000 7fd6553d3640 1 --2- 172.21.15.19:0/1289195505 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd6300664a0 0x7fd630068960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd6400ae000 tx=0x7fd6400b0040 comp rx=0 tx=0).stop 2023-11-20T06:42:49.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.547+0000 7fd6553d3640 1 -- 172.21.15.19:0/1289195505 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd65015a460 msgr2=0x7fd6501eb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:49.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.547+0000 7fd6553d3640 1 --2- 172.21.15.19:0/1289195505 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd65015a460 0x7fd6501eb1c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd6500c9420 tx=0x7fd64800e530 comp rx=0 tx=0).stop 2023-11-20T06:42:49.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.547+0000 7fd6553d3640 1 -- 172.21.15.19:0/1289195505 shutdown_connections 2023-11-20T06:42:49.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.547+0000 7fd6553d3640 1 --2- 172.21.15.19:0/1289195505 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd6300664a0 0x7fd630068960 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:49.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.547+0000 7fd6553d3640 1 --2- 172.21.15.19:0/1289195505 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd65015a460 0x7fd6501eb1c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:49.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.547+0000 7fd6553d3640 1 --2- 172.21.15.19:0/1289195505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd65006c500 0x7fd650159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:49.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.547+0000 7fd6553d3640 1 --2- 172.21.15.19:0/1289195505 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd63c003980 0x7fd6501e94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:49.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.547+0000 7fd6553d3640 1 -- 172.21.15.19:0/1289195505 >> 172.21.15.19:0/1289195505 conn(0x7fd65009bc50 msgr2=0x7fd6500d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:49.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.547+0000 7fd6553d3640 1 -- 172.21.15.19:0/1289195505 shutdown_connections 2023-11-20T06:42:49.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:49.547+0000 7fd6553d3640 1 -- 172.21.15.19:0/1289195505 wait complete. 2023-11-20T06:42:49.974 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-20T06:42:43.280879+0000', 'modified': '2023-11-20T06:42:46.648235+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5472': {'gid': 5472, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.19:6835/203468016', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6834', 'nonce': 203468016}, {'type': 'v1', 'addr': '172.21.15.19:6835', 'nonce': 203468016}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-20T06:42:49.974 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-20T06:42:49.974 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-20T06:42:50.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.115+0000 7feba6632640 1 Processor -- start 2023-11-20T06:42:50.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.115+0000 7feba6632640 1 -- start start 2023-11-20T06:42:50.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.115+0000 7feba6632640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7feba0070c40 0x7feba015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.115+0000 7feba6632640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba015be60 con 0x7feba00b07f0 2023-11-20T06:42:50.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.115+0000 7feba6632640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba015c1f0 con 0x7feba00b4020 2023-11-20T06:42:50.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.115+0000 7feba6632640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba015b3b0 con 0x7feba0070c40 2023-11-20T06:42:50.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.119+0000 7feba4bcf640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7feba00b07f0 0x7feba0164490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59286/0 (socket says 172.21.15.19:59286) 2023-11-20T06:42:50.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.119+0000 7feba4bcf640 1 -- 172.21.15.19:0/223692291 learned_addr learned my addr 172.21.15.19:0/223692291 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:50.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.119+0000 7feb9ffff640 1 --2- 172.21.15.19:0/223692291 >> v2:172.21.15.19:3300/0 conn(0x7feba0070c40 0x7feba015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.119+0000 7feb9effd640 1 -- 172.21.15.19:0/223692291 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886205971 0 0) 0x7feba015be60 con 0x7feba00b07f0 2023-11-20T06:42:50.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.119+0000 7feb9effd640 1 -- 172.21.15.19:0/223692291 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb88003530 con 0x7feba00b07f0 2023-11-20T06:42:50.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.119+0000 7feb9ffff640 1 -- 172.21.15.19:0/223692291 >> v1:172.21.15.190:6789/0 conn(0x7feba00b4020 legacy=0x7feba00b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:50.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.119+0000 7feb9ffff640 1 -- 172.21.15.19:0/223692291 >> v1:172.21.15.19:6789/0 conn(0x7feba00b07f0 legacy=0x7feba0164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:50.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.119+0000 7feb9ffff640 1 -- 172.21.15.19:0/223692291 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba0071020 con 0x7feba0070c40 2023-11-20T06:42:50.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.119+0000 7feb9ffff640 1 --2- 172.21.15.19:0/223692291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feba0070c40 0x7feba015ae70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7feb900097c0 tx=0x7feb9001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c49feca6af9e4a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:50.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.123+0000 7feb9effd640 1 -- 172.21.15.19:0/223692291 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900ab5f0 con 0x7feba0070c40 2023-11-20T06:42:50.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.123+0000 7feb9effd640 1 -- 172.21.15.19:0/223692291 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb900ab750 con 0x7feba0070c40 2023-11-20T06:42:50.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.123+0000 7feb9effd640 1 -- 172.21.15.19:0/223692291 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900abae0 con 0x7feba0070c40 2023-11-20T06:42:50.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.123+0000 7feba6632640 1 -- 172.21.15.19:0/223692291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feba0070c40 msgr2=0x7feba015ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:50.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.123+0000 7feba6632640 1 --2- 172.21.15.19:0/223692291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feba0070c40 0x7feba015ae70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7feb900097c0 tx=0x7feb9001c3f0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.123+0000 7feba6632640 1 -- 172.21.15.19:0/223692291 shutdown_connections 2023-11-20T06:42:50.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.123+0000 7feba6632640 1 --2- 172.21.15.19:0/223692291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feba0070c40 0x7feba015ae70 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.123+0000 7feba6632640 1 -- 172.21.15.19:0/223692291 >> 172.21.15.19:0/223692291 conn(0x7feba006c190 msgr2=0x7feba006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:50.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.123+0000 7feba6632640 1 -- 172.21.15.19:0/223692291 shutdown_connections 2023-11-20T06:42:50.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.123+0000 7feba6632640 1 -- 172.21.15.19:0/223692291 wait complete. 2023-11-20T06:42:50.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.123+0000 7feba6632640 1 Processor -- start 2023-11-20T06:42:50.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.123+0000 7feba6632640 1 -- start start 2023-11-20T06:42:50.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.123+0000 7feba6632640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feba0070c40 0x7feba00c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.123+0000 7feba6632640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feba00b07f0 0x7feba013f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.123+0000 7feba6632640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feba00b4020 0x7feba00c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.123+0000 7feba6632640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba013d4b0 con 0x7feba00b07f0 2023-11-20T06:42:50.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.123+0000 7feba6632640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba013d790 con 0x7feba0070c40 2023-11-20T06:42:50.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.123+0000 7feba6632640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba013da70 con 0x7feba00b4020 2023-11-20T06:42:50.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.127+0000 7feb9f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feba00b07f0 0x7feba013f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.127+0000 7feb9f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feba00b07f0 0x7feba013f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36568/0 (socket says 172.21.15.19:36568) 2023-11-20T06:42:50.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.127+0000 7feb9f7fe640 1 -- 172.21.15.19:0/2668533755 learned_addr learned my addr 172.21.15.19:0/2668533755 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:50.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.127+0000 7feb9ffff640 1 --2- 172.21.15.19:0/2668533755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feba0070c40 0x7feba00c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.127+0000 7feba4bcf640 1 --2- 172.21.15.19:0/2668533755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feba00b4020 0x7feba00c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.127+0000 7feb9f7fe640 1 -- 172.21.15.19:0/2668533755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feba00b4020 msgr2=0x7feba00c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:50.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.127+0000 7feb9f7fe640 1 --2- 172.21.15.19:0/2668533755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feba00b4020 0x7feba00c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.127+0000 7feb9f7fe640 1 -- 172.21.15.19:0/2668533755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feba0070c40 msgr2=0x7feba00c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:50.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.127+0000 7feb9f7fe640 1 --2- 172.21.15.19:0/2668533755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feba0070c40 0x7feba00c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.127+0000 7feb9f7fe640 1 -- 172.21.15.19:0/2668533755 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90009420 con 0x7feba00b07f0 2023-11-20T06:42:50.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.127+0000 7feba4bcf640 1 --2- 172.21.15.19:0/2668533755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feba00b4020 0x7feba00c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:50.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.127+0000 7feb9f7fe640 1 --2- 172.21.15.19:0/2668533755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feba00b07f0 0x7feba013f670 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7feb9400c3c0 tx=0x7feb9400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:50.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.127+0000 7feb9cff9640 1 -- 172.21.15.19:0/2668533755 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb940052d0 con 0x7feba00b07f0 2023-11-20T06:42:50.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.127+0000 7feb9cff9640 1 -- 172.21.15.19:0/2668533755 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb94005430 con 0x7feba00b07f0 2023-11-20T06:42:50.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.127+0000 7feb9cff9640 1 -- 172.21.15.19:0/2668533755 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94003840 con 0x7feba00b07f0 2023-11-20T06:42:50.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.127+0000 7feba6632640 1 -- 172.21.15.19:0/2668533755 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba013dd50 con 0x7feba00b07f0 2023-11-20T06:42:50.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.127+0000 7feba6632640 1 -- 172.21.15.19:0/2668533755 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba0151c30 con 0x7feba00b07f0 2023-11-20T06:42:50.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.127+0000 7feb9cff9640 1 -- 172.21.15.19:0/2668533755 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7feb940039a0 con 0x7feba00b07f0 2023-11-20T06:42:50.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feb9cff9640 1 --2- 172.21.15.19:0/2668533755 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feb8c0664a0 0x7feb8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feb9cff9640 1 -- 172.21.15.19:0/2668533755 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feb94083510 con 0x7feba00b07f0 2023-11-20T06:42:50.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feba99b5000 1 Processor -- start 2023-11-20T06:42:50.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feba99b5000 1 -- start start 2023-11-20T06:42:50.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feb9ffff640 1 --2- 172.21.15.19:0/2668533755 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feb8c0664a0 0x7feb8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feba99b5000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29c38840 0x555d29c38c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feba99b5000 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29bee6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feba99b5000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29beebf0 0x555d29beefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feba99b5000 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d299e3cc0 con 0x555d29c39160 2023-11-20T06:42:50.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feba99b5000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d29a468e0 con 0x555d29beebf0 2023-11-20T06:42:50.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feba99b5000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d29a43e10 con 0x555d29c38840 2023-11-20T06:42:50.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feb9ffff640 1 --2- 172.21.15.19:0/2668533755 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feb8c0664a0 0x7feb8c068960 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7feb900af000 tx=0x7feb900a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:50.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feb9f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29bee6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feb9ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29c38840 0x555d29c38c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feb9f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29bee6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36570/0 (socket says 172.21.15.19:36570) 2023-11-20T06:42:50.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feb9f7fe640 1 -- 172.21.15.19:0/793850255 learned_addr learned my addr 172.21.15.19:0/793850255 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:50.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feba4bcf640 1 --2- 172.21.15.19:0/793850255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29beebf0 0x555d29beefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feb9f7fe640 1 -- 172.21.15.19:0/793850255 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29c38840 msgr2=0x555d29c38c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:50.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feb9f7fe640 1 --2- 172.21.15.19:0/793850255 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29c38840 0x555d29c38c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feb9f7fe640 1 -- 172.21.15.19:0/793850255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29beebf0 msgr2=0x555d29beefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:50.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feb9f7fe640 1 --2- 172.21.15.19:0/793850255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29beebf0 0x555d29beefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feb9f7fe640 1 -- 172.21.15.19:0/793850255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d29738890 con 0x555d29c39160 2023-11-20T06:42:50.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feb9f7fe640 1 --2- 172.21.15.19:0/793850255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29bee6b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7feb94081900 tx=0x7feb94054180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3bc637fbb62bd17 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:50.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feb85ffb640 1 -- 172.21.15.19:0/793850255 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9405c810 con 0x555d29c39160 2023-11-20T06:42:50.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feb85ffb640 1 -- 172.21.15.19:0/793850255 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb940528b0 con 0x555d29c39160 2023-11-20T06:42:50.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feb85ffb640 1 -- 172.21.15.19:0/793850255 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9405c380 con 0x555d29c39160 2023-11-20T06:42:50.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feba99b5000 1 -- 172.21.15.19:0/793850255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 msgr2=0x555d29bee6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:50.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feba99b5000 1 --2- 172.21.15.19:0/793850255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29bee6b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7feb94081900 tx=0x7feb94054180 comp rx=0 tx=0).stop 2023-11-20T06:42:50.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feba99b5000 1 -- 172.21.15.19:0/793850255 shutdown_connections 2023-11-20T06:42:50.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feba99b5000 1 --2- 172.21.15.19:0/793850255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29beebf0 0x555d29beefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feba99b5000 1 --2- 172.21.15.19:0/793850255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29bee6b0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feba99b5000 1 --2- 172.21.15.19:0/793850255 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29c38840 0x555d29c38c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feba99b5000 1 -- 172.21.15.19:0/793850255 >> 172.21.15.19:0/793850255 conn(0x555d29be5f60 msgr2=0x555d29becf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:50.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feba99b5000 1 -- 172.21.15.19:0/793850255 shutdown_connections 2023-11-20T06:42:50.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.131+0000 7feba99b5000 1 -- 172.21.15.19:0/793850255 wait complete. 2023-11-20T06:42:50.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba99b5000 1 -- start start 2023-11-20T06:42:50.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba99b5000 1 Processor -- start 2023-11-20T06:42:50.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba99b5000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29beebf0 0x555d29c38290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba99b5000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29c38840 0x555d29bf3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba99b5000 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29bf41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba99b5000 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d29a3f700 con 0x555d29c39160 2023-11-20T06:42:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba99b5000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d299fed10 con 0x555d29c38840 2023-11-20T06:42:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba99b5000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d299fe9b0 con 0x555d29beebf0 2023-11-20T06:42:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba99b5000 10 client.0 _ll_register_callbacks cb 0x555d29bda330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-20T06:42:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba4bcf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29bf41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feb9f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29c38840 0x555d29bf3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feb9ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29beebf0 0x555d29c38290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feb9f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29c38840 0x555d29bf3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:49668/0 (socket says 172.21.15.19:49668) 2023-11-20T06:42:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feb9f7fe640 1 -- 172.21.15.19:0/2561247151 learned_addr learned my addr 172.21.15.19:0/2561247151 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba4bcf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29bf41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36574/0 (socket says 172.21.15.19:36574) 2023-11-20T06:42:50.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba4bcf640 1 -- 172.21.15.19:0/2561247151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29beebf0 msgr2=0x555d29c38290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:50.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba4bcf640 1 --2- 172.21.15.19:0/2561247151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29beebf0 0x555d29c38290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba4bcf640 1 -- 172.21.15.19:0/2561247151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29c38840 msgr2=0x555d29bf3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:50.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba4bcf640 1 --2- 172.21.15.19:0/2561247151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29c38840 0x555d29bf3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba4bcf640 1 -- 172.21.15.19:0/2561247151 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba0151c30 con 0x555d29c39160 2023-11-20T06:42:50.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba4bcf640 1 --2- 172.21.15.19:0/2561247151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29bf41e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7feb980012f0 tx=0x7feb98010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e95538aa0ec6355 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:50.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feb7effd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2023-11-20T06:42:50.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feb7effd640 1 -- 172.21.15.19:0/2561247151 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800eb80 con 0x555d29c39160 2023-11-20T06:42:50.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba99b5000 1 -- 172.21.15.19:0/2561247151 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d299f3370 con 0x555d29c39160 2023-11-20T06:42:50.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feb7effd640 1 -- 172.21.15.19:0/2561247151 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feb9800ece0 con 0x555d29c39160 2023-11-20T06:42:50.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feb7effd640 1 -- 172.21.15.19:0/2561247151 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb9800eea0 con 0x555d29c39160 2023-11-20T06:42:50.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba99b5000 10 client.5628 fetch_fsmap learned FSMap version 18 2023-11-20T06:42:50.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba99b5000 1 -- 172.21.15.19:0/2561247151 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x555d29a01460 con 0x555d29c39160 2023-11-20T06:42:50.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feb7effd640 1 -- 172.21.15.19:0/2561247151 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555d299f3370 con 0x555d29c39160 2023-11-20T06:42:50.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feb7effd640 1 -- 172.21.15.19:0/2561247151 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7feb98012040 con 0x555d29c39160 2023-11-20T06:42:50.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba99b5000 10 client.5628 fetch_fsmap finished waiting for FSMap version 18 2023-11-20T06:42:50.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba99b5000 10 client.5628 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-20T06:42:50.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba99b5000 20 client.5628 populate_metadata read hostname 'smithi019' 2023-11-20T06:42:50.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba99b5000 1 --2- 172.21.15.19:0/2561247151 >> [v2:172.21.15.19:6834/203468016,v1:172.21.15.19:6835/203468016] conn(0x555d29bfb080 0x555d29c4ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba99b5000 4 client.5628 mds_command: new command op to 5472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-20T06:42:50.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feba99b5000 1 -- 172.21.15.19:0/2561247151 --> [v2:172.21.15.19:6834/203468016,v1:172.21.15.19:6835/203468016] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555d299d92d0 con 0x555d29bfb080 2023-11-20T06:42:50.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.135+0000 7feb9ffff640 1 --2- 172.21.15.19:0/2561247151 >> [v2:172.21.15.19:6834/203468016,v1:172.21.15.19:6835/203468016] conn(0x555d29bfb080 0x555d29c4ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.139+0000 7feb7effd640 10 client.5628 ms_handle_connect on v2:172.21.15.19:6834/203468016 2023-11-20T06:42:50.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.139+0000 7feb9ffff640 1 --2- 172.21.15.19:0/2561247151 >> [v2:172.21.15.19:6834/203468016,v1:172.21.15.19:6835/203468016] conn(0x555d29bfb080 0x555d29c4ab00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8f611bae237a290 server_cookie=c0f3a3ea7351760c in_seq=0 out_seq=0 2023-11-20T06:42:50.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.139+0000 7feb7effd640 1 -- 172.21.15.19:0/2561247151 <== mds.0 v2:172.21.15.19:6834/203468016 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555d299d92d0 con 0x555d29bfb080 2023-11-20T06:42:50.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.139+0000 7feb7effd640 10 client.5628 handle_command_reply: tid=0 2023-11-20T06:42:50.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.139+0000 7feba99b5000 1 client.5628 shutdown 2023-11-20T06:42:50.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.139+0000 7feba99b5000 1 -- 172.21.15.19:0/2561247151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 msgr2=0x555d29bf41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:50.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.139+0000 7feba99b5000 1 --2- 172.21.15.19:0/2561247151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29bf41e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7feb980012f0 tx=0x7feb98010d90 comp rx=0 tx=0).stop 2023-11-20T06:42:50.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.139+0000 7feba99b5000 1 -- 172.21.15.19:0/2561247151 shutdown_connections 2023-11-20T06:42:50.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.139+0000 7feba99b5000 1 --2- 172.21.15.19:0/2561247151 >> [v2:172.21.15.19:6834/203468016,v1:172.21.15.19:6835/203468016] conn(0x555d29bfb080 0x555d29c4ab00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.139+0000 7feba99b5000 1 --2- 172.21.15.19:0/2561247151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29bf41e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.139+0000 7feba99b5000 1 --2- 172.21.15.19:0/2561247151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29c38840 0x555d29bf3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.139+0000 7feba99b5000 1 --2- 172.21.15.19:0/2561247151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29beebf0 0x555d29c38290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.139+0000 7feb7effd640 0 client.5628 ms_handle_reset on v2:172.21.15.19:6834/203468016 2023-11-20T06:42:50.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.139+0000 7feba99b5000 1 -- 172.21.15.19:0/2561247151 >> 172.21.15.19:0/2561247151 conn(0x555d29be5f60 msgr2=0x555d29bed690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:50.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.139+0000 7feba99b5000 1 -- 172.21.15.19:0/2561247151 shutdown_connections 2023-11-20T06:42:50.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.139+0000 7feba99b5000 1 -- 172.21.15.19:0/2561247151 wait complete. 2023-11-20T06:42:50.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.139+0000 7feba99b5000 20 client.5628 trim_cache size 0 max 16384 2023-11-20T06:42:50.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.155+0000 7feba99b5000 1 Processor -- start 2023-11-20T06:42:50.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.155+0000 7feba99b5000 1 -- start start 2023-11-20T06:42:50.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.155+0000 7feba99b5000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29beebf0 0x555d29c4c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.155+0000 7feba99b5000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29c38840 0x555d29c4c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.155+0000 7feba99b5000 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29c33620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.155+0000 7feba99b5000 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d296f9940 con 0x555d29c39160 2023-11-20T06:42:50.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.155+0000 7feba99b5000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d29a08720 con 0x555d29beebf0 2023-11-20T06:42:50.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.155+0000 7feba99b5000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d29a43700 con 0x555d29c38840 2023-11-20T06:42:50.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.155+0000 7feba4bcf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29c33620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.155+0000 7feba4bcf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29c33620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36578/0 (socket says 172.21.15.19:36578) 2023-11-20T06:42:50.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.155+0000 7feba4bcf640 1 -- 172.21.15.19:0/3142259630 learned_addr learned my addr 172.21.15.19:0/3142259630 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:50.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.155+0000 7feb9f7fe640 1 --2- 172.21.15.19:0/3142259630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29c38840 0x555d29c4c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.155+0000 7feb9ffff640 1 --2- 172.21.15.19:0/3142259630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29beebf0 0x555d29c4c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.155+0000 7feba4bcf640 1 -- 172.21.15.19:0/3142259630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29c38840 msgr2=0x555d29c4c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:50.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.155+0000 7feba4bcf640 1 --2- 172.21.15.19:0/3142259630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29c38840 0x555d29c4c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.155+0000 7feba4bcf640 1 -- 172.21.15.19:0/3142259630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29beebf0 msgr2=0x555d29c4c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:50.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.155+0000 7feba4bcf640 1 --2- 172.21.15.19:0/3142259630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29beebf0 0x555d29c4c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.155+0000 7feba4bcf640 1 -- 172.21.15.19:0/3142259630 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d299e7760 con 0x555d29c39160 2023-11-20T06:42:50.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.155+0000 7feba4bcf640 1 --2- 172.21.15.19:0/3142259630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29c33620 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7feb98001230 tx=0x7feb9800b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5c7fe51432e9ba server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:50.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feb867fc640 1 -- 172.21.15.19:0/3142259630 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98001970 con 0x555d29c39160 2023-11-20T06:42:50.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feb867fc640 1 -- 172.21.15.19:0/3142259630 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9800d050 con 0x555d29c39160 2023-11-20T06:42:50.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feb867fc640 1 -- 172.21.15.19:0/3142259630 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800edc0 con 0x555d29c39160 2023-11-20T06:42:50.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba99b5000 1 -- 172.21.15.19:0/3142259630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 msgr2=0x555d29c33620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:50.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba99b5000 1 --2- 172.21.15.19:0/3142259630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29c33620 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7feb98001230 tx=0x7feb9800b000 comp rx=0 tx=0).stop 2023-11-20T06:42:50.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba99b5000 1 -- 172.21.15.19:0/3142259630 shutdown_connections 2023-11-20T06:42:50.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba99b5000 1 --2- 172.21.15.19:0/3142259630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29c33620 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba99b5000 1 --2- 172.21.15.19:0/3142259630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29c38840 0x555d29c4c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba99b5000 1 --2- 172.21.15.19:0/3142259630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29beebf0 0x555d29c4c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba99b5000 1 -- 172.21.15.19:0/3142259630 >> 172.21.15.19:0/3142259630 conn(0x555d29be5f60 msgr2=0x555d29c4ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:50.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba99b5000 1 -- 172.21.15.19:0/3142259630 shutdown_connections 2023-11-20T06:42:50.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba99b5000 1 -- 172.21.15.19:0/3142259630 wait complete. 2023-11-20T06:42:50.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba99b5000 1 -- start start 2023-11-20T06:42:50.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba99b5000 1 Processor -- start 2023-11-20T06:42:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba99b5000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29beebf0 0x555d29c36cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba99b5000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29c38840 0x555d29c53ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba99b5000 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29c54400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba99b5000 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d299fe4d0 con 0x555d29c39160 2023-11-20T06:42:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba99b5000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d29a80b40 con 0x555d29beebf0 2023-11-20T06:42:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba99b5000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d29be7a10 con 0x555d29c38840 2023-11-20T06:42:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba99b5000 10 client.0 _ll_register_callbacks cb 0x7feb94050850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-20T06:42:50.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba4bcf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29c54400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feb9ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29beebf0 0x555d29c36cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feb9f7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29c38840 0x555d29c53ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba4bcf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29c54400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36588/0 (socket says 172.21.15.19:36588) 2023-11-20T06:42:50.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feba4bcf640 1 -- 172.21.15.19:0/1364479445 learned_addr learned my addr 172.21.15.19:0/1364479445 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:50.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feb9ffff640 1 --2- 172.21.15.19:0/1364479445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29beebf0 0x555d29c36cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:49688/0 (socket says 172.21.15.19:49688) 2023-11-20T06:42:50.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feb9f7fe640 1 -- 172.21.15.19:0/1364479445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29beebf0 msgr2=0x555d29c36cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:50.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feb9f7fe640 1 --2- 172.21.15.19:0/1364479445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29beebf0 0x555d29c36cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feb9f7fe640 1 -- 172.21.15.19:0/1364479445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 msgr2=0x555d29c54400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:50.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feb9f7fe640 1 --2- 172.21.15.19:0/1364479445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29c54400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.159+0000 7feb9f7fe640 1 -- 172.21.15.19:0/1364479445 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555d29a01460 con 0x555d29c38840 2023-11-20T06:42:50.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feb9f7fe640 1 --2- 172.21.15.19:0/1364479445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29c38840 0x555d29c53ec0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feb940509c0 tx=0x7feb9401e070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f996644a9acf30d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:50.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feb7effd640 10 client.0 ms_handle_connect on v2:172.21.15.190:3301/0 2023-11-20T06:42:50.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feb7effd640 1 -- 172.21.15.19:0/1364479445 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9406f070 con 0x555d29c38840 2023-11-20T06:42:50.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 1 -- 172.21.15.19:0/1364479445 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d29bf9f70 con 0x555d29c38840 2023-11-20T06:42:50.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feb7effd640 1 -- 172.21.15.19:0/1364479445 <== mon.2 v2:172.21.15.190:3301/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feb9405c810 con 0x555d29c38840 2023-11-20T06:42:50.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feb7effd640 1 -- 172.21.15.19:0/1364479445 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb94050c20 con 0x555d29c38840 2023-11-20T06:42:50.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 10 client.5219 fetch_fsmap learned FSMap version 18 2023-11-20T06:42:50.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 1 -- 172.21.15.19:0/1364479445 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x555d29738cc0 con 0x555d29c38840 2023-11-20T06:42:50.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feb7effd640 1 -- 172.21.15.19:0/1364479445 <== mon.2 v2:172.21.15.190:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555d29bf9f70 con 0x555d29c38840 2023-11-20T06:42:50.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feb7effd640 1 -- 172.21.15.19:0/1364479445 <== mon.2 v2:172.21.15.190:3301/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7feb94081d20 con 0x555d29c38840 2023-11-20T06:42:50.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 10 client.5219 fetch_fsmap finished waiting for FSMap version 18 2023-11-20T06:42:50.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 10 client.5219 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-20T06:42:50.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 20 client.5219 populate_metadata read hostname 'smithi019' 2023-11-20T06:42:50.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 1 --2- 172.21.15.19:0/1364479445 >> [v2:172.21.15.19:6834/203468016,v1:172.21.15.19:6835/203468016] conn(0x555d29c972f0 0x555d29c976d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 4 client.5219 mds_command: new command op to 5472 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-20T06:42:50.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 1 -- 172.21.15.19:0/1364479445 --> [v2:172.21.15.19:6834/203468016,v1:172.21.15.19:6835/203468016] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555d299d76f0 con 0x555d29c972f0 2023-11-20T06:42:50.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feb9ffff640 1 --2- 172.21.15.19:0/1364479445 >> [v2:172.21.15.19:6834/203468016,v1:172.21.15.19:6835/203468016] conn(0x555d29c972f0 0x555d29c976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feb7effd640 10 client.5219 ms_handle_connect on v2:172.21.15.19:6834/203468016 2023-11-20T06:42:50.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feb9ffff640 1 --2- 172.21.15.19:0/1364479445 >> [v2:172.21.15.19:6834/203468016,v1:172.21.15.19:6835/203468016] conn(0x555d29c972f0 0x555d29c976d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8380cfde6d9d029a server_cookie=e24f25676b083f0b in_seq=0 out_seq=0 2023-11-20T06:42:50.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feb7effd640 1 -- 172.21.15.19:0/1364479445 <== mds.0 v2:172.21.15.19:6834/203468016 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x555d299d76f0 con 0x555d29c972f0 2023-11-20T06:42:50.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feb7effd640 10 client.5219 handle_command_reply: tid=0 2023-11-20T06:42:50.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 1 client.5219 shutdown 2023-11-20T06:42:50.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 1 -- 172.21.15.19:0/1364479445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29c38840 msgr2=0x555d29c53ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:50.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 1 --2- 172.21.15.19:0/1364479445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29c38840 0x555d29c53ec0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feb940509c0 tx=0x7feb9401e070 comp rx=0 tx=0).stop 2023-11-20T06:42:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 1 -- 172.21.15.19:0/1364479445 shutdown_connections 2023-11-20T06:42:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 1 --2- 172.21.15.19:0/1364479445 >> [v2:172.21.15.19:6834/203468016,v1:172.21.15.19:6835/203468016] conn(0x555d29c972f0 0x555d29c976d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 1 --2- 172.21.15.19:0/1364479445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d29c39160 0x555d29c54400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 1 --2- 172.21.15.19:0/1364479445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555d29c38840 0x555d29c53ec0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feb7effd640 0 client.5219 ms_handle_reset on v2:172.21.15.19:6834/203468016 2023-11-20T06:42:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 1 --2- 172.21.15.19:0/1364479445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d29beebf0 0x555d29c36cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 1 -- 172.21.15.19:0/1364479445 >> 172.21.15.19:0/1364479445 conn(0x555d29be5f60 msgr2=0x555d29c4ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 1 -- 172.21.15.19:0/1364479445 shutdown_connections 2023-11-20T06:42:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 1 -- 172.21.15.19:0/1364479445 wait complete. 2023-11-20T06:42:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba99b5000 20 client.5219 trim_cache size 0 max 16384 2023-11-20T06:42:50.175 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-20T06:42:50.175 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "c7c2bc89-520e-40d6-94f5-74b01db83356", 2023-11-20T06:42:50.175 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2023-11-20T06:42:50.175 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 5472, 2023-11-20T06:42:50.175 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2023-11-20T06:42:50.175 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2023-11-20T06:42:50.175 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2023-11-20T06:42:50.175 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 5.9275191730000003, 2023-11-20T06:42:50.175 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 18, 2023-11-20T06:42:50.175 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 39, 2023-11-20T06:42:50.175 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 39, 2023-11-20T06:42:50.176 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 14.125463412 2023-11-20T06:42:50.176 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-20T06:42:50.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba6632640 1 -- 172.21.15.19:0/2668533755 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feb8c0664a0 msgr2=0x7feb8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:50.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba6632640 1 --2- 172.21.15.19:0/2668533755 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feb8c0664a0 0x7feb8c068960 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7feb900af000 tx=0x7feb900a7000 comp rx=0 tx=0).stop 2023-11-20T06:42:50.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba6632640 1 -- 172.21.15.19:0/2668533755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feba00b07f0 msgr2=0x7feba013f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:50.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba6632640 1 --2- 172.21.15.19:0/2668533755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feba00b07f0 0x7feba013f670 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7feb9400c3c0 tx=0x7feb9400c880 comp rx=0 tx=0).stop 2023-11-20T06:42:50.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba6632640 1 -- 172.21.15.19:0/2668533755 shutdown_connections 2023-11-20T06:42:50.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba6632640 1 --2- 172.21.15.19:0/2668533755 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7feb8c0664a0 0x7feb8c068960 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba6632640 1 --2- 172.21.15.19:0/2668533755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feba00b4020 0x7feba00c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba6632640 1 --2- 172.21.15.19:0/2668533755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feba00b07f0 0x7feba013f670 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba6632640 1 --2- 172.21.15.19:0/2668533755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feba0070c40 0x7feba00c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba6632640 1 -- 172.21.15.19:0/2668533755 >> 172.21.15.19:0/2668533755 conn(0x7feba006c190 msgr2=0x7feba00afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:50.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba6632640 1 -- 172.21.15.19:0/2668533755 shutdown_connections 2023-11-20T06:42:50.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.163+0000 7feba6632640 1 -- 172.21.15.19:0/2668533755 wait complete. 2023-11-20T06:42:50.189 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-20T06:42:50.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.327+0000 7fe4bca46640 1 Processor -- start 2023-11-20T06:42:50.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.327+0000 7fe4bca46640 1 -- start start 2023-11-20T06:42:50.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.327+0000 7fe4bca46640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe4b815cb90 0x7fe4b80cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.327+0000 7fe4bca46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4b80d15d0 0x7fe4b80c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.327+0000 7fe4bca46640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b80ce770 con 0x7fe4b80d3010 2023-11-20T06:42:50.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.327+0000 7fe4bca46640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b80d0600 con 0x7fe4b815cb90 2023-11-20T06:42:50.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.327+0000 7fe4bca46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b80c6450 con 0x7fe4b80d15d0 2023-11-20T06:42:50.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.331+0000 7fe4b659c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe4b815cb90 0x7fe4b80cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.331+0000 7fe4b6d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4b80d15d0 0x7fe4b80c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.331+0000 7fe4b659c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe4b815cb90 0x7fe4b80cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:49698/0 (socket says 172.21.15.19:49698) 2023-11-20T06:42:50.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.331+0000 7fe4b659c640 1 -- 172.21.15.19:0/3825214799 learned_addr learned my addr 172.21.15.19:0/3825214799 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:50.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.331+0000 7fe4b5d9b640 1 -- 172.21.15.19:0/3825214799 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823487502 0 0) 0x7fe4b80ce770 con 0x7fe4b80d3010 2023-11-20T06:42:50.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.331+0000 7fe4b6d9d640 1 -- 172.21.15.19:0/3825214799 >> v2:172.21.15.190:3300/0 conn(0x7fe4b815cb90 msgr2=0x7fe4b80cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:50.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.331+0000 7fe4b6d9d640 1 --2- 172.21.15.19:0/3825214799 >> v2:172.21.15.190:3300/0 conn(0x7fe4b815cb90 0x7fe4b80cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.331+0000 7fe4b6d9d640 1 -- 172.21.15.19:0/3825214799 >> v1:172.21.15.190:6789/0 conn(0x7fe4b80d3010 legacy=0x7fe4b80d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:50.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.331+0000 7fe4b6d9d640 1 -- 172.21.15.19:0/3825214799 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b80d08a0 con 0x7fe4b80d15d0 2023-11-20T06:42:50.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.331+0000 7fe4b659c640 1 --2- 172.21.15.19:0/3825214799 >> v2:172.21.15.190:3300/0 conn(0x7fe4b815cb90 0x7fe4b80cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:42:50.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.331+0000 7fe4b6d9d640 1 --2- 172.21.15.19:0/3825214799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4b80d15d0 0x7fe4b80c6c10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0009d90 tx=0x7fe4b001c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cec59c12e410a4a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:50.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.335+0000 7fe4b5d9b640 1 -- 172.21.15.19:0/3825214799 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b00a5950 con 0x7fe4b80d15d0 2023-11-20T06:42:50.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.335+0000 7fe4b5d9b640 1 -- 172.21.15.19:0/3825214799 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b00a5ab0 con 0x7fe4b80d15d0 2023-11-20T06:42:50.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.335+0000 7fe4b5d9b640 1 -- 172.21.15.19:0/3825214799 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b00a5e40 con 0x7fe4b80d15d0 2023-11-20T06:42:50.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.335+0000 7fe4bca46640 1 -- 172.21.15.19:0/3825214799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4b80d15d0 msgr2=0x7fe4b80c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:50.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.335+0000 7fe4bca46640 1 --2- 172.21.15.19:0/3825214799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4b80d15d0 0x7fe4b80c6c10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0009d90 tx=0x7fe4b001c890 comp rx=0 tx=0).stop 2023-11-20T06:42:50.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.335+0000 7fe4bca46640 1 -- 172.21.15.19:0/3825214799 shutdown_connections 2023-11-20T06:42:50.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.335+0000 7fe4bca46640 1 --2- 172.21.15.19:0/3825214799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4b80d15d0 0x7fe4b80c6c10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.335+0000 7fe4bca46640 1 --2- 172.21.15.19:0/3825214799 >> v2:172.21.15.190:3300/0 conn(0x7fe4b815cb90 0x7fe4b80cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.335+0000 7fe4bca46640 1 -- 172.21.15.19:0/3825214799 >> 172.21.15.19:0/3825214799 conn(0x7fe4b809bc50 msgr2=0x7fe4b80d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:50.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.335+0000 7fe4bca46640 1 -- 172.21.15.19:0/3825214799 shutdown_connections 2023-11-20T06:42:50.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.335+0000 7fe4bca46640 1 -- 172.21.15.19:0/3825214799 wait complete. 2023-11-20T06:42:50.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.335+0000 7fe4bca46640 1 Processor -- start 2023-11-20T06:42:50.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.335+0000 7fe4bca46640 1 -- start start 2023-11-20T06:42:50.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.335+0000 7fe4bca46640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4b80d15d0 0x7fe4b80cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.335+0000 7fe4bca46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4b80d3010 0x7fe4b815b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.335+0000 7fe4bca46640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4b815cb90 0x7fe4b8155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.335+0000 7fe4bca46640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b80b8380 con 0x7fe4b815cb90 2023-11-20T06:42:50.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.335+0000 7fe4bca46640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b80b80a0 con 0x7fe4b80d15d0 2023-11-20T06:42:50.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.335+0000 7fe4bca46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b815a980 con 0x7fe4b80d3010 2023-11-20T06:42:50.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.339+0000 7fe4b6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4b815cb90 0x7fe4b8155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.339+0000 7fe4b6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4b815cb90 0x7fe4b8155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36594/0 (socket says 172.21.15.19:36594) 2023-11-20T06:42:50.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.339+0000 7fe4b6d9d640 1 -- 172.21.15.19:0/707648335 learned_addr learned my addr 172.21.15.19:0/707648335 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:50.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.339+0000 7fe4b659c640 1 --2- 172.21.15.19:0/707648335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4b80d15d0 0x7fe4b80cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.339+0000 7fe4affff640 1 --2- 172.21.15.19:0/707648335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4b80d3010 0x7fe4b815b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.339+0000 7fe4b6d9d640 1 -- 172.21.15.19:0/707648335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4b80d3010 msgr2=0x7fe4b815b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:50.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.339+0000 7fe4b6d9d640 1 --2- 172.21.15.19:0/707648335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4b80d3010 0x7fe4b815b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.339+0000 7fe4b6d9d640 1 -- 172.21.15.19:0/707648335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4b80d15d0 msgr2=0x7fe4b80cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:50.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.339+0000 7fe4b6d9d640 1 --2- 172.21.15.19:0/707648335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4b80d15d0 0x7fe4b80cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.339+0000 7fe4b6d9d640 1 -- 172.21.15.19:0/707648335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a8009480 con 0x7fe4b815cb90 2023-11-20T06:42:50.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.339+0000 7fe4b6d9d640 1 --2- 172.21.15.19:0/707648335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4b815cb90 0x7fe4b8155ac0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe4b001af40 tx=0x7fe4b0019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:50.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.339+0000 7fe4aeffd640 1 -- 172.21.15.19:0/707648335 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b00add90 con 0x7fe4b815cb90 2023-11-20T06:42:50.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.339+0000 7fe4aeffd640 1 -- 172.21.15.19:0/707648335 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b0009450 con 0x7fe4b815cb90 2023-11-20T06:42:50.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.339+0000 7fe4bca46640 1 -- 172.21.15.19:0/707648335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b0009a70 con 0x7fe4b815cb90 2023-11-20T06:42:50.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.339+0000 7fe4aeffd640 1 -- 172.21.15.19:0/707648335 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b00b9670 con 0x7fe4b815cb90 2023-11-20T06:42:50.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.339+0000 7fe4bca46640 1 -- 172.21.15.19:0/707648335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b815af40 con 0x7fe4b815cb90 2023-11-20T06:42:50.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.339+0000 7fe4bca46640 1 -- 172.21.15.19:0/707648335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b815b130 con 0x7fe4b815cb90 2023-11-20T06:42:50.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.339+0000 7fe4aeffd640 1 -- 172.21.15.19:0/707648335 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe4b00b97d0 con 0x7fe4b815cb90 2023-11-20T06:42:50.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.343+0000 7fe4aeffd640 1 --2- 172.21.15.19:0/707648335 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe4980664a0 0x7fe498068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:50.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.343+0000 7fe4aeffd640 1 -- 172.21.15.19:0/707648335 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe4b011f5f0 con 0x7fe4b815cb90 2023-11-20T06:42:50.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.343+0000 7fe4b659c640 1 --2- 172.21.15.19:0/707648335 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe4980664a0 0x7fe498068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:50.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.343+0000 7fe4b659c640 1 --2- 172.21.15.19:0/707648335 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe4980664a0 0x7fe498068960 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8006fd0 tx=0x7fe4a8009210 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:50.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.347+0000 7fe4aeffd640 1 -- 172.21.15.19:0/707648335 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe4b00ecb90 con 0x7fe4b815cb90 2023-11-20T06:42:50.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.571+0000 7fe4bca46640 1 -- 172.21.15.19:0/707648335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe4b8074010 con 0x7fe4b815cb90 2023-11-20T06:42:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.571+0000 7fe4aeffd640 1 -- 172.21.15.19:0/707648335 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe4b00f01b0 con 0x7fe4b815cb90 2023-11-20T06:42:50.577 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-20T06:42:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.571+0000 7fe4bca46640 1 -- 172.21.15.19:0/707648335 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe4980664a0 msgr2=0x7fe498068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.571+0000 7fe4bca46640 1 --2- 172.21.15.19:0/707648335 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe4980664a0 0x7fe498068960 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8006fd0 tx=0x7fe4a8009210 comp rx=0 tx=0).stop 2023-11-20T06:42:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.571+0000 7fe4bca46640 1 -- 172.21.15.19:0/707648335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4b815cb90 msgr2=0x7fe4b8155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.571+0000 7fe4bca46640 1 --2- 172.21.15.19:0/707648335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4b815cb90 0x7fe4b8155ac0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe4b001af40 tx=0x7fe4b0019630 comp rx=0 tx=0).stop 2023-11-20T06:42:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.571+0000 7fe4bca46640 1 -- 172.21.15.19:0/707648335 shutdown_connections 2023-11-20T06:42:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.571+0000 7fe4bca46640 1 --2- 172.21.15.19:0/707648335 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe4980664a0 0x7fe498068960 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.571+0000 7fe4bca46640 1 --2- 172.21.15.19:0/707648335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4b815cb90 0x7fe4b8155ac0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.571+0000 7fe4bca46640 1 --2- 172.21.15.19:0/707648335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4b80d3010 0x7fe4b815b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.571+0000 7fe4bca46640 1 --2- 172.21.15.19:0/707648335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4b80d15d0 0x7fe4b80cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.571+0000 7fe4bca46640 1 -- 172.21.15.19:0/707648335 >> 172.21.15.19:0/707648335 conn(0x7fe4b809bc50 msgr2=0x7fe4b80c8500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.575+0000 7fe4bca46640 1 -- 172.21.15.19:0/707648335 shutdown_connections 2023-11-20T06:42:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:50.575+0000 7fe4bca46640 1 -- 172.21.15.19:0/707648335 wait complete. 2023-11-20T06:42:50.598 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-20T06:42:50.598 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-20T06:42:50.598 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2023-11-20T06:42:50.598 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-20T06:42:50.599 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-20T06:42:50.599 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-20T06:42:50.599 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-20T06:42:50.599 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-20T06:42:50.599 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-20T06:42:50.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:50.599 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2023-11-20T06:42:50.609 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-20T06:42:50.609 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-20T06:42:50.609 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2023-11-20T06:42:50.609 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:42:50.609 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2023-11-20T06:42:50.609 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:42:50.609 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T06:42:50.609 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2023-11-20T06:42:50.609 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2023-11-20T06:42:50.609 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T06:42:50.610 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2023-11-20T06:42:50.610 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2023-11-20T06:42:50.610 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-20T06:42:50.610 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2023-11-20T06:42:50.610 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2023-11-20T06:42:50.610 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-20T06:42:50.610 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42344sec preferred_lft 42344sec 2023-11-20T06:42:50.610 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2023-11-20T06:42:50.610 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:42:50.610 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T06:42:50.610 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2023-11-20T06:42:50.610 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2023-11-20T06:42:50.611 INFO:teuthology.orchestra.run.smithi019.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-20T06:42:50.611 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:42:42:0b:69:dd brd ff:ff:ff:ff:ff:ff 2023-11-20T06:42:50.611 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-20T06:42:50.611 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:42:50.611 INFO:teuthology.orchestra.run.smithi019.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-20T06:42:50.611 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-20T06:42:50.611 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-20T06:42:50.611 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:42:50.611 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-20T06:42:50.611 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:42:50.611 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-20T06:42:50.611 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T06:42:50.611 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-20T06:42:50.612 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:42:50.612 INFO:teuthology.orchestra.run.smithi019.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-20T06:42:50.612 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T06:42:50.612 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-20T06:42:50.612 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2023-11-20T06:42:50.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:50.613 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-20T06:42:50.673 INFO:teuthology.orchestra.run.smithi019.stdout:1 2023-11-20T06:42:50.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:50.676 DEBUG:teuthology.orchestra.run.smithi019:> route 2023-11-20T06:42:50.728 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2023-11-20T06:42:50.728 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-20T06:42:50.729 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-20T06:42:50.729 INFO:teuthology.orchestra.run.smithi019.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-20T06:42:50.729 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-20T06:42:50.729 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-20T06:42:50.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:50.729 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2023-11-20T06:42:50.729 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2023-11-20T06:42:50.729 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-20T06:42:50.729 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-20T06:42:50.730 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-20T06:42:50.730 DEBUG:teuthology.orchestra.run.smithi019:> ') 2023-11-20T06:42:50.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:50.824 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2023-11-20T06:42:50.834 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-20T06:42:50.834 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-20T06:42:50.834 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-20T06:42:50.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:50.835 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2023-11-20T06:42:50.900 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-20T06:42:50.900 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T06:42:50.900 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-20T06:42:50.955 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-20T06:42:50.956 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T06:42:50.956 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-20T06:42:51.007 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2023-11-20T06:42:51.072 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T06:42:51.125 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2023-11-20T06:42:51.125 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2023-11-20T06:42:51.125 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2023-11-20T06:42:51.125 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2023-11-20T06:42:51.125 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2023-11-20T06:42:51.125 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2023-11-20T06:42:51.125 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2023-11-20T06:42:51.125 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2023-11-20T06:42:51.126 INFO:teuthology.orchestra.run.smithi019.stdout:/run/lock 2023-11-20T06:42:51.126 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2023-11-20T06:42:51.126 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2023-11-20T06:42:51.126 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2023-11-20T06:42:51.126 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T06:42:51.126 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2023-11-20T06:42:51.126 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2023-11-20T06:42:51.126 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2023-11-20T06:42:51.126 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2023-11-20T06:42:51.126 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/fs/nfsd 2023-11-20T06:42:51.126 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2023-11-20T06:42:51.126 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2023-11-20T06:42:51.127 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T06:42:51.127 INFO:teuthology.orchestra.run.smithi019.stdout:/run/rpc_pipefs 2023-11-20T06:42:51.127 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2023-11-20T06:42:51.127 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2023-11-20T06:42:51.127 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2023-11-20T06:42:51.127 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2023-11-20T06:42:51.127 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2023-11-20T06:42:51.127 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2023-11-20T06:42:51.127 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2023-11-20T06:42:51.127 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T06:42:51.127 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T06:42:51.127 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T06:42:51.127 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T06:42:51.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:51.128 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2023-11-20T06:42:51.179 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-20T06:42:51.179 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-20T06:42:51.225 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2023-11-20T06:42:51.247 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T06:42:51.301 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2023-11-20T06:42:51.301 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2023-11-20T06:42:51.301 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2023-11-20T06:42:51.301 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2023-11-20T06:42:51.301 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2023-11-20T06:42:51.301 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2023-11-20T06:42:51.301 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2023-11-20T06:42:51.301 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2023-11-20T06:42:51.301 INFO:teuthology.orchestra.run.smithi019.stdout:/run/lock 2023-11-20T06:42:51.301 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2023-11-20T06:42:51.302 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2023-11-20T06:42:51.302 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2023-11-20T06:42:51.302 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T06:42:51.302 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2023-11-20T06:42:51.302 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2023-11-20T06:42:51.302 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2023-11-20T06:42:51.302 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2023-11-20T06:42:51.302 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/fs/nfsd 2023-11-20T06:42:51.302 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2023-11-20T06:42:51.302 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2023-11-20T06:42:51.302 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T06:42:51.302 INFO:teuthology.orchestra.run.smithi019.stdout:/run/rpc_pipefs 2023-11-20T06:42:51.302 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2023-11-20T06:42:51.303 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2023-11-20T06:42:51.303 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2023-11-20T06:42:51.303 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2023-11-20T06:42:51.303 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2023-11-20T06:42:51.303 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2023-11-20T06:42:51.303 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2023-11-20T06:42:51.303 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T06:42:51.303 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T06:42:51.303 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T06:42:51.303 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T06:42:51.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:51.304 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2023-11-20T06:42:51.326 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:2023-11-20T06:42:51.319+0000 7fb87bd17580 -1 init, newargv = 0x564b4515f030 newargc=15 2023-11-20T06:42:51.326 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[49418]: starting ceph client 2023-11-20T06:42:51.333 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[49418]: starting fuse 2023-11-20T06:42:51.335 INFO:teuthology.orchestra.run.smithi019.stdout:43 2023-11-20T06:42:51.335 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-20T06:42:51.336 DEBUG:teuthology.orchestra.run.smithi019:> sudo stdin-killer -- python3 -c ' 2023-11-20T06:42:51.336 DEBUG:teuthology.orchestra.run.smithi019:> import glob 2023-11-20T06:42:51.336 DEBUG:teuthology.orchestra.run.smithi019:> import re 2023-11-20T06:42:51.336 DEBUG:teuthology.orchestra.run.smithi019:> import os 2023-11-20T06:42:51.336 DEBUG:teuthology.orchestra.run.smithi019:> import subprocess 2023-11-20T06:42:51.336 DEBUG:teuthology.orchestra.run.smithi019:> 2023-11-20T06:42:51.336 DEBUG:teuthology.orchestra.run.smithi019:> def _find_admin_socket(client_name): 2023-11-20T06:42:51.336 DEBUG:teuthology.orchestra.run.smithi019:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-20T06:42:51.336 DEBUG:teuthology.orchestra.run.smithi019:> files = glob.glob(asok_path) 2023-11-20T06:42:51.336 DEBUG:teuthology.orchestra.run.smithi019:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-20T06:42:51.336 DEBUG:teuthology.orchestra.run.smithi019:> 2023-11-20T06:42:51.337 DEBUG:teuthology.orchestra.run.smithi019:> # Given a non-glob path, it better be there 2023-11-20T06:42:51.337 DEBUG:teuthology.orchestra.run.smithi019:> if "*" not in asok_path: 2023-11-20T06:42:51.337 DEBUG:teuthology.orchestra.run.smithi019:> assert(len(files) == 1) 2023-11-20T06:42:51.337 DEBUG:teuthology.orchestra.run.smithi019:> return files[0] 2023-11-20T06:42:51.337 DEBUG:teuthology.orchestra.run.smithi019:> 2023-11-20T06:42:51.337 DEBUG:teuthology.orchestra.run.smithi019:> for f in files: 2023-11-20T06:42:51.337 DEBUG:teuthology.orchestra.run.smithi019:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-20T06:42:51.337 DEBUG:teuthology.orchestra.run.smithi019:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-20T06:42:51.337 DEBUG:teuthology.orchestra.run.smithi019:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-20T06:42:51.337 DEBUG:teuthology.orchestra.run.smithi019:> contents = proc_f.read() 2023-11-20T06:42:51.337 DEBUG:teuthology.orchestra.run.smithi019:> if mountpoint in contents: 2023-11-20T06:42:51.337 DEBUG:teuthology.orchestra.run.smithi019:> return f 2023-11-20T06:42:51.337 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-20T06:42:51.338 DEBUG:teuthology.orchestra.run.smithi019:> 2023-11-20T06:42:51.338 DEBUG:teuthology.orchestra.run.smithi019:> print(_find_admin_socket("client.0")) 2023-11-20T06:42:51.338 DEBUG:teuthology.orchestra.run.smithi019:> ' 2023-11-20T06:42:51.462 INFO:teuthology.orchestra.run.smithi019.stdout:/var/run/ceph/ceph-client.0.49418.asok 2023-11-20T06:42:51.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-20T06:42:51.473 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49418.asok 2023-11-20T06:42:51.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:51.474 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49418.asok status 2023-11-20T06:42:51.651 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-20T06:42:51.652 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": { 2023-11-20T06:42:51.652 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-20T06:42:51.652 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-20T06:42:51.653 INFO:teuthology.orchestra.run.smithi019.stdout: "entity_id": "0", 2023-11-20T06:42:51.653 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": "smithi019", 2023-11-20T06:42:51.653 INFO:teuthology.orchestra.run.smithi019.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-20T06:42:51.653 INFO:teuthology.orchestra.run.smithi019.stdout: "pid": "49418", 2023-11-20T06:42:51.653 INFO:teuthology.orchestra.run.smithi019.stdout: "root": "/" 2023-11-20T06:42:51.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:51.654 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_count": 0, 2023-11-20T06:42:51.654 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_pinned_count": 0, 2023-11-20T06:42:51.654 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 5643, 2023-11-20T06:42:51.654 INFO:teuthology.orchestra.run.smithi019.stdout: "inst": { 2023-11-20T06:42:51.654 INFO:teuthology.orchestra.run.smithi019.stdout: "name": { 2023-11-20T06:42:51.654 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "client", 2023-11-20T06:42:51.654 INFO:teuthology.orchestra.run.smithi019.stdout: "num": 5643 2023-11-20T06:42:51.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:51.655 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2023-11-20T06:42:51.655 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-11-20T06:42:51.655 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2023-11-20T06:42:51.655 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 272540313 2023-11-20T06:42:51.655 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-20T06:42:51.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:51.656 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2023-11-20T06:42:51.656 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-11-20T06:42:51.656 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2023-11-20T06:42:51.656 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 272540313 2023-11-20T06:42:51.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-20T06:42:51.657 INFO:teuthology.orchestra.run.smithi019.stdout: "inst_str": "client.5643 192.168.0.1:0/272540313", 2023-11-20T06:42:51.657 INFO:teuthology.orchestra.run.smithi019.stdout: "addr_str": "192.168.0.1:0/272540313", 2023-11-20T06:42:51.657 INFO:teuthology.orchestra.run.smithi019.stdout: "inode_count": 1, 2023-11-20T06:42:51.657 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_epoch": 18, 2023-11-20T06:42:51.657 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch": 39, 2023-11-20T06:42:51.657 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch_barrier": 0, 2023-11-20T06:42:51.657 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklisted": false, 2023-11-20T06:42:51.657 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs" 2023-11-20T06:42:51.657 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-20T06:42:51.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:51.667 DEBUG:teuthology.orchestra.run.smithi019:> stat --file-system '--printf=%T 2023-11-20T06:42:51.667 DEBUG:teuthology.orchestra.run.smithi019:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-20T06:42:51.677 INFO:teuthology.orchestra.run.smithi019.stdout:fuseblk 2023-11-20T06:42:51.677 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-20T06:42:51.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:51.677 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-20T06:42:51.744 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-20T06:42:51.744 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-20T06:42:51.890 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-20T06:42:51.979 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-20T06:42:51.979 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:42:51.979 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:42:51.989 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:52.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.167+0000 7f7ee1d3e640 1 Processor -- start 2023-11-20T06:42:52.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.167+0000 7f7ee1d3e640 1 -- start start 2023-11-20T06:42:52.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.167+0000 7f7ee1d3e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7edc0b2ad0 0x7f7edc06b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:52.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.167+0000 7f7ee1d3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7edc15cf90 0x7f7edc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:52.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.167+0000 7f7ee1d3e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7edc15d4e0 con 0x7f7edc0ce310 2023-11-20T06:42:52.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.167+0000 7f7ee1d3e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7edc160580 con 0x7f7edc0b2ad0 2023-11-20T06:42:52.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.167+0000 7f7ee1d3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc15d7c0 con 0x7f7edc15cf90 2023-11-20T06:42:52.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.167+0000 7f7edbfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7edc0ce310 0x7f7edc1609d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40758/0 (socket says 172.21.15.19:40758) 2023-11-20T06:42:52.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.167+0000 7f7edbfff640 1 -- 172.21.15.19:0/2949318211 learned_addr learned my addr 172.21.15.19:0/2949318211 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:52.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.167+0000 7f7edb7fe640 1 --2- 172.21.15.19:0/2949318211 >> v2:172.21.15.190:3300/0 conn(0x7f7edc0b2ad0 0x7f7edc06b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:52.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.167+0000 7f7edaffd640 1 --2- 172.21.15.19:0/2949318211 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7edc15cf90 0x7f7edc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:52.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.171+0000 7f7eda7fc640 1 -- 172.21.15.19:0/2949318211 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256275591 0 0) 0x7f7edc15d4e0 con 0x7f7edc0ce310 2023-11-20T06:42:52.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.171+0000 7f7eda7fc640 1 -- 172.21.15.19:0/2949318211 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ec4003530 con 0x7f7edc0ce310 2023-11-20T06:42:52.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.171+0000 7f7edaffd640 1 -- 172.21.15.19:0/2949318211 >> v2:172.21.15.190:3300/0 conn(0x7f7edc0b2ad0 msgr2=0x7f7edc06b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:52.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.171+0000 7f7edaffd640 1 --2- 172.21.15.19:0/2949318211 >> v2:172.21.15.190:3300/0 conn(0x7f7edc0b2ad0 0x7f7edc06b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.171+0000 7f7edaffd640 1 -- 172.21.15.19:0/2949318211 >> v1:172.21.15.19:6789/0 conn(0x7f7edc0ce310 legacy=0x7f7edc1609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:52.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.171+0000 7f7edaffd640 1 -- 172.21.15.19:0/2949318211 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc15daa0 con 0x7f7edc15cf90 2023-11-20T06:42:52.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.171+0000 7f7edb7fe640 1 --2- 172.21.15.19:0/2949318211 >> v2:172.21.15.190:3300/0 conn(0x7f7edc0b2ad0 0x7f7edc06b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:42:52.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.171+0000 7f7edaffd640 1 --2- 172.21.15.19:0/2949318211 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7edc15cf90 0x7f7edc06c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00097c0 tx=0x7f7ed001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=665ff789b36a9b80 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:52.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.171+0000 7f7eda7fc640 1 -- 172.21.15.19:0/2949318211 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed00ad660 con 0x7f7edc15cf90 2023-11-20T06:42:52.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.171+0000 7f7eda7fc640 1 -- 172.21.15.19:0/2949318211 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed00ad7c0 con 0x7f7edc15cf90 2023-11-20T06:42:52.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.171+0000 7f7eda7fc640 1 -- 172.21.15.19:0/2949318211 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed00adb50 con 0x7f7edc15cf90 2023-11-20T06:42:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.175+0000 7f7ee1d3e640 1 -- 172.21.15.19:0/2949318211 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7edc15cf90 msgr2=0x7f7edc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.175+0000 7f7ee1d3e640 1 --2- 172.21.15.19:0/2949318211 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7edc15cf90 0x7f7edc06c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00097c0 tx=0x7f7ed001c450 comp rx=0 tx=0).stop 2023-11-20T06:42:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.175+0000 7f7ee1d3e640 1 -- 172.21.15.19:0/2949318211 shutdown_connections 2023-11-20T06:42:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.175+0000 7f7ee1d3e640 1 --2- 172.21.15.19:0/2949318211 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7edc15cf90 0x7f7edc06c8f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.175+0000 7f7ee1d3e640 1 --2- 172.21.15.19:0/2949318211 >> v2:172.21.15.190:3300/0 conn(0x7f7edc0b2ad0 0x7f7edc06b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.175+0000 7f7ee1d3e640 1 -- 172.21.15.19:0/2949318211 >> 172.21.15.19:0/2949318211 conn(0x7f7edc0cd1c0 msgr2=0x7f7edc0cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:52.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.175+0000 7f7ee1d3e640 1 -- 172.21.15.19:0/2949318211 shutdown_connections 2023-11-20T06:42:52.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.175+0000 7f7ee1d3e640 1 -- 172.21.15.19:0/2949318211 wait complete. 2023-11-20T06:42:52.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.175+0000 7f7ee1d3e640 1 Processor -- start 2023-11-20T06:42:52.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.175+0000 7f7ee1d3e640 1 -- start start 2023-11-20T06:42:52.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.175+0000 7f7ee1d3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7edc0b2ad0 0x7f7edc159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:52.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.175+0000 7f7ee1d3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7edc0ce310 0x7f7edc153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:52.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.175+0000 7f7ee1d3e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7edc15cf90 0x7f7edc0c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:52.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.175+0000 7f7ee1d3e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0c6000 con 0x7f7edc0ce310 2023-11-20T06:42:52.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.175+0000 7f7ee1d3e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0c53f0 con 0x7f7edc15cf90 2023-11-20T06:42:52.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.175+0000 7f7ee1d3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0c56d0 con 0x7f7edc0b2ad0 2023-11-20T06:42:52.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.175+0000 7f7edaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7edc0ce310 0x7f7edc153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:52.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.175+0000 7f7edaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7edc0ce310 0x7f7edc153150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42616/0 (socket says 172.21.15.19:42616) 2023-11-20T06:42:52.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.175+0000 7f7edaffd640 1 -- 172.21.15.19:0/1742721689 learned_addr learned my addr 172.21.15.19:0/1742721689 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:52.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.179+0000 7f7edb7fe640 1 --2- 172.21.15.19:0/1742721689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7edc0b2ad0 0x7f7edc159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:52.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.179+0000 7f7edbfff640 1 --2- 172.21.15.19:0/1742721689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7edc15cf90 0x7f7edc0c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.179+0000 7f7edaffd640 1 -- 172.21.15.19:0/1742721689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7edc0b2ad0 msgr2=0x7f7edc159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.179+0000 7f7edaffd640 1 --2- 172.21.15.19:0/1742721689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7edc0b2ad0 0x7f7edc159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.179+0000 7f7edaffd640 1 -- 172.21.15.19:0/1742721689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7edc15cf90 msgr2=0x7f7edc0c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.179+0000 7f7edaffd640 1 --2- 172.21.15.19:0/1742721689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7edc15cf90 0x7f7edc0c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.179+0000 7f7edaffd640 1 -- 172.21.15.19:0/1742721689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc009420 con 0x7f7edc0ce310 2023-11-20T06:42:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.179+0000 7f7edbfff640 1 --2- 172.21.15.19:0/1742721689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7edc15cf90 0x7f7edc0c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.179+0000 7f7edaffd640 1 --2- 172.21.15.19:0/1742721689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7edc0ce310 0x7f7edc153150 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7ed001ab00 tx=0x7f7ed00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.179+0000 7f7ec3fff640 1 -- 172.21.15.19:0/1742721689 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed00b7670 con 0x7f7edc0ce310 2023-11-20T06:42:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.179+0000 7f7ec3fff640 1 -- 172.21.15.19:0/1742721689 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed00b77f0 con 0x7f7edc0ce310 2023-11-20T06:42:52.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.179+0000 7f7ec3fff640 1 -- 172.21.15.19:0/1742721689 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed00b7ba0 con 0x7f7edc0ce310 2023-11-20T06:42:52.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.179+0000 7f7ee1d3e640 1 -- 172.21.15.19:0/1742721689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed0009420 con 0x7f7edc0ce310 2023-11-20T06:42:52.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.179+0000 7f7ee1d3e640 1 -- 172.21.15.19:0/1742721689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7edc0cecb0 con 0x7f7edc0ce310 2023-11-20T06:42:52.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.179+0000 7f7ee1d3e640 1 -- 172.21.15.19:0/1742721689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7edc0c6170 con 0x7f7edc0ce310 2023-11-20T06:42:52.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.179+0000 7f7ec3fff640 1 -- 172.21.15.19:0/1742721689 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7ed00b4040 con 0x7f7edc0ce310 2023-11-20T06:42:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.183+0000 7f7ec3fff640 1 --2- 172.21.15.19:0/1742721689 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7ec80664a0 0x7f7ec8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.183+0000 7f7ec3fff640 1 -- 172.21.15.19:0/1742721689 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7ed011e760 con 0x7f7edc0ce310 2023-11-20T06:42:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.183+0000 7f7edb7fe640 1 --2- 172.21.15.19:0/1742721689 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7ec80664a0 0x7f7ec8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.183+0000 7f7edb7fe640 1 --2- 172.21.15.19:0/1742721689 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7ec80664a0 0x7f7ec8068960 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0c7070 tx=0x7f7ecc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:52.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.183+0000 7f7ec3fff640 1 -- 172.21.15.19:0/1742721689 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7ed00eba90 con 0x7f7edc0ce310 2023-11-20T06:42:52.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.343+0000 7f7ee1d3e640 1 -- 172.21.15.19:0/1742721689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7edc074010 con 0x7f7edc0ce310 2023-11-20T06:42:52.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.343+0000 7f7ec3fff640 1 -- 172.21.15.19:0/1742721689 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16762 (secure 0 0 0) 0x7f7ed00ef0b0 con 0x7f7edc0ce310 2023-11-20T06:42:52.351 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:52.351 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":39,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:42:44.883106+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:42:41.076502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-20T06:42:42.316293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:52.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.347+0000 7f7ee1d3e640 1 -- 172.21.15.19:0/1742721689 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7ec80664a0 msgr2=0x7f7ec8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:52.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.347+0000 7f7ee1d3e640 1 --2- 172.21.15.19:0/1742721689 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7ec80664a0 0x7f7ec8068960 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0c7070 tx=0x7f7ecc008040 comp rx=0 tx=0).stop 2023-11-20T06:42:52.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.347+0000 7f7ee1d3e640 1 -- 172.21.15.19:0/1742721689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7edc0ce310 msgr2=0x7f7edc153150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:52.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.347+0000 7f7ee1d3e640 1 --2- 172.21.15.19:0/1742721689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7edc0ce310 0x7f7edc153150 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7ed001ab00 tx=0x7f7ed00191f0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.347+0000 7f7ee1d3e640 1 -- 172.21.15.19:0/1742721689 shutdown_connections 2023-11-20T06:42:52.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.347+0000 7f7ee1d3e640 1 --2- 172.21.15.19:0/1742721689 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7ec80664a0 0x7f7ec8068960 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.347+0000 7f7ee1d3e640 1 --2- 172.21.15.19:0/1742721689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7edc15cf90 0x7f7edc0c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.347+0000 7f7ee1d3e640 1 --2- 172.21.15.19:0/1742721689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7edc0ce310 0x7f7edc153150 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.347+0000 7f7ee1d3e640 1 --2- 172.21.15.19:0/1742721689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7edc0b2ad0 0x7f7edc159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.347+0000 7f7ee1d3e640 1 -- 172.21.15.19:0/1742721689 >> 172.21.15.19:0/1742721689 conn(0x7f7edc0cd1c0 msgr2=0x7f7edc0b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:52.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.347+0000 7f7ee1d3e640 1 -- 172.21.15.19:0/1742721689 shutdown_connections 2023-11-20T06:42:52.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.347+0000 7f7ee1d3e640 1 -- 172.21.15.19:0/1742721689 wait complete. 2023-11-20T06:42:52.371 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T06:42:41.076502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T06:42:42.316293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-20T06:42:52.372 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:42:52.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.511+0000 7fa04759e640 1 Processor -- start 2023-11-20T06:42:52.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.511+0000 7fa04759e640 1 -- start start 2023-11-20T06:42:52.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.515+0000 7fa04759e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0480cf210 0x7fa0480cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:52.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.515+0000 7fa04759e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa04815cdc0 0x7fa0480b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:52.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.515+0000 7fa04759e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0480cfb30 con 0x7fa0480d3320 2023-11-20T06:42:52.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.515+0000 7fa04759e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0480d0880 con 0x7fa04815cdc0 2023-11-20T06:42:52.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.515+0000 7fa04759e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480b1c00 con 0x7fa0480cf210 2023-11-20T06:42:52.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.515+0000 7fa03ffff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa04815cdc0 0x7fa0480b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:52.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.515+0000 7fa04659c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0480cf210 0x7fa0480cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:52.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.515+0000 7fa03ffff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa04815cdc0 0x7fa0480b2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:48022/0 (socket says 172.21.15.19:48022) 2023-11-20T06:42:52.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.515+0000 7fa046d9d640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fa0480d3320 0x7fa0480b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:41180/0 (socket says 172.21.15.19:41180) 2023-11-20T06:42:52.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.515+0000 7fa03ffff640 1 -- 172.21.15.19:0/1356857936 learned_addr learned my addr 172.21.15.19:0/1356857936 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:52.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.515+0000 7fa03ffff640 1 -- 172.21.15.19:0/1356857936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0480cf210 msgr2=0x7fa0480cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:52.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.515+0000 7fa03ffff640 1 --2- 172.21.15.19:0/1356857936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0480cf210 0x7fa0480cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.515+0000 7fa03ffff640 1 -- 172.21.15.19:0/1356857936 >> v1:172.21.15.190:6789/0 conn(0x7fa0480d3320 legacy=0x7fa0480b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:52.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.515+0000 7fa03ffff640 1 -- 172.21.15.19:0/1356857936 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0480b1ee0 con 0x7fa04815cdc0 2023-11-20T06:42:52.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.519+0000 7fa03ffff640 1 --2- 172.21.15.19:0/1356857936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa04815cdc0 0x7fa0480b2ca0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa030009870 tx=0x7fa0480b4100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c57cd3c7f69a47d server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:52.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.519+0000 7fa045d9b640 1 -- 172.21.15.19:0/1356857936 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0300aa670 con 0x7fa04815cdc0 2023-11-20T06:42:52.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.519+0000 7fa045d9b640 1 -- 172.21.15.19:0/1356857936 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0300aa7d0 con 0x7fa04815cdc0 2023-11-20T06:42:52.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.519+0000 7fa045d9b640 1 -- 172.21.15.19:0/1356857936 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0300aab60 con 0x7fa04815cdc0 2023-11-20T06:42:52.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.519+0000 7fa04759e640 1 -- 172.21.15.19:0/1356857936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa04815cdc0 msgr2=0x7fa0480b2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:52.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.519+0000 7fa04759e640 1 --2- 172.21.15.19:0/1356857936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa04815cdc0 0x7fa0480b2ca0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa030009870 tx=0x7fa0480b4100 comp rx=0 tx=0).stop 2023-11-20T06:42:52.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.519+0000 7fa04759e640 1 -- 172.21.15.19:0/1356857936 shutdown_connections 2023-11-20T06:42:52.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.519+0000 7fa04759e640 1 --2- 172.21.15.19:0/1356857936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa04815cdc0 0x7fa0480b2ca0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.519+0000 7fa04759e640 1 --2- 172.21.15.19:0/1356857936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0480cf210 0x7fa0480cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.519+0000 7fa04759e640 1 -- 172.21.15.19:0/1356857936 >> 172.21.15.19:0/1356857936 conn(0x7fa0480d2800 msgr2=0x7fa0480d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:52.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.519+0000 7fa04759e640 1 -- 172.21.15.19:0/1356857936 shutdown_connections 2023-11-20T06:42:52.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.519+0000 7fa04759e640 1 -- 172.21.15.19:0/1356857936 wait complete. 2023-11-20T06:42:52.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.519+0000 7fa04759e640 1 Processor -- start 2023-11-20T06:42:52.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.519+0000 7fa04759e640 1 -- start start 2023-11-20T06:42:52.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa04759e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0480cf210 0x7fa0480c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:52.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa04759e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0480d3320 0x7fa0480c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:52.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa04759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa04815cdc0 0x7fa0480b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:52.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa04759e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa048154e70 con 0x7fa04815cdc0 2023-11-20T06:42:52.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa04759e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480c6b60 con 0x7fa0480cf210 2023-11-20T06:42:52.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa04759e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480c7400 con 0x7fa0480d3320 2023-11-20T06:42:52.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa046d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa04815cdc0 0x7fa0480b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:52.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa046d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa04815cdc0 0x7fa0480b4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42628/0 (socket says 172.21.15.19:42628) 2023-11-20T06:42:52.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa046d9d640 1 -- 172.21.15.19:0/795719670 learned_addr learned my addr 172.21.15.19:0/795719670 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:52.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa03ffff640 1 --2- 172.21.15.19:0/795719670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0480d3320 0x7fa0480c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:52.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa04659c640 1 --2- 172.21.15.19:0/795719670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0480cf210 0x7fa0480c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:52.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa046d9d640 1 -- 172.21.15.19:0/795719670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0480d3320 msgr2=0x7fa0480c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:52.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa046d9d640 1 --2- 172.21.15.19:0/795719670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0480d3320 0x7fa0480c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa046d9d640 1 -- 172.21.15.19:0/795719670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0480cf210 msgr2=0x7fa0480c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:52.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa046d9d640 1 --2- 172.21.15.19:0/795719670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0480cf210 0x7fa0480c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa046d9d640 1 -- 172.21.15.19:0/795719670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0300094d0 con 0x7fa04815cdc0 2023-11-20T06:42:52.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa04659c640 1 --2- 172.21.15.19:0/795719670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0480cf210 0x7fa0480c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:52.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa046d9d640 1 --2- 172.21.15.19:0/795719670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa04815cdc0 0x7fa0480b4360 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa04000c7a0 tx=0x7fa04000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:52.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa03effd640 1 -- 172.21.15.19:0/795719670 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04000a640 con 0x7fa04815cdc0 2023-11-20T06:42:52.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa03effd640 1 -- 172.21.15.19:0/795719670 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04000a7a0 con 0x7fa04815cdc0 2023-11-20T06:42:52.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa03effd640 1 -- 172.21.15.19:0/795719670 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04000ab10 con 0x7fa04815cdc0 2023-11-20T06:42:52.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa04759e640 1 -- 172.21.15.19:0/795719670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0480c66a0 con 0x7fa04815cdc0 2023-11-20T06:42:52.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa04759e640 1 -- 172.21.15.19:0/795719670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0480c7090 con 0x7fa04815cdc0 2023-11-20T06:42:52.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa04759e640 1 -- 172.21.15.19:0/795719670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0480c7570 con 0x7fa04815cdc0 2023-11-20T06:42:52.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.523+0000 7fa03effd640 1 -- 172.21.15.19:0/795719670 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa04000ac70 con 0x7fa04815cdc0 2023-11-20T06:42:52.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.527+0000 7fa03effd640 1 --2- 172.21.15.19:0/795719670 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa0280664a0 0x7fa028068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:52.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.527+0000 7fa03effd640 1 -- 172.21.15.19:0/795719670 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa040083770 con 0x7fa04815cdc0 2023-11-20T06:42:52.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.527+0000 7fa04659c640 1 --2- 172.21.15.19:0/795719670 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa0280664a0 0x7fa028068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:52.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.527+0000 7fa04659c640 1 --2- 172.21.15.19:0/795719670 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa0280664a0 0x7fa028068960 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa038009b90 tx=0x7fa038008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:52.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.531+0000 7fa03effd640 1 -- 172.21.15.19:0/795719670 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa040050ac0 con 0x7fa04815cdc0 2023-11-20T06:42:52.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.687+0000 7fa04759e640 1 -- 172.21.15.19:0/795719670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa04804e9c0 con 0x7fa04815cdc0 2023-11-20T06:42:52.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.691+0000 7fa03effd640 1 -- 172.21.15.19:0/795719670 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa040017020 con 0x7fa04815cdc0 2023-11-20T06:42:52.695 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:42:52.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.691+0000 7fa04759e640 1 -- 172.21.15.19:0/795719670 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa0280664a0 msgr2=0x7fa028068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:52.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.691+0000 7fa04759e640 1 --2- 172.21.15.19:0/795719670 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa0280664a0 0x7fa028068960 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa038009b90 tx=0x7fa038008040 comp rx=0 tx=0).stop 2023-11-20T06:42:52.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.691+0000 7fa04759e640 1 -- 172.21.15.19:0/795719670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa04815cdc0 msgr2=0x7fa0480b4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:52.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.691+0000 7fa04759e640 1 --2- 172.21.15.19:0/795719670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa04815cdc0 0x7fa0480b4360 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa04000c7a0 tx=0x7fa04000cc60 comp rx=0 tx=0).stop 2023-11-20T06:42:52.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.691+0000 7fa04759e640 1 -- 172.21.15.19:0/795719670 shutdown_connections 2023-11-20T06:42:52.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.691+0000 7fa04759e640 1 --2- 172.21.15.19:0/795719670 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa0280664a0 0x7fa028068960 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.691+0000 7fa04759e640 1 --2- 172.21.15.19:0/795719670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa04815cdc0 0x7fa0480b4360 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.691+0000 7fa04759e640 1 --2- 172.21.15.19:0/795719670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0480d3320 0x7fa0480c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.691+0000 7fa04759e640 1 --2- 172.21.15.19:0/795719670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0480cf210 0x7fa0480c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.691+0000 7fa04759e640 1 -- 172.21.15.19:0/795719670 >> 172.21.15.19:0/795719670 conn(0x7fa0480d2800 msgr2=0x7fa0480d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:52.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.691+0000 7fa04759e640 1 -- 172.21.15.19:0/795719670 shutdown_connections 2023-11-20T06:42:52.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.691+0000 7fa04759e640 1 -- 172.21.15.19:0/795719670 wait complete. 2023-11-20T06:42:52.717 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T06:42:52.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.859+0000 7f32e21d3640 1 Processor -- start 2023-11-20T06:42:52.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.859+0000 7f32e21d3640 1 -- start start 2023-11-20T06:42:52.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.859+0000 7f32e21d3640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f32dc0d0210 0x7f32dc0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:52.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.859+0000 7f32e21d3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32dc0b84e0 0x7f32dc0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:52.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.859+0000 7f32e21d3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32dc0d1670 con 0x7f32dc15cba0 2023-11-20T06:42:52.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.859+0000 7f32e21d3640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32dc0d1460 con 0x7f32dc0d0210 2023-11-20T06:42:52.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.859+0000 7f32e21d3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc0d1950 con 0x7f32dc0b84e0 2023-11-20T06:42:52.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.859+0000 7f32daffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f32dc0d0210 0x7f32dc0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:52.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.859+0000 7f32dbfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32dc0b84e0 0x7f32dc0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:52.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.859+0000 7f32db7fe640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f32dc15cba0 0x7f32dc0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:41194/0 (socket says 172.21.15.19:41194) 2023-11-20T06:42:52.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.859+0000 7f32dbfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32dc0b84e0 0x7f32dc0b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:59008/0 (socket says 172.21.15.19:59008) 2023-11-20T06:42:52.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.859+0000 7f32db7fe640 1 -- 172.21.15.19:0/2533615167 learned_addr learned my addr 172.21.15.19:0/2533615167 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:52.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.859+0000 7f32daffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f32dc0d0210 0x7f32dc0d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:48042/0 (socket says 172.21.15.19:48042) 2023-11-20T06:42:52.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.859+0000 7f32da7fc640 1 -- 172.21.15.19:0/2533615167 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305621236 0 0) 0x7f32dc0d1670 con 0x7f32dc15cba0 2023-11-20T06:42:52.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.859+0000 7f32dbfff640 1 -- 172.21.15.19:0/2533615167 >> v2:172.21.15.190:3300/0 conn(0x7f32dc0d0210 msgr2=0x7f32dc0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:52.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.859+0000 7f32dbfff640 1 --2- 172.21.15.19:0/2533615167 >> v2:172.21.15.190:3300/0 conn(0x7f32dc0d0210 0x7f32dc0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.859+0000 7f32dbfff640 1 -- 172.21.15.19:0/2533615167 >> v1:172.21.15.190:6789/0 conn(0x7f32dc15cba0 legacy=0x7f32dc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:52.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.859+0000 7f32dbfff640 1 -- 172.21.15.19:0/2533615167 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc0d1c30 con 0x7f32dc0b84e0 2023-11-20T06:42:52.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.863+0000 7f32dbfff640 1 --2- 172.21.15.19:0/2533615167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32dc0b84e0 0x7f32dc0b5cf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009d90 tx=0x7f32d401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0e63f40d4f002f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:52.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.863+0000 7f32da7fc640 1 -- 172.21.15.19:0/2533615167 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d40a5a10 con 0x7f32dc0b84e0 2023-11-20T06:42:52.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.863+0000 7f32da7fc640 1 -- 172.21.15.19:0/2533615167 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d40a5b70 con 0x7f32dc0b84e0 2023-11-20T06:42:52.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.863+0000 7f32da7fc640 1 -- 172.21.15.19:0/2533615167 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d40ad440 con 0x7f32dc0b84e0 2023-11-20T06:42:52.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.863+0000 7f32e21d3640 1 -- 172.21.15.19:0/2533615167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32dc0b84e0 msgr2=0x7f32dc0b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:52.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.863+0000 7f32e21d3640 1 --2- 172.21.15.19:0/2533615167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32dc0b84e0 0x7f32dc0b5cf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009d90 tx=0x7f32d401c950 comp rx=0 tx=0).stop 2023-11-20T06:42:52.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.863+0000 7f32e21d3640 1 -- 172.21.15.19:0/2533615167 shutdown_connections 2023-11-20T06:42:52.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.863+0000 7f32e21d3640 1 --2- 172.21.15.19:0/2533615167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32dc0b84e0 0x7f32dc0b5cf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.863+0000 7f32e21d3640 1 --2- 172.21.15.19:0/2533615167 >> v2:172.21.15.190:3300/0 conn(0x7f32dc0d0210 0x7f32dc0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.863+0000 7f32e21d3640 1 -- 172.21.15.19:0/2533615167 >> 172.21.15.19:0/2533615167 conn(0x7f32dc0719c0 msgr2=0x7f32dc071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:52.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.863+0000 7f32e21d3640 1 -- 172.21.15.19:0/2533615167 shutdown_connections 2023-11-20T06:42:52.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.863+0000 7f32e21d3640 1 -- 172.21.15.19:0/2533615167 wait complete. 2023-11-20T06:42:52.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32e21d3640 1 Processor -- start 2023-11-20T06:42:52.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32e21d3640 1 -- start start 2023-11-20T06:42:52.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32e21d3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32dc0b84e0 0x7f32dc0c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:52.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32e21d3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32dc0d0210 0x7f32dc0c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:52.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32e21d3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32dc15cba0 0x7f32dc140a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:52.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32e21d3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc14ffe0 con 0x7f32dc0b84e0 2023-11-20T06:42:52.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32e21d3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc0c7b80 con 0x7f32dc0d0210 2023-11-20T06:42:52.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32e21d3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc0c7e60 con 0x7f32dc15cba0 2023-11-20T06:42:52.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32db7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32dc0b84e0 0x7f32dc0c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:52.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32db7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32dc0b84e0 0x7f32dc0c7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42630/0 (socket says 172.21.15.19:42630) 2023-11-20T06:42:52.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32db7fe640 1 -- 172.21.15.19:0/97981054 learned_addr learned my addr 172.21.15.19:0/97981054 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:52.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32dbfff640 1 --2- 172.21.15.19:0/97981054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32dc15cba0 0x7f32dc140a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:52.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32daffd640 1 --2- 172.21.15.19:0/97981054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32dc0d0210 0x7f32dc0c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:52.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32db7fe640 1 -- 172.21.15.19:0/97981054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32dc15cba0 msgr2=0x7f32dc140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:52.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32db7fe640 1 --2- 172.21.15.19:0/97981054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32dc15cba0 0x7f32dc140a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32db7fe640 1 -- 172.21.15.19:0/97981054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32dc0d0210 msgr2=0x7f32dc0c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:52.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32db7fe640 1 --2- 172.21.15.19:0/97981054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32dc0d0210 0x7f32dc0c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:52.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32db7fe640 1 -- 172.21.15.19:0/97981054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d4009a70 con 0x7f32dc0b84e0 2023-11-20T06:42:52.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32db7fe640 1 --2- 172.21.15.19:0/97981054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32dc0b84e0 0x7f32dc0c7580 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00c480 tx=0x7f32cc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:52.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32c3fff640 1 -- 172.21.15.19:0/97981054 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc0074e0 con 0x7f32dc0b84e0 2023-11-20T06:42:52.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32c3fff640 1 -- 172.21.15.19:0/97981054 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32cc007660 con 0x7f32dc0b84e0 2023-11-20T06:42:52.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32e21d3640 1 -- 172.21.15.19:0/97981054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32dc0c8140 con 0x7f32dc0b84e0 2023-11-20T06:42:52.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32c3fff640 1 -- 172.21.15.19:0/97981054 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc004a30 con 0x7f32dc0b84e0 2023-11-20T06:42:52.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.867+0000 7f32e21d3640 1 -- 172.21.15.19:0/97981054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32dc0c8700 con 0x7f32dc0b84e0 2023-11-20T06:42:52.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.871+0000 7f32e21d3640 1 -- 172.21.15.19:0/97981054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32dc04e170 con 0x7f32dc0b84e0 2023-11-20T06:42:52.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.871+0000 7f32c3fff640 1 -- 172.21.15.19:0/97981054 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f32cc004b90 con 0x7f32dc0b84e0 2023-11-20T06:42:52.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.871+0000 7f32c3fff640 1 --2- 172.21.15.19:0/97981054 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f32c80664a0 0x7f32c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:52.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.871+0000 7f32c3fff640 1 -- 172.21.15.19:0/97981054 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f32cc083500 con 0x7f32dc0b84e0 2023-11-20T06:42:52.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.871+0000 7f32daffd640 1 --2- 172.21.15.19:0/97981054 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f32c80664a0 0x7f32c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:52.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.871+0000 7f32daffd640 1 --2- 172.21.15.19:0/97981054 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f32c80664a0 0x7f32c8068960 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0cfcb0 tx=0x7f32d0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:52.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:52.875+0000 7f32c3fff640 1 -- 172.21.15.19:0/97981054 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f32cc0542c0 con 0x7f32dc0b84e0 2023-11-20T06:42:53.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.035+0000 7f32e21d3640 1 -- 172.21.15.19:0/97981054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f32dc0ce830 con 0x7f32dc0b84e0 2023-11-20T06:42:53.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.035+0000 7f32c3fff640 1 -- 172.21.15.19:0/97981054 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f32cc053e50 con 0x7f32dc0b84e0 2023-11-20T06:42:53.040 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:53.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.035+0000 7f32e21d3640 1 -- 172.21.15.19:0/97981054 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f32c80664a0 msgr2=0x7f32c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:53.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.035+0000 7f32e21d3640 1 --2- 172.21.15.19:0/97981054 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f32c80664a0 0x7f32c8068960 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0cfcb0 tx=0x7f32d0008040 comp rx=0 tx=0).stop 2023-11-20T06:42:53.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.035+0000 7f32e21d3640 1 -- 172.21.15.19:0/97981054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32dc0b84e0 msgr2=0x7f32dc0c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:53.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.035+0000 7f32e21d3640 1 --2- 172.21.15.19:0/97981054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32dc0b84e0 0x7f32dc0c7580 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00c480 tx=0x7f32cc00c940 comp rx=0 tx=0).stop 2023-11-20T06:42:53.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.035+0000 7f32e21d3640 1 -- 172.21.15.19:0/97981054 shutdown_connections 2023-11-20T06:42:53.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.035+0000 7f32e21d3640 1 --2- 172.21.15.19:0/97981054 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f32c80664a0 0x7f32c8068960 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:53.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.035+0000 7f32e21d3640 1 --2- 172.21.15.19:0/97981054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32dc15cba0 0x7f32dc140a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:53.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.035+0000 7f32e21d3640 1 --2- 172.21.15.19:0/97981054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32dc0d0210 0x7f32dc0c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:53.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.035+0000 7f32e21d3640 1 --2- 172.21.15.19:0/97981054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32dc0b84e0 0x7f32dc0c7580 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:53.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.035+0000 7f32e21d3640 1 -- 172.21.15.19:0/97981054 >> 172.21.15.19:0/97981054 conn(0x7f32dc0719c0 msgr2=0x7f32dc071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:53.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.035+0000 7f32e21d3640 1 -- 172.21.15.19:0/97981054 shutdown_connections 2023-11-20T06:42:53.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.035+0000 7f32e21d3640 1 -- 172.21.15.19:0/97981054 wait complete. 2023-11-20T06:42:53.062 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T06:42:53.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.203+0000 7fcf94f0f640 1 Processor -- start 2023-11-20T06:42:53.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.203+0000 7fcf94f0f640 1 -- start start 2023-11-20T06:42:53.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.203+0000 7fcf94f0f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcf9006a5a0 0x7fcf9006e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:53.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.203+0000 7fcf94f0f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf900b4370 con 0x7fcf900b3f00 2023-11-20T06:42:53.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.203+0000 7fcf94f0f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf900b4600 con 0x7fcf90159900 2023-11-20T06:42:53.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.203+0000 7fcf94f0f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf900cd740 con 0x7fcf9006a5a0 2023-11-20T06:42:53.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.203+0000 7fcf8ed9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcf900b3f00 0x7fcf900c9b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40772/0 (socket says 172.21.15.19:40772) 2023-11-20T06:42:53.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.203+0000 7fcf8ed9d640 1 -- 172.21.15.19:0/2156553862 learned_addr learned my addr 172.21.15.19:0/2156553862 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:53.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.203+0000 7fcf8dd9b640 1 --2- 172.21.15.19:0/2156553862 >> v2:172.21.15.190:3300/0 conn(0x7fcf9006a5a0 0x7fcf9006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.203+0000 7fcf8d59a640 1 -- 172.21.15.19:0/2156553862 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3553206580 0 0) 0x7fcf900b4370 con 0x7fcf900b3f00 2023-11-20T06:42:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.203+0000 7fcf8d59a640 1 -- 172.21.15.19:0/2156553862 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf78005740 con 0x7fcf900b3f00 2023-11-20T06:42:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.203+0000 7fcf8dd9b640 1 -- 172.21.15.19:0/2156553862 >> v1:172.21.15.190:6789/0 conn(0x7fcf90159900 legacy=0x7fcf90069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.203+0000 7fcf8dd9b640 1 -- 172.21.15.19:0/2156553862 >> v1:172.21.15.19:6789/0 conn(0x7fcf900b3f00 legacy=0x7fcf900c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.203+0000 7fcf8d59a640 1 -- 172.21.15.19:0/2156553862 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410690148 0 0) 0x7fcf900b4600 con 0x7fcf90159900 2023-11-20T06:42:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.203+0000 7fcf8dd9b640 1 -- 172.21.15.19:0/2156553862 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf900c8dd0 con 0x7fcf9006a5a0 2023-11-20T06:42:53.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.207+0000 7fcf8dd9b640 1 --2- 172.21.15.19:0/2156553862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf9006a5a0 0x7fcf9006e260 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcf840097c0 tx=0x7fcf8401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=507ad6f51f82daf8 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:53.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.207+0000 7fcf8d59a640 1 -- 172.21.15.19:0/2156553862 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf840ab650 con 0x7fcf9006a5a0 2023-11-20T06:42:53.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.207+0000 7fcf8d59a640 1 -- 172.21.15.19:0/2156553862 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf840ab7b0 con 0x7fcf9006a5a0 2023-11-20T06:42:53.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.207+0000 7fcf8d59a640 1 -- 172.21.15.19:0/2156553862 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf840abb40 con 0x7fcf9006a5a0 2023-11-20T06:42:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.207+0000 7fcf94f0f640 1 -- 172.21.15.19:0/2156553862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf9006a5a0 msgr2=0x7fcf9006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.207+0000 7fcf94f0f640 1 --2- 172.21.15.19:0/2156553862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf9006a5a0 0x7fcf9006e260 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcf840097c0 tx=0x7fcf8401c450 comp rx=0 tx=0).stop 2023-11-20T06:42:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.207+0000 7fcf94f0f640 1 -- 172.21.15.19:0/2156553862 shutdown_connections 2023-11-20T06:42:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.207+0000 7fcf94f0f640 1 --2- 172.21.15.19:0/2156553862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf9006a5a0 0x7fcf9006e260 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.207+0000 7fcf94f0f640 1 -- 172.21.15.19:0/2156553862 >> 172.21.15.19:0/2156553862 conn(0x7fcf900b0da0 msgr2=0x7fcf900ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.207+0000 7fcf94f0f640 1 -- 172.21.15.19:0/2156553862 shutdown_connections 2023-11-20T06:42:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.207+0000 7fcf94f0f640 1 -- 172.21.15.19:0/2156553862 wait complete. 2023-11-20T06:42:53.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf94f0f640 1 Processor -- start 2023-11-20T06:42:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf94f0f640 1 -- start start 2023-11-20T06:42:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf94f0f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf9006a5a0 0x7fcf90153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf94f0f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf900b3f00 0x7fcf9015b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf94f0f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf90159900 0x7fcf9015acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf94f0f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9015bff0 con 0x7fcf900b3f00 2023-11-20T06:42:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf94f0f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9015a210 con 0x7fcf90159900 2023-11-20T06:42:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf94f0f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9015a4f0 con 0x7fcf9006a5a0 2023-11-20T06:42:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf8dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf900b3f00 0x7fcf9015b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf8dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf900b3f00 0x7fcf9015b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42642/0 (socket says 172.21.15.19:42642) 2023-11-20T06:42:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf8dd9b640 1 -- 172.21.15.19:0/4143662246 learned_addr learned my addr 172.21.15.19:0/4143662246 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf8ed9d640 1 --2- 172.21.15.19:0/4143662246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf90159900 0x7fcf9015acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf8e59c640 1 --2- 172.21.15.19:0/4143662246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf9006a5a0 0x7fcf90153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf8dd9b640 1 -- 172.21.15.19:0/4143662246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf9006a5a0 msgr2=0x7fcf90153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf8dd9b640 1 --2- 172.21.15.19:0/4143662246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf9006a5a0 0x7fcf90153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf8dd9b640 1 -- 172.21.15.19:0/4143662246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf90159900 msgr2=0x7fcf9015acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf8dd9b640 1 --2- 172.21.15.19:0/4143662246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf90159900 0x7fcf9015acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf8dd9b640 1 -- 172.21.15.19:0/4143662246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf84009420 con 0x7fcf900b3f00 2023-11-20T06:42:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf8dd9b640 1 --2- 172.21.15.19:0/4143662246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf900b3f00 0x7fcf9015b6f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcf840097c0 tx=0x7fcf8401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf7effd640 1 -- 172.21.15.19:0/4143662246 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84004220 con 0x7fcf900b3f00 2023-11-20T06:42:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf7effd640 1 -- 172.21.15.19:0/4143662246 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf84004380 con 0x7fcf900b3f00 2023-11-20T06:42:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf94f0f640 1 -- 172.21.15.19:0/4143662246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf9015a7d0 con 0x7fcf900b3f00 2023-11-20T06:42:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf7effd640 1 -- 172.21.15.19:0/4143662246 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84003840 con 0x7fcf900b3f00 2023-11-20T06:42:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.211+0000 7fcf94f0f640 1 -- 172.21.15.19:0/4143662246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9015bc30 con 0x7fcf900b3f00 2023-11-20T06:42:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.215+0000 7fcf94f0f640 1 -- 172.21.15.19:0/4143662246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9015a070 con 0x7fcf900b3f00 2023-11-20T06:42:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.215+0000 7fcf7effd640 1 -- 172.21.15.19:0/4143662246 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcf840039a0 con 0x7fcf900b3f00 2023-11-20T06:42:53.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.215+0000 7fcf7effd640 1 --2- 172.21.15.19:0/4143662246 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fcf700664a0 0x7fcf70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:53.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.215+0000 7fcf7effd640 1 -- 172.21.15.19:0/4143662246 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcf8411e480 con 0x7fcf900b3f00 2023-11-20T06:42:53.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.215+0000 7fcf8e59c640 1 --2- 172.21.15.19:0/4143662246 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fcf700664a0 0x7fcf70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:53.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.215+0000 7fcf8e59c640 1 --2- 172.21.15.19:0/4143662246 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fcf700664a0 0x7fcf70068960 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcf80000f70 tx=0x7fcf80009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.219+0000 7fcf7effd640 1 -- 172.21.15.19:0/4143662246 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcf9015a070 con 0x7fcf900b3f00 2023-11-20T06:42:53.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.375+0000 7fcf94f0f640 1 -- 172.21.15.19:0/4143662246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcf9015a070 con 0x7fcf900b3f00 2023-11-20T06:42:53.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.375+0000 7fcf7effd640 1 -- 172.21.15.19:0/4143662246 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcf9015a070 con 0x7fcf900b3f00 2023-11-20T06:42:53.382 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-20T06:42:53.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.379+0000 7fcf94f0f640 1 -- 172.21.15.19:0/4143662246 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fcf700664a0 msgr2=0x7fcf70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:53.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.379+0000 7fcf94f0f640 1 --2- 172.21.15.19:0/4143662246 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fcf700664a0 0x7fcf70068960 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcf80000f70 tx=0x7fcf80009040 comp rx=0 tx=0).stop 2023-11-20T06:42:53.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.379+0000 7fcf94f0f640 1 -- 172.21.15.19:0/4143662246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf900b3f00 msgr2=0x7fcf9015b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:53.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.379+0000 7fcf94f0f640 1 --2- 172.21.15.19:0/4143662246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf900b3f00 0x7fcf9015b6f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcf840097c0 tx=0x7fcf8401ac90 comp rx=0 tx=0).stop 2023-11-20T06:42:53.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.379+0000 7fcf94f0f640 1 -- 172.21.15.19:0/4143662246 shutdown_connections 2023-11-20T06:42:53.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.379+0000 7fcf94f0f640 1 --2- 172.21.15.19:0/4143662246 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fcf700664a0 0x7fcf70068960 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:53.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.379+0000 7fcf94f0f640 1 --2- 172.21.15.19:0/4143662246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf90159900 0x7fcf9015acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:53.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.379+0000 7fcf94f0f640 1 --2- 172.21.15.19:0/4143662246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf900b3f00 0x7fcf9015b6f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:53.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.379+0000 7fcf94f0f640 1 --2- 172.21.15.19:0/4143662246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf9006a5a0 0x7fcf90153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:53.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.379+0000 7fcf94f0f640 1 -- 172.21.15.19:0/4143662246 >> 172.21.15.19:0/4143662246 conn(0x7fcf900b0da0 msgr2=0x7fcf90154d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:53.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.379+0000 7fcf94f0f640 1 -- 172.21.15.19:0/4143662246 shutdown_connections 2023-11-20T06:42:53.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.379+0000 7fcf94f0f640 1 -- 172.21.15.19:0/4143662246 wait complete. 2023-11-20T06:42:53.403 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T06:42:53.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.543+0000 7fa40069c640 1 Processor -- start 2023-11-20T06:42:53.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.543+0000 7fa40069c640 1 -- start start 2023-11-20T06:42:53.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.543+0000 7fa40069c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa3f815ca70 0x7fa3f80d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:53.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.543+0000 7fa40069c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa3f80d3550 0x7fa3f80cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:53.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.543+0000 7fa40069c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f80cfa00 con 0x7fa3f80cf5d0 2023-11-20T06:42:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.543+0000 7fa40069c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f80ce820 con 0x7fa3f815ca70 2023-11-20T06:42:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.543+0000 7fa40069c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f80c65f0 con 0x7fa3f80d3550 2023-11-20T06:42:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.543+0000 7fa3fe438640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa3f815ca70 0x7fa3f80d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.543+0000 7fa3fec39640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa3f80cf5d0 0x7fa3f80d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40780/0 (socket says 172.21.15.19:40780) 2023-11-20T06:42:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.543+0000 7fa3fec39640 1 -- 172.21.15.19:0/1531311908 learned_addr learned my addr 172.21.15.19:0/1531311908 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.543+0000 7fa3fdc37640 1 --2- 172.21.15.19:0/1531311908 >> v2:172.21.15.190:3300/0 conn(0x7fa3f80d3550 0x7fa3f80cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.543+0000 7fa3fe438640 1 -- 172.21.15.19:0/1531311908 >> v2:172.21.15.190:3300/0 conn(0x7fa3f80d3550 msgr2=0x7fa3f80cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.543+0000 7fa3fe438640 1 --2- 172.21.15.19:0/1531311908 >> v2:172.21.15.190:3300/0 conn(0x7fa3f80d3550 0x7fa3f80cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:53.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.543+0000 7fa3fe438640 1 -- 172.21.15.19:0/1531311908 >> v1:172.21.15.19:6789/0 conn(0x7fa3f80cf5d0 legacy=0x7fa3f80d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:53.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.543+0000 7fa3fe438640 1 -- 172.21.15.19:0/1531311908 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f80cdf80 con 0x7fa3f815ca70 2023-11-20T06:42:53.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.543+0000 7fa3fd436640 1 -- 172.21.15.19:0/1531311908 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060742816 0 0) 0x7fa3f80cfa00 con 0x7fa3f80cf5d0 2023-11-20T06:42:53.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.547+0000 7fa3fe438640 1 --2- 172.21.15.19:0/1531311908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3f815ca70 0x7fa3f80d3010 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80b54f0 tx=0x7fa3f401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f2d4fd6f331a3f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:53.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.547+0000 7fa3fd436640 1 -- 172.21.15.19:0/1531311908 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f40ab610 con 0x7fa3f815ca70 2023-11-20T06:42:53.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.547+0000 7fa3fd436640 1 -- 172.21.15.19:0/1531311908 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f40ab770 con 0x7fa3f815ca70 2023-11-20T06:42:53.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.547+0000 7fa3fd436640 1 -- 172.21.15.19:0/1531311908 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f40abb00 con 0x7fa3f815ca70 2023-11-20T06:42:53.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.547+0000 7fa40069c640 1 -- 172.21.15.19:0/1531311908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3f815ca70 msgr2=0x7fa3f80d3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:53.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.547+0000 7fa40069c640 1 --2- 172.21.15.19:0/1531311908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3f815ca70 0x7fa3f80d3010 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80b54f0 tx=0x7fa3f401c410 comp rx=0 tx=0).stop 2023-11-20T06:42:53.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.547+0000 7fa40069c640 1 -- 172.21.15.19:0/1531311908 shutdown_connections 2023-11-20T06:42:53.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.547+0000 7fa40069c640 1 --2- 172.21.15.19:0/1531311908 >> v2:172.21.15.190:3300/0 conn(0x7fa3f80d3550 0x7fa3f80cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:53.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.547+0000 7fa40069c640 1 --2- 172.21.15.19:0/1531311908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3f815ca70 0x7fa3f80d3010 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:53.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.547+0000 7fa40069c640 1 -- 172.21.15.19:0/1531311908 >> 172.21.15.19:0/1531311908 conn(0x7fa3f809bc50 msgr2=0x7fa3f80d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:53.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.547+0000 7fa40069c640 1 -- 172.21.15.19:0/1531311908 shutdown_connections 2023-11-20T06:42:53.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.547+0000 7fa40069c640 1 -- 172.21.15.19:0/1531311908 wait complete. 2023-11-20T06:42:53.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.547+0000 7fa40069c640 1 Processor -- start 2023-11-20T06:42:53.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.547+0000 7fa40069c640 1 -- start start 2023-11-20T06:42:53.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa40069c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3f80cf5d0 0x7fa3f8152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:53.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa40069c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3f80d3550 0x7fa3f815ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:53.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa40069c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3f815ca70 0x7fa3f815b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:53.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa40069c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f815c320 con 0x7fa3f815ca70 2023-11-20T06:42:53.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa40069c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f815d4a0 con 0x7fa3f80d3550 2023-11-20T06:42:53.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa40069c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f815d780 con 0x7fa3f80cf5d0 2023-11-20T06:42:53.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa3fec39640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3f815ca70 0x7fa3f815b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:53.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa3fec39640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3f815ca70 0x7fa3f815b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42664/0 (socket says 172.21.15.19:42664) 2023-11-20T06:42:53.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa3fec39640 1 -- 172.21.15.19:0/770120103 learned_addr learned my addr 172.21.15.19:0/770120103 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:53.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa3fdc37640 1 --2- 172.21.15.19:0/770120103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3f80d3550 0x7fa3f815ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:53.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa3fe438640 1 --2- 172.21.15.19:0/770120103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3f80cf5d0 0x7fa3f8152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:53.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa3fec39640 1 -- 172.21.15.19:0/770120103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3f80cf5d0 msgr2=0x7fa3f8152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:53.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa3fec39640 1 --2- 172.21.15.19:0/770120103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3f80cf5d0 0x7fa3f8152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:53.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa3fec39640 1 -- 172.21.15.19:0/770120103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3f80d3550 msgr2=0x7fa3f815ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:53.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa3fec39640 1 --2- 172.21.15.19:0/770120103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3f80d3550 0x7fa3f815ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:53.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa3fec39640 1 -- 172.21.15.19:0/770120103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f40093b0 con 0x7fa3f815ca70 2023-11-20T06:42:53.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa3fec39640 1 --2- 172.21.15.19:0/770120103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3f815ca70 0x7fa3f815b2c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000c7a0 tx=0x7fa3f000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:53.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa3eeffd640 1 -- 172.21.15.19:0/770120103 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f000a640 con 0x7fa3f815ca70 2023-11-20T06:42:53.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa3eeffd640 1 -- 172.21.15.19:0/770120103 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f000a7a0 con 0x7fa3f815ca70 2023-11-20T06:42:53.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa3eeffd640 1 -- 172.21.15.19:0/770120103 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f000abd0 con 0x7fa3f815ca70 2023-11-20T06:42:53.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa40069c640 1 -- 172.21.15.19:0/770120103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f815da60 con 0x7fa3f815ca70 2023-11-20T06:42:53.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa40069c640 1 -- 172.21.15.19:0/770120103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f815e020 con 0x7fa3f815ca70 2023-11-20T06:42:53.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.551+0000 7fa40069c640 1 -- 172.21.15.19:0/770120103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f8074010 con 0x7fa3f815ca70 2023-11-20T06:42:53.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.555+0000 7fa3eeffd640 1 -- 172.21.15.19:0/770120103 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa3f000ad30 con 0x7fa3f815ca70 2023-11-20T06:42:53.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.555+0000 7fa3eeffd640 1 --2- 172.21.15.19:0/770120103 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa3dc0664a0 0x7fa3dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:53.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.555+0000 7fa3eeffd640 1 -- 172.21.15.19:0/770120103 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa3f0083490 con 0x7fa3f815ca70 2023-11-20T06:42:53.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.555+0000 7fa3fe438640 1 --2- 172.21.15.19:0/770120103 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa3dc0664a0 0x7fa3dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:53.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.555+0000 7fa3fe438640 1 --2- 172.21.15.19:0/770120103 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa3dc0664a0 0x7fa3dc068960 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40af000 tx=0x7fa3f40a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:53.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.559+0000 7fa3eeffd640 1 -- 172.21.15.19:0/770120103 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa3f0050880 con 0x7fa3f815ca70 2023-11-20T06:42:53.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.727+0000 7fa40069c640 1 -- 172.21.15.19:0/770120103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa3f8156440 con 0x7fa3f815ca70 2023-11-20T06:42:53.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.727+0000 7fa3eeffd640 1 -- 172.21.15.19:0/770120103 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa3f0018080 con 0x7fa3f815ca70 2023-11-20T06:42:53.734 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2023-11-20T06:42:53.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.731+0000 7fa40069c640 1 -- 172.21.15.19:0/770120103 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa3dc0664a0 msgr2=0x7fa3dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:53.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.731+0000 7fa40069c640 1 --2- 172.21.15.19:0/770120103 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa3dc0664a0 0x7fa3dc068960 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40af000 tx=0x7fa3f40a7000 comp rx=0 tx=0).stop 2023-11-20T06:42:53.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.731+0000 7fa40069c640 1 -- 172.21.15.19:0/770120103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3f815ca70 msgr2=0x7fa3f815b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:53.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.731+0000 7fa40069c640 1 --2- 172.21.15.19:0/770120103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3f815ca70 0x7fa3f815b2c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000c7a0 tx=0x7fa3f000cc60 comp rx=0 tx=0).stop 2023-11-20T06:42:53.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.731+0000 7fa40069c640 1 -- 172.21.15.19:0/770120103 shutdown_connections 2023-11-20T06:42:53.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.731+0000 7fa40069c640 1 --2- 172.21.15.19:0/770120103 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa3dc0664a0 0x7fa3dc068960 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:53.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.731+0000 7fa40069c640 1 --2- 172.21.15.19:0/770120103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3f815ca70 0x7fa3f815b2c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:53.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.731+0000 7fa40069c640 1 --2- 172.21.15.19:0/770120103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3f80d3550 0x7fa3f815ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:53.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.731+0000 7fa40069c640 1 --2- 172.21.15.19:0/770120103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3f80cf5d0 0x7fa3f8152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:53.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.731+0000 7fa40069c640 1 -- 172.21.15.19:0/770120103 >> 172.21.15.19:0/770120103 conn(0x7fa3f809bc50 msgr2=0x7fa3f81593c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:53.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.731+0000 7fa40069c640 1 -- 172.21.15.19:0/770120103 shutdown_connections 2023-11-20T06:42:53.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:53.731+0000 7fa40069c640 1 -- 172.21.15.19:0/770120103 wait complete. 2023-11-20T06:42:53.754 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi019.front.sepia.ceph.com... 2023-11-20T06:42:53.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:53.754 DEBUG:teuthology.orchestra.run.smithi019:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-20T06:42:53.774 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[49418]: fuse finished with error 0 and tester_r 0 2023-11-20T06:42:53.776 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2023-11-20T06:42:53.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:53.776 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-20T06:42:53.908 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:42:53.909 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:42:53.918 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2531 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-20T06:42:53.919 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-11-20T06:42:53.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:53.919 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-20T06:42:53.968 INFO:teuthology.orchestra.run.smithi190.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-20T06:42:53.969 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:42:53.970 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:42:53.970 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:42:53.979 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357772k,nr_inodes=4089443,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2598 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-20T06:42:53.979 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2023-11-20T06:42:53.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:53.979 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-20T06:42:54.031 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-20T06:42:54.031 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:42:54.032 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:42:54.032 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:42:54.041 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2531 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-20T06:42:54.042 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-11-20T06:42:54.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:42:54.042 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-20T06:42:54.093 INFO:teuthology.orchestra.run.smithi190.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-20T06:42:54.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:42:54.094 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T06:42:54.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.231+0000 7f7a6f209640 1 Processor -- start 2023-11-20T06:42:54.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.231+0000 7f7a6f209640 1 -- start start 2023-11-20T06:42:54.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.231+0000 7f7a6f209640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7a681597c0 0x7f7a680ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:54.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.231+0000 7f7a6f209640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a680adc10 0x7f7a680cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:54.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.231+0000 7f7a6f209640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a680723d0 con 0x7f7a68159ba0 2023-11-20T06:42:54.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.231+0000 7f7a6f209640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a680717c0 con 0x7f7a681597c0 2023-11-20T06:42:54.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.231+0000 7f7a6f209640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a68071aa0 con 0x7f7a680adc10 2023-11-20T06:42:54.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.231+0000 7f7a6cfa5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7a681597c0 0x7f7a680ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:54.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.231+0000 7f7a6cfa5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7a681597c0 0x7f7a680ad6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42672/0 (socket says 172.21.15.19:42672) 2023-11-20T06:42:54.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.231+0000 7f7a6cfa5640 1 -- 172.21.15.19:0/1773597214 learned_addr learned my addr 172.21.15.19:0/1773597214 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:54.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.231+0000 7f7a6d7a6640 1 --2- 172.21.15.19:0/1773597214 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a680adc10 0x7f7a680cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:54.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.235+0000 7f7a6cfa5640 1 -- 172.21.15.19:0/1773597214 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a680adc10 msgr2=0x7f7a680cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:54.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.235+0000 7f7a6cfa5640 1 --2- 172.21.15.19:0/1773597214 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a680adc10 0x7f7a680cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.235+0000 7f7a6cfa5640 1 -- 172.21.15.19:0/1773597214 >> v1:172.21.15.190:6789/0 conn(0x7f7a68159ba0 legacy=0x7f7a680cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:54.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.235+0000 7f7a6cfa5640 1 -- 172.21.15.19:0/1773597214 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a68071d80 con 0x7f7a681597c0 2023-11-20T06:42:54.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.235+0000 7f7a6cfa5640 1 --2- 172.21.15.19:0/1773597214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a681597c0 0x7f7a680ad6d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009870 tx=0x7f7a5c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b722ade7af06c61b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:54.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.235+0000 7f7a677fe640 1 -- 172.21.15.19:0/1773597214 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c0aa640 con 0x7f7a681597c0 2023-11-20T06:42:54.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.235+0000 7f7a677fe640 1 -- 172.21.15.19:0/1773597214 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c0aa7a0 con 0x7f7a681597c0 2023-11-20T06:42:54.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.235+0000 7f7a677fe640 1 -- 172.21.15.19:0/1773597214 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c0aab30 con 0x7f7a681597c0 2023-11-20T06:42:54.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.235+0000 7f7a6f209640 1 -- 172.21.15.19:0/1773597214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a681597c0 msgr2=0x7f7a680ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:54.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.235+0000 7f7a6f209640 1 --2- 172.21.15.19:0/1773597214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a681597c0 0x7f7a680ad6d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009870 tx=0x7f7a5c01c540 comp rx=0 tx=0).stop 2023-11-20T06:42:54.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.235+0000 7f7a6f209640 1 -- 172.21.15.19:0/1773597214 shutdown_connections 2023-11-20T06:42:54.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.235+0000 7f7a6f209640 1 --2- 172.21.15.19:0/1773597214 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a680adc10 0x7f7a680cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.235+0000 7f7a6f209640 1 --2- 172.21.15.19:0/1773597214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a681597c0 0x7f7a680ad6d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.235+0000 7f7a6f209640 1 -- 172.21.15.19:0/1773597214 >> 172.21.15.19:0/1773597214 conn(0x7f7a6806c190 msgr2=0x7f7a6806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:54.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.235+0000 7f7a6f209640 1 -- 172.21.15.19:0/1773597214 shutdown_connections 2023-11-20T06:42:54.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.235+0000 7f7a6f209640 1 -- 172.21.15.19:0/1773597214 wait complete. 2023-11-20T06:42:54.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a6f209640 1 Processor -- start 2023-11-20T06:42:54.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a6f209640 1 -- start start 2023-11-20T06:42:54.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a6f209640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a680adc10 0x7f7a68155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:54.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a6f209640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a681597c0 0x7f7a681470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:54.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a6f209640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a68159ba0 0x7f7a68158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:54.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a6f209640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a68147600 con 0x7f7a68159ba0 2023-11-20T06:42:54.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a6f209640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a68158e90 con 0x7f7a680adc10 2023-11-20T06:42:54.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a6f209640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a680c6de0 con 0x7f7a681597c0 2023-11-20T06:42:54.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a6d7a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a68159ba0 0x7f7a68158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:54.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a6d7a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a68159ba0 0x7f7a68158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42676/0 (socket says 172.21.15.19:42676) 2023-11-20T06:42:54.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a6d7a6640 1 -- 172.21.15.19:0/2280342736 learned_addr learned my addr 172.21.15.19:0/2280342736 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:54.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a6cfa5640 1 --2- 172.21.15.19:0/2280342736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a680adc10 0x7f7a68155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:54.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a67fff640 1 --2- 172.21.15.19:0/2280342736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a681597c0 0x7f7a681470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:54.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a6d7a6640 1 -- 172.21.15.19:0/2280342736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a681597c0 msgr2=0x7f7a681470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:54.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a6d7a6640 1 --2- 172.21.15.19:0/2280342736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a681597c0 0x7f7a681470c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a6d7a6640 1 -- 172.21.15.19:0/2280342736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a680adc10 msgr2=0x7f7a68155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:54.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a6d7a6640 1 --2- 172.21.15.19:0/2280342736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a680adc10 0x7f7a68155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a6d7a6640 1 -- 172.21.15.19:0/2280342736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c0094d0 con 0x7f7a68159ba0 2023-11-20T06:42:54.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a6d7a6640 1 --2- 172.21.15.19:0/2280342736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a68159ba0 0x7f7a68158110 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7a60007db0 tx=0x7f7a6000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:54.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a657fa640 1 -- 172.21.15.19:0/2280342736 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a60014420 con 0x7f7a68159ba0 2023-11-20T06:42:54.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.239+0000 7f7a657fa640 1 -- 172.21.15.19:0/2280342736 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a60014580 con 0x7f7a68159ba0 2023-11-20T06:42:54.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.243+0000 7f7a657fa640 1 -- 172.21.15.19:0/2280342736 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a60014930 con 0x7f7a68159ba0 2023-11-20T06:42:54.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.243+0000 7f7a6f209640 1 -- 172.21.15.19:0/2280342736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a68158650 con 0x7f7a68159ba0 2023-11-20T06:42:54.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.243+0000 7f7a6f209640 1 -- 172.21.15.19:0/2280342736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a681588d0 con 0x7f7a68159ba0 2023-11-20T06:42:54.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.243+0000 7f7a6f209640 1 -- 172.21.15.19:0/2280342736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a680c6910 con 0x7f7a68159ba0 2023-11-20T06:42:54.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.243+0000 7f7a657fa640 1 -- 172.21.15.19:0/2280342736 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7a60014a90 con 0x7f7a68159ba0 2023-11-20T06:42:54.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.243+0000 7f7a657fa640 1 --2- 172.21.15.19:0/2280342736 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7a4c0664a0 0x7f7a4c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:54.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.243+0000 7f7a657fa640 1 -- 172.21.15.19:0/2280342736 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7a60084790 con 0x7f7a68159ba0 2023-11-20T06:42:54.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.243+0000 7f7a6cfa5640 1 --2- 172.21.15.19:0/2280342736 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7a4c0664a0 0x7f7a4c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:54.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.247+0000 7f7a6cfa5640 1 --2- 172.21.15.19:0/2280342736 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7a4c0664a0 0x7f7a4c068960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0ae000 tx=0x7f7a5c0b5040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:54.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.247+0000 7f7a657fa640 1 -- 172.21.15.19:0/2280342736 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7a680c6910 con 0x7f7a68159ba0 2023-11-20T06:42:54.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.439+0000 7f7a6f209640 1 -- 172.21.15.19:0/2280342736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a680c6910 con 0x7f7a68159ba0 2023-11-20T06:42:54.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.439+0000 7f7a657fa640 1 -- 172.21.15.19:0/2280342736 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f7a680c6910 con 0x7f7a68159ba0 2023-11-20T06:42:54.444 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:54.444 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3692171038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3692171038},{"type":"v1","addr":"172.21.15.190:6835","nonce":3692171038}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2633535615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":2633535615},{"type":"v1","addr":"172.21.15.190:6837","nonce":2633535615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/1822146855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1822146855},{"type":"v1","addr":"172.21.15.19:6833","nonce":1822146855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T06:42:43.280879+0000","modified":"2023-11-20T06:42:46.648235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/203468016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":203468016},{"type":"v1","addr":"172.21.15.19:6835","nonce":203468016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-20T06:42:54.445 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 18 2023-11-20T06:42:54.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.439+0000 7f7a6f209640 1 -- 172.21.15.19:0/2280342736 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7a4c0664a0 msgr2=0x7f7a4c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:54.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.439+0000 7f7a6f209640 1 --2- 172.21.15.19:0/2280342736 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7a4c0664a0 0x7f7a4c068960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0ae000 tx=0x7f7a5c0b5040 comp rx=0 tx=0).stop 2023-11-20T06:42:54.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.439+0000 7f7a6f209640 1 -- 172.21.15.19:0/2280342736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a68159ba0 msgr2=0x7f7a68158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:54.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.439+0000 7f7a6f209640 1 --2- 172.21.15.19:0/2280342736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a68159ba0 0x7f7a68158110 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7a60007db0 tx=0x7f7a6000e4b0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.439+0000 7f7a6f209640 1 -- 172.21.15.19:0/2280342736 shutdown_connections 2023-11-20T06:42:54.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.439+0000 7f7a6f209640 1 --2- 172.21.15.19:0/2280342736 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f7a4c0664a0 0x7f7a4c068960 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.439+0000 7f7a6f209640 1 --2- 172.21.15.19:0/2280342736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a68159ba0 0x7f7a68158110 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.439+0000 7f7a6f209640 1 --2- 172.21.15.19:0/2280342736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a681597c0 0x7f7a681470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.439+0000 7f7a6f209640 1 --2- 172.21.15.19:0/2280342736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a680adc10 0x7f7a68155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.439+0000 7f7a6f209640 1 -- 172.21.15.19:0/2280342736 >> 172.21.15.19:0/2280342736 conn(0x7f7a6806c190 msgr2=0x7f7a680ae730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:54.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.439+0000 7f7a6f209640 1 -- 172.21.15.19:0/2280342736 shutdown_connections 2023-11-20T06:42:54.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.439+0000 7f7a6f209640 1 -- 172.21.15.19:0/2280342736 wait complete. 2023-11-20T06:42:54.466 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:54.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.603+0000 7f0ba1805640 1 Processor -- start 2023-11-20T06:42:54.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.603+0000 7f0ba1805640 1 -- start start 2023-11-20T06:42:54.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0ba1805640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0b9c0cf520 0x7f0b9c0c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:54.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0ba1805640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9c0c65f0 con 0x7f0b9c0cf090 2023-11-20T06:42:54.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0ba1805640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9c0cdf80 con 0x7f0b9c15ca70 2023-11-20T06:42:54.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0ba1805640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b9c0ce820 con 0x7f0b9c0cf520 2023-11-20T06:42:54.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b93fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0b9c0cf090 0x7f0b9c0c6ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40784/0 (socket says 172.21.15.19:40784) 2023-11-20T06:42:54.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b93fff640 1 -- 172.21.15.19:0/583078854 learned_addr learned my addr 172.21.15.19:0/583078854 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:54.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b9b7fe640 1 --2- 172.21.15.19:0/583078854 >> v2:172.21.15.190:3300/0 conn(0x7f0b9c0cf520 0x7f0b9c0c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:54.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b9a7fc640 1 -- 172.21.15.19:0/583078854 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611614264 0 0) 0x7f0b9c0c65f0 con 0x7f0b9c0cf090 2023-11-20T06:42:54.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b9a7fc640 1 -- 172.21.15.19:0/583078854 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b88003530 con 0x7f0b9c0cf090 2023-11-20T06:42:54.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b9a7fc640 1 -- 172.21.15.19:0/583078854 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3403419717 0 0) 0x7f0b88003530 con 0x7f0b9c0cf090 2023-11-20T06:42:54.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b9a7fc640 1 -- 172.21.15.19:0/583078854 >> v2:172.21.15.190:3300/0 conn(0x7f0b9c0cf520 msgr2=0x7f0b9c0c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:54.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b9a7fc640 1 --2- 172.21.15.19:0/583078854 >> v2:172.21.15.190:3300/0 conn(0x7f0b9c0cf520 0x7f0b9c0c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b9a7fc640 1 -- 172.21.15.19:0/583078854 >> v1:172.21.15.190:6789/0 conn(0x7f0b9c15ca70 legacy=0x7f0b9c0d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:54.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b9a7fc640 1 -- 172.21.15.19:0/583078854 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c0ce260 con 0x7f0b9c0cf090 2023-11-20T06:42:54.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b9a7fc640 1 -- 172.21.15.19:0/583078854 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7f0b84001680 con 0x7f0b9c0cf090 2023-11-20T06:42:54.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b9a7fc640 1 -- 172.21.15.19:0/583078854 >> v1:172.21.15.19:6789/0 conn(0x7f0b9c0cf090 legacy=0x7f0b9c0c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:54.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b9a7fc640 1 --2- 172.21.15.19:0/583078854 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b88003980 0x7f0b88003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:54.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b9a7fc640 1 --2- 172.21.15.19:0/583078854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b880047d0 0x7f0b88004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:54.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b9a7fc640 1 --2- 172.21.15.19:0/583078854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b88005190 0x7f0b8800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:54.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b9a7fc640 1 -- 172.21.15.19:0/583078854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c0ce820 con 0x7f0b880047d0 2023-11-20T06:42:54.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b9a7fc640 1 -- 172.21.15.19:0/583078854 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8800c030 con 0x7f0b88005190 2023-11-20T06:42:54.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b9a7fc640 1 -- 172.21.15.19:0/583078854 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8800c1f0 con 0x7f0b88003980 2023-11-20T06:42:54.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b93fff640 1 --2- 172.21.15.19:0/583078854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b880047d0 0x7f0b88004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:54.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b9affd640 1 --2- 172.21.15.19:0/583078854 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b88003980 0x7f0b88003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:54.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b9b7fe640 1 --2- 172.21.15.19:0/583078854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b88005190 0x7f0b8800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:54.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b93fff640 1 -- 172.21.15.19:0/583078854 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b88003980 msgr2=0x7f0b88003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:54.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b93fff640 1 --2- 172.21.15.19:0/583078854 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b88003980 0x7f0b88003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b93fff640 1 -- 172.21.15.19:0/583078854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b88005190 msgr2=0x7f0b8800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:54.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b93fff640 1 --2- 172.21.15.19:0/583078854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b88005190 0x7f0b8800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b93fff640 1 -- 172.21.15.19:0/583078854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b88003530 con 0x7f0b880047d0 2023-11-20T06:42:54.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b9b7fe640 1 --2- 172.21.15.19:0/583078854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b88005190 0x7f0b8800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:54.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.607+0000 7f0b9b7fe640 1 -- 172.21.15.19:0/583078854 reap_dead start 2023-11-20T06:42:54.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.611+0000 7f0b93fff640 1 --2- 172.21.15.19:0/583078854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b880047d0 0x7f0b88004c50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400c1c0 tx=0x7f0b8401f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff963ccac28d4bfc server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:54.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.611+0000 7f0b9a7fc640 1 -- 172.21.15.19:0/583078854 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b84005ae0 con 0x7f0b880047d0 2023-11-20T06:42:54.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.611+0000 7f0b9a7fc640 1 -- 172.21.15.19:0/583078854 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b840ab070 con 0x7f0b880047d0 2023-11-20T06:42:54.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.611+0000 7f0b9a7fc640 1 -- 172.21.15.19:0/583078854 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b84007070 con 0x7f0b880047d0 2023-11-20T06:42:54.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.611+0000 7f0ba1805640 1 -- 172.21.15.19:0/583078854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b880047d0 msgr2=0x7f0b88004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:54.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.611+0000 7f0ba1805640 1 --2- 172.21.15.19:0/583078854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b880047d0 0x7f0b88004c50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400c1c0 tx=0x7f0b8401f350 comp rx=0 tx=0).stop 2023-11-20T06:42:54.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.611+0000 7f0ba1805640 1 -- 172.21.15.19:0/583078854 shutdown_connections 2023-11-20T06:42:54.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.611+0000 7f0ba1805640 1 --2- 172.21.15.19:0/583078854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b880047d0 0x7f0b88004c50 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.611+0000 7f0ba1805640 1 -- 172.21.15.19:0/583078854 >> 172.21.15.19:0/583078854 conn(0x7f0b9c09bc50 msgr2=0x7f0b9c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:54.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.611+0000 7f0ba1805640 1 -- 172.21.15.19:0/583078854 shutdown_connections 2023-11-20T06:42:54.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.611+0000 7f0ba1805640 1 -- 172.21.15.19:0/583078854 wait complete. 2023-11-20T06:42:54.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.611+0000 7f0ba1805640 1 Processor -- start 2023-11-20T06:42:54.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.611+0000 7f0ba1805640 1 -- start start 2023-11-20T06:42:54.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0ba1805640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b880047d0 0x7f0b9c154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:54.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0ba1805640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b9c158780 0x7f0b9c15aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:54.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0ba1805640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b9c157150 0x7f0b9c15b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:54.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0ba1805640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c15af60 con 0x7f0b880047d0 2023-11-20T06:42:54.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0ba1805640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c158c10 con 0x7f0b9c158780 2023-11-20T06:42:54.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0ba1805640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c156670 con 0x7f0b9c157150 2023-11-20T06:42:54.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0b9affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b880047d0 0x7f0b9c154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:54.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0b9affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b880047d0 0x7f0b9c154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42686/0 (socket says 172.21.15.19:42686) 2023-11-20T06:42:54.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0b9affd640 1 -- 172.21.15.19:0/2308469279 learned_addr learned my addr 172.21.15.19:0/2308469279 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:54.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0b9b7fe640 1 --2- 172.21.15.19:0/2308469279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b9c157150 0x7f0b9c15b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:54.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0b93fff640 1 --2- 172.21.15.19:0/2308469279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b9c158780 0x7f0b9c15aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:54.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0b9affd640 1 -- 172.21.15.19:0/2308469279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b9c157150 msgr2=0x7f0b9c15b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:54.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0b9affd640 1 --2- 172.21.15.19:0/2308469279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b9c157150 0x7f0b9c15b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0b9affd640 1 -- 172.21.15.19:0/2308469279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b9c158780 msgr2=0x7f0b9c15aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:54.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0b9affd640 1 --2- 172.21.15.19:0/2308469279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b9c158780 0x7f0b9c15aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0b9affd640 1 -- 172.21.15.19:0/2308469279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c156950 con 0x7f0b880047d0 2023-11-20T06:42:54.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0b93fff640 1 --2- 172.21.15.19:0/2308469279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b9c158780 0x7f0b9c15aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:54.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0b9affd640 1 --2- 172.21.15.19:0/2308469279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b880047d0 0x7f0b9c154db0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00f820 tx=0x7f0b8c00fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:54.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0b98ff9640 1 -- 172.21.15.19:0/2308469279 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c0050d0 con 0x7f0b880047d0 2023-11-20T06:42:54.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0b98ff9640 1 -- 172.21.15.19:0/2308469279 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8c005230 con 0x7f0b880047d0 2023-11-20T06:42:54.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0b98ff9640 1 -- 172.21.15.19:0/2308469279 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c00d730 con 0x7f0b880047d0 2023-11-20T06:42:54.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0ba1805640 1 -- 172.21.15.19:0/2308469279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9c156c30 con 0x7f0b880047d0 2023-11-20T06:42:54.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0ba1805640 1 -- 172.21.15.19:0/2308469279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9c15b750 con 0x7f0b880047d0 2023-11-20T06:42:54.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0ba1805640 1 -- 172.21.15.19:0/2308469279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b9c1564d0 con 0x7f0b880047d0 2023-11-20T06:42:54.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.615+0000 7f0b98ff9640 1 -- 172.21.15.19:0/2308469279 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0b8c00d890 con 0x7f0b880047d0 2023-11-20T06:42:54.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.619+0000 7f0b98ff9640 1 --2- 172.21.15.19:0/2308469279 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0b7c0664d0 0x7f0b7c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:54.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.619+0000 7f0b98ff9640 1 -- 172.21.15.19:0/2308469279 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0b8c083fe0 con 0x7f0b880047d0 2023-11-20T06:42:54.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.619+0000 7f0b93fff640 1 --2- 172.21.15.19:0/2308469279 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0b7c0664d0 0x7f0b7c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:54.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.619+0000 7f0b93fff640 1 --2- 172.21.15.19:0/2308469279 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0b7c0664d0 0x7f0b7c068990 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0b840af000 tx=0x7f0b840aa000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:54.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.623+0000 7f0b98ff9640 1 -- 172.21.15.19:0/2308469279 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0b9c1564d0 con 0x7f0b880047d0 2023-11-20T06:42:54.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.779+0000 7f0ba1805640 1 -- 172.21.15.19:0/2308469279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b9c1564d0 con 0x7f0b880047d0 2023-11-20T06:42:54.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.783+0000 7f0b98ff9640 1 -- 172.21.15.19:0/2308469279 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16762 (secure 0 0 0) 0x7f0b9c1564d0 con 0x7f0b880047d0 2023-11-20T06:42:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:54.788 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":39,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:42:44.883106+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:42:41.076502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-20T06:42:42.316293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:54.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.783+0000 7f0ba1805640 1 -- 172.21.15.19:0/2308469279 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0b7c0664d0 msgr2=0x7f0b7c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:54.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.783+0000 7f0ba1805640 1 --2- 172.21.15.19:0/2308469279 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0b7c0664d0 0x7f0b7c068990 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0b840af000 tx=0x7f0b840aa000 comp rx=0 tx=0).stop 2023-11-20T06:42:54.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.783+0000 7f0ba1805640 1 -- 172.21.15.19:0/2308469279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b880047d0 msgr2=0x7f0b9c154db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:54.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.783+0000 7f0ba1805640 1 --2- 172.21.15.19:0/2308469279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b880047d0 0x7f0b9c154db0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00f820 tx=0x7f0b8c00fce0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.783+0000 7f0ba1805640 1 -- 172.21.15.19:0/2308469279 shutdown_connections 2023-11-20T06:42:54.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.783+0000 7f0ba1805640 1 --2- 172.21.15.19:0/2308469279 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0b7c0664d0 0x7f0b7c068990 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.783+0000 7f0ba1805640 1 --2- 172.21.15.19:0/2308469279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b9c157150 0x7f0b9c15b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.783+0000 7f0ba1805640 1 --2- 172.21.15.19:0/2308469279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b9c158780 0x7f0b9c15aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.783+0000 7f0ba1805640 1 --2- 172.21.15.19:0/2308469279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b880047d0 0x7f0b9c154db0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.783+0000 7f0ba1805640 1 -- 172.21.15.19:0/2308469279 >> 172.21.15.19:0/2308469279 conn(0x7f0b9c09bc50 msgr2=0x7f0b9c06c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:54.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.783+0000 7f0ba1805640 1 -- 172.21.15.19:0/2308469279 shutdown_connections 2023-11-20T06:42:54.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.783+0000 7f0ba1805640 1 -- 172.21.15.19:0/2308469279 wait complete. 2023-11-20T06:42:54.809 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T06:41:01.541780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T06:42:41.076502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T06:42:42.316293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-20T06:42:54.809 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T06:42:54.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.951+0000 7f0655f3e640 1 Processor -- start 2023-11-20T06:42:54.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.951+0000 7f0655f3e640 1 -- start start 2023-11-20T06:42:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.951+0000 7f0655f3e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f06500d0210 0x7f06500d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.951+0000 7f0655f3e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f06500b84e0 0x7f06500b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.951+0000 7f0655f3e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06500d1670 con 0x7f065015cba0 2023-11-20T06:42:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.951+0000 7f0655f3e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06500d1460 con 0x7f06500b84e0 2023-11-20T06:42:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.951+0000 7f0655f3e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06500d1950 con 0x7f06500d0210 2023-11-20T06:42:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.951+0000 7f064ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f06500b84e0 0x7f06500b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.951+0000 7f064ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f06500b84e0 0x7f06500b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42694/0 (socket says 172.21.15.19:42694) 2023-11-20T06:42:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.951+0000 7f064ffff640 1 -- 172.21.15.19:0/3939217821 learned_addr learned my addr 172.21.15.19:0/3939217821 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.951+0000 7f064effd640 1 --2- 172.21.15.19:0/3939217821 >> v2:172.21.15.190:3300/0 conn(0x7f06500d0210 0x7f06500d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.951+0000 7f064ffff640 1 -- 172.21.15.19:0/3939217821 >> v2:172.21.15.190:3300/0 conn(0x7f06500d0210 msgr2=0x7f06500d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.951+0000 7f064ffff640 1 --2- 172.21.15.19:0/3939217821 >> v2:172.21.15.190:3300/0 conn(0x7f06500d0210 0x7f06500d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.951+0000 7f064ffff640 1 -- 172.21.15.19:0/3939217821 >> v1:172.21.15.19:6789/0 conn(0x7f065015cba0 legacy=0x7f06500cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.951+0000 7f064ffff640 1 -- 172.21.15.19:0/3939217821 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06500d1c30 con 0x7f06500b84e0 2023-11-20T06:42:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.951+0000 7f064e7fc640 1 -- 172.21.15.19:0/3939217821 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233907711 0 0) 0x7f06500d1670 con 0x7f065015cba0 2023-11-20T06:42:54.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.955+0000 7f064ffff640 1 --2- 172.21.15.19:0/3939217821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06500b84e0 0x7f06500b5cf0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f06500cf010 tx=0x7f064801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8697f1eea8bb500b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:54.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.955+0000 7f064e7fc640 1 -- 172.21.15.19:0/3939217821 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06480a5800 con 0x7f06500b84e0 2023-11-20T06:42:54.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.955+0000 7f064e7fc640 1 -- 172.21.15.19:0/3939217821 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06480a5960 con 0x7f06500b84e0 2023-11-20T06:42:54.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.955+0000 7f064e7fc640 1 -- 172.21.15.19:0/3939217821 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06480a5cf0 con 0x7f06500b84e0 2023-11-20T06:42:54.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.955+0000 7f0655f3e640 1 -- 172.21.15.19:0/3939217821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06500b84e0 msgr2=0x7f06500b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:54.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.955+0000 7f0655f3e640 1 --2- 172.21.15.19:0/3939217821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06500b84e0 0x7f06500b5cf0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f06500cf010 tx=0x7f064801c940 comp rx=0 tx=0).stop 2023-11-20T06:42:54.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.955+0000 7f0655f3e640 1 -- 172.21.15.19:0/3939217821 shutdown_connections 2023-11-20T06:42:54.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.955+0000 7f0655f3e640 1 --2- 172.21.15.19:0/3939217821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06500b84e0 0x7f06500b5cf0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.955+0000 7f0655f3e640 1 --2- 172.21.15.19:0/3939217821 >> v2:172.21.15.190:3300/0 conn(0x7f06500d0210 0x7f06500d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.955+0000 7f0655f3e640 1 -- 172.21.15.19:0/3939217821 >> 172.21.15.19:0/3939217821 conn(0x7f06500719c0 msgr2=0x7f0650071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:54.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.955+0000 7f0655f3e640 1 -- 172.21.15.19:0/3939217821 shutdown_connections 2023-11-20T06:42:54.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.955+0000 7f0655f3e640 1 -- 172.21.15.19:0/3939217821 wait complete. 2023-11-20T06:42:54.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.955+0000 7f0655f3e640 1 Processor -- start 2023-11-20T06:42:54.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f0655f3e640 1 -- start start 2023-11-20T06:42:54.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f0655f3e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06500b84e0 0x7f0650152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:54.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f0655f3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06500d0210 0x7f065014a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:54.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f0655f3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f065015cba0 0x7f0650151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:54.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f0655f3e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06500c9380 con 0x7f06500d0210 2023-11-20T06:42:54.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f0655f3e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06500c87e0 con 0x7f06500b84e0 2023-11-20T06:42:54.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f0655f3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06500c8a50 con 0x7f065015cba0 2023-11-20T06:42:54.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f064effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06500d0210 0x7f065014a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:54.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f064effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06500d0210 0x7f065014a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42702/0 (socket says 172.21.15.19:42702) 2023-11-20T06:42:54.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f064effd640 1 -- 172.21.15.19:0/1842017534 learned_addr learned my addr 172.21.15.19:0/1842017534 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:54.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f064effd640 1 -- 172.21.15.19:0/1842017534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f065015cba0 msgr2=0x7f0650151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:54.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f064effd640 1 --2- 172.21.15.19:0/1842017534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f065015cba0 0x7f0650151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f064effd640 1 -- 172.21.15.19:0/1842017534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06500b84e0 msgr2=0x7f0650152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:54.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f064f7fe640 1 --2- 172.21.15.19:0/1842017534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06500b84e0 0x7f0650152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:54.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f064effd640 1 --2- 172.21.15.19:0/1842017534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06500b84e0 0x7f0650152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:54.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f064effd640 1 -- 172.21.15.19:0/1842017534 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0648009b30 con 0x7f06500d0210 2023-11-20T06:42:54.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f064f7fe640 1 --2- 172.21.15.19:0/1842017534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06500b84e0 0x7f0650152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:54.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f064effd640 1 --2- 172.21.15.19:0/1842017534 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06500d0210 0x7f065014a250 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f064400d800 tx=0x7f064400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:54.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f0637fff640 1 -- 172.21.15.19:0/1842017534 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644018070 con 0x7f06500d0210 2023-11-20T06:42:54.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f0637fff640 1 -- 172.21.15.19:0/1842017534 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0644004020 con 0x7f06500d0210 2023-11-20T06:42:54.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f0637fff640 1 -- 172.21.15.19:0/1842017534 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06440041d0 con 0x7f06500d0210 2023-11-20T06:42:54.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f0655f3e640 1 -- 172.21.15.19:0/1842017534 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06500c8d30 con 0x7f06500d0210 2023-11-20T06:42:54.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f0655f3e640 1 -- 172.21.15.19:0/1842017534 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0650153350 con 0x7f06500d0210 2023-11-20T06:42:54.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.959+0000 7f0655f3e640 1 -- 172.21.15.19:0/1842017534 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065004e170 con 0x7f06500d0210 2023-11-20T06:42:54.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.963+0000 7f0637fff640 1 -- 172.21.15.19:0/1842017534 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0644004330 con 0x7f06500d0210 2023-11-20T06:42:54.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.963+0000 7f0637fff640 1 --2- 172.21.15.19:0/1842017534 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f063c0664a0 0x7f063c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:54.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.963+0000 7f0637fff640 1 -- 172.21.15.19:0/1842017534 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0644083f10 con 0x7f06500d0210 2023-11-20T06:42:54.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.963+0000 7f064f7fe640 1 --2- 172.21.15.19:0/1842017534 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f063c0664a0 0x7f063c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:54.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.963+0000 7f064f7fe640 1 --2- 172.21.15.19:0/1842017534 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f063c0664a0 0x7f063c068960 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0640000f70 tx=0x7f0640009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:54.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:54.967+0000 7f0637fff640 1 -- 172.21.15.19:0/1842017534 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f06440511b0 con 0x7f06500d0210 2023-11-20T06:42:55.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.123+0000 7f0655f3e640 1 -- 172.21.15.19:0/1842017534 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0650071da0 con 0x7f06500d0210 2023-11-20T06:42:55.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.123+0000 7f0637fff640 1 -- 172.21.15.19:0/1842017534 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f06440547d0 con 0x7f06500d0210 2023-11-20T06:42:55.130 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-20T06:42:55.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.127+0000 7f0655f3e640 1 -- 172.21.15.19:0/1842017534 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f063c0664a0 msgr2=0x7f063c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:55.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.127+0000 7f0655f3e640 1 --2- 172.21.15.19:0/1842017534 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f063c0664a0 0x7f063c068960 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0640000f70 tx=0x7f0640009040 comp rx=0 tx=0).stop 2023-11-20T06:42:55.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.127+0000 7f0655f3e640 1 -- 172.21.15.19:0/1842017534 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06500d0210 msgr2=0x7f065014a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:55.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.127+0000 7f0655f3e640 1 --2- 172.21.15.19:0/1842017534 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06500d0210 0x7f065014a250 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f064400d800 tx=0x7f064400dcc0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.127+0000 7f0655f3e640 1 -- 172.21.15.19:0/1842017534 shutdown_connections 2023-11-20T06:42:55.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.127+0000 7f0655f3e640 1 --2- 172.21.15.19:0/1842017534 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f063c0664a0 0x7f063c068960 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.127+0000 7f0655f3e640 1 --2- 172.21.15.19:0/1842017534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f065015cba0 0x7f0650151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.127+0000 7f0655f3e640 1 --2- 172.21.15.19:0/1842017534 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06500d0210 0x7f065014a250 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.127+0000 7f0655f3e640 1 --2- 172.21.15.19:0/1842017534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06500b84e0 0x7f0650152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.127+0000 7f0655f3e640 1 -- 172.21.15.19:0/1842017534 >> 172.21.15.19:0/1842017534 conn(0x7f06500719c0 msgr2=0x7f0650153d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:55.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.127+0000 7f0655f3e640 1 -- 172.21.15.19:0/1842017534 shutdown_connections 2023-11-20T06:42:55.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.127+0000 7f0655f3e640 1 -- 172.21.15.19:0/1842017534 wait complete. 2023-11-20T06:42:55.151 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T06:42:55.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.295+0000 7fdf94e09640 1 Processor -- start 2023-11-20T06:42:55.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.295+0000 7fdf94e09640 1 -- start start 2023-11-20T06:42:55.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.295+0000 7fdf94e09640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf900b84e0 0x7fdf900d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:55.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.295+0000 7fdf94e09640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf900d1670 con 0x7fdf900d0210 2023-11-20T06:42:55.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.295+0000 7fdf94e09640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf900d1950 con 0x7fdf9015cba0 2023-11-20T06:42:55.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.295+0000 7fdf94e09640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900d1460 con 0x7fdf900b84e0 2023-11-20T06:42:55.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.295+0000 7fdf8dd9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdf900d0210 0x7fdf900b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40808/0 (socket says 172.21.15.19:40808) 2023-11-20T06:42:55.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.295+0000 7fdf8ed9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf900b84e0 0x7fdf900d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:55.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.295+0000 7fdf8dd9b640 1 -- 172.21.15.19:0/3369718950 learned_addr learned my addr 172.21.15.19:0/3369718950 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:55.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.295+0000 7fdf8e59c640 1 --1- 172.21.15.19:0/3369718950 >> v1:172.21.15.190:6789/0 conn(0x7fdf9015cba0 0x7fdf900cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:41238/0 (socket says 172.21.15.19:41238) 2023-11-20T06:42:55.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.295+0000 7fdf8ed9d640 1 -- 172.21.15.19:0/3369718950 >> v1:172.21.15.190:6789/0 conn(0x7fdf9015cba0 legacy=0x7fdf900cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:55.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.295+0000 7fdf8ed9d640 1 -- 172.21.15.19:0/3369718950 >> v1:172.21.15.19:6789/0 conn(0x7fdf900d0210 legacy=0x7fdf900b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:55.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.295+0000 7fdf8d59a640 1 -- 172.21.15.19:0/3369718950 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963457203 0 0) 0x7fdf900d1950 con 0x7fdf9015cba0 2023-11-20T06:42:55.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.295+0000 7fdf8ed9d640 1 -- 172.21.15.19:0/3369718950 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf900d1c30 con 0x7fdf900b84e0 2023-11-20T06:42:55.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.299+0000 7fdf8ed9d640 1 --2- 172.21.15.19:0/3369718950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf900b84e0 0x7fdf900d0f20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009dc0 tx=0x7fdf8801c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=707e7d82becc0c81 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:55.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.299+0000 7fdf8d59a640 1 -- 172.21.15.19:0/3369718950 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf880a5860 con 0x7fdf900b84e0 2023-11-20T06:42:55.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.299+0000 7fdf8d59a640 1 -- 172.21.15.19:0/3369718950 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf880a59c0 con 0x7fdf900b84e0 2023-11-20T06:42:55.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.299+0000 7fdf8d59a640 1 -- 172.21.15.19:0/3369718950 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf880a5d50 con 0x7fdf900b84e0 2023-11-20T06:42:55.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.299+0000 7fdf94e09640 1 -- 172.21.15.19:0/3369718950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf900b84e0 msgr2=0x7fdf900d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:55.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.299+0000 7fdf94e09640 1 --2- 172.21.15.19:0/3369718950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf900b84e0 0x7fdf900d0f20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009dc0 tx=0x7fdf8801c800 comp rx=0 tx=0).stop 2023-11-20T06:42:55.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.299+0000 7fdf94e09640 1 -- 172.21.15.19:0/3369718950 shutdown_connections 2023-11-20T06:42:55.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.299+0000 7fdf94e09640 1 --2- 172.21.15.19:0/3369718950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf900b84e0 0x7fdf900d0f20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.299+0000 7fdf94e09640 1 -- 172.21.15.19:0/3369718950 >> 172.21.15.19:0/3369718950 conn(0x7fdf900719c0 msgr2=0x7fdf90071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:55.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.299+0000 7fdf94e09640 1 -- 172.21.15.19:0/3369718950 shutdown_connections 2023-11-20T06:42:55.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.299+0000 7fdf94e09640 1 -- 172.21.15.19:0/3369718950 wait complete. 2023-11-20T06:42:55.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf94e09640 1 Processor -- start 2023-11-20T06:42:55.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf94e09640 1 -- start start 2023-11-20T06:42:55.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf94e09640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf900b84e0 0x7fdf9014cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:55.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf94e09640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf900d0210 0x7fdf900c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:55.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf94e09640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf9015cba0 0x7fdf900c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:55.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf94e09640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900c81f0 con 0x7fdf900d0210 2023-11-20T06:42:55.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf94e09640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9014e300 con 0x7fdf900b84e0 2023-11-20T06:42:55.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf94e09640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900c7f10 con 0x7fdf9015cba0 2023-11-20T06:42:55.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf8dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf900d0210 0x7fdf900c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:55.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf8dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf900d0210 0x7fdf900c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42704/0 (socket says 172.21.15.19:42704) 2023-11-20T06:42:55.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf8dd9b640 1 -- 172.21.15.19:0/4078152566 learned_addr learned my addr 172.21.15.19:0/4078152566 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:55.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf8ed9d640 1 --2- 172.21.15.19:0/4078152566 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf9015cba0 0x7fdf900c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:55.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf8e59c640 1 --2- 172.21.15.19:0/4078152566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf900b84e0 0x7fdf9014cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:55.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf8dd9b640 1 -- 172.21.15.19:0/4078152566 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf9015cba0 msgr2=0x7fdf900c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:55.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf8dd9b640 1 --2- 172.21.15.19:0/4078152566 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf9015cba0 0x7fdf900c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf8dd9b640 1 -- 172.21.15.19:0/4078152566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf900b84e0 msgr2=0x7fdf9014cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:55.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf8dd9b640 1 --2- 172.21.15.19:0/4078152566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf900b84e0 0x7fdf9014cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf8dd9b640 1 -- 172.21.15.19:0/4078152566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf88009a70 con 0x7fdf900d0210 2023-11-20T06:42:55.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf8ed9d640 1 --2- 172.21.15.19:0/4078152566 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf9015cba0 0x7fdf900c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:55.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf8dd9b640 1 --2- 172.21.15.19:0/4078152566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf900d0210 0x7fdf900c8800 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009ef0 tx=0x7fdf8400c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:55.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf7effd640 1 -- 172.21.15.19:0/4078152566 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84007af0 con 0x7fdf900d0210 2023-11-20T06:42:55.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf7effd640 1 -- 172.21.15.19:0/4078152566 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf84007c50 con 0x7fdf900d0210 2023-11-20T06:42:55.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf7effd640 1 -- 172.21.15.19:0/4078152566 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8400ce10 con 0x7fdf900d0210 2023-11-20T06:42:55.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf94e09640 1 -- 172.21.15.19:0/4078152566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9014e5a0 con 0x7fdf900d0210 2023-11-20T06:42:55.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.303+0000 7fdf94e09640 1 -- 172.21.15.19:0/4078152566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9014eb60 con 0x7fdf900d0210 2023-11-20T06:42:55.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.307+0000 7fdf94e09640 1 -- 172.21.15.19:0/4078152566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf9014ed50 con 0x7fdf900d0210 2023-11-20T06:42:55.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.307+0000 7fdf7effd640 1 -- 172.21.15.19:0/4078152566 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdf84009070 con 0x7fdf900d0210 2023-11-20T06:42:55.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.307+0000 7fdf7effd640 1 --2- 172.21.15.19:0/4078152566 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdf700664a0 0x7fdf70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:55.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.307+0000 7fdf7effd640 1 -- 172.21.15.19:0/4078152566 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdf84085e60 con 0x7fdf900d0210 2023-11-20T06:42:55.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.307+0000 7fdf8e59c640 1 --2- 172.21.15.19:0/4078152566 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdf700664a0 0x7fdf70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:55.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.307+0000 7fdf8e59c640 1 --2- 172.21.15.19:0/4078152566 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdf700664a0 0x7fdf70068960 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdf80000f70 tx=0x7fdf80007d10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:55.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.311+0000 7fdf7effd640 1 -- 172.21.15.19:0/4078152566 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdf84053220 con 0x7fdf900d0210 2023-11-20T06:42:55.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.467+0000 7fdf94e09640 1 -- 172.21.15.19:0/4078152566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf9004e170 con 0x7fdf900d0210 2023-11-20T06:42:55.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.467+0000 7fdf7effd640 1 -- 172.21.15.19:0/4078152566 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdf84019020 con 0x7fdf900d0210 2023-11-20T06:42:55.474 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-20T06:42:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.471+0000 7fdf94e09640 1 -- 172.21.15.19:0/4078152566 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdf700664a0 msgr2=0x7fdf70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.471+0000 7fdf94e09640 1 --2- 172.21.15.19:0/4078152566 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdf700664a0 0x7fdf70068960 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdf80000f70 tx=0x7fdf80007d10 comp rx=0 tx=0).stop 2023-11-20T06:42:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.471+0000 7fdf94e09640 1 -- 172.21.15.19:0/4078152566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf900d0210 msgr2=0x7fdf900c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.471+0000 7fdf94e09640 1 --2- 172.21.15.19:0/4078152566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf900d0210 0x7fdf900c8800 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009ef0 tx=0x7fdf8400c430 comp rx=0 tx=0).stop 2023-11-20T06:42:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.471+0000 7fdf94e09640 1 -- 172.21.15.19:0/4078152566 shutdown_connections 2023-11-20T06:42:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.471+0000 7fdf94e09640 1 --2- 172.21.15.19:0/4078152566 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdf700664a0 0x7fdf70068960 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.471+0000 7fdf94e09640 1 --2- 172.21.15.19:0/4078152566 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf9015cba0 0x7fdf900c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.471+0000 7fdf94e09640 1 --2- 172.21.15.19:0/4078152566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf900d0210 0x7fdf900c8800 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.471+0000 7fdf94e09640 1 --2- 172.21.15.19:0/4078152566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf900b84e0 0x7fdf9014cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.471+0000 7fdf94e09640 1 -- 172.21.15.19:0/4078152566 >> 172.21.15.19:0/4078152566 conn(0x7fdf900719c0 msgr2=0x7fdf900b5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:55.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.471+0000 7fdf94e09640 1 -- 172.21.15.19:0/4078152566 shutdown_connections 2023-11-20T06:42:55.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.471+0000 7fdf94e09640 1 -- 172.21.15.19:0/4078152566 wait complete. 2023-11-20T06:42:55.495 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T06:42:55.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.635+0000 7f8d60df8640 1 Processor -- start 2023-11-20T06:42:55.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.635+0000 7f8d60df8640 1 -- start start 2023-11-20T06:42:55.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.639+0000 7f8d60df8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8d5c06a5a0 0x7f8d5c06e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:55.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.639+0000 7f8d60df8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d5c0b3f00 0x7f8d5c0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:55.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.639+0000 7f8d60df8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d5c0b4370 con 0x7f8d5c159900 2023-11-20T06:42:55.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.639+0000 7f8d60df8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d5c0cd740 con 0x7f8d5c06a5a0 2023-11-20T06:42:55.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.639+0000 7f8d60df8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c0b4600 con 0x7f8d5c0b3f00 2023-11-20T06:42:55.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.639+0000 7f8d53fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8d5c06a5a0 0x7f8d5c06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:55.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.639+0000 7f8d53fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8d5c06a5a0 0x7f8d5c06e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42708/0 (socket says 172.21.15.19:42708) 2023-11-20T06:42:55.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.639+0000 7f8d53fff640 1 -- 172.21.15.19:0/1540559451 learned_addr learned my addr 172.21.15.19:0/1540559451 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:55.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.639+0000 7f8d5ad9d640 1 --2- 172.21.15.19:0/1540559451 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d5c0b3f00 0x7f8d5c0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:55.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.639+0000 7f8d53fff640 1 -- 172.21.15.19:0/1540559451 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d5c0b3f00 msgr2=0x7f8d5c0c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:55.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.639+0000 7f8d53fff640 1 --2- 172.21.15.19:0/1540559451 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d5c0b3f00 0x7f8d5c0c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.639+0000 7f8d53fff640 1 -- 172.21.15.19:0/1540559451 >> v1:172.21.15.190:6789/0 conn(0x7f8d5c159900 legacy=0x7f8d5c069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:55.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.639+0000 7f8d53fff640 1 -- 172.21.15.19:0/1540559451 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5c0c8dd0 con 0x7f8d5c06a5a0 2023-11-20T06:42:55.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.643+0000 7f8d53fff640 1 --2- 172.21.15.19:0/1540559451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d5c06a5a0 0x7f8d5c06e260 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009870 tx=0x7f8d4401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a92cc6a6d0a4541 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:55.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.643+0000 7f8d59d9b640 1 -- 172.21.15.19:0/1540559451 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d440aa670 con 0x7f8d5c06a5a0 2023-11-20T06:42:55.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.643+0000 7f8d59d9b640 1 -- 172.21.15.19:0/1540559451 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d440aa7d0 con 0x7f8d5c06a5a0 2023-11-20T06:42:55.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.643+0000 7f8d59d9b640 1 -- 172.21.15.19:0/1540559451 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d440aab60 con 0x7f8d5c06a5a0 2023-11-20T06:42:55.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.643+0000 7f8d60df8640 1 -- 172.21.15.19:0/1540559451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d5c06a5a0 msgr2=0x7f8d5c06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:55.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.643+0000 7f8d60df8640 1 --2- 172.21.15.19:0/1540559451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d5c06a5a0 0x7f8d5c06e260 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009870 tx=0x7f8d4401c510 comp rx=0 tx=0).stop 2023-11-20T06:42:55.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.643+0000 7f8d60df8640 1 -- 172.21.15.19:0/1540559451 shutdown_connections 2023-11-20T06:42:55.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.643+0000 7f8d60df8640 1 --2- 172.21.15.19:0/1540559451 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d5c0b3f00 0x7f8d5c0c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.643+0000 7f8d60df8640 1 --2- 172.21.15.19:0/1540559451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d5c06a5a0 0x7f8d5c06e260 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.643+0000 7f8d60df8640 1 -- 172.21.15.19:0/1540559451 >> 172.21.15.19:0/1540559451 conn(0x7f8d5c0b0da0 msgr2=0x7f8d5c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:55.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.643+0000 7f8d60df8640 1 -- 172.21.15.19:0/1540559451 shutdown_connections 2023-11-20T06:42:55.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.643+0000 7f8d60df8640 1 -- 172.21.15.19:0/1540559451 wait complete. 2023-11-20T06:42:55.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.643+0000 7f8d60df8640 1 Processor -- start 2023-11-20T06:42:55.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.643+0000 7f8d60df8640 1 -- start start 2023-11-20T06:42:55.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d60df8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d5c06a5a0 0x7f8d5c152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:55.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d60df8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d5c0b3f00 0x7f8d5c157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:55.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d60df8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d5c159900 0x7f8d5c1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:55.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d60df8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c157bc0 con 0x7f8d5c06a5a0 2023-11-20T06:42:55.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d60df8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c155af0 con 0x7f8d5c0b3f00 2023-11-20T06:42:55.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d60df8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c155d90 con 0x7f8d5c159900 2023-11-20T06:42:55.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d5a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d5c06a5a0 0x7f8d5c152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d5a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d5c06a5a0 0x7f8d5c152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42724/0 (socket says 172.21.15.19:42724) 2023-11-20T06:42:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d5a59c640 1 -- 172.21.15.19:0/1971472590 learned_addr learned my addr 172.21.15.19:0/1971472590 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d5ad9d640 1 --2- 172.21.15.19:0/1971472590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d5c159900 0x7f8d5c1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d53fff640 1 --2- 172.21.15.19:0/1971472590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d5c0b3f00 0x7f8d5c157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d5a59c640 1 -- 172.21.15.19:0/1971472590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d5c159900 msgr2=0x7f8d5c1555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d5a59c640 1 --2- 172.21.15.19:0/1971472590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d5c159900 0x7f8d5c1555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d5a59c640 1 -- 172.21.15.19:0/1971472590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d5c0b3f00 msgr2=0x7f8d5c157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d5a59c640 1 --2- 172.21.15.19:0/1971472590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d5c0b3f00 0x7f8d5c157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d5a59c640 1 -- 172.21.15.19:0/1971472590 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d440094d0 con 0x7f8d5c06a5a0 2023-11-20T06:42:55.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d5a59c640 1 --2- 172.21.15.19:0/1971472590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d5c06a5a0 0x7f8d5c152480 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00c3c0 tx=0x7f8d4c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:55.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d52ffd640 1 -- 172.21.15.19:0/1971472590 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c0052d0 con 0x7f8d5c06a5a0 2023-11-20T06:42:55.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d52ffd640 1 -- 172.21.15.19:0/1971472590 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4c005430 con 0x7f8d5c06a5a0 2023-11-20T06:42:55.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d60df8640 1 -- 172.21.15.19:0/1971472590 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d5c156070 con 0x7f8d5c06a5a0 2023-11-20T06:42:55.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d52ffd640 1 -- 172.21.15.19:0/1971472590 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c003840 con 0x7f8d5c06a5a0 2023-11-20T06:42:55.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d60df8640 1 -- 172.21.15.19:0/1971472590 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5c0c70a0 con 0x7f8d5c06a5a0 2023-11-20T06:42:55.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d60df8640 1 -- 172.21.15.19:0/1971472590 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d5c04e170 con 0x7f8d5c06a5a0 2023-11-20T06:42:55.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.647+0000 7f8d52ffd640 1 -- 172.21.15.19:0/1971472590 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8d4c0039a0 con 0x7f8d5c06a5a0 2023-11-20T06:42:55.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.651+0000 7f8d52ffd640 1 --2- 172.21.15.19:0/1971472590 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8d3c0664a0 0x7f8d3c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:55.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.651+0000 7f8d52ffd640 1 -- 172.21.15.19:0/1971472590 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8d4c083530 con 0x7f8d5c06a5a0 2023-11-20T06:42:55.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.651+0000 7f8d53fff640 1 --2- 172.21.15.19:0/1971472590 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8d3c0664a0 0x7f8d3c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:55.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.651+0000 7f8d53fff640 1 --2- 172.21.15.19:0/1971472590 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8d3c0664a0 0x7f8d3c068960 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8d440ae000 tx=0x7f8d440a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:55.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.655+0000 7f8d52ffd640 1 -- 172.21.15.19:0/1971472590 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8d4c050850 con 0x7f8d5c06a5a0 2023-11-20T06:42:55.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.811+0000 7f8d60df8640 1 -- 172.21.15.19:0/1971472590 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8d5c06a0a0 con 0x7f8d5c06a5a0 2023-11-20T06:42:55.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.811+0000 7f8d52ffd640 1 -- 172.21.15.19:0/1971472590 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8d4c053e70 con 0x7f8d5c06a5a0 2023-11-20T06:42:55.819 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-20T06:42:55.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.815+0000 7f8d60df8640 1 -- 172.21.15.19:0/1971472590 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8d3c0664a0 msgr2=0x7f8d3c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:55.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.815+0000 7f8d60df8640 1 --2- 172.21.15.19:0/1971472590 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8d3c0664a0 0x7f8d3c068960 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8d440ae000 tx=0x7f8d440a7000 comp rx=0 tx=0).stop 2023-11-20T06:42:55.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.815+0000 7f8d60df8640 1 -- 172.21.15.19:0/1971472590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d5c06a5a0 msgr2=0x7f8d5c152480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:55.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.815+0000 7f8d60df8640 1 --2- 172.21.15.19:0/1971472590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d5c06a5a0 0x7f8d5c152480 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00c3c0 tx=0x7f8d4c00c880 comp rx=0 tx=0).stop 2023-11-20T06:42:55.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.815+0000 7f8d60df8640 1 -- 172.21.15.19:0/1971472590 shutdown_connections 2023-11-20T06:42:55.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.815+0000 7f8d60df8640 1 --2- 172.21.15.19:0/1971472590 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f8d3c0664a0 0x7f8d3c068960 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.815+0000 7f8d60df8640 1 --2- 172.21.15.19:0/1971472590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d5c159900 0x7f8d5c1555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.815+0000 7f8d60df8640 1 --2- 172.21.15.19:0/1971472590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d5c0b3f00 0x7f8d5c157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.815+0000 7f8d60df8640 1 --2- 172.21.15.19:0/1971472590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d5c06a5a0 0x7f8d5c152480 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.815+0000 7f8d60df8640 1 -- 172.21.15.19:0/1971472590 >> 172.21.15.19:0/1971472590 conn(0x7f8d5c0b0da0 msgr2=0x7f8d5c0ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:55.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.815+0000 7f8d60df8640 1 -- 172.21.15.19:0/1971472590 shutdown_connections 2023-11-20T06:42:55.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.815+0000 7f8d60df8640 1 -- 172.21.15.19:0/1971472590 wait complete. 2023-11-20T06:42:55.840 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T06:42:55.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.975+0000 7fa3aced6640 1 Processor -- start 2023-11-20T06:42:55.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.975+0000 7fa3aced6640 1 -- start start 2023-11-20T06:42:55.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.979+0000 7fa3aced6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3a80d15d0 0x7fa3a80cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:55.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.979+0000 7fa3aced6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa3a80d3010 0x7fa3a80c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:55.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.979+0000 7fa3aced6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a80ce770 con 0x7fa3a815cb90 2023-11-20T06:42:55.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.979+0000 7fa3aced6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a80d0600 con 0x7fa3a80d3010 2023-11-20T06:42:55.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.979+0000 7fa3aced6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80c6450 con 0x7fa3a80d15d0 2023-11-20T06:42:55.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.979+0000 7fa3a5d9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3a80d15d0 0x7fa3a80cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:55.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.979+0000 7fa3a6d9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa3a80d3010 0x7fa3a80c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:55.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.979+0000 7fa3a5d9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3a80d15d0 0x7fa3a80cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:59102/0 (socket says 172.21.15.19:59102) 2023-11-20T06:42:55.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.979+0000 7fa3a5d9b640 1 -- 172.21.15.19:0/3923358287 learned_addr learned my addr 172.21.15.19:0/3923358287 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:55.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.979+0000 7fa3a5d9b640 1 -- 172.21.15.19:0/3923358287 >> v2:172.21.15.190:3300/0 conn(0x7fa3a80d3010 msgr2=0x7fa3a80c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:55.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.979+0000 7fa3a5d9b640 1 --2- 172.21.15.19:0/3923358287 >> v2:172.21.15.190:3300/0 conn(0x7fa3a80d3010 0x7fa3a80c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.979+0000 7fa3a5d9b640 1 -- 172.21.15.19:0/3923358287 >> v1:172.21.15.190:6789/0 conn(0x7fa3a815cb90 legacy=0x7fa3a80d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:55.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.979+0000 7fa3a5d9b640 1 -- 172.21.15.19:0/3923358287 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a80d08a0 con 0x7fa3a80d15d0 2023-11-20T06:42:55.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.983+0000 7fa3a5d9b640 1 --2- 172.21.15.19:0/3923358287 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3a80d15d0 0x7fa3a80cfb10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009870 tx=0x7fa39c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d69f4e810f3c20ed server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:55.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.983+0000 7fa3a559a640 1 -- 172.21.15.19:0/3923358287 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0ab680 con 0x7fa3a80d15d0 2023-11-20T06:42:55.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.983+0000 7fa3a559a640 1 -- 172.21.15.19:0/3923358287 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c0ab7e0 con 0x7fa3a80d15d0 2023-11-20T06:42:55.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.983+0000 7fa3a559a640 1 -- 172.21.15.19:0/3923358287 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0abb70 con 0x7fa3a80d15d0 2023-11-20T06:42:55.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.983+0000 7fa3aced6640 1 -- 172.21.15.19:0/3923358287 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3a80d15d0 msgr2=0x7fa3a80cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:55.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.983+0000 7fa3aced6640 1 --2- 172.21.15.19:0/3923358287 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3a80d15d0 0x7fa3a80cfb10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009870 tx=0x7fa39c01c480 comp rx=0 tx=0).stop 2023-11-20T06:42:55.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.983+0000 7fa3aced6640 1 -- 172.21.15.19:0/3923358287 shutdown_connections 2023-11-20T06:42:55.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.983+0000 7fa3aced6640 1 --2- 172.21.15.19:0/3923358287 >> v2:172.21.15.190:3300/0 conn(0x7fa3a80d3010 0x7fa3a80c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.983+0000 7fa3aced6640 1 --2- 172.21.15.19:0/3923358287 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3a80d15d0 0x7fa3a80cfb10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.983+0000 7fa3aced6640 1 -- 172.21.15.19:0/3923358287 >> 172.21.15.19:0/3923358287 conn(0x7fa3a809bc50 msgr2=0x7fa3a80d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:55.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.983+0000 7fa3aced6640 1 -- 172.21.15.19:0/3923358287 shutdown_connections 2023-11-20T06:42:55.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.983+0000 7fa3aced6640 1 -- 172.21.15.19:0/3923358287 wait complete. 2023-11-20T06:42:55.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.983+0000 7fa3aced6640 1 Processor -- start 2023-11-20T06:42:55.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.983+0000 7fa3aced6640 1 -- start start 2023-11-20T06:42:55.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa3aced6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3a80d15d0 0x7fa3a8153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:55.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa3aced6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a80d3010 0x7fa3a80b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:55.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa3aced6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3a815cb90 0x7fa3a81587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:55.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa3aced6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a81536d0 con 0x7fa3a80d3010 2023-11-20T06:42:55.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa3aced6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a8153b20 con 0x7fa3a80d15d0 2023-11-20T06:42:55.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa3aced6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a8153e00 con 0x7fa3a815cb90 2023-11-20T06:42:55.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa3a5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a80d3010 0x7fa3a80b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:55.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa3a5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a80d3010 0x7fa3a80b5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42734/0 (socket says 172.21.15.19:42734) 2023-11-20T06:42:55.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa3a5d9b640 1 -- 172.21.15.19:0/2675660236 learned_addr learned my addr 172.21.15.19:0/2675660236 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:55.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa3a659c640 1 --2- 172.21.15.19:0/2675660236 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3a80d15d0 0x7fa3a8153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:55.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa3a6d9d640 1 --2- 172.21.15.19:0/2675660236 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3a815cb90 0x7fa3a81587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:55.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa3a5d9b640 1 -- 172.21.15.19:0/2675660236 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3a815cb90 msgr2=0x7fa3a81587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:55.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa3a5d9b640 1 --2- 172.21.15.19:0/2675660236 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3a815cb90 0x7fa3a81587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa3a5d9b640 1 -- 172.21.15.19:0/2675660236 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3a80d15d0 msgr2=0x7fa3a8153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:55.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa3a5d9b640 1 --2- 172.21.15.19:0/2675660236 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3a80d15d0 0x7fa3a8153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:55.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa3a5d9b640 1 -- 172.21.15.19:0/2675660236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c0094d0 con 0x7fa3a80d3010 2023-11-20T06:42:55.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa3a5d9b640 1 --2- 172.21.15.19:0/2675660236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a80d3010 0x7fa3a80b5520 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0ad040 tx=0x7fa39c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:55.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa396ffd640 1 -- 172.21.15.19:0/2675660236 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0ab680 con 0x7fa3a80d3010 2023-11-20T06:42:55.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa396ffd640 1 -- 172.21.15.19:0/2675660236 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c0b4800 con 0x7fa3a80d3010 2023-11-20T06:42:55.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa3aced6640 1 -- 172.21.15.19:0/2675660236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a81540e0 con 0x7fa3a80d3010 2023-11-20T06:42:55.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa396ffd640 1 -- 172.21.15.19:0/2675660236 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0b4bb0 con 0x7fa3a80d3010 2023-11-20T06:42:55.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa3aced6640 1 -- 172.21.15.19:0/2675660236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a81546a0 con 0x7fa3a80d3010 2023-11-20T06:42:55.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.987+0000 7fa3aced6640 1 -- 172.21.15.19:0/2675660236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a8074010 con 0x7fa3a80d3010 2023-11-20T06:42:55.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.991+0000 7fa396ffd640 1 -- 172.21.15.19:0/2675660236 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa39c0b4d10 con 0x7fa3a80d3010 2023-11-20T06:42:55.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.991+0000 7fa396ffd640 1 --2- 172.21.15.19:0/2675660236 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa3880664d0 0x7fa388068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:55.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.991+0000 7fa396ffd640 1 -- 172.21.15.19:0/2675660236 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa39c11e1f0 con 0x7fa3a80d3010 2023-11-20T06:42:55.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.991+0000 7fa3a659c640 1 --2- 172.21.15.19:0/2675660236 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa3880664d0 0x7fa388068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:55.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.991+0000 7fa3a659c640 1 --2- 172.21.15.19:0/2675660236 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa3880664d0 0x7fa388068990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa398000fc0 tx=0x7fa398009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:55.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:55.995+0000 7fa396ffd640 1 -- 172.21.15.19:0/2675660236 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa39c0eb490 con 0x7fa3a80d3010 2023-11-20T06:42:56.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.191+0000 7fa3aced6640 1 -- 172.21.15.19:0/2675660236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3a80d13b0 con 0x7fa3a80d3010 2023-11-20T06:42:56.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.191+0000 7fa396ffd640 1 -- 172.21.15.19:0/2675660236 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4916 (secure 0 0 0) 0x7fa39c0eeab0 con 0x7fa3a80d3010 2023-11-20T06:42:56.196 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:56.196 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3692171038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3692171038},{"type":"v1","addr":"172.21.15.190:6835","nonce":3692171038}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2633535615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":2633535615},{"type":"v1","addr":"172.21.15.190:6837","nonce":2633535615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/1822146855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1822146855},{"type":"v1","addr":"172.21.15.19:6833","nonce":1822146855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T06:42:43.280879+0000","modified":"2023-11-20T06:42:46.648235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/203468016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":203468016},{"type":"v1","addr":"172.21.15.19:6835","nonce":203468016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-20T06:42:56.196 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 18 2023-11-20T06:42:56.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.191+0000 7fa3aced6640 1 -- 172.21.15.19:0/2675660236 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa3880664d0 msgr2=0x7fa388068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:56.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.191+0000 7fa3aced6640 1 --2- 172.21.15.19:0/2675660236 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa3880664d0 0x7fa388068990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa398000fc0 tx=0x7fa398009040 comp rx=0 tx=0).stop 2023-11-20T06:42:56.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.191+0000 7fa3aced6640 1 -- 172.21.15.19:0/2675660236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a80d3010 msgr2=0x7fa3a80b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:56.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.191+0000 7fa3aced6640 1 --2- 172.21.15.19:0/2675660236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a80d3010 0x7fa3a80b5520 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0ad040 tx=0x7fa39c01acc0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.191+0000 7fa3aced6640 1 -- 172.21.15.19:0/2675660236 shutdown_connections 2023-11-20T06:42:56.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.191+0000 7fa3aced6640 1 --2- 172.21.15.19:0/2675660236 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa3880664d0 0x7fa388068990 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.191+0000 7fa3aced6640 1 --2- 172.21.15.19:0/2675660236 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3a815cb90 0x7fa3a81587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.191+0000 7fa3aced6640 1 --2- 172.21.15.19:0/2675660236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a80d3010 0x7fa3a80b5520 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.191+0000 7fa3aced6640 1 --2- 172.21.15.19:0/2675660236 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3a80d15d0 0x7fa3a8153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.191+0000 7fa3aced6640 1 -- 172.21.15.19:0/2675660236 >> 172.21.15.19:0/2675660236 conn(0x7fa3a809bc50 msgr2=0x7fa3a80ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:56.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.191+0000 7fa3aced6640 1 -- 172.21.15.19:0/2675660236 shutdown_connections 2023-11-20T06:42:56.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.191+0000 7fa3aced6640 1 -- 172.21.15.19:0/2675660236 wait complete. 2023-11-20T06:42:56.217 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:56.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.355+0000 7fa9bb3f5640 1 Processor -- start 2023-11-20T06:42:56.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.355+0000 7fa9bb3f5640 1 -- start start 2023-11-20T06:42:56.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9bb3f5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa9b415a880 0x7fa9b415dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:56.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9bb3f5640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b41614a0 con 0x7fa9b40b00e0 2023-11-20T06:42:56.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9bb3f5640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b415e000 con 0x7fa9b40cda30 2023-11-20T06:42:56.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9bb3f5640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b40cb1d0 con 0x7fa9b415a880 2023-11-20T06:42:56.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9b8990640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa9b40b00e0 0x7fa9b4160680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40818/0 (socket says 172.21.15.19:40818) 2023-11-20T06:42:56.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9b8990640 1 -- 172.21.15.19:0/536309707 learned_addr learned my addr 172.21.15.19:0/536309707 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:56.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9abfff640 1 -- 172.21.15.19:0/536309707 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191391923 0 0) 0x7fa9b41614a0 con 0x7fa9b40b00e0 2023-11-20T06:42:56.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9abfff640 1 -- 172.21.15.19:0/536309707 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9a0003530 con 0x7fa9b40b00e0 2023-11-20T06:42:56.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9b9191640 1 --2- 172.21.15.19:0/536309707 >> v2:172.21.15.190:3300/0 conn(0x7fa9b415a880 0x7fa9b415dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:56.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9abfff640 1 -- 172.21.15.19:0/536309707 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2287802249 0 0) 0x7fa9a0003530 con 0x7fa9b40b00e0 2023-11-20T06:42:56.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9abfff640 1 -- 172.21.15.19:0/536309707 >> v2:172.21.15.190:3300/0 conn(0x7fa9b415a880 msgr2=0x7fa9b415dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:56.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9abfff640 1 --2- 172.21.15.19:0/536309707 >> v2:172.21.15.190:3300/0 conn(0x7fa9b415a880 0x7fa9b415dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9abfff640 1 -- 172.21.15.19:0/536309707 >> v1:172.21.15.190:6789/0 conn(0x7fa9b40cda30 legacy=0x7fa9b4160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:56.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9abfff640 1 -- 172.21.15.19:0/536309707 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b40cb4b0 con 0x7fa9b40b00e0 2023-11-20T06:42:56.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9abfff640 1 -- 172.21.15.19:0/536309707 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7fa9a4001680 con 0x7fa9b40b00e0 2023-11-20T06:42:56.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9abfff640 1 -- 172.21.15.19:0/536309707 >> v1:172.21.15.19:6789/0 conn(0x7fa9b40b00e0 legacy=0x7fa9b4160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:56.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9abfff640 1 --2- 172.21.15.19:0/536309707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9a00039d0 0x7fa9a0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:56.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9abfff640 1 --2- 172.21.15.19:0/536309707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9a00047d0 0x7fa9a0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:56.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9abfff640 1 --2- 172.21.15.19:0/536309707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9a0005190 0x7fa9a000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:56.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9abfff640 1 -- 172.21.15.19:0/536309707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b40cb1d0 con 0x7fa9a00039d0 2023-11-20T06:42:56.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9abfff640 1 -- 172.21.15.19:0/536309707 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a000c090 con 0x7fa9a00047d0 2023-11-20T06:42:56.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9abfff640 1 -- 172.21.15.19:0/536309707 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a000c250 con 0x7fa9a0005190 2023-11-20T06:42:56.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9b9191640 1 --2- 172.21.15.19:0/536309707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9a00039d0 0x7fa9a0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:56.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9b8990640 1 --2- 172.21.15.19:0/536309707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9a00047d0 0x7fa9a0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:56.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9b9992640 1 --2- 172.21.15.19:0/536309707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9a0005190 0x7fa9a000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:56.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9b9191640 1 -- 172.21.15.19:0/536309707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9a0005190 msgr2=0x7fa9a000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:56.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9b9191640 1 --2- 172.21.15.19:0/536309707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9a0005190 0x7fa9a000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9b9191640 1 -- 172.21.15.19:0/536309707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9a00047d0 msgr2=0x7fa9a0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:56.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9b9191640 1 --2- 172.21.15.19:0/536309707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9a00047d0 0x7fa9a0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9b9191640 1 -- 172.21.15.19:0/536309707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a0003530 con 0x7fa9a00039d0 2023-11-20T06:42:56.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9b9992640 1 --2- 172.21.15.19:0/536309707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9a0005190 0x7fa9a000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:56.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.359+0000 7fa9b9992640 1 -- 172.21.15.19:0/536309707 reap_dead start 2023-11-20T06:42:56.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.363+0000 7fa9b9191640 1 --2- 172.21.15.19:0/536309707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9a00039d0 0x7fa9a0003df0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009ae0 tx=0x7fa9b001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8149a48e0e83e0b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:56.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.363+0000 7fa9abfff640 1 -- 172.21.15.19:0/536309707 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00a6430 con 0x7fa9a00039d0 2023-11-20T06:42:56.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.363+0000 7fa9abfff640 1 -- 172.21.15.19:0/536309707 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b00a6590 con 0x7fa9a00039d0 2023-11-20T06:42:56.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.363+0000 7fa9abfff640 1 -- 172.21.15.19:0/536309707 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00a6940 con 0x7fa9a00039d0 2023-11-20T06:42:56.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.363+0000 7fa9bb3f5640 1 -- 172.21.15.19:0/536309707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9a00039d0 msgr2=0x7fa9a0003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:56.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.363+0000 7fa9bb3f5640 1 --2- 172.21.15.19:0/536309707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9a00039d0 0x7fa9a0003df0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009ae0 tx=0x7fa9b001ca50 comp rx=0 tx=0).stop 2023-11-20T06:42:56.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.363+0000 7fa9bb3f5640 1 -- 172.21.15.19:0/536309707 shutdown_connections 2023-11-20T06:42:56.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.363+0000 7fa9bb3f5640 1 --2- 172.21.15.19:0/536309707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9a00039d0 0x7fa9a0003df0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.363+0000 7fa9bb3f5640 1 -- 172.21.15.19:0/536309707 >> 172.21.15.19:0/536309707 conn(0x7fa9b406c190 msgr2=0x7fa9b406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:56.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.363+0000 7fa9bb3f5640 1 -- 172.21.15.19:0/536309707 shutdown_connections 2023-11-20T06:42:56.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.363+0000 7fa9bb3f5640 1 -- 172.21.15.19:0/536309707 wait complete. 2023-11-20T06:42:56.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.363+0000 7fa9bb3f5640 1 Processor -- start 2023-11-20T06:42:56.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.363+0000 7fa9bb3f5640 1 -- start start 2023-11-20T06:42:56.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9bb3f5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9a00039d0 0x7fa9b40c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:56.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9bb3f5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9b40c5730 0x7fa9b40c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:56.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9bb3f5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9b415bd00 0x7fa9b415c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:56.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9bb3f5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b415c6c0 con 0x7fa9a00039d0 2023-11-20T06:42:56.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9bb3f5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b40c6da0 con 0x7fa9b415bd00 2023-11-20T06:42:56.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9bb3f5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b41f8f40 con 0x7fa9b40c5730 2023-11-20T06:42:56.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9b9191640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9a00039d0 0x7fa9b40c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:56.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9b9191640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9a00039d0 0x7fa9b40c6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42754/0 (socket says 172.21.15.19:42754) 2023-11-20T06:42:56.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9b9191640 1 -- 172.21.15.19:0/3141666950 learned_addr learned my addr 172.21.15.19:0/3141666950 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:56.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9b9992640 1 --2- 172.21.15.19:0/3141666950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9b415bd00 0x7fa9b415c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:56.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9b9191640 1 -- 172.21.15.19:0/3141666950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9b40c5730 msgr2=0x7fa9b40c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:56.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9b9191640 1 --2- 172.21.15.19:0/3141666950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9b40c5730 0x7fa9b40c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9b9191640 1 -- 172.21.15.19:0/3141666950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9b415bd00 msgr2=0x7fa9b415c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:56.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9b9191640 1 --2- 172.21.15.19:0/3141666950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9b415bd00 0x7fa9b415c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9b9191640 1 -- 172.21.15.19:0/3141666950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b41f9200 con 0x7fa9a00039d0 2023-11-20T06:42:56.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9b9992640 1 --2- 172.21.15.19:0/3141666950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9b415bd00 0x7fa9b415c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:56.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9b9191640 1 --2- 172.21.15.19:0/3141666950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9a00039d0 0x7fa9b40c6860 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009ae0 tx=0x7fa9b00197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:56.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9a9ffb640 1 -- 172.21.15.19:0/3141666950 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00a6e00 con 0x7fa9a00039d0 2023-11-20T06:42:56.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9a9ffb640 1 -- 172.21.15.19:0/3141666950 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b000f000 con 0x7fa9a00039d0 2023-11-20T06:42:56.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9bb3f5640 1 -- 172.21.15.19:0/3141666950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b41f94e0 con 0x7fa9a00039d0 2023-11-20T06:42:56.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9a9ffb640 1 -- 172.21.15.19:0/3141666950 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00b9630 con 0x7fa9a00039d0 2023-11-20T06:42:56.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9bb3f5640 1 -- 172.21.15.19:0/3141666950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b41f9aa0 con 0x7fa9a00039d0 2023-11-20T06:42:56.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.367+0000 7fa9bb3f5640 1 -- 172.21.15.19:0/3141666950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b40cad80 con 0x7fa9a00039d0 2023-11-20T06:42:56.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.371+0000 7fa9a9ffb640 1 -- 172.21.15.19:0/3141666950 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa9b00a7410 con 0x7fa9a00039d0 2023-11-20T06:42:56.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.371+0000 7fa9a9ffb640 1 --2- 172.21.15.19:0/3141666950 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa9980664d0 0x7fa998068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:56.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.371+0000 7fa9a9ffb640 1 -- 172.21.15.19:0/3141666950 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa9b011dad0 con 0x7fa9a00039d0 2023-11-20T06:42:56.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.371+0000 7fa9b8990640 1 --2- 172.21.15.19:0/3141666950 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa9980664d0 0x7fa998068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:56.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.371+0000 7fa9b8990640 1 --2- 172.21.15.19:0/3141666950 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa9980664d0 0x7fa998068990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4001bd0 tx=0x7fa9a4001a60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:56.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.375+0000 7fa9a9ffb640 1 -- 172.21.15.19:0/3141666950 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa9b00ead50 con 0x7fa9a00039d0 2023-11-20T06:42:56.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.535+0000 7fa9bb3f5640 1 -- 172.21.15.19:0/3141666950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9b4074010 con 0x7fa9a00039d0 2023-11-20T06:42:56.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.535+0000 7fa9a9ffb640 1 -- 172.21.15.19:0/3141666950 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16811 (secure 0 0 0) 0x7fa9b00be070 con 0x7fa9a00039d0 2023-11-20T06:42:56.540 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:56.540 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":41,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:42:56.292055+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:42:41.076502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-20T06:42:42.316293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.10","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:56.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.535+0000 7fa9bb3f5640 1 -- 172.21.15.19:0/3141666950 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa9980664d0 msgr2=0x7fa998068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:56.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.535+0000 7fa9bb3f5640 1 --2- 172.21.15.19:0/3141666950 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa9980664d0 0x7fa998068990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4001bd0 tx=0x7fa9a4001a60 comp rx=0 tx=0).stop 2023-11-20T06:42:56.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.535+0000 7fa9bb3f5640 1 -- 172.21.15.19:0/3141666950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9a00039d0 msgr2=0x7fa9b40c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:56.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.535+0000 7fa9bb3f5640 1 --2- 172.21.15.19:0/3141666950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9a00039d0 0x7fa9b40c6860 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009ae0 tx=0x7fa9b00197f0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.535+0000 7fa9bb3f5640 1 -- 172.21.15.19:0/3141666950 shutdown_connections 2023-11-20T06:42:56.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.535+0000 7fa9bb3f5640 1 --2- 172.21.15.19:0/3141666950 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa9980664d0 0x7fa998068990 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.535+0000 7fa9bb3f5640 1 --2- 172.21.15.19:0/3141666950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9b415bd00 0x7fa9b415c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.535+0000 7fa9bb3f5640 1 --2- 172.21.15.19:0/3141666950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9b40c5730 0x7fa9b40c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.535+0000 7fa9bb3f5640 1 --2- 172.21.15.19:0/3141666950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9a00039d0 0x7fa9b40c6860 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.535+0000 7fa9bb3f5640 1 -- 172.21.15.19:0/3141666950 >> 172.21.15.19:0/3141666950 conn(0x7fa9b406c190 msgr2=0x7fa9b40ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:56.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.535+0000 7fa9bb3f5640 1 -- 172.21.15.19:0/3141666950 shutdown_connections 2023-11-20T06:42:56.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.535+0000 7fa9bb3f5640 1 -- 172.21.15.19:0/3141666950 wait complete. 2023-11-20T06:42:56.562 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-20T06:42:56.562 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T06:42:56.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.699+0000 7f162f7d3640 1 Processor -- start 2023-11-20T06:42:56.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.699+0000 7f162f7d3640 1 -- start start 2023-11-20T06:42:56.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.703+0000 7f162f7d3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1628164520 0x7f16280ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:56.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.703+0000 7f162f7d3640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f16280ad960 0x7f16280b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:56.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.703+0000 7f162f7d3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16280c96f0 con 0x7f16280c9b80 2023-11-20T06:42:56.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.703+0000 7f162f7d3640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1628164900 con 0x7f16280ad960 2023-11-20T06:42:56.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.703+0000 7f162f7d3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16280cb950 con 0x7f1628164520 2023-11-20T06:42:56.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.703+0000 7f162cd6e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f16280ad960 0x7f16280b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:56.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.703+0000 7f162cd6e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f16280ad960 0x7f16280b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42760/0 (socket says 172.21.15.19:42760) 2023-11-20T06:42:56.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.703+0000 7f162cd6e640 1 -- 172.21.15.19:0/1790977389 learned_addr learned my addr 172.21.15.19:0/1790977389 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:56.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.703+0000 7f162d56f640 1 --2- 172.21.15.19:0/1790977389 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1628164520 0x7f16280ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:56.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.703+0000 7f162cd6e640 1 -- 172.21.15.19:0/1790977389 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1628164520 msgr2=0x7f16280ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:56.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.703+0000 7f162cd6e640 1 --2- 172.21.15.19:0/1790977389 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1628164520 0x7f16280ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.703+0000 7f162cd6e640 1 -- 172.21.15.19:0/1790977389 >> v1:172.21.15.190:6789/0 conn(0x7f16280c9b80 legacy=0x7f1628164ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:56.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.703+0000 7f162cd6e640 1 -- 172.21.15.19:0/1790977389 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16280cbed0 con 0x7f16280ad960 2023-11-20T06:42:56.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.703+0000 7f162d56f640 1 --2- 172.21.15.19:0/1790977389 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1628164520 0x7f16280ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:56.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.707+0000 7f162cd6e640 1 --2- 172.21.15.19:0/1790977389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16280ad960 0x7f16280b00e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1618009870 tx=0x7f161801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c187f06684cad2 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:56.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.707+0000 7f161ffff640 1 -- 172.21.15.19:0/1790977389 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180ab670 con 0x7f16280ad960 2023-11-20T06:42:56.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.707+0000 7f161ffff640 1 -- 172.21.15.19:0/1790977389 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16180ab7d0 con 0x7f16280ad960 2023-11-20T06:42:56.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.707+0000 7f161ffff640 1 -- 172.21.15.19:0/1790977389 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180abb60 con 0x7f16280ad960 2023-11-20T06:42:56.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.707+0000 7f162f7d3640 1 -- 172.21.15.19:0/1790977389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16280ad960 msgr2=0x7f16280b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:56.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.707+0000 7f162f7d3640 1 --2- 172.21.15.19:0/1790977389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16280ad960 0x7f16280b00e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1618009870 tx=0x7f161801c4d0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.707+0000 7f162f7d3640 1 -- 172.21.15.19:0/1790977389 shutdown_connections 2023-11-20T06:42:56.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.707+0000 7f162f7d3640 1 --2- 172.21.15.19:0/1790977389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16280ad960 0x7f16280b00e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.707+0000 7f162f7d3640 1 --2- 172.21.15.19:0/1790977389 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1628164520 0x7f16280ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.707+0000 7f162f7d3640 1 -- 172.21.15.19:0/1790977389 >> 172.21.15.19:0/1790977389 conn(0x7f162806c190 msgr2=0x7f162806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:56.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.707+0000 7f162f7d3640 1 -- 172.21.15.19:0/1790977389 shutdown_connections 2023-11-20T06:42:56.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.707+0000 7f162f7d3640 1 -- 172.21.15.19:0/1790977389 wait complete. 2023-11-20T06:42:56.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.707+0000 7f162f7d3640 1 Processor -- start 2023-11-20T06:42:56.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.707+0000 7f162f7d3640 1 -- start start 2023-11-20T06:42:56.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162f7d3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16280ad960 0x7f16280c4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:56.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162f7d3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16280c9b80 0x7f16280ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:56.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162f7d3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1628164520 0x7f162815ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:56.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162f7d3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280c4610 con 0x7f1628164520 2023-11-20T06:42:56.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162f7d3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280c5b40 con 0x7f16280c9b80 2023-11-20T06:42:56.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162f7d3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162815e360 con 0x7f16280ad960 2023-11-20T06:42:56.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162dd70640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1628164520 0x7f162815ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:56.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162dd70640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1628164520 0x7f162815ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42770/0 (socket says 172.21.15.19:42770) 2023-11-20T06:42:56.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162dd70640 1 -- 172.21.15.19:0/1653835369 learned_addr learned my addr 172.21.15.19:0/1653835369 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:56.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162d56f640 1 --2- 172.21.15.19:0/1653835369 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16280ad960 0x7f16280c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:56.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162cd6e640 1 --2- 172.21.15.19:0/1653835369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16280c9b80 0x7f16280ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:56.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162dd70640 1 -- 172.21.15.19:0/1653835369 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16280ad960 msgr2=0x7f16280c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:56.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162dd70640 1 --2- 172.21.15.19:0/1653835369 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16280ad960 0x7f16280c4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162dd70640 1 -- 172.21.15.19:0/1653835369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16280c9b80 msgr2=0x7f16280ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:56.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162dd70640 1 --2- 172.21.15.19:0/1653835369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16280c9b80 0x7f16280ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162dd70640 1 -- 172.21.15.19:0/1653835369 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16180094d0 con 0x7f1628164520 2023-11-20T06:42:56.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162cd6e640 1 --2- 172.21.15.19:0/1653835369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16280c9b80 0x7f16280ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:56.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162d56f640 1 --2- 172.21.15.19:0/1653835369 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16280ad960 0x7f16280c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:56.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162dd70640 1 --2- 172.21.15.19:0/1653835369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1628164520 0x7f162815ed00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f162000ba10 tx=0x7f162000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:56.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f161dffb640 1 -- 172.21.15.19:0/1653835369 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1620003b80 con 0x7f1628164520 2023-11-20T06:42:56.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f161dffb640 1 -- 172.21.15.19:0/1653835369 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1620003ce0 con 0x7f1628164520 2023-11-20T06:42:56.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f161dffb640 1 -- 172.21.15.19:0/1653835369 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162000cae0 con 0x7f1628164520 2023-11-20T06:42:56.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162f7d3640 1 -- 172.21.15.19:0/1653835369 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16280c4050 con 0x7f1628164520 2023-11-20T06:42:56.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162f7d3640 1 -- 172.21.15.19:0/1653835369 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16280c57d0 con 0x7f1628164520 2023-11-20T06:42:56.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f162f7d3640 1 -- 172.21.15.19:0/1653835369 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16280c5cd0 con 0x7f1628164520 2023-11-20T06:42:56.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.711+0000 7f161dffb640 1 -- 172.21.15.19:0/1653835369 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f162000cc40 con 0x7f1628164520 2023-11-20T06:42:56.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.715+0000 7f161dffb640 1 --2- 172.21.15.19:0/1653835369 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f160c0664d0 0x7f160c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:56.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.715+0000 7f161dffb640 1 -- 172.21.15.19:0/1653835369 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1620083c20 con 0x7f1628164520 2023-11-20T06:42:56.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.715+0000 7f162d56f640 1 --2- 172.21.15.19:0/1653835369 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f160c0664d0 0x7f160c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:56.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.715+0000 7f162d56f640 1 --2- 172.21.15.19:0/1653835369 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f160c0664d0 0x7f160c068990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f16280c89d0 tx=0x7f1624008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:56.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.719+0000 7f161dffb640 1 -- 172.21.15.19:0/1653835369 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1620050f40 con 0x7f1628164520 2023-11-20T06:42:56.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.907+0000 7f162f7d3640 1 -- 172.21.15.19:0/1653835369 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1628074010 con 0x7f1628164520 2023-11-20T06:42:56.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.907+0000 7f161dffb640 1 -- 172.21.15.19:0/1653835369 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f1620054560 con 0x7f1628164520 2023-11-20T06:42:56.912 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:56.912 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3692171038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3692171038},{"type":"v1","addr":"172.21.15.190:6835","nonce":3692171038}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2633535615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":2633535615},{"type":"v1","addr":"172.21.15.190:6837","nonce":2633535615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/1822146855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1822146855},{"type":"v1","addr":"172.21.15.19:6833","nonce":1822146855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T06:42:43.280879+0000","modified":"2023-11-20T06:42:46.648235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/203468016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":203468016},{"type":"v1","addr":"172.21.15.19:6835","nonce":203468016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-20T06:42:56.912 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 18 2023-11-20T06:42:56.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.907+0000 7f162f7d3640 1 -- 172.21.15.19:0/1653835369 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f160c0664d0 msgr2=0x7f160c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:56.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.907+0000 7f162f7d3640 1 --2- 172.21.15.19:0/1653835369 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f160c0664d0 0x7f160c068990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f16280c89d0 tx=0x7f1624008040 comp rx=0 tx=0).stop 2023-11-20T06:42:56.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.907+0000 7f162f7d3640 1 -- 172.21.15.19:0/1653835369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1628164520 msgr2=0x7f162815ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:56.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.907+0000 7f162f7d3640 1 --2- 172.21.15.19:0/1653835369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1628164520 0x7f162815ed00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f162000ba10 tx=0x7f162000bed0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.907+0000 7f162f7d3640 1 -- 172.21.15.19:0/1653835369 shutdown_connections 2023-11-20T06:42:56.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.907+0000 7f162f7d3640 1 --2- 172.21.15.19:0/1653835369 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f160c0664d0 0x7f160c068990 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.907+0000 7f162f7d3640 1 --2- 172.21.15.19:0/1653835369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1628164520 0x7f162815ed00 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.907+0000 7f162f7d3640 1 --2- 172.21.15.19:0/1653835369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16280c9b80 0x7f16280ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.907+0000 7f162f7d3640 1 --2- 172.21.15.19:0/1653835369 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16280ad960 0x7f16280c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:56.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.907+0000 7f162f7d3640 1 -- 172.21.15.19:0/1653835369 >> 172.21.15.19:0/1653835369 conn(0x7f162806c190 msgr2=0x7f16280c8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:56.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.907+0000 7f162f7d3640 1 -- 172.21.15.19:0/1653835369 shutdown_connections 2023-11-20T06:42:56.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:56.907+0000 7f162f7d3640 1 -- 172.21.15.19:0/1653835369 wait complete. 2023-11-20T06:42:56.933 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T06:42:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.071+0000 7fdc5c009640 1 Processor -- start 2023-11-20T06:42:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.071+0000 7fdc5c009640 1 -- start start 2023-11-20T06:42:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.071+0000 7fdc5c009640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc541597c0 0x7fdc540ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.071+0000 7fdc5c009640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc540723d0 con 0x7fdc540adc10 2023-11-20T06:42:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.071+0000 7fdc5c009640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc540717c0 con 0x7fdc54159ba0 2023-11-20T06:42:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.071+0000 7fdc5c009640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc54071aa0 con 0x7fdc541597c0 2023-11-20T06:42:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.071+0000 7fdc5a5a6640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdc540adc10 0x7fdc5415d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40832/0 (socket says 172.21.15.19:40832) 2023-11-20T06:42:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.071+0000 7fdc5a5a6640 1 -- 172.21.15.19:0/1275258906 learned_addr learned my addr 172.21.15.19:0/1275258906 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.071+0000 7fdc59da5640 1 --2- 172.21.15.19:0/1275258906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc541597c0 0x7fdc540ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.071+0000 7fdc58da3640 1 -- 172.21.15.19:0/1275258906 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195621118 0 0) 0x7fdc540723d0 con 0x7fdc540adc10 2023-11-20T06:42:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.071+0000 7fdc58da3640 1 -- 172.21.15.19:0/1275258906 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc40003530 con 0x7fdc540adc10 2023-11-20T06:42:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.071+0000 7fdc58da3640 1 -- 172.21.15.19:0/1275258906 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846833476 0 0) 0x7fdc540717c0 con 0x7fdc54159ba0 2023-11-20T06:42:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.071+0000 7fdc58da3640 1 -- 172.21.15.19:0/1275258906 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc540723d0 con 0x7fdc54159ba0 2023-11-20T06:42:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.071+0000 7fdc59da5640 1 -- 172.21.15.19:0/1275258906 >> v1:172.21.15.190:6789/0 conn(0x7fdc54159ba0 legacy=0x7fdc540cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.071+0000 7fdc59da5640 1 -- 172.21.15.19:0/1275258906 >> v1:172.21.15.19:6789/0 conn(0x7fdc540adc10 legacy=0x7fdc5415d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.071+0000 7fdc59da5640 1 -- 172.21.15.19:0/1275258906 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc54071d80 con 0x7fdc541597c0 2023-11-20T06:42:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.075+0000 7fdc59da5640 1 --2- 172.21.15.19:0/1275258906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc541597c0 0x7fdc540ad6d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdc500097f0 tx=0x7fdc5001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53ec9513d2adb077 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.075+0000 7fdc58da3640 1 -- 172.21.15.19:0/1275258906 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc500a7070 con 0x7fdc541597c0 2023-11-20T06:42:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.075+0000 7fdc58da3640 1 -- 172.21.15.19:0/1275258906 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc500ab430 con 0x7fdc541597c0 2023-11-20T06:42:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.075+0000 7fdc58da3640 1 -- 172.21.15.19:0/1275258906 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc500ab7c0 con 0x7fdc541597c0 2023-11-20T06:42:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.075+0000 7fdc5c009640 1 -- 172.21.15.19:0/1275258906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc541597c0 msgr2=0x7fdc540ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.075+0000 7fdc5c009640 1 --2- 172.21.15.19:0/1275258906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc541597c0 0x7fdc540ad6d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdc500097f0 tx=0x7fdc5001c490 comp rx=0 tx=0).stop 2023-11-20T06:42:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.075+0000 7fdc5c009640 1 -- 172.21.15.19:0/1275258906 shutdown_connections 2023-11-20T06:42:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.075+0000 7fdc5c009640 1 --2- 172.21.15.19:0/1275258906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc541597c0 0x7fdc540ad6d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.075+0000 7fdc5c009640 1 -- 172.21.15.19:0/1275258906 >> 172.21.15.19:0/1275258906 conn(0x7fdc5406c190 msgr2=0x7fdc5406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.075+0000 7fdc5c009640 1 -- 172.21.15.19:0/1275258906 shutdown_connections 2023-11-20T06:42:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc5c009640 1 -- 172.21.15.19:0/1275258906 wait complete. 2023-11-20T06:42:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc5c009640 1 Processor -- start 2023-11-20T06:42:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc5c009640 1 -- start start 2023-11-20T06:42:57.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc5c009640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc540adc10 0x7fdc540c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:57.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc5c009640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc541597c0 0x7fdc540c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:57.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc5c009640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc54159ba0 0x7fdc5414a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:57.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc5c009640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc540c6280 con 0x7fdc541597c0 2023-11-20T06:42:57.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc5c009640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc540c86a0 con 0x7fdc540adc10 2023-11-20T06:42:57.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc5c009640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc540c80e0 con 0x7fdc54159ba0 2023-11-20T06:42:57.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc595a4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc541597c0 0x7fdc540c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:57.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc595a4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc541597c0 0x7fdc540c7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42778/0 (socket says 172.21.15.19:42778) 2023-11-20T06:42:57.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc595a4640 1 -- 172.21.15.19:0/2231246137 learned_addr learned my addr 172.21.15.19:0/2231246137 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:57.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc5a5a6640 1 --2- 172.21.15.19:0/2231246137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc54159ba0 0x7fdc5414a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:57.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc59da5640 1 --2- 172.21.15.19:0/2231246137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc540adc10 0x7fdc540c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:57.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc595a4640 1 -- 172.21.15.19:0/2231246137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc54159ba0 msgr2=0x7fdc5414a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:57.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc595a4640 1 --2- 172.21.15.19:0/2231246137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc54159ba0 0x7fdc5414a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc595a4640 1 -- 172.21.15.19:0/2231246137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc540adc10 msgr2=0x7fdc540c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:57.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc595a4640 1 --2- 172.21.15.19:0/2231246137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc540adc10 0x7fdc540c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc595a4640 1 -- 172.21.15.19:0/2231246137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc50009420 con 0x7fdc541597c0 2023-11-20T06:42:57.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc5a5a6640 1 --2- 172.21.15.19:0/2231246137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc54159ba0 0x7fdc5414a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:57.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.079+0000 7fdc595a4640 1 --2- 172.21.15.19:0/2231246137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc541597c0 0x7fdc540c7640 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400c430 tx=0x7fdc4400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:57.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.083+0000 7fdc4a7fc640 1 -- 172.21.15.19:0/2231246137 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc440052d0 con 0x7fdc541597c0 2023-11-20T06:42:57.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.083+0000 7fdc4a7fc640 1 -- 172.21.15.19:0/2231246137 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc44005450 con 0x7fdc541597c0 2023-11-20T06:42:57.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.083+0000 7fdc5c009640 1 -- 172.21.15.19:0/2231246137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc540c83c0 con 0x7fdc541597c0 2023-11-20T06:42:57.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.083+0000 7fdc4a7fc640 1 -- 172.21.15.19:0/2231246137 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc44003840 con 0x7fdc541597c0 2023-11-20T06:42:57.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.083+0000 7fdc5c009640 1 -- 172.21.15.19:0/2231246137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5415aad0 con 0x7fdc541597c0 2023-11-20T06:42:57.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.083+0000 7fdc5c009640 1 -- 172.21.15.19:0/2231246137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc5415acf0 con 0x7fdc541597c0 2023-11-20T06:42:57.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.083+0000 7fdc4a7fc640 1 -- 172.21.15.19:0/2231246137 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdc440039a0 con 0x7fdc541597c0 2023-11-20T06:42:57.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.083+0000 7fdc4a7fc640 1 --2- 172.21.15.19:0/2231246137 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdc380664a0 0x7fdc38068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.083+0000 7fdc4a7fc640 1 -- 172.21.15.19:0/2231246137 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdc44083570 con 0x7fdc541597c0 2023-11-20T06:42:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.083+0000 7fdc59da5640 1 --2- 172.21.15.19:0/2231246137 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdc380664a0 0x7fdc38068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.087+0000 7fdc59da5640 1 --2- 172.21.15.19:0/2231246137 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdc380664a0 0x7fdc38068960 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdc500af000 tx=0x7fdc500a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:57.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.087+0000 7fdc4a7fc640 1 -- 172.21.15.19:0/2231246137 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdc44050930 con 0x7fdc541597c0 2023-11-20T06:42:57.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.275+0000 7fdc5c009640 1 -- 172.21.15.19:0/2231246137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc54074010 con 0x7fdc541597c0 2023-11-20T06:42:57.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.279+0000 7fdc4a7fc640 1 -- 172.21.15.19:0/2231246137 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4916 (secure 0 0 0) 0x7fdc44053f50 con 0x7fdc541597c0 2023-11-20T06:42:57.286 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:57.286 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3692171038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3692171038},{"type":"v1","addr":"172.21.15.190:6835","nonce":3692171038}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2633535615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":2633535615},{"type":"v1","addr":"172.21.15.190:6837","nonce":2633535615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/1822146855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1822146855},{"type":"v1","addr":"172.21.15.19:6833","nonce":1822146855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T06:42:43.280879+0000","modified":"2023-11-20T06:42:46.648235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/203468016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":203468016},{"type":"v1","addr":"172.21.15.19:6835","nonce":203468016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-20T06:42:57.287 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 18 2023-11-20T06:42:57.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.279+0000 7fdc5c009640 1 -- 172.21.15.19:0/2231246137 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdc380664a0 msgr2=0x7fdc38068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:57.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.279+0000 7fdc5c009640 1 --2- 172.21.15.19:0/2231246137 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdc380664a0 0x7fdc38068960 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdc500af000 tx=0x7fdc500a7000 comp rx=0 tx=0).stop 2023-11-20T06:42:57.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.279+0000 7fdc5c009640 1 -- 172.21.15.19:0/2231246137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc541597c0 msgr2=0x7fdc540c7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:57.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.279+0000 7fdc5c009640 1 --2- 172.21.15.19:0/2231246137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc541597c0 0x7fdc540c7640 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400c430 tx=0x7fdc4400c8f0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.279+0000 7fdc5c009640 1 -- 172.21.15.19:0/2231246137 shutdown_connections 2023-11-20T06:42:57.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.279+0000 7fdc5c009640 1 --2- 172.21.15.19:0/2231246137 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fdc380664a0 0x7fdc38068960 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.279+0000 7fdc5c009640 1 --2- 172.21.15.19:0/2231246137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc54159ba0 0x7fdc5414a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.279+0000 7fdc5c009640 1 --2- 172.21.15.19:0/2231246137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc541597c0 0x7fdc540c7640 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.279+0000 7fdc5c009640 1 --2- 172.21.15.19:0/2231246137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc540adc10 0x7fdc540c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.279+0000 7fdc5c009640 1 -- 172.21.15.19:0/2231246137 >> 172.21.15.19:0/2231246137 conn(0x7fdc5406c190 msgr2=0x7fdc5414f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:57.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.279+0000 7fdc5c009640 1 -- 172.21.15.19:0/2231246137 shutdown_connections 2023-11-20T06:42:57.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.279+0000 7fdc5c009640 1 -- 172.21.15.19:0/2231246137 wait complete. 2023-11-20T06:42:57.305 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:42:57.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.443+0000 7fe406e2f640 1 Processor -- start 2023-11-20T06:42:57.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.443+0000 7fe406e2f640 1 -- start start 2023-11-20T06:42:57.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.443+0000 7fe406e2f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe40015cd60 0x7fe40006af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:57.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.443+0000 7fe406e2f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4000d3510 con 0x7fe40015c980 2023-11-20T06:42:57.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.443+0000 7fe406e2f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4000d2f50 con 0x7fe4000d1490 2023-11-20T06:42:57.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.443+0000 7fe406e2f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4000cd2b0 con 0x7fe40015cd60 2023-11-20T06:42:57.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.443+0000 7fe405e2d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe40015c980 0x7fe4000d0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40836/0 (socket says 172.21.15.19:40836) 2023-11-20T06:42:57.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.443+0000 7fe405e2d640 1 -- 172.21.15.19:0/2313579675 learned_addr learned my addr 172.21.15.19:0/2313579675 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:57.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.443+0000 7fe40662e640 1 --2- 172.21.15.19:0/2313579675 >> v2:172.21.15.190:3300/0 conn(0x7fe40015cd60 0x7fe40006af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:57.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.443+0000 7fe404e2b640 1 -- 172.21.15.19:0/2313579675 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2394848126 0 0) 0x7fe3fc0012a0 con 0x7fe40015c980 2023-11-20T06:42:57.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.443+0000 7fe404e2b640 1 -- 172.21.15.19:0/2313579675 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3ec003530 con 0x7fe40015c980 2023-11-20T06:42:57.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.443+0000 7fe40662e640 1 -- 172.21.15.19:0/2313579675 >> v1:172.21.15.190:6789/0 conn(0x7fe4000d1490 legacy=0x7fe4000cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:57.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.443+0000 7fe404e2b640 1 -- 172.21.15.19:0/2313579675 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119603445 0 0) 0x7fe4000d2f50 con 0x7fe4000d1490 2023-11-20T06:42:57.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.443+0000 7fe40662e640 1 -- 172.21.15.19:0/2313579675 >> v1:172.21.15.19:6789/0 conn(0x7fe40015c980 legacy=0x7fe4000d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:57.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.443+0000 7fe40662e640 1 -- 172.21.15.19:0/2313579675 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4000d3230 con 0x7fe40015cd60 2023-11-20T06:42:57.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.447+0000 7fe40662e640 1 --2- 172.21.15.19:0/2313579675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe40015cd60 0x7fe40006af90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8009d90 tx=0x7fe3f801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15627f1e15857042 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:57.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.447+0000 7fe404e2b640 1 -- 172.21.15.19:0/2313579675 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f80a5970 con 0x7fe40015cd60 2023-11-20T06:42:57.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.447+0000 7fe404e2b640 1 -- 172.21.15.19:0/2313579675 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f80a5ad0 con 0x7fe40015cd60 2023-11-20T06:42:57.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.447+0000 7fe404e2b640 1 -- 172.21.15.19:0/2313579675 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f80a5e60 con 0x7fe40015cd60 2023-11-20T06:42:57.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.447+0000 7fe406e2f640 1 -- 172.21.15.19:0/2313579675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe40015cd60 msgr2=0x7fe40006af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:57.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.447+0000 7fe406e2f640 1 --2- 172.21.15.19:0/2313579675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe40015cd60 0x7fe40006af90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8009d90 tx=0x7fe3f801c890 comp rx=0 tx=0).stop 2023-11-20T06:42:57.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.447+0000 7fe406e2f640 1 -- 172.21.15.19:0/2313579675 shutdown_connections 2023-11-20T06:42:57.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.447+0000 7fe406e2f640 1 --2- 172.21.15.19:0/2313579675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe40015cd60 0x7fe40006af90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.447+0000 7fe406e2f640 1 -- 172.21.15.19:0/2313579675 >> 172.21.15.19:0/2313579675 conn(0x7fe40009ba80 msgr2=0x7fe4000d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:57.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.447+0000 7fe406e2f640 1 -- 172.21.15.19:0/2313579675 shutdown_connections 2023-11-20T06:42:57.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.447+0000 7fe406e2f640 1 -- 172.21.15.19:0/2313579675 wait complete. 2023-11-20T06:42:57.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe406e2f640 1 Processor -- start 2023-11-20T06:42:57.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe406e2f640 1 -- start start 2023-11-20T06:42:57.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe406e2f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4000d1490 0x7fe400156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:57.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe406e2f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe40015c980 0x7fe400159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:57.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe406e2f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe40015cd60 0x7fe4000c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:57.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe406e2f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000b5c90 con 0x7fe40015c980 2023-11-20T06:42:57.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe406e2f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40015a550 con 0x7fe4000d1490 2023-11-20T06:42:57.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe406e2f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40015a830 con 0x7fe40015cd60 2023-11-20T06:42:57.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe40562c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe40015c980 0x7fe400159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:57.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe40562c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe40015c980 0x7fe400159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42792/0 (socket says 172.21.15.19:42792) 2023-11-20T06:42:57.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe40562c640 1 -- 172.21.15.19:0/1406648893 learned_addr learned my addr 172.21.15.19:0/1406648893 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:57.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe405e2d640 1 --2- 172.21.15.19:0/1406648893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4000d1490 0x7fe400156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:57.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe40662e640 1 --2- 172.21.15.19:0/1406648893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe40015cd60 0x7fe4000c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:57.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe40562c640 1 -- 172.21.15.19:0/1406648893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe40015cd60 msgr2=0x7fe4000c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:57.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe40562c640 1 --2- 172.21.15.19:0/1406648893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe40015cd60 0x7fe4000c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe40562c640 1 -- 172.21.15.19:0/1406648893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4000d1490 msgr2=0x7fe400156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:57.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe40562c640 1 --2- 172.21.15.19:0/1406648893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4000d1490 0x7fe400156f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe40562c640 1 -- 172.21.15.19:0/1406648893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f8009a70 con 0x7fe40015c980 2023-11-20T06:42:57.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe405e2d640 1 --2- 172.21.15.19:0/1406648893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4000d1490 0x7fe400156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:57.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe40662e640 1 --2- 172.21.15.19:0/1406648893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe40015cd60 0x7fe4000c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:57.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe40562c640 1 --2- 172.21.15.19:0/1406648893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe40015c980 0x7fe400159a90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000c470 tx=0x7fe3f000c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:57.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe3f67fc640 1 -- 172.21.15.19:0/1406648893 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0005480 con 0x7fe40015c980 2023-11-20T06:42:57.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe3f67fc640 1 -- 172.21.15.19:0/1406648893 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f0003600 con 0x7fe40015c980 2023-11-20T06:42:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe3f67fc640 1 -- 172.21.15.19:0/1406648893 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f00039b0 con 0x7fe40015c980 2023-11-20T06:42:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe406e2f640 1 -- 172.21.15.19:0/1406648893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe40015ab10 con 0x7fe40015c980 2023-11-20T06:42:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe406e2f640 1 -- 172.21.15.19:0/1406648893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4000b4570 con 0x7fe40015c980 2023-11-20T06:42:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.451+0000 7fe406e2f640 1 -- 172.21.15.19:0/1406648893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4000b5af0 con 0x7fe40015c980 2023-11-20T06:42:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.455+0000 7fe3f67fc640 1 -- 172.21.15.19:0/1406648893 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe3f0003b10 con 0x7fe40015c980 2023-11-20T06:42:57.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.455+0000 7fe3f67fc640 1 --2- 172.21.15.19:0/1406648893 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe3e40664a0 0x7fe3e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:57.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.455+0000 7fe3f67fc640 1 -- 172.21.15.19:0/1406648893 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe3f0083640 con 0x7fe40015c980 2023-11-20T06:42:57.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.455+0000 7fe405e2d640 1 --2- 172.21.15.19:0/1406648893 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe3e40664a0 0x7fe3e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:57.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.455+0000 7fe405e2d640 1 --2- 172.21.15.19:0/1406648893 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe3e40664a0 0x7fe3e4068960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc001400 tx=0x7fe3fc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:57.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.459+0000 7fe3f67fc640 1 -- 172.21.15.19:0/1406648893 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe4000b5af0 con 0x7fe40015c980 2023-11-20T06:42:57.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.619+0000 7fe406e2f640 1 -- 172.21.15.19:0/1406648893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4000b5af0 con 0x7fe40015c980 2023-11-20T06:42:57.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.619+0000 7fe3f67fc640 1 -- 172.21.15.19:0/1406648893 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16811 (secure 0 0 0) 0x7fe4000b5af0 con 0x7fe40015c980 2023-11-20T06:42:57.625 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:42:57.625 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":41,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:42:56.292055+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-20T06:42:41.076502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-20T06:42:42.316293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.10","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:42:57.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.619+0000 7fe406e2f640 1 -- 172.21.15.19:0/1406648893 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe3e40664a0 msgr2=0x7fe3e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:57.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.619+0000 7fe406e2f640 1 --2- 172.21.15.19:0/1406648893 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe3e40664a0 0x7fe3e4068960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc001400 tx=0x7fe3fc009040 comp rx=0 tx=0).stop 2023-11-20T06:42:57.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.619+0000 7fe406e2f640 1 -- 172.21.15.19:0/1406648893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe40015c980 msgr2=0x7fe400159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:57.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.619+0000 7fe406e2f640 1 --2- 172.21.15.19:0/1406648893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe40015c980 0x7fe400159a90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000c470 tx=0x7fe3f000c930 comp rx=0 tx=0).stop 2023-11-20T06:42:57.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.619+0000 7fe406e2f640 1 -- 172.21.15.19:0/1406648893 shutdown_connections 2023-11-20T06:42:57.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.619+0000 7fe406e2f640 1 --2- 172.21.15.19:0/1406648893 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fe3e40664a0 0x7fe3e4068960 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.619+0000 7fe406e2f640 1 --2- 172.21.15.19:0/1406648893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe40015cd60 0x7fe4000c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.619+0000 7fe406e2f640 1 --2- 172.21.15.19:0/1406648893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe40015c980 0x7fe400159a90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.619+0000 7fe406e2f640 1 --2- 172.21.15.19:0/1406648893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4000d1490 0x7fe400156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.619+0000 7fe406e2f640 1 -- 172.21.15.19:0/1406648893 >> 172.21.15.19:0/1406648893 conn(0x7fe40009ba80 msgr2=0x7fe40006be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:57.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.619+0000 7fe406e2f640 1 -- 172.21.15.19:0/1406648893 shutdown_connections 2023-11-20T06:42:57.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.623+0000 7fe406e2f640 1 -- 172.21.15.19:0/1406648893 wait complete. 2023-11-20T06:42:57.647 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-20T06:42:57.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.783+0000 7fa8fca17640 1 Processor -- start 2023-11-20T06:42:57.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.783+0000 7fa8fca17640 1 -- start start 2023-11-20T06:42:57.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8fca17640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa8f815aa30 0x7fa8f80b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:57.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8fca17640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f815ae10 con 0x7fa8f80cfb80 2023-11-20T06:42:57.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8fca17640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f80cb9e0 con 0x7fa8f815e4b0 2023-11-20T06:42:57.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8fca17640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f80b3ad0 con 0x7fa8f815aa30 2023-11-20T06:42:57.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f6d9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa8f80cfb80 0x7fa8f80cffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40852/0 (socket says 172.21.15.19:40852) 2023-11-20T06:42:57.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f6d9d640 1 -- 172.21.15.19:0/1348579181 learned_addr learned my addr 172.21.15.19:0/1348579181 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f659c640 1 --2- 172.21.15.19:0/1348579181 >> v2:172.21.15.190:3300/0 conn(0x7fa8f815aa30 0x7fa8f80b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f559a640 1 -- 172.21.15.19:0/1348579181 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752993073 0 0) 0x7fa8f00014a0 con 0x7fa8f80cfb80 2023-11-20T06:42:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f559a640 1 -- 172.21.15.19:0/1348579181 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8e0003530 con 0x7fa8f80cfb80 2023-11-20T06:42:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f559a640 1 -- 172.21.15.19:0/1348579181 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1300124930 0 0) 0x7fa8e0003530 con 0x7fa8f80cfb80 2023-11-20T06:42:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f559a640 1 -- 172.21.15.19:0/1348579181 >> v2:172.21.15.190:3300/0 conn(0x7fa8f815aa30 msgr2=0x7fa8f80b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f559a640 1 --2- 172.21.15.19:0/1348579181 >> v2:172.21.15.190:3300/0 conn(0x7fa8f815aa30 0x7fa8f80b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f559a640 1 -- 172.21.15.19:0/1348579181 >> v1:172.21.15.190:6789/0 conn(0x7fa8f815e4b0 legacy=0x7fa8f80b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f559a640 1 -- 172.21.15.19:0/1348579181 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f815ea30 con 0x7fa8f80cfb80 2023-11-20T06:42:57.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f559a640 1 -- 172.21.15.19:0/1348579181 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7fa8f0001b90 con 0x7fa8f80cfb80 2023-11-20T06:42:57.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f559a640 1 -- 172.21.15.19:0/1348579181 >> v1:172.21.15.19:6789/0 conn(0x7fa8f80cfb80 legacy=0x7fa8f80cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:57.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f559a640 1 --2- 172.21.15.19:0/1348579181 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8e0003980 0x7fa8e0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:57.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f559a640 1 --2- 172.21.15.19:0/1348579181 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8e00047d0 0x7fa8e0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:57.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f559a640 1 --2- 172.21.15.19:0/1348579181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8e0005190 0x7fa8e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:57.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f559a640 1 -- 172.21.15.19:0/1348579181 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f80b3ad0 con 0x7fa8e0005190 2023-11-20T06:42:57.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f559a640 1 -- 172.21.15.19:0/1348579181 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e000c130 con 0x7fa8e0003980 2023-11-20T06:42:57.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f559a640 1 -- 172.21.15.19:0/1348579181 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e000c2f0 con 0x7fa8e00047d0 2023-11-20T06:42:57.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f6d9d640 1 --2- 172.21.15.19:0/1348579181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8e0005190 0x7fa8e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:57.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f659c640 1 --2- 172.21.15.19:0/1348579181 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8e0003980 0x7fa8e0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:57.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f5d9b640 1 --2- 172.21.15.19:0/1348579181 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8e00047d0 0x7fa8e0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:57.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f6d9d640 1 -- 172.21.15.19:0/1348579181 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8e00047d0 msgr2=0x7fa8e0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:57.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f6d9d640 1 --2- 172.21.15.19:0/1348579181 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8e00047d0 0x7fa8e0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f6d9d640 1 -- 172.21.15.19:0/1348579181 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8e0003980 msgr2=0x7fa8e0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:57.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f6d9d640 1 --2- 172.21.15.19:0/1348579181 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8e0003980 0x7fa8e0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.787+0000 7fa8f6d9d640 1 -- 172.21.15.19:0/1348579181 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e0003530 con 0x7fa8e0005190 2023-11-20T06:42:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.791+0000 7fa8f6d9d640 1 -- 172.21.15.19:0/1348579181 reap_dead start 2023-11-20T06:42:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.791+0000 7fa8f6d9d640 1 --2- 172.21.15.19:0/1348579181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8e0005190 0x7fa8e000b990 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000a830 tx=0x7fa8f001faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618fd3dc4cfe7de9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.791+0000 7fa8f559a640 1 -- 172.21.15.19:0/1348579181 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f00af070 con 0x7fa8e0005190 2023-11-20T06:42:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.791+0000 7fa8f559a640 1 -- 172.21.15.19:0/1348579181 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f00aa4d0 con 0x7fa8e0005190 2023-11-20T06:42:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.791+0000 7fa8f559a640 1 -- 172.21.15.19:0/1348579181 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f00aa8a0 con 0x7fa8e0005190 2023-11-20T06:42:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.791+0000 7fa8fca17640 1 -- 172.21.15.19:0/1348579181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8e0005190 msgr2=0x7fa8e000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.791+0000 7fa8fca17640 1 --2- 172.21.15.19:0/1348579181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8e0005190 0x7fa8e000b990 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000a830 tx=0x7fa8f001faa0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.791+0000 7fa8fca17640 1 -- 172.21.15.19:0/1348579181 shutdown_connections 2023-11-20T06:42:57.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.791+0000 7fa8fca17640 1 --2- 172.21.15.19:0/1348579181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8e0005190 0x7fa8e000b990 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.791+0000 7fa8fca17640 1 -- 172.21.15.19:0/1348579181 >> 172.21.15.19:0/1348579181 conn(0x7fa8f80cd1c0 msgr2=0x7fa8f80cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:57.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.791+0000 7fa8fca17640 1 -- 172.21.15.19:0/1348579181 shutdown_connections 2023-11-20T06:42:57.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.791+0000 7fa8fca17640 1 -- 172.21.15.19:0/1348579181 wait complete. 2023-11-20T06:42:57.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8fca17640 1 Processor -- start 2023-11-20T06:42:57.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8fca17640 1 -- start start 2023-11-20T06:42:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8fca17640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8e0005190 0x7fa8f8151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8fca17640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8f815dc70 0x7fa8f81563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8fca17640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8f815b6a0 0x7fa8f815bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8fca17640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f815c070 con 0x7fa8e0005190 2023-11-20T06:42:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8fca17640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f80c8760 con 0x7fa8f815dc70 2023-11-20T06:42:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8fca17640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f8151cb0 con 0x7fa8f815b6a0 2023-11-20T06:42:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8f659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8e0005190 0x7fa8f8151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8f659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8e0005190 0x7fa8f8151770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42800/0 (socket says 172.21.15.19:42800) 2023-11-20T06:42:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8f659c640 1 -- 172.21.15.19:0/4075989657 learned_addr learned my addr 172.21.15.19:0/4075989657 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8f659c640 1 -- 172.21.15.19:0/4075989657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8f815b6a0 msgr2=0x7fa8f815bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8f6d9d640 1 --2- 172.21.15.19:0/4075989657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8f815b6a0 0x7fa8f815bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8f5d9b640 1 --2- 172.21.15.19:0/4075989657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8f815dc70 0x7fa8f81563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8f659c640 1 --2- 172.21.15.19:0/4075989657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8f815b6a0 0x7fa8f815bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8f659c640 1 -- 172.21.15.19:0/4075989657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8f815dc70 msgr2=0x7fa8f81563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8f659c640 1 --2- 172.21.15.19:0/4075989657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8f815dc70 0x7fa8f81563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8f659c640 1 -- 172.21.15.19:0/4075989657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f81f0000 con 0x7fa8e0005190 2023-11-20T06:42:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8f6d9d640 1 --2- 172.21.15.19:0/4075989657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8f815b6a0 0x7fa8f815bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8f5d9b640 1 --2- 172.21.15.19:0/4075989657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8f815dc70 0x7fa8f81563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:42:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8f659c640 1 --2- 172.21.15.19:0/4075989657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8e0005190 0x7fa8f8151770 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8011990 tx=0x7fa8e8011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8e6ffd640 1 -- 172.21.15.19:0/4075989657 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e800fad0 con 0x7fa8e0005190 2023-11-20T06:42:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8e6ffd640 1 -- 172.21.15.19:0/4075989657 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e800fc30 con 0x7fa8e0005190 2023-11-20T06:42:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8fca17640 1 -- 172.21.15.19:0/4075989657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f8156d60 con 0x7fa8e0005190 2023-11-20T06:42:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8e6ffd640 1 -- 172.21.15.19:0/4075989657 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8014440 con 0x7fa8e0005190 2023-11-20T06:42:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.795+0000 7fa8fca17640 1 -- 172.21.15.19:0/4075989657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f8157320 con 0x7fa8e0005190 2023-11-20T06:42:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.799+0000 7fa8fca17640 1 -- 172.21.15.19:0/4075989657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f8074010 con 0x7fa8e0005190 2023-11-20T06:42:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.799+0000 7fa8e6ffd640 1 -- 172.21.15.19:0/4075989657 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa8e801d400 con 0x7fa8e0005190 2023-11-20T06:42:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.799+0000 7fa8e6ffd640 1 --2- 172.21.15.19:0/4075989657 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa8d80664d0 0x7fa8d8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.799+0000 7fa8e6ffd640 1 -- 172.21.15.19:0/4075989657 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa8e8084880 con 0x7fa8e0005190 2023-11-20T06:42:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.799+0000 7fa8f5d9b640 1 --2- 172.21.15.19:0/4075989657 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa8d80664d0 0x7fa8d8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:57.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.799+0000 7fa8f5d9b640 1 --2- 172.21.15.19:0/4075989657 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa8d80664d0 0x7fa8d8068990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec000c10 tx=0x7fa8ec009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:57.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.803+0000 7fa8e6ffd640 1 -- 172.21.15.19:0/4075989657 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa8e8051b00 con 0x7fa8e0005190 2023-11-20T06:42:58.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.995+0000 7fa8fca17640 1 -- 172.21.15.19:0/4075989657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa8f815efc0 con 0x7fa8e0005190 2023-11-20T06:42:58.000 INFO:tasks.ceph.mon.a.smithi019.stderr:2023-11-20T06:42:57.995+0000 7f6bb0e90640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-20T06:42:58.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.999+0000 7fa8e6ffd640 1 -- 172.21.15.19:0/4075989657 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa8e8055120 con 0x7fa8e0005190 2023-11-20T06:42:58.003 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-20T06:42:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.999+0000 7fa8fca17640 1 -- 172.21.15.19:0/4075989657 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa8d80664d0 msgr2=0x7fa8d8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.999+0000 7fa8fca17640 1 --2- 172.21.15.19:0/4075989657 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa8d80664d0 0x7fa8d8068990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec000c10 tx=0x7fa8ec009040 comp rx=0 tx=0).stop 2023-11-20T06:42:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.999+0000 7fa8fca17640 1 -- 172.21.15.19:0/4075989657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8e0005190 msgr2=0x7fa8f8151770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.999+0000 7fa8fca17640 1 --2- 172.21.15.19:0/4075989657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8e0005190 0x7fa8f8151770 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8011990 tx=0x7fa8e8011e50 comp rx=0 tx=0).stop 2023-11-20T06:42:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.999+0000 7fa8fca17640 1 -- 172.21.15.19:0/4075989657 shutdown_connections 2023-11-20T06:42:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.999+0000 7fa8fca17640 1 --2- 172.21.15.19:0/4075989657 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa8d80664d0 0x7fa8d8068990 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.999+0000 7fa8fca17640 1 --2- 172.21.15.19:0/4075989657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8f815b6a0 0x7fa8f815bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.999+0000 7fa8fca17640 1 --2- 172.21.15.19:0/4075989657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8f815dc70 0x7fa8f81563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.999+0000 7fa8fca17640 1 --2- 172.21.15.19:0/4075989657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8e0005190 0x7fa8f8151770 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.999+0000 7fa8fca17640 1 -- 172.21.15.19:0/4075989657 >> 172.21.15.19:0/4075989657 conn(0x7fa8f80cd1c0 msgr2=0x7fa8f8072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.999+0000 7fa8fca17640 1 -- 172.21.15.19:0/4075989657 shutdown_connections 2023-11-20T06:42:58.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:57.999+0000 7fa8fca17640 1 -- 172.21.15.19:0/4075989657 wait complete. 2023-11-20T06:42:58.010 INFO:tasks.ceph.mds.a.smithi019.stderr: -556> 2023-11-20T06:42:47.859+0000 7f51d9f4a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-20T06:42:58.027 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-20T06:42:58.053 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2023-11-20T06:42:58.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.171+0000 7f2e66c68640 1 Processor -- start 2023-11-20T06:42:58.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.171+0000 7f2e66c68640 1 -- start start 2023-11-20T06:42:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.171+0000 7f2e66c68640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2e600d0210 0x7f2e600d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.171+0000 7f2e66c68640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e600d1670 con 0x7f2e6015cba0 2023-11-20T06:42:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.171+0000 7f2e66c68640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e600d1950 con 0x7f2e600b84e0 2023-11-20T06:42:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.171+0000 7f2e66c68640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e600d1460 con 0x7f2e600d0210 2023-11-20T06:42:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.171+0000 7f2e64a04640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2e6015cba0 0x7f2e600cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40866/0 (socket says 172.21.15.19:40866) 2023-11-20T06:42:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.171+0000 7f2e64a04640 1 -- 172.21.15.19:0/467499043 learned_addr learned my addr 172.21.15.19:0/467499043 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.171+0000 7f2e5ffff640 1 --2- 172.21.15.19:0/467499043 >> v2:172.21.15.190:3300/0 conn(0x7f2e600d0210 0x7f2e600d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.171+0000 7f2e5f7fe640 1 -- 172.21.15.19:0/467499043 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424336803 0 0) 0x7f2e600d1670 con 0x7f2e6015cba0 2023-11-20T06:42:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.171+0000 7f2e5f7fe640 1 -- 172.21.15.19:0/467499043 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e50003530 con 0x7f2e6015cba0 2023-11-20T06:42:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.171+0000 7f2e5f7fe640 1 -- 172.21.15.19:0/467499043 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662194278 0 0) 0x7f2e600d1950 con 0x7f2e600b84e0 2023-11-20T06:42:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.171+0000 7f2e5f7fe640 1 -- 172.21.15.19:0/467499043 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e600d1670 con 0x7f2e600b84e0 2023-11-20T06:42:58.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.171+0000 7f2e5ffff640 1 -- 172.21.15.19:0/467499043 >> v1:172.21.15.190:6789/0 conn(0x7f2e600b84e0 legacy=0x7f2e600b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:58.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.171+0000 7f2e5ffff640 1 -- 172.21.15.19:0/467499043 >> v1:172.21.15.19:6789/0 conn(0x7f2e6015cba0 legacy=0x7f2e600cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:58.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.171+0000 7f2e5ffff640 1 -- 172.21.15.19:0/467499043 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e600d1c30 con 0x7f2e600d0210 2023-11-20T06:42:58.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.175+0000 7f2e5ffff640 1 --2- 172.21.15.19:0/467499043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e600d0210 0x7f2e600d0f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0097c0 tx=0x7f2e4c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=feb1762f6eca4f9e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:58.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.175+0000 7f2e5f7fe640 1 -- 172.21.15.19:0/467499043 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0ab5f0 con 0x7f2e600d0210 2023-11-20T06:42:58.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.175+0000 7f2e5f7fe640 1 -- 172.21.15.19:0/467499043 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c0ab750 con 0x7f2e600d0210 2023-11-20T06:42:58.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.175+0000 7f2e5f7fe640 1 -- 172.21.15.19:0/467499043 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0abae0 con 0x7f2e600d0210 2023-11-20T06:42:58.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.175+0000 7f2e66c68640 1 -- 172.21.15.19:0/467499043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e600d0210 msgr2=0x7f2e600d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:58.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.175+0000 7f2e66c68640 1 --2- 172.21.15.19:0/467499043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e600d0210 0x7f2e600d0f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0097c0 tx=0x7f2e4c01c3f0 comp rx=0 tx=0).stop 2023-11-20T06:42:58.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.175+0000 7f2e66c68640 1 -- 172.21.15.19:0/467499043 shutdown_connections 2023-11-20T06:42:58.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.175+0000 7f2e66c68640 1 --2- 172.21.15.19:0/467499043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e600d0210 0x7f2e600d0f20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:58.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.175+0000 7f2e66c68640 1 -- 172.21.15.19:0/467499043 >> 172.21.15.19:0/467499043 conn(0x7f2e600719c0 msgr2=0x7f2e60071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:58.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.175+0000 7f2e66c68640 1 -- 172.21.15.19:0/467499043 shutdown_connections 2023-11-20T06:42:58.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.175+0000 7f2e66c68640 1 -- 172.21.15.19:0/467499043 wait complete. 2023-11-20T06:42:58.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e66c68640 1 Processor -- start 2023-11-20T06:42:58.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e66c68640 1 -- start start 2023-11-20T06:42:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e66c68640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e600b84e0 0x7f2e6014cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e66c68640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e600d0210 0x7f2e600b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e66c68640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e6015cba0 0x7f2e600c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e66c68640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e600c7630 con 0x7f2e6015cba0 2023-11-20T06:42:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e66c68640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e600c81b0 con 0x7f2e600d0210 2023-11-20T06:42:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e66c68640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e600c7880 con 0x7f2e600b84e0 2023-11-20T06:42:58.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e65205640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e6015cba0 0x7f2e600c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:58.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e65205640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e6015cba0 0x7f2e600c8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42814/0 (socket says 172.21.15.19:42814) 2023-11-20T06:42:58.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e65205640 1 -- 172.21.15.19:0/3078224933 learned_addr learned my addr 172.21.15.19:0/3078224933 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:58.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e64a04640 1 --2- 172.21.15.19:0/3078224933 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e600b84e0 0x7f2e6014cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:58.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e5ffff640 1 --2- 172.21.15.19:0/3078224933 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e600d0210 0x7f2e600b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:58.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e65205640 1 -- 172.21.15.19:0/3078224933 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e600b84e0 msgr2=0x7f2e6014cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:58.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e65205640 1 --2- 172.21.15.19:0/3078224933 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e600b84e0 0x7f2e6014cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:58.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e65205640 1 -- 172.21.15.19:0/3078224933 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e600d0210 msgr2=0x7f2e600b71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:58.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e65205640 1 --2- 172.21.15.19:0/3078224933 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e600d0210 0x7f2e600b71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:58.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e65205640 1 -- 172.21.15.19:0/3078224933 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c009420 con 0x7f2e6015cba0 2023-11-20T06:42:58.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e5ffff640 1 --2- 172.21.15.19:0/3078224933 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e600d0210 0x7f2e600b71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:42:58.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e65205640 1 --2- 172.21.15.19:0/3078224933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e6015cba0 0x7f2e600c8640 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800c7d0 tx=0x7f2e5800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e5d7fa640 1 -- 172.21.15.19:0/3078224933 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e58003b80 con 0x7f2e6015cba0 2023-11-20T06:42:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e5d7fa640 1 -- 172.21.15.19:0/3078224933 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e58003ce0 con 0x7f2e6015cba0 2023-11-20T06:42:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e5d7fa640 1 -- 172.21.15.19:0/3078224933 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5800aa90 con 0x7f2e6015cba0 2023-11-20T06:42:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e66c68640 1 -- 172.21.15.19:0/3078224933 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e600c7b60 con 0x7f2e6015cba0 2023-11-20T06:42:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.179+0000 7f2e66c68640 1 -- 172.21.15.19:0/3078224933 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6014d180 con 0x7f2e6015cba0 2023-11-20T06:42:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.183+0000 7f2e66c68640 1 -- 172.21.15.19:0/3078224933 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e600c8340 con 0x7f2e6015cba0 2023-11-20T06:42:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.183+0000 7f2e5d7fa640 1 -- 172.21.15.19:0/3078224933 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2e5800abf0 con 0x7f2e6015cba0 2023-11-20T06:42:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.183+0000 7f2e5d7fa640 1 --2- 172.21.15.19:0/3078224933 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2e440664a0 0x7f2e44068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.183+0000 7f2e5d7fa640 1 -- 172.21.15.19:0/3078224933 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f2e58083f60 con 0x7f2e6015cba0 2023-11-20T06:42:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.183+0000 7f2e64a04640 1 --2- 172.21.15.19:0/3078224933 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2e440664a0 0x7f2e44068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:58.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.183+0000 7f2e64a04640 1 --2- 172.21.15.19:0/3078224933 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2e440664a0 0x7f2e44068960 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2e540011f0 tx=0x7f2e54009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:58.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.187+0000 7f2e5d7fa640 1 -- 172.21.15.19:0/3078224933 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2e580511b0 con 0x7f2e6015cba0 2023-11-20T06:42:58.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.379+0000 7f2e66c68640 1 -- 172.21.15.19:0/3078224933 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2e6004e170 con 0x7f2e6015cba0 2023-11-20T06:42:59.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:58.999+0000 7f2e5d7fa640 1 -- 172.21.15.19:0/3078224933 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2e580547d0 con 0x7f2e6015cba0 2023-11-20T06:42:59.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.003+0000 7f2e66c68640 1 -- 172.21.15.19:0/3078224933 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2e440664a0 msgr2=0x7f2e44068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:59.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.003+0000 7f2e66c68640 1 --2- 172.21.15.19:0/3078224933 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2e440664a0 0x7f2e44068960 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2e540011f0 tx=0x7f2e54009040 comp rx=0 tx=0).stop 2023-11-20T06:42:59.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.003+0000 7f2e66c68640 1 -- 172.21.15.19:0/3078224933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e6015cba0 msgr2=0x7f2e600c8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:59.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.003+0000 7f2e66c68640 1 --2- 172.21.15.19:0/3078224933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e6015cba0 0x7f2e600c8640 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800c7d0 tx=0x7f2e5800cc90 comp rx=0 tx=0).stop 2023-11-20T06:42:59.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.003+0000 7f2e66c68640 1 -- 172.21.15.19:0/3078224933 shutdown_connections 2023-11-20T06:42:59.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.003+0000 7f2e66c68640 1 --2- 172.21.15.19:0/3078224933 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2e440664a0 0x7f2e44068960 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:59.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.003+0000 7f2e66c68640 1 --2- 172.21.15.19:0/3078224933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e6015cba0 0x7f2e600c8640 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:59.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.003+0000 7f2e66c68640 1 --2- 172.21.15.19:0/3078224933 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e600d0210 0x7f2e600b71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:59.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.003+0000 7f2e66c68640 1 --2- 172.21.15.19:0/3078224933 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e600b84e0 0x7f2e6014cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:59.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.003+0000 7f2e66c68640 1 -- 172.21.15.19:0/3078224933 >> 172.21.15.19:0/3078224933 conn(0x7f2e600719c0 msgr2=0x7f2e6015a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:59.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.003+0000 7f2e66c68640 1 -- 172.21.15.19:0/3078224933 shutdown_connections 2023-11-20T06:42:59.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.003+0000 7f2e66c68640 1 -- 172.21.15.19:0/3078224933 wait complete. 2023-11-20T06:42:59.033 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-20T06:42:59.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.227+0000 7f441ca79640 1 Processor -- start 2023-11-20T06:42:59.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.227+0000 7f441ca79640 1 -- start start 2023-11-20T06:42:59.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.227+0000 7f441ca79640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44180cdc80 0x7f44180cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:59.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.227+0000 7f441ca79640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f441815dec0 0x7f44180cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:59.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.227+0000 7f441ca79640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44180ce460 con 0x7f44180d2570 2023-11-20T06:42:59.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.227+0000 7f441ca79640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44180cd830 con 0x7f441815dec0 2023-11-20T06:42:59.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.227+0000 7f441ca79640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441815da30 con 0x7f44180cdc80 2023-11-20T06:42:59.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.227+0000 7f441659c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f44180d2570 0x7f4418161210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40874/0 (socket says 172.21.15.19:40874) 2023-11-20T06:42:59.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.227+0000 7f441659c640 1 -- 172.21.15.19:0/392278739 learned_addr learned my addr 172.21.15.19:0/392278739 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:42:59.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.227+0000 7f440ffff640 1 --2- 172.21.15.19:0/392278739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44180cdc80 0x7f44180cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:59.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.227+0000 7f4416d9d640 1 --2- 172.21.15.19:0/392278739 >> v2:172.21.15.190:3300/0 conn(0x7f441815dec0 0x7f44180cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:59.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.227+0000 7f4415d9b640 1 -- 172.21.15.19:0/392278739 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524642332 0 0) 0x7f44180ce460 con 0x7f44180d2570 2023-11-20T06:42:59.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.227+0000 7f4415d9b640 1 -- 172.21.15.19:0/392278739 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4404003530 con 0x7f44180d2570 2023-11-20T06:42:59.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.227+0000 7f4416d9d640 1 -- 172.21.15.19:0/392278739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44180cdc80 msgr2=0x7f44180cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:42:59.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.227+0000 7f4416d9d640 1 --2- 172.21.15.19:0/392278739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44180cdc80 0x7f44180cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:59.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.227+0000 7f4416d9d640 1 -- 172.21.15.19:0/392278739 >> v1:172.21.15.19:6789/0 conn(0x7f44180d2570 legacy=0x7f4418161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:59.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.227+0000 7f4416d9d640 1 -- 172.21.15.19:0/392278739 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44180ce180 con 0x7f441815dec0 2023-11-20T06:42:59.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.231+0000 7f4416d9d640 1 --2- 172.21.15.19:0/392278739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f441815dec0 0x7f44180cfb50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4410009d90 tx=0x7f441001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bc34b77b612f94a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:59.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.231+0000 7f4415d9b640 1 -- 172.21.15.19:0/392278739 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44100a59e0 con 0x7f441815dec0 2023-11-20T06:42:59.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.231+0000 7f4415d9b640 1 -- 172.21.15.19:0/392278739 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44100a5b40 con 0x7f441815dec0 2023-11-20T06:42:59.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.231+0000 7f4415d9b640 1 -- 172.21.15.19:0/392278739 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44100ad440 con 0x7f441815dec0 2023-11-20T06:42:59.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.231+0000 7f441ca79640 1 -- 172.21.15.19:0/392278739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f441815dec0 msgr2=0x7f44180cfb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:59.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.231+0000 7f441ca79640 1 --2- 172.21.15.19:0/392278739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f441815dec0 0x7f44180cfb50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4410009d90 tx=0x7f441001c920 comp rx=0 tx=0).stop 2023-11-20T06:42:59.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.231+0000 7f441ca79640 1 -- 172.21.15.19:0/392278739 shutdown_connections 2023-11-20T06:42:59.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.231+0000 7f441ca79640 1 --2- 172.21.15.19:0/392278739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f441815dec0 0x7f44180cfb50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:59.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.231+0000 7f441ca79640 1 --2- 172.21.15.19:0/392278739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44180cdc80 0x7f44180cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:59.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.231+0000 7f441ca79640 1 -- 172.21.15.19:0/392278739 >> 172.21.15.19:0/392278739 conn(0x7f44180715c0 msgr2=0x7f44180719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:42:59.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.231+0000 7f441ca79640 1 -- 172.21.15.19:0/392278739 shutdown_connections 2023-11-20T06:42:59.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.231+0000 7f441ca79640 1 -- 172.21.15.19:0/392278739 wait complete. 2023-11-20T06:42:59.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f441ca79640 1 Processor -- start 2023-11-20T06:42:59.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f441ca79640 1 -- start start 2023-11-20T06:42:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f441ca79640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44180cdc80 0x7f4418150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f441ca79640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44180d2570 0x7f4418155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f441ca79640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f441815dec0 0x7f4418158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f441ca79640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4418150680 con 0x7f44180d2570 2023-11-20T06:42:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f441ca79640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44181527f0 con 0x7f44180cdc80 2023-11-20T06:42:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f441ca79640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4418152ad0 con 0x7f441815dec0 2023-11-20T06:42:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f440ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44180d2570 0x7f4418155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:59.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f440ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44180d2570 0x7f4418155f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42816/0 (socket says 172.21.15.19:42816) 2023-11-20T06:42:59.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f440ffff640 1 -- 172.21.15.19:0/2564803586 learned_addr learned my addr 172.21.15.19:0/2564803586 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:42:59.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f441659c640 1 --2- 172.21.15.19:0/2564803586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44180cdc80 0x7f4418150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:59.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f4416d9d640 1 --2- 172.21.15.19:0/2564803586 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f441815dec0 0x7f4418158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:59.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f440ffff640 1 -- 172.21.15.19:0/2564803586 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f441815dec0 msgr2=0x7f4418158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:59.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f440ffff640 1 --2- 172.21.15.19:0/2564803586 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f441815dec0 0x7f4418158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:59.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f440ffff640 1 -- 172.21.15.19:0/2564803586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44180cdc80 msgr2=0x7f4418150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:42:59.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f440ffff640 1 --2- 172.21.15.19:0/2564803586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44180cdc80 0x7f4418150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:42:59.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f440ffff640 1 -- 172.21.15.19:0/2564803586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4410009a70 con 0x7f44180d2570 2023-11-20T06:42:59.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f440ffff640 1 --2- 172.21.15.19:0/2564803586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44180d2570 0x7f4418155f20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f440000e870 tx=0x7f440000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:59.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f440effd640 1 -- 172.21.15.19:0/2564803586 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400009510 con 0x7f44180d2570 2023-11-20T06:42:59.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f440effd640 1 -- 172.21.15.19:0/2564803586 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440000eec0 con 0x7f44180d2570 2023-11-20T06:42:59.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f441ca79640 1 -- 172.21.15.19:0/2564803586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4418152db0 con 0x7f44180d2570 2023-11-20T06:42:59.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f440effd640 1 -- 172.21.15.19:0/2564803586 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440000cb40 con 0x7f44180d2570 2023-11-20T06:42:59.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f441ca79640 1 -- 172.21.15.19:0/2564803586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4418153370 con 0x7f44180d2570 2023-11-20T06:42:59.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.235+0000 7f441ca79640 1 -- 172.21.15.19:0/2564803586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441804e170 con 0x7f44180d2570 2023-11-20T06:42:59.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.239+0000 7f440effd640 1 -- 172.21.15.19:0/2564803586 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f440000cca0 con 0x7f44180d2570 2023-11-20T06:42:59.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.239+0000 7f440effd640 1 --2- 172.21.15.19:0/2564803586 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f43f80664a0 0x7f43f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:42:59.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.239+0000 7f440effd640 1 -- 172.21.15.19:0/2564803586 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f44000841e0 con 0x7f44180d2570 2023-11-20T06:42:59.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.239+0000 7f441659c640 1 --2- 172.21.15.19:0/2564803586 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f43f80664a0 0x7f43f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:42:59.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.239+0000 7f441659c640 1 --2- 172.21.15.19:0/2564803586 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f43f80664a0 0x7f43f8068960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4408005890 tx=0x7f4408009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:42:59.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.243+0000 7f440effd640 1 -- 172.21.15.19:0/2564803586 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4400051430 con 0x7f44180d2570 2023-11-20T06:42:59.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:42:59.403+0000 7f441ca79640 1 -- 172.21.15.19:0/2564803586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f44180cda60 con 0x7f44180d2570 2023-11-20T06:43:00.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.307+0000 7f440effd640 1 -- 172.21.15.19:0/2564803586 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4400054a50 con 0x7f44180d2570 2023-11-20T06:43:00.315 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2023-11-20T06:43:00.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.311+0000 7f441ca79640 1 -- 172.21.15.19:0/2564803586 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f43f80664a0 msgr2=0x7f43f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:00.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.311+0000 7f441ca79640 1 --2- 172.21.15.19:0/2564803586 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f43f80664a0 0x7f43f8068960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4408005890 tx=0x7f4408009040 comp rx=0 tx=0).stop 2023-11-20T06:43:00.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.311+0000 7f441ca79640 1 -- 172.21.15.19:0/2564803586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44180d2570 msgr2=0x7f4418155f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:00.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.311+0000 7f441ca79640 1 --2- 172.21.15.19:0/2564803586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44180d2570 0x7f4418155f20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f440000e870 tx=0x7f440000ec70 comp rx=0 tx=0).stop 2023-11-20T06:43:00.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.311+0000 7f441ca79640 1 -- 172.21.15.19:0/2564803586 shutdown_connections 2023-11-20T06:43:00.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.311+0000 7f441ca79640 1 --2- 172.21.15.19:0/2564803586 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f43f80664a0 0x7f43f8068960 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:00.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.311+0000 7f441ca79640 1 --2- 172.21.15.19:0/2564803586 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f441815dec0 0x7f4418158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:00.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.311+0000 7f441ca79640 1 --2- 172.21.15.19:0/2564803586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44180d2570 0x7f4418155f20 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:00.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.311+0000 7f441ca79640 1 --2- 172.21.15.19:0/2564803586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44180cdc80 0x7f4418150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:00.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.311+0000 7f441ca79640 1 -- 172.21.15.19:0/2564803586 >> 172.21.15.19:0/2564803586 conn(0x7f44180715c0 msgr2=0x7f44180d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:00.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.311+0000 7f441ca79640 1 -- 172.21.15.19:0/2564803586 shutdown_connections 2023-11-20T06:43:00.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.311+0000 7f441ca79640 1 -- 172.21.15.19:0/2564803586 wait complete. 2023-11-20T06:43:00.344 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-20T06:43:00.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.491+0000 7f0206301640 1 Processor -- start 2023-11-20T06:43:00.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.491+0000 7f0206301640 1 -- start start 2023-11-20T06:43:00.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.491+0000 7f0206301640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f02001595a0 0x7f020006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:00.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.491+0000 7f0206301640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0200159980 0x7f020006c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:00.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.491+0000 7f0206301640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02000c8a20 con 0x7f02000b3bc0 2023-11-20T06:43:00.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.491+0000 7f0206301640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f020015e300 con 0x7f0200159980 2023-11-20T06:43:00.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.491+0000 7f0206301640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02000c8c10 con 0x7f02001595a0 2023-11-20T06:43:00.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.491+0000 7f01ff7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0200159980 0x7f020006c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:00.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.491+0000 7f01ff7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0200159980 0x7f020006c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42832/0 (socket says 172.21.15.19:42832) 2023-11-20T06:43:00.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.491+0000 7f01ff7fe640 1 -- 172.21.15.19:0/1474297551 learned_addr learned my addr 172.21.15.19:0/1474297551 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:00.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.491+0000 7f01fffff640 1 --2- 172.21.15.19:0/1474297551 >> v2:172.21.15.190:3300/0 conn(0x7f02001595a0 0x7f020006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:00.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.491+0000 7f01ff7fe640 1 -- 172.21.15.19:0/1474297551 >> v2:172.21.15.190:3300/0 conn(0x7f02001595a0 msgr2=0x7f020006c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:00.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.491+0000 7f01ff7fe640 1 --2- 172.21.15.19:0/1474297551 >> v2:172.21.15.190:3300/0 conn(0x7f02001595a0 0x7f020006c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:00.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.491+0000 7f01ff7fe640 1 -- 172.21.15.19:0/1474297551 >> v1:172.21.15.190:6789/0 conn(0x7f02000b3bc0 legacy=0x7f02000cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:00.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.491+0000 7f01ff7fe640 1 -- 172.21.15.19:0/1474297551 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02000c8ef0 con 0x7f0200159980 2023-11-20T06:43:00.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.491+0000 7f01feffd640 1 -- 172.21.15.19:0/1474297551 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798080161 0 0) 0x7f02000c8a20 con 0x7f02000b3bc0 2023-11-20T06:43:00.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.495+0000 7f01ff7fe640 1 --2- 172.21.15.19:0/1474297551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0200159980 0x7f020006c9f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f020006d5e0 tx=0x7f01f401eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c57fc8a57b241d server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:00.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.495+0000 7f01feffd640 1 -- 172.21.15.19:0/1474297551 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f40a7be0 con 0x7f0200159980 2023-11-20T06:43:00.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.495+0000 7f01feffd640 1 -- 172.21.15.19:0/1474297551 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f40a7d40 con 0x7f0200159980 2023-11-20T06:43:00.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.495+0000 7f01feffd640 1 -- 172.21.15.19:0/1474297551 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f40af660 con 0x7f0200159980 2023-11-20T06:43:00.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.495+0000 7f0206301640 1 -- 172.21.15.19:0/1474297551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0200159980 msgr2=0x7f020006c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:00.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.495+0000 7f0206301640 1 --2- 172.21.15.19:0/1474297551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0200159980 0x7f020006c9f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f020006d5e0 tx=0x7f01f401eb10 comp rx=0 tx=0).stop 2023-11-20T06:43:00.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.495+0000 7f0206301640 1 -- 172.21.15.19:0/1474297551 shutdown_connections 2023-11-20T06:43:00.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.495+0000 7f0206301640 1 --2- 172.21.15.19:0/1474297551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0200159980 0x7f020006c9f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:00.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.495+0000 7f0206301640 1 --2- 172.21.15.19:0/1474297551 >> v2:172.21.15.190:3300/0 conn(0x7f02001595a0 0x7f020006c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:00.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.495+0000 7f0206301640 1 -- 172.21.15.19:0/1474297551 >> 172.21.15.19:0/1474297551 conn(0x7f020006a820 msgr2=0x7f02000b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:00.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.495+0000 7f0206301640 1 -- 172.21.15.19:0/1474297551 shutdown_connections 2023-11-20T06:43:00.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.495+0000 7f0206301640 1 -- 172.21.15.19:0/1474297551 wait complete. 2023-11-20T06:43:00.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f0206301640 1 Processor -- start 2023-11-20T06:43:00.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f0206301640 1 -- start start 2023-11-20T06:43:00.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f0206301640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02000b3bc0 0x7f020015c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:00.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f0206301640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02001595a0 0x7f02000ce610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:00.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f0206301640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02001f4e20 0x7f02000ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:00.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f0206301640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02001f40f0 con 0x7f02001595a0 2023-11-20T06:43:00.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f0206301640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02001f4990 con 0x7f02001f4e20 2023-11-20T06:43:00.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f0206301640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02001f18e0 con 0x7f02000b3bc0 2023-11-20T06:43:00.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f01ff7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02001595a0 0x7f02000ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:00.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f01ff7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02001595a0 0x7f02000ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42834/0 (socket says 172.21.15.19:42834) 2023-11-20T06:43:00.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f01ff7fe640 1 -- 172.21.15.19:0/2519413293 learned_addr learned my addr 172.21.15.19:0/2519413293 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:00.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f01fffff640 1 --2- 172.21.15.19:0/2519413293 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02000b3bc0 0x7f020015c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:00.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f020489e640 1 --2- 172.21.15.19:0/2519413293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02001f4e20 0x7f02000ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:00.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f01ff7fe640 1 -- 172.21.15.19:0/2519413293 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02000b3bc0 msgr2=0x7f020015c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:00.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f01ff7fe640 1 --2- 172.21.15.19:0/2519413293 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02000b3bc0 0x7f020015c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:00.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f01ff7fe640 1 -- 172.21.15.19:0/2519413293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02001f4e20 msgr2=0x7f02000ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:00.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f01ff7fe640 1 --2- 172.21.15.19:0/2519413293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02001f4e20 0x7f02000ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:00.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f01ff7fe640 1 -- 172.21.15.19:0/2519413293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f400b770 con 0x7f02001595a0 2023-11-20T06:43:00.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f020489e640 1 --2- 172.21.15.19:0/2519413293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02001f4e20 0x7f02000ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:43:00.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f01ff7fe640 1 --2- 172.21.15.19:0/2519413293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02001595a0 0x7f02000ce610 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f01f400b2c0 tx=0x7f01f401b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:00.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f01fcff9640 1 -- 172.21.15.19:0/2519413293 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f40afd30 con 0x7f02001595a0 2023-11-20T06:43:00.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f01fcff9640 1 -- 172.21.15.19:0/2519413293 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f40afe90 con 0x7f02001595a0 2023-11-20T06:43:00.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f01fcff9640 1 -- 172.21.15.19:0/2519413293 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f40b9680 con 0x7f02001595a0 2023-11-20T06:43:00.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.499+0000 7f0206301640 1 -- 172.21.15.19:0/2519413293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02001f4340 con 0x7f02001595a0 2023-11-20T06:43:00.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.503+0000 7f0206301640 1 -- 172.21.15.19:0/2519413293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020015c860 con 0x7f02001595a0 2023-11-20T06:43:00.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.503+0000 7f0206301640 1 -- 172.21.15.19:0/2519413293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020004e170 con 0x7f02001595a0 2023-11-20T06:43:00.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.503+0000 7f01fcff9640 1 -- 172.21.15.19:0/2519413293 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f01f40b97e0 con 0x7f02001595a0 2023-11-20T06:43:00.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.503+0000 7f01fcff9640 1 --2- 172.21.15.19:0/2519413293 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f01ec0664d0 0x7f01ec068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:00.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.503+0000 7f01fcff9640 1 -- 172.21.15.19:0/2519413293 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f01f4121160 con 0x7f02001595a0 2023-11-20T06:43:00.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.503+0000 7f01fffff640 1 --2- 172.21.15.19:0/2519413293 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f01ec0664d0 0x7f01ec068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:00.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.503+0000 7f01fffff640 1 --2- 172.21.15.19:0/2519413293 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f01ec0664d0 0x7f01ec068990 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009b40 tx=0x7f01f0009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:00.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.507+0000 7f01fcff9640 1 -- 172.21.15.19:0/2519413293 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f01f40ee680 con 0x7f02001595a0 2023-11-20T06:43:00.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:00.667+0000 7f0206301640 1 -- 172.21.15.19:0/2519413293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f02000b1100 con 0x7f02001595a0 2023-11-20T06:43:01.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.311+0000 7f01fcff9640 1 -- 172.21.15.19:0/2519413293 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) v1 ==== 169+0+0 (secure 0 0 0) 0x7f01f40f1ca0 con 0x7f02001595a0 2023-11-20T06:43:01.317 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2023-11-20T06:43:01.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.315+0000 7f0206301640 1 -- 172.21.15.19:0/2519413293 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f01ec0664d0 msgr2=0x7f01ec068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:01.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.315+0000 7f0206301640 1 --2- 172.21.15.19:0/2519413293 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f01ec0664d0 0x7f01ec068990 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009b40 tx=0x7f01f0009190 comp rx=0 tx=0).stop 2023-11-20T06:43:01.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.315+0000 7f0206301640 1 -- 172.21.15.19:0/2519413293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02001595a0 msgr2=0x7f02000ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:01.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.315+0000 7f0206301640 1 --2- 172.21.15.19:0/2519413293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02001595a0 0x7f02000ce610 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f01f400b2c0 tx=0x7f01f401b8b0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.315+0000 7f0206301640 1 -- 172.21.15.19:0/2519413293 shutdown_connections 2023-11-20T06:43:01.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.315+0000 7f0206301640 1 --2- 172.21.15.19:0/2519413293 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f01ec0664d0 0x7f01ec068990 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.315+0000 7f0206301640 1 --2- 172.21.15.19:0/2519413293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02001f4e20 0x7f02000ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.315+0000 7f0206301640 1 --2- 172.21.15.19:0/2519413293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02001595a0 0x7f02000ce610 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.315+0000 7f0206301640 1 --2- 172.21.15.19:0/2519413293 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02000b3bc0 0x7f020015c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.315+0000 7f0206301640 1 -- 172.21.15.19:0/2519413293 >> 172.21.15.19:0/2519413293 conn(0x7f020006a820 msgr2=0x7f020015d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:01.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.315+0000 7f0206301640 1 -- 172.21.15.19:0/2519413293 shutdown_connections 2023-11-20T06:43:01.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.315+0000 7f0206301640 1 -- 172.21.15.19:0/2519413293 wait complete. 2023-11-20T06:43:01.349 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-20T06:43:01.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.491+0000 7fd30010f640 1 Processor -- start 2023-11-20T06:43:01.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.491+0000 7fd30010f640 1 -- start start 2023-11-20T06:43:01.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.495+0000 7fd30010f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd2f815cba0 0x7fd2f80d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:01.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.495+0000 7fd30010f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f80d0210 0x7fd2f80b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:01.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.495+0000 7fd30010f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f80d1670 con 0x7fd2f80b84e0 2023-11-20T06:43:01.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.495+0000 7fd30010f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f80d1460 con 0x7fd2f815cba0 2023-11-20T06:43:01.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.495+0000 7fd30010f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f80d1950 con 0x7fd2f80d0210 2023-11-20T06:43:01.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.495+0000 7fd2fe6ac640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f80d0210 0x7fd2f80b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:01.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.495+0000 7fd2fdeab640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd2f815cba0 0x7fd2f80d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:01.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.495+0000 7fd2fe6ac640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f80d0210 0x7fd2f80b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:59262/0 (socket says 172.21.15.19:59262) 2023-11-20T06:43:01.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.495+0000 7fd2fe6ac640 1 -- 172.21.15.19:0/4274594063 learned_addr learned my addr 172.21.15.19:0/4274594063 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:01.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.495+0000 7fd2fe6ac640 1 -- 172.21.15.19:0/4274594063 >> v2:172.21.15.190:3300/0 conn(0x7fd2f815cba0 msgr2=0x7fd2f80d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:01.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.495+0000 7fd2fe6ac640 1 --2- 172.21.15.19:0/4274594063 >> v2:172.21.15.190:3300/0 conn(0x7fd2f815cba0 0x7fd2f80d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.495+0000 7fd2fe6ac640 1 -- 172.21.15.19:0/4274594063 >> v1:172.21.15.190:6789/0 conn(0x7fd2f80b84e0 legacy=0x7fd2f80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:01.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.495+0000 7fd2fe6ac640 1 -- 172.21.15.19:0/4274594063 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f80d1c30 con 0x7fd2f80d0210 2023-11-20T06:43:01.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.495+0000 7fd2fdeab640 1 --2- 172.21.15.19:0/4274594063 >> v2:172.21.15.190:3300/0 conn(0x7fd2f815cba0 0x7fd2f80d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:43:01.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.495+0000 7fd2fe6ac640 1 --2- 172.21.15.19:0/4274594063 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f80d0210 0x7fd2f80b5cf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009e50 tx=0x7fd2f001ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=959d6f784f8f4758 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:01.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.499+0000 7fd2fcea9640 1 -- 172.21.15.19:0/4274594063 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f00a58e0 con 0x7fd2f80d0210 2023-11-20T06:43:01.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.499+0000 7fd2fcea9640 1 -- 172.21.15.19:0/4274594063 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f00a5a40 con 0x7fd2f80d0210 2023-11-20T06:43:01.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.499+0000 7fd2fcea9640 1 -- 172.21.15.19:0/4274594063 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f00a5dd0 con 0x7fd2f80d0210 2023-11-20T06:43:01.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.499+0000 7fd30010f640 1 -- 172.21.15.19:0/4274594063 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f80d0210 msgr2=0x7fd2f80b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:01.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.499+0000 7fd30010f640 1 --2- 172.21.15.19:0/4274594063 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f80d0210 0x7fd2f80b5cf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009e50 tx=0x7fd2f001ca10 comp rx=0 tx=0).stop 2023-11-20T06:43:01.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.499+0000 7fd30010f640 1 -- 172.21.15.19:0/4274594063 shutdown_connections 2023-11-20T06:43:01.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.499+0000 7fd30010f640 1 --2- 172.21.15.19:0/4274594063 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f80d0210 0x7fd2f80b5cf0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.499+0000 7fd30010f640 1 --2- 172.21.15.19:0/4274594063 >> v2:172.21.15.190:3300/0 conn(0x7fd2f815cba0 0x7fd2f80d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.499+0000 7fd30010f640 1 -- 172.21.15.19:0/4274594063 >> 172.21.15.19:0/4274594063 conn(0x7fd2f80719c0 msgr2=0x7fd2f8071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:01.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.499+0000 7fd30010f640 1 -- 172.21.15.19:0/4274594063 shutdown_connections 2023-11-20T06:43:01.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.499+0000 7fd30010f640 1 -- 172.21.15.19:0/4274594063 wait complete. 2023-11-20T06:43:01.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.499+0000 7fd30010f640 1 Processor -- start 2023-11-20T06:43:01.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.499+0000 7fd30010f640 1 -- start start 2023-11-20T06:43:01.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.499+0000 7fd30010f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2f80b84e0 0x7fd2f81f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:01.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.499+0000 7fd30010f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f80d0210 0x7fd2f80cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:01.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.499+0000 7fd30010f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f815cba0 0x7fd2f813fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:01.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.499+0000 7fd30010f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f81f8590 con 0x7fd2f815cba0 2023-11-20T06:43:01.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.499+0000 7fd30010f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f81f8870 con 0x7fd2f80b84e0 2023-11-20T06:43:01.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.499+0000 7fd30010f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f81f8b50 con 0x7fd2f80d0210 2023-11-20T06:43:01.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.499+0000 7fd2fe6ac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f815cba0 0x7fd2f813fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:01.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.503+0000 7fd2fdeab640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2f80b84e0 0x7fd2f81f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:01.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.503+0000 7fd2fe6ac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f815cba0 0x7fd2f813fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42838/0 (socket says 172.21.15.19:42838) 2023-11-20T06:43:01.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.503+0000 7fd2fe6ac640 1 -- 172.21.15.19:0/437377722 learned_addr learned my addr 172.21.15.19:0/437377722 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:01.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.503+0000 7fd2fd6aa640 1 --2- 172.21.15.19:0/437377722 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f80d0210 0x7fd2f80cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:01.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.503+0000 7fd2fe6ac640 1 -- 172.21.15.19:0/437377722 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f80d0210 msgr2=0x7fd2f80cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:01.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.503+0000 7fd2fe6ac640 1 --2- 172.21.15.19:0/437377722 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f80d0210 0x7fd2f80cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.503+0000 7fd2fe6ac640 1 -- 172.21.15.19:0/437377722 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2f80b84e0 msgr2=0x7fd2f81f7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:01.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.503+0000 7fd2fe6ac640 1 --2- 172.21.15.19:0/437377722 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2f80b84e0 0x7fd2f81f7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.503+0000 7fd2fe6ac640 1 -- 172.21.15.19:0/437377722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f4009420 con 0x7fd2f815cba0 2023-11-20T06:43:01.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.503+0000 7fd2fe6ac640 1 --2- 172.21.15.19:0/437377722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f815cba0 0x7fd2f813fd50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd2f001a640 tx=0x7fd2f00197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:01.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.503+0000 7fd2ee7fc640 1 -- 172.21.15.19:0/437377722 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f00b8640 con 0x7fd2f815cba0 2023-11-20T06:43:01.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.503+0000 7fd2ee7fc640 1 -- 172.21.15.19:0/437377722 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f00b87c0 con 0x7fd2f815cba0 2023-11-20T06:43:01.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.503+0000 7fd30010f640 1 -- 172.21.15.19:0/437377722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f0009b30 con 0x7fd2f815cba0 2023-11-20T06:43:01.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.503+0000 7fd2ee7fc640 1 -- 172.21.15.19:0/437377722 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f00b8b70 con 0x7fd2f815cba0 2023-11-20T06:43:01.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.503+0000 7fd30010f640 1 -- 172.21.15.19:0/437377722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f81551f0 con 0x7fd2f815cba0 2023-11-20T06:43:01.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.503+0000 7fd30010f640 1 -- 172.21.15.19:0/437377722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f81553e0 con 0x7fd2f815cba0 2023-11-20T06:43:01.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.503+0000 7fd2ee7fc640 1 -- 172.21.15.19:0/437377722 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd2f00b8cd0 con 0x7fd2f815cba0 2023-11-20T06:43:01.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.507+0000 7fd2ee7fc640 1 --2- 172.21.15.19:0/437377722 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd2dc0664a0 0x7fd2dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:01.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.507+0000 7fd2ee7fc640 1 -- 172.21.15.19:0/437377722 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd2f011edb0 con 0x7fd2f815cba0 2023-11-20T06:43:01.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.507+0000 7fd2fdeab640 1 --2- 172.21.15.19:0/437377722 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd2dc0664a0 0x7fd2dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:01.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.507+0000 7fd2fdeab640 1 --2- 172.21.15.19:0/437377722 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd2dc0664a0 0x7fd2dc068960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4009c50 tx=0x7fd2f4009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:01.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.507+0000 7fd2ee7fc640 1 -- 172.21.15.19:0/437377722 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd2f0123070 con 0x7fd2f815cba0 2023-11-20T06:43:01.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.667+0000 7fd30010f640 1 -- 172.21.15.19:0/437377722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd2f804e170 con 0x7fd2f815cba0 2023-11-20T06:43:01.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.671+0000 7fd2ee7fc640 1 -- 172.21.15.19:0/437377722 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd2f00efe90 con 0x7fd2f815cba0 2023-11-20T06:43:01.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.675+0000 7fd30010f640 1 -- 172.21.15.19:0/437377722 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd2dc0664a0 msgr2=0x7fd2dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:01.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.675+0000 7fd30010f640 1 --2- 172.21.15.19:0/437377722 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd2dc0664a0 0x7fd2dc068960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4009c50 tx=0x7fd2f4009190 comp rx=0 tx=0).stop 2023-11-20T06:43:01.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.675+0000 7fd30010f640 1 -- 172.21.15.19:0/437377722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f815cba0 msgr2=0x7fd2f813fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:01.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.675+0000 7fd30010f640 1 --2- 172.21.15.19:0/437377722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f815cba0 0x7fd2f813fd50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd2f001a640 tx=0x7fd2f00197b0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.675+0000 7fd30010f640 1 -- 172.21.15.19:0/437377722 shutdown_connections 2023-11-20T06:43:01.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.675+0000 7fd30010f640 1 --2- 172.21.15.19:0/437377722 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd2dc0664a0 0x7fd2dc068960 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.675+0000 7fd30010f640 1 --2- 172.21.15.19:0/437377722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f815cba0 0x7fd2f813fd50 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.675+0000 7fd30010f640 1 --2- 172.21.15.19:0/437377722 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f80d0210 0x7fd2f80cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.675+0000 7fd30010f640 1 --2- 172.21.15.19:0/437377722 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2f80b84e0 0x7fd2f81f7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.675+0000 7fd30010f640 1 -- 172.21.15.19:0/437377722 >> 172.21.15.19:0/437377722 conn(0x7fd2f80719c0 msgr2=0x7fd2f8071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:01.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.675+0000 7fd30010f640 1 -- 172.21.15.19:0/437377722 shutdown_connections 2023-11-20T06:43:01.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.675+0000 7fd30010f640 1 -- 172.21.15.19:0/437377722 wait complete. 2023-11-20T06:43:01.699 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection' 2023-11-20T06:43:01.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.855+0000 7f874759e640 1 Processor -- start 2023-11-20T06:43:01.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.855+0000 7f874759e640 1 -- start start 2023-11-20T06:43:01.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.855+0000 7f874759e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f874815c980 0x7f874806af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:01.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.855+0000 7f874759e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87480d1490 0x7f87480b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:01.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.855+0000 7f874759e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87480d3510 con 0x7f874815cd60 2023-11-20T06:43:01.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.855+0000 7f874759e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87480cd2b0 con 0x7f874815c980 2023-11-20T06:43:01.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.855+0000 7f874759e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87480d2f50 con 0x7f87480d1490 2023-11-20T06:43:01.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.855+0000 7f874659c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f874815c980 0x7f874806af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:01.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.855+0000 7f8746d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87480d1490 0x7f87480b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:01.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.859+0000 7f8746d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87480d1490 0x7f87480b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:59272/0 (socket says 172.21.15.19:59272) 2023-11-20T06:43:01.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.859+0000 7f8745d9b640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f874815cd60 0x7f87480d0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:41326/0 (socket says 172.21.15.19:41326) 2023-11-20T06:43:01.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.859+0000 7f8746d9d640 1 -- 172.21.15.19:0/4145372584 learned_addr learned my addr 172.21.15.19:0/4145372584 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:01.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.859+0000 7f874659c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f874815c980 0x7f874806af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:48378/0 (socket says 172.21.15.19:48378) 2023-11-20T06:43:01.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.859+0000 7f874659c640 1 -- 172.21.15.19:0/4145372584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87480d1490 msgr2=0x7f87480b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:01.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.859+0000 7f874659c640 1 --2- 172.21.15.19:0/4145372584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87480d1490 0x7f87480b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.859+0000 7f874659c640 1 -- 172.21.15.19:0/4145372584 >> v1:172.21.15.190:6789/0 conn(0x7f874815cd60 legacy=0x7f87480d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:01.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.859+0000 7f874659c640 1 -- 172.21.15.19:0/4145372584 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87480d3230 con 0x7f874815c980 2023-11-20T06:43:01.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.859+0000 7f874559a640 1 -- 172.21.15.19:0/4145372584 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373323263 0 0) 0x7f873c001120 con 0x7f874815cd60 2023-11-20T06:43:01.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.859+0000 7f874659c640 1 --2- 172.21.15.19:0/4145372584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f874815c980 0x7f874806af90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f87380097a0 tx=0x7f873801c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d75952b4f531301 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:01.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.859+0000 7f874559a640 1 -- 172.21.15.19:0/4145372584 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87380ab600 con 0x7f874815c980 2023-11-20T06:43:01.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.859+0000 7f874559a640 1 -- 172.21.15.19:0/4145372584 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87380a7050 con 0x7f874815c980 2023-11-20T06:43:01.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.859+0000 7f874559a640 1 -- 172.21.15.19:0/4145372584 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87380ab980 con 0x7f874815c980 2023-11-20T06:43:01.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.863+0000 7f874759e640 1 -- 172.21.15.19:0/4145372584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f874815c980 msgr2=0x7f874806af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:01.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.863+0000 7f874759e640 1 --2- 172.21.15.19:0/4145372584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f874815c980 0x7f874806af90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f87380097a0 tx=0x7f873801c3d0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.863+0000 7f874759e640 1 -- 172.21.15.19:0/4145372584 shutdown_connections 2023-11-20T06:43:01.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.863+0000 7f874759e640 1 --2- 172.21.15.19:0/4145372584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87480d1490 0x7f87480b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.863+0000 7f874759e640 1 --2- 172.21.15.19:0/4145372584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f874815c980 0x7f874806af90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.863+0000 7f874759e640 1 -- 172.21.15.19:0/4145372584 >> 172.21.15.19:0/4145372584 conn(0x7f874809ba80 msgr2=0x7f87480d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:01.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.863+0000 7f874759e640 1 -- 172.21.15.19:0/4145372584 shutdown_connections 2023-11-20T06:43:01.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.863+0000 7f874759e640 1 -- 172.21.15.19:0/4145372584 wait complete. 2023-11-20T06:43:01.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.863+0000 7f874759e640 1 Processor -- start 2023-11-20T06:43:01.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.863+0000 7f874759e640 1 -- start start 2023-11-20T06:43:01.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.863+0000 7f874759e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87480d1490 0x7f874815f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:01.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.863+0000 7f874759e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f874815c980 0x7f87480c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:01.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.863+0000 7f874759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f874815cd60 0x7f87480c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.863+0000 7f874759e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8748154b70 con 0x7f874815cd60 2023-11-20T06:43:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.863+0000 7f874759e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874815ffe0 con 0x7f874815c980 2023-11-20T06:43:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.863+0000 7f874759e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874815e780 con 0x7f87480d1490 2023-11-20T06:43:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.863+0000 7f8746d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f874815cd60 0x7f87480c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.863+0000 7f8746d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f874815cd60 0x7f87480c82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42846/0 (socket says 172.21.15.19:42846) 2023-11-20T06:43:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.863+0000 7f8746d9d640 1 -- 172.21.15.19:0/1422794225 learned_addr learned my addr 172.21.15.19:0/1422794225 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.867+0000 7f874659c640 1 --2- 172.21.15.19:0/1422794225 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87480d1490 0x7f874815f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.867+0000 7f8745d9b640 1 --2- 172.21.15.19:0/1422794225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f874815c980 0x7f87480c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.867+0000 7f8746d9d640 1 -- 172.21.15.19:0/1422794225 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87480d1490 msgr2=0x7f874815f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.867+0000 7f8746d9d640 1 --2- 172.21.15.19:0/1422794225 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87480d1490 0x7f874815f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.867+0000 7f8746d9d640 1 -- 172.21.15.19:0/1422794225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f874815c980 msgr2=0x7f87480c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.867+0000 7f8746d9d640 1 --2- 172.21.15.19:0/1422794225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f874815c980 0x7f87480c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:01.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.867+0000 7f8746d9d640 1 -- 172.21.15.19:0/1422794225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87380093b0 con 0x7f874815cd60 2023-11-20T06:43:01.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.867+0000 7f8746d9d640 1 --2- 172.21.15.19:0/1422794225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f874815cd60 0x7f87480c82c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f874000efc0 tx=0x7f874000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:01.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.867+0000 7f8736ffd640 1 -- 172.21.15.19:0/1422794225 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874000cd20 con 0x7f874815cd60 2023-11-20T06:43:01.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.867+0000 7f8736ffd640 1 -- 172.21.15.19:0/1422794225 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874000f040 con 0x7f874815cd60 2023-11-20T06:43:01.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.867+0000 7f8736ffd640 1 -- 172.21.15.19:0/1422794225 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740003be0 con 0x7f874815cd60 2023-11-20T06:43:01.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.867+0000 7f874759e640 1 -- 172.21.15.19:0/1422794225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f874815deb0 con 0x7f874815cd60 2023-11-20T06:43:01.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.867+0000 7f874759e640 1 -- 172.21.15.19:0/1422794225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874815e130 con 0x7f874815cd60 2023-11-20T06:43:01.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.867+0000 7f874759e640 1 -- 172.21.15.19:0/1422794225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f874804e9c0 con 0x7f874815cd60 2023-11-20T06:43:01.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.867+0000 7f8736ffd640 1 -- 172.21.15.19:0/1422794225 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8740003d40 con 0x7f874815cd60 2023-11-20T06:43:01.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.867+0000 7f8736ffd640 1 --2- 172.21.15.19:0/1422794225 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f87280664a0 0x7f8728068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:01.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.867+0000 7f8736ffd640 1 -- 172.21.15.19:0/1422794225 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8740084380 con 0x7f874815cd60 2023-11-20T06:43:01.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.867+0000 7f874659c640 1 --2- 172.21.15.19:0/1422794225 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f87280664a0 0x7f8728068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:01.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.871+0000 7f874659c640 1 --2- 172.21.15.19:0/1422794225 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f87280664a0 0x7f8728068960 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f87380ad000 tx=0x7f87380a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:01.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:01.871+0000 7f8736ffd640 1 -- 172.21.15.19:0/1422794225 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f87400519b0 con 0x7f874815cd60 2023-11-20T06:43:02.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:02.083+0000 7f874759e640 1 -- 172.21.15.19:0/1422794225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection"]} v 0) v1 -- 0x7f87480d36b0 con 0x7f874815cd60 2023-11-20T06:43:02.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:02.331+0000 7f8736ffd640 1 -- 172.21.15.19:0/1422794225 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection"]}]=0 v124) v1 ==== 145+0+0 (secure 0 0 0) 0x7f8740054fd0 con 0x7f874815cd60 2023-11-20T06:43:02.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:02.335+0000 7f874759e640 1 -- 172.21.15.19:0/1422794225 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f87280664a0 msgr2=0x7f8728068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:02.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:02.335+0000 7f874759e640 1 --2- 172.21.15.19:0/1422794225 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f87280664a0 0x7f8728068960 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f87380ad000 tx=0x7f87380a6000 comp rx=0 tx=0).stop 2023-11-20T06:43:02.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:02.335+0000 7f874759e640 1 -- 172.21.15.19:0/1422794225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f874815cd60 msgr2=0x7f87480c82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:02.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:02.335+0000 7f874759e640 1 --2- 172.21.15.19:0/1422794225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f874815cd60 0x7f87480c82c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f874000efc0 tx=0x7f874000c490 comp rx=0 tx=0).stop 2023-11-20T06:43:02.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:02.335+0000 7f874759e640 1 -- 172.21.15.19:0/1422794225 shutdown_connections 2023-11-20T06:43:02.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:02.335+0000 7f874759e640 1 --2- 172.21.15.19:0/1422794225 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f87280664a0 0x7f8728068960 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:02.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:02.335+0000 7f874759e640 1 --2- 172.21.15.19:0/1422794225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f874815cd60 0x7f87480c82c0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:02.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:02.335+0000 7f874759e640 1 --2- 172.21.15.19:0/1422794225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f874815c980 0x7f87480c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:02.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:02.335+0000 7f874759e640 1 --2- 172.21.15.19:0/1422794225 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87480d1490 0x7f874815f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:02.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:02.335+0000 7f874759e640 1 -- 172.21.15.19:0/1422794225 >> 172.21.15.19:0/1422794225 conn(0x7f874809ba80 msgr2=0x7f87480b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:02.335+0000 7f874759e640 1 -- 172.21.15.19:0/1422794225 shutdown_connections 2023-11-20T06:43:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:02.335+0000 7f874759e640 1 -- 172.21.15.19:0/1422794225 wait complete. 2023-11-20T06:43:02.361 INFO:tasks.cephfs_test_runner:That when injecting a dentry into a fragmented directory, we put it in the right fragment. ... ERROR 2023-11-20T06:43:02.362 INFO:tasks.cephfs_test_runner: 2023-11-20T06:43:02.362 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-20T06:43:02.362 INFO:tasks.cephfs_test_runner:ERROR: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-11-20T06:43:02.362 INFO:tasks.cephfs_test_runner:That when injecting a dentry into a fragmented directory, we put it in the right fragment. 2023-11-20T06:43:02.362 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-20T06:43:02.362 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-20T06:43:02.362 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_dc2d87c1fc8f518422f0be9931df0b31dc6a3bad/qa/tasks/cephfs/test_data_scan.py", line 530, in test_fragmented_injection 2023-11-20T06:43:02.362 INFO:tasks.cephfs_test_runner: self.fs.mon_manager.run_cluster_cmd('config', 'set', 'mds', 2023-11-20T06:43:02.362 INFO:tasks.cephfs_test_runner:TypeError: run_cluster_cmd() takes 1 positional argument but 6 were given 2023-11-20T06:43:02.362 INFO:tasks.cephfs_test_runner: 2023-11-20T06:43:02.362 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-20T06:43:02.363 INFO:tasks.cephfs_test_runner:Ran 1 test in 55.336s 2023-11-20T06:43:02.363 INFO:tasks.cephfs_test_runner: 2023-11-20T06:43:02.363 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-20T06:43:02.363 INFO:tasks.cephfs_test_runner: 2023-11-20T06:43:02.363 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-20T06:43:02.363 INFO:tasks.cephfs_test_runner:ERROR: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-11-20T06:43:02.363 INFO:tasks.cephfs_test_runner:That when injecting a dentry into a fragmented directory, we put it in the right fragment. 2023-11-20T06:43:02.363 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-20T06:43:02.363 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-20T06:43:02.363 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_dc2d87c1fc8f518422f0be9931df0b31dc6a3bad/qa/tasks/cephfs/test_data_scan.py", line 530, in test_fragmented_injection 2023-11-20T06:43:02.363 INFO:tasks.cephfs_test_runner: self.fs.mon_manager.run_cluster_cmd('config', 'set', 'mds', 2023-11-20T06:43:02.363 INFO:tasks.cephfs_test_runner:TypeError: run_cluster_cmd() takes 1 positional argument but 6 were given 2023-11-20T06:43:02.363 INFO:tasks.cephfs_test_runner: 2023-11-20T06:43:02.364 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_vshankar_ceph_dc2d87c1fc8f518422f0be9931df0b31dc6a3bad/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-11-20T06:43:03.987 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=91487e8155134dd9bbeb048aaf957ea3 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_vshankar_ceph_dc2d87c1fc8f518422f0be9931df0b31dc6a3bad/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-11-20T06:43:03.988 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-20T06:43:03.997 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-20T06:43:04.029 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-20T06:43:04.029 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:43:04.029 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:43:04.056 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357772k,nr_inodes=4089443,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2598 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-20T06:43:04.056 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-20T06:43:04.057 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:43:04.112 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357772k,nr_inodes=4089443,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2598 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-20T06:43:04.112 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:43:04.113 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:43:04.124 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2531 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-20T06:43:04.124 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-20T06:43:04.125 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T06:43:04.177 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2531 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-20T06:43:04.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:43:04.177 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2023-11-20T06:43:04.187 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-20T06:43:04.187 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-20T06:43:04.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:43:04.188 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T06:43:04.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:43:04.258 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T06:43:04.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:43:04.369 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2023-11-20T06:43:04.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:43:04.538 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2023-11-20T06:43:04.548 INFO:teuthology.orchestra.run.smithi190.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-20T06:43:04.548 INFO:teuthology.orchestra.run.smithi190.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-20T06:43:04.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:43:04.549 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T06:43:04.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:43:04.615 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-20T06:43:04.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T06:43:04.709 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link delete ceph-brx 2023-11-20T06:43:04.903 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-20T06:43:04.912 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-20T06:43:04.912 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T06:43:05.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f166db72640 1 Processor -- start 2023-11-20T06:43:05.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f166db72640 1 -- start start 2023-11-20T06:43:05.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f166db72640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16680d15d0 0x7f16680cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:05.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f166db72640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16680ce770 con 0x7f166815cb90 2023-11-20T06:43:05.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f166db72640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16680d0600 con 0x7f16680d3010 2023-11-20T06:43:05.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f166db72640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16680c6450 con 0x7f16680d15d0 2023-11-20T06:43:05.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f16677fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f166815cb90 0x7f16680d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42542/0 (socket says 172.21.15.19:42542) 2023-11-20T06:43:05.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f16677fe640 1 -- 172.21.15.19:0/4223296579 learned_addr learned my addr 172.21.15.19:0/4223296579 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:43:05.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f16667fc640 1 -- 172.21.15.19:0/4223296579 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1837184765 0 0) 0x7f16680ce770 con 0x7f166815cb90 2023-11-20T06:43:05.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f16667fc640 1 -- 172.21.15.19:0/4223296579 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1650003530 con 0x7f166815cb90 2023-11-20T06:43:05.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f1666ffd640 1 --2- 172.21.15.19:0/4223296579 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16680d15d0 0x7f16680cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f16667fc640 1 -- 172.21.15.19:0/4223296579 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2570669220 0 0) 0x7f1650003530 con 0x7f166815cb90 2023-11-20T06:43:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f16667fc640 1 -- 172.21.15.19:0/4223296579 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16680d15d0 msgr2=0x7f16680cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f16667fc640 1 --2- 172.21.15.19:0/4223296579 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16680d15d0 0x7f16680cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f16667fc640 1 -- 172.21.15.19:0/4223296579 >> v1:172.21.15.190:6789/0 conn(0x7f16680d3010 legacy=0x7f16680c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f16667fc640 1 -- 172.21.15.19:0/4223296579 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16680d08a0 con 0x7f166815cb90 2023-11-20T06:43:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f16667fc640 1 -- 172.21.15.19:0/4223296579 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 462346919 0 0) 0x7f1658001800 con 0x7f166815cb90 2023-11-20T06:43:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f16667fc640 1 -- 172.21.15.19:0/4223296579 >> v1:172.21.15.19:6789/0 conn(0x7f166815cb90 legacy=0x7f16680d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:05.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f16667fc640 1 --2- 172.21.15.19:0/4223296579 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16500039b0 0x7f1650003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:05.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f16667fc640 1 --2- 172.21.15.19:0/4223296579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16500047d0 0x7f1650004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:05.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f16667fc640 1 --2- 172.21.15.19:0/4223296579 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16680d15d0 0x7f16500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:05.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f16667fc640 1 -- 172.21.15.19:0/4223296579 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16680c6450 con 0x7f16500047d0 2023-11-20T06:43:05.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f16667fc640 1 -- 172.21.15.19:0/4223296579 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165000bac0 con 0x7f16500039b0 2023-11-20T06:43:05.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f16667fc640 1 -- 172.21.15.19:0/4223296579 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165000bc80 con 0x7f16680d15d0 2023-11-20T06:43:05.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f1666ffd640 1 --2- 172.21.15.19:0/4223296579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16500047d0 0x7f1650004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:05.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f16677fe640 1 --2- 172.21.15.19:0/4223296579 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16500039b0 0x7f1650003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:05.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f1667fff640 1 --2- 172.21.15.19:0/4223296579 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16680d15d0 0x7f16500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:05.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f1666ffd640 1 -- 172.21.15.19:0/4223296579 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16680d15d0 msgr2=0x7f16500051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:05.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f1666ffd640 1 --2- 172.21.15.19:0/4223296579 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16680d15d0 0x7f16500051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f1666ffd640 1 -- 172.21.15.19:0/4223296579 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16500039b0 msgr2=0x7f1650003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:05.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f1666ffd640 1 --2- 172.21.15.19:0/4223296579 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16500039b0 0x7f1650003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.059+0000 7f1666ffd640 1 -- 172.21.15.19:0/4223296579 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1650003530 con 0x7f16500047d0 2023-11-20T06:43:05.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.063+0000 7f1666ffd640 1 --2- 172.21.15.19:0/4223296579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16500047d0 0x7f1650004c50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f165c009ae0 tx=0x7f165c01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d53230284f3cc8c server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:05.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.063+0000 7f16667fc640 1 -- 172.21.15.19:0/4223296579 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c0a6510 con 0x7f16500047d0 2023-11-20T06:43:05.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.063+0000 7f16667fc640 1 -- 172.21.15.19:0/4223296579 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c0a6670 con 0x7f16500047d0 2023-11-20T06:43:05.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.063+0000 7f16667fc640 1 -- 172.21.15.19:0/4223296579 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c0a6a20 con 0x7f16500047d0 2023-11-20T06:43:05.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.063+0000 7f166db72640 1 -- 172.21.15.19:0/4223296579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16500047d0 msgr2=0x7f1650004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:05.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.063+0000 7f166db72640 1 --2- 172.21.15.19:0/4223296579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16500047d0 0x7f1650004c50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f165c009ae0 tx=0x7f165c01ca20 comp rx=0 tx=0).stop 2023-11-20T06:43:05.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.063+0000 7f1667fff640 1 -- 172.21.15.19:0/4223296579 reap_dead start 2023-11-20T06:43:05.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.063+0000 7f166db72640 1 -- 172.21.15.19:0/4223296579 shutdown_connections 2023-11-20T06:43:05.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.063+0000 7f166db72640 1 -- 172.21.15.19:0/4223296579 >> 172.21.15.19:0/4223296579 conn(0x7f166809bc50 msgr2=0x7f16680d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:05.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.063+0000 7f166db72640 1 -- 172.21.15.19:0/4223296579 shutdown_connections 2023-11-20T06:43:05.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.063+0000 7f166db72640 1 -- 172.21.15.19:0/4223296579 wait complete. 2023-11-20T06:43:05.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f166db72640 1 Processor -- start 2023-11-20T06:43:05.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f166db72640 1 -- start start 2023-11-20T06:43:05.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f166db72640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16500047d0 0x7f166809e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:05.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f166db72640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16681f4dc0 0x7f16680b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:05.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f166db72640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1668159690 0x7f1668159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:05.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f166db72640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166815a060 con 0x7f16500047d0 2023-11-20T06:43:05.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f166db72640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166809eb70 con 0x7f1668159690 2023-11-20T06:43:05.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f166db72640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16680a03b0 con 0x7f16681f4dc0 2023-11-20T06:43:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f16677fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16500047d0 0x7f166809e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f16677fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16500047d0 0x7f166809e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51676/0 (socket says 172.21.15.19:51676) 2023-11-20T06:43:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f16677fe640 1 -- 172.21.15.19:0/2744602889 learned_addr learned my addr 172.21.15.19:0/2744602889 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f1667fff640 1 --2- 172.21.15.19:0/2744602889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1668159690 0x7f1668159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f1666ffd640 1 --2- 172.21.15.19:0/2744602889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16681f4dc0 0x7f16680b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f16677fe640 1 -- 172.21.15.19:0/2744602889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16681f4dc0 msgr2=0x7f16680b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f16677fe640 1 --2- 172.21.15.19:0/2744602889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16681f4dc0 0x7f16680b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f16677fe640 1 -- 172.21.15.19:0/2744602889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1668159690 msgr2=0x7f1668159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f16677fe640 1 --2- 172.21.15.19:0/2744602889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1668159690 0x7f1668159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f16677fe640 1 -- 172.21.15.19:0/2744602889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166809c6c0 con 0x7f16500047d0 2023-11-20T06:43:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f16677fe640 1 --2- 172.21.15.19:0/2744602889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16500047d0 0x7f166809e630 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f165800f7e0 tx=0x7f165800fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f164ffff640 1 -- 172.21.15.19:0/2744602889 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1658001090 con 0x7f16500047d0 2023-11-20T06:43:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f164ffff640 1 -- 172.21.15.19:0/2744602889 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16580072e0 con 0x7f16500047d0 2023-11-20T06:43:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f166db72640 1 -- 172.21.15.19:0/2744602889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16680cc100 con 0x7f16500047d0 2023-11-20T06:43:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f164ffff640 1 -- 172.21.15.19:0/2744602889 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16580057b0 con 0x7f16500047d0 2023-11-20T06:43:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.067+0000 7f166db72640 1 -- 172.21.15.19:0/2744602889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16680cc6c0 con 0x7f16500047d0 2023-11-20T06:43:05.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.071+0000 7f166db72640 1 -- 172.21.15.19:0/2744602889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1668074010 con 0x7f16500047d0 2023-11-20T06:43:05.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.071+0000 7f164ffff640 1 -- 172.21.15.19:0/2744602889 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1658005910 con 0x7f16500047d0 2023-11-20T06:43:05.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.071+0000 7f164ffff640 1 --2- 172.21.15.19:0/2744602889 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f16540664a0 0x7f1654068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:05.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.071+0000 7f164ffff640 1 -- 172.21.15.19:0/2744602889 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1658083f00 con 0x7f16500047d0 2023-11-20T06:43:05.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.071+0000 7f1666ffd640 1 --2- 172.21.15.19:0/2744602889 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f16540664a0 0x7f1654068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:05.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.071+0000 7f1666ffd640 1 --2- 172.21.15.19:0/2744602889 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f16540664a0 0x7f1654068960 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f165c0af000 tx=0x7f165c0046d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:05.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.075+0000 7f164ffff640 1 -- 172.21.15.19:0/2744602889 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f16580514a0 con 0x7f16500047d0 2023-11-20T06:43:05.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.231+0000 7f166db72640 1 -- 172.21.15.19:0/2744602889 --> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f166815cf70 con 0x7f16540664a0 2023-11-20T06:43:05.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.235+0000 7f164ffff640 1 -- 172.21.15.19:0/2744602889 <== mgr.4109 v2:172.21.15.190:6832/142426253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50664 (secure 0 0 0) 0x7f165c004040 con 0x7f16540664a0 2023-11-20T06:43:05.242 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:43:05.242 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-20T06:43:05.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.239+0000 7f166db72640 1 -- 172.21.15.19:0/2744602889 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f16540664a0 msgr2=0x7f1654068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:05.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.239+0000 7f166db72640 1 --2- 172.21.15.19:0/2744602889 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f16540664a0 0x7f1654068960 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f165c0af000 tx=0x7f165c0046d0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.239+0000 7f166db72640 1 -- 172.21.15.19:0/2744602889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16500047d0 msgr2=0x7f166809e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:05.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.239+0000 7f166db72640 1 --2- 172.21.15.19:0/2744602889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16500047d0 0x7f166809e630 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f165800f7e0 tx=0x7f165800fca0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.239+0000 7f166db72640 1 -- 172.21.15.19:0/2744602889 shutdown_connections 2023-11-20T06:43:05.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.239+0000 7f166db72640 1 --2- 172.21.15.19:0/2744602889 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f16540664a0 0x7f1654068960 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.239+0000 7f166db72640 1 --2- 172.21.15.19:0/2744602889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1668159690 0x7f1668159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.239+0000 7f166db72640 1 --2- 172.21.15.19:0/2744602889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16681f4dc0 0x7f16680b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.239+0000 7f166db72640 1 --2- 172.21.15.19:0/2744602889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16500047d0 0x7f166809e630 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.239+0000 7f166db72640 1 -- 172.21.15.19:0/2744602889 >> 172.21.15.19:0/2744602889 conn(0x7f166809bc50 msgr2=0x7f166806baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:05.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.239+0000 7f166db72640 1 -- 172.21.15.19:0/2744602889 shutdown_connections 2023-11-20T06:43:05.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.239+0000 7f166db72640 1 -- 172.21.15.19:0/2744602889 wait complete. 2023-11-20T06:43:05.263 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2023-11-20T06:43:03.509084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":221240,"kb_used_data":5068,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753480,"statfs":{"total":773094113280,"available":772867563520,"internally_reserved":0,"allocated":5189632,"data_stored":2934289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3806,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-48,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001223"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":185,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-20T06:42:59.428805+0000","last_change":"2023-11-20T06:41:03.783345+0000","last_active":"2023-11-20T06:42:59.428805+0000","last_peered":"2023-11-20T06:42:59.428805+0000","last_clean":"2023-11-20T06:42:59.428805+0000","last_became_active":"2023-11-20T06:41:03.782257+0000","last_became_peered":"2023-11-20T06:41:03.782257+0000","last_unstale":"2023-11-20T06:42:59.428805+0000","last_undegraded":"2023-11-20T06:42:59.428805+0000","last_fullsized":"2023-11-20T06:42:59.428805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:01.979090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:01.979090+0000","last_clean_scrub_stamp":"2023-11-20T06:41:01.979090+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:20:41.084382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1097728,"data_stored":808728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.80500000000000005}]},{"osd":1,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.64900000000000002}]},{"osd":2,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.73599999999999999}]},{"osd":3,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.755},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":2,"5min":2,"15min":2},"last":0.79200000000000004}]},{"osd":4,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.68500000000000005}]},{"osd":5,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.83999999999999997}]},{"osd":6,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.60799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":215864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":0.54800000000000004}]},{"osd":1,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.502}]},{"osd":2,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.60899999999999999}]},{"osd":3,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":4.3029999999999999,"5min":4.3029999999999999,"15min":4.3029999999999999},"last":0.70999999999999996}]},{"osd":4,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.65900000000000003}]},{"osd":5,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.74399999999999999}]},{"osd":7,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.75900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":221663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":4.7450000000000001,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.60199999999999998}]},{"osd":1,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.62},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.63600000000000001}]},{"osd":2,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":0.67300000000000004}]},{"osd":3,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":8.9250000000000007,"5min":8.9250000000000007,"15min":8.9250000000000007},"last":0.55100000000000005},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":8.891,"5min":8.891,"15min":8.891},"last":0.64300000000000002}]},{"osd":4,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.45800000000000002}]},{"osd":6,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.44},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.56699999999999995}]},{"osd":7,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.69799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":221663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.55400000000000005}]},{"osd":1,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":4.8710000000000004,"5min":4.8710000000000004,"15min":4.8710000000000004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.52800000000000002}]},{"osd":2,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":4.8499999999999996,"5min":4.8499999999999996,"15min":4.8499999999999996},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.76900000000000002}]},{"osd":3,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.752}]},{"osd":5,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.70799999999999996}]},{"osd":6,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.78100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":503808,"data_stored":218324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":3.714,"5min":3.714,"15min":3.714},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.28699999999999998}]},{"osd":1,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":3.8330000000000002,"5min":3.8330000000000002,"15min":3.8330000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.7629999999999999,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":0.34799999999999998}]},{"osd":2,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.0709999999999997,"5min":4.0709999999999997,"15min":4.0709999999999997},"last":0.442},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.45300000000000001}]},{"osd":4,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.9169999999999998,"5min":3.9169999999999998,"15min":3.9169999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.2069999999999999,"5min":4.2069999999999999,"15min":4.2069999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.52300000000000002}]},{"osd":6,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":4.3659999999999997,"5min":4.3659999999999997,"15min":4.3659999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.66500000000000004}]},{"osd":7,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":3.9700000000000002,"5min":3.9700000000000002,"15min":3.9700000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":0.65200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":221663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.46500000000000002}]},{"osd":1,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.39800000000000002}]},{"osd":3,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.35299999999999998}]},{"osd":4,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.749}]},{"osd":5,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.67300000000000004}]},{"osd":6,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.63900000000000001}]},{"osd":7,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.624},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.72599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":215372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.42399999999999999}]},{"osd":2,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.46100000000000002}]},{"osd":3,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.54400000000000004}]},{"osd":4,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.56200000000000006}]},{"osd":5,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.627}]},{"osd":6,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.66300000000000003}]},{"osd":7,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.68899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1093632,"data_stored":811012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.42599999999999999}]},{"osd":2,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.625,"5min":2.625,"15min":2.625},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.52800000000000002}]},{"osd":3,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.6669999999999998,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":0.47099999999999997}]},{"osd":4,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.86399999999999999}]},{"osd":5,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":3.0550000000000002,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.84099999999999997}]},{"osd":6,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.79500000000000004}]},{"osd":7,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.81999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T06:43:05.265 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T06:43:05.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.403+0000 7f4ac172a640 1 Processor -- start 2023-11-20T06:43:05.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.403+0000 7f4ac172a640 1 -- start start 2023-11-20T06:43:05.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.403+0000 7f4ac172a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4abc15cb90 0x7f4abc0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:05.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.403+0000 7f4ac172a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4abc0d3010 0x7f4abc0d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:05.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.403+0000 7f4ac172a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4abc0ce770 con 0x7f4abc0d1400 2023-11-20T06:43:05.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.403+0000 7f4ac172a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4abc0d1890 con 0x7f4abc0d3010 2023-11-20T06:43:05.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.403+0000 7f4ac172a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc0d0600 con 0x7f4abc15cb90 2023-11-20T06:43:05.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.403+0000 7f4ab3fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4abc0d3010 0x7f4abc0d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:05.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.403+0000 7f4ab3fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4abc0d3010 0x7f4abc0d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51688/0 (socket says 172.21.15.19:51688) 2023-11-20T06:43:05.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.403+0000 7f4ab3fff640 1 -- 172.21.15.19:0/633721752 learned_addr learned my addr 172.21.15.19:0/633721752 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:05.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.403+0000 7f4abaffd640 1 --2- 172.21.15.19:0/633721752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4abc15cb90 0x7f4abc0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:05.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.403+0000 7f4ab3fff640 1 -- 172.21.15.19:0/633721752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4abc15cb90 msgr2=0x7f4abc0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:05.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.403+0000 7f4ab3fff640 1 --2- 172.21.15.19:0/633721752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4abc15cb90 0x7f4abc0cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.403+0000 7f4ab3fff640 1 -- 172.21.15.19:0/633721752 >> v1:172.21.15.190:6789/0 conn(0x7f4abc0d1400 legacy=0x7f4abc0cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:05.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.403+0000 7f4ab3fff640 1 -- 172.21.15.19:0/633721752 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4abc0c6450 con 0x7f4abc0d3010 2023-11-20T06:43:05.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.407+0000 7f4ab3fff640 1 --2- 172.21.15.19:0/633721752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4abc0d3010 0x7f4abc0d0ec0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009870 tx=0x7f4aa401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b17717f53dd77fc server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:05.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.407+0000 7f4aba7fc640 1 -- 172.21.15.19:0/633721752 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40ab680 con 0x7f4abc0d3010 2023-11-20T06:43:05.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.407+0000 7f4aba7fc640 1 -- 172.21.15.19:0/633721752 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa40ab7e0 con 0x7f4abc0d3010 2023-11-20T06:43:05.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.407+0000 7f4aba7fc640 1 -- 172.21.15.19:0/633721752 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40abb70 con 0x7f4abc0d3010 2023-11-20T06:43:05.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.407+0000 7f4ac172a640 1 -- 172.21.15.19:0/633721752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4abc0d3010 msgr2=0x7f4abc0d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:05.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.407+0000 7f4ac172a640 1 --2- 172.21.15.19:0/633721752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4abc0d3010 0x7f4abc0d0ec0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009870 tx=0x7f4aa401c480 comp rx=0 tx=0).stop 2023-11-20T06:43:05.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.407+0000 7f4ac172a640 1 -- 172.21.15.19:0/633721752 shutdown_connections 2023-11-20T06:43:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.407+0000 7f4ac172a640 1 --2- 172.21.15.19:0/633721752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4abc0d3010 0x7f4abc0d0ec0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.407+0000 7f4ac172a640 1 --2- 172.21.15.19:0/633721752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4abc15cb90 0x7f4abc0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.407+0000 7f4ac172a640 1 -- 172.21.15.19:0/633721752 >> 172.21.15.19:0/633721752 conn(0x7f4abc09bc50 msgr2=0x7f4abc0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.407+0000 7f4ac172a640 1 -- 172.21.15.19:0/633721752 shutdown_connections 2023-11-20T06:43:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.407+0000 7f4ac172a640 1 -- 172.21.15.19:0/633721752 wait complete. 2023-11-20T06:43:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4ac172a640 1 Processor -- start 2023-11-20T06:43:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4ac172a640 1 -- start start 2023-11-20T06:43:05.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4ac172a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4abc0d1400 0x7f4abc159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:05.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4ac172a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4abc0d3010 0x7f4abc15a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:05.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4ac172a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4abc15cb90 0x7f4abc15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:05.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4ac172a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc157fc0 con 0x7f4abc15cb90 2023-11-20T06:43:05.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4ac172a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc155880 con 0x7f4abc0d1400 2023-11-20T06:43:05.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4ac172a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc156090 con 0x7f4abc0d3010 2023-11-20T06:43:05.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4abb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4abc15cb90 0x7f4abc15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:05.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4abb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4abc15cb90 0x7f4abc15a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51702/0 (socket says 172.21.15.19:51702) 2023-11-20T06:43:05.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4abb7fe640 1 -- 172.21.15.19:0/2294219088 learned_addr learned my addr 172.21.15.19:0/2294219088 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:05.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4abaffd640 1 --2- 172.21.15.19:0/2294219088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4abc0d1400 0x7f4abc159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:05.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4ab3fff640 1 --2- 172.21.15.19:0/2294219088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4abc0d3010 0x7f4abc15a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:05.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4abb7fe640 1 -- 172.21.15.19:0/2294219088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4abc0d3010 msgr2=0x7f4abc15a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:05.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4abb7fe640 1 --2- 172.21.15.19:0/2294219088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4abc0d3010 0x7f4abc15a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4abb7fe640 1 -- 172.21.15.19:0/2294219088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4abc0d1400 msgr2=0x7f4abc159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:05.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4abb7fe640 1 --2- 172.21.15.19:0/2294219088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4abc0d1400 0x7f4abc159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4abb7fe640 1 -- 172.21.15.19:0/2294219088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa40094d0 con 0x7f4abc15cb90 2023-11-20T06:43:05.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4abb7fe640 1 --2- 172.21.15.19:0/2294219088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4abc15cb90 0x7f4abc15a9b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400c730 tx=0x7f4ab400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:05.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4ab37fe640 1 -- 172.21.15.19:0/2294219088 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4003b80 con 0x7f4abc15cb90 2023-11-20T06:43:05.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4ab37fe640 1 -- 172.21.15.19:0/2294219088 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab4003ce0 con 0x7f4abc15cb90 2023-11-20T06:43:05.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4ab37fe640 1 -- 172.21.15.19:0/2294219088 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab400aa30 con 0x7f4abc15cb90 2023-11-20T06:43:05.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4ac172a640 1 -- 172.21.15.19:0/2294219088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4abc155ad0 con 0x7f4abc15cb90 2023-11-20T06:43:05.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4ac172a640 1 -- 172.21.15.19:0/2294219088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4abc1581a0 con 0x7f4abc15cb90 2023-11-20T06:43:05.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.411+0000 7f4ac172a640 1 -- 172.21.15.19:0/2294219088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4abc074010 con 0x7f4abc15cb90 2023-11-20T06:43:05.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.415+0000 7f4ab37fe640 1 -- 172.21.15.19:0/2294219088 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4ab400ab90 con 0x7f4abc15cb90 2023-11-20T06:43:05.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.415+0000 7f4ab37fe640 1 --2- 172.21.15.19:0/2294219088 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4a9c0664a0 0x7f4a9c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:05.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.415+0000 7f4ab37fe640 1 -- 172.21.15.19:0/2294219088 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4ab4083950 con 0x7f4abc15cb90 2023-11-20T06:43:05.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.415+0000 7f4abaffd640 1 --2- 172.21.15.19:0/2294219088 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4a9c0664a0 0x7f4a9c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:05.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.415+0000 7f4abaffd640 1 --2- 172.21.15.19:0/2294219088 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4a9c0664a0 0x7f4a9c068960 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009b40 tx=0x7f4aac006f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:05.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.419+0000 7f4ab37fe640 1 -- 172.21.15.19:0/2294219088 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4ab4051020 con 0x7f4abc15cb90 2023-11-20T06:43:05.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.575+0000 7f4ac172a640 1 -- 172.21.15.19:0/2294219088 --> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4abc15cf70 con 0x7f4a9c0664a0 2023-11-20T06:43:05.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.575+0000 7f4ab37fe640 1 -- 172.21.15.19:0/2294219088 <== mgr.4109 v2:172.21.15.190:6832/142426253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50664 (secure 0 0 0) 0x7f4aac011a60 con 0x7f4a9c0664a0 2023-11-20T06:43:05.583 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:43:05.583 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-20T06:43:05.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.579+0000 7f4ac172a640 1 -- 172.21.15.19:0/2294219088 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4a9c0664a0 msgr2=0x7f4a9c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:05.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.579+0000 7f4ac172a640 1 --2- 172.21.15.19:0/2294219088 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4a9c0664a0 0x7f4a9c068960 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009b40 tx=0x7f4aac006f90 comp rx=0 tx=0).stop 2023-11-20T06:43:05.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.579+0000 7f4ac172a640 1 -- 172.21.15.19:0/2294219088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4abc15cb90 msgr2=0x7f4abc15a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:05.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.579+0000 7f4ac172a640 1 --2- 172.21.15.19:0/2294219088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4abc15cb90 0x7f4abc15a9b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400c730 tx=0x7f4ab400cbf0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.579+0000 7f4ac172a640 1 -- 172.21.15.19:0/2294219088 shutdown_connections 2023-11-20T06:43:05.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.579+0000 7f4ac172a640 1 --2- 172.21.15.19:0/2294219088 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f4a9c0664a0 0x7f4a9c068960 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.579+0000 7f4ac172a640 1 --2- 172.21.15.19:0/2294219088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4abc15cb90 0x7f4abc15a9b0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.579+0000 7f4ac172a640 1 --2- 172.21.15.19:0/2294219088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4abc0d3010 0x7f4abc15a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.579+0000 7f4ac172a640 1 --2- 172.21.15.19:0/2294219088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4abc0d1400 0x7f4abc159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.579+0000 7f4ac172a640 1 -- 172.21.15.19:0/2294219088 >> 172.21.15.19:0/2294219088 conn(0x7f4abc09bc50 msgr2=0x7f4abc072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:05.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.579+0000 7f4ac172a640 1 -- 172.21.15.19:0/2294219088 shutdown_connections 2023-11-20T06:43:05.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.579+0000 7f4ac172a640 1 -- 172.21.15.19:0/2294219088 wait complete. 2023-11-20T06:43:05.604 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2023-11-20T06:43:05.509429+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":221240,"kb_used_data":5068,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753480,"statfs":{"total":773094113280,"available":772867563520,"internally_reserved":0,"allocated":5189632,"data_stored":2934289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3806,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-48,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.502935"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":185,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-20T06:42:59.428805+0000","last_change":"2023-11-20T06:41:03.783345+0000","last_active":"2023-11-20T06:42:59.428805+0000","last_peered":"2023-11-20T06:42:59.428805+0000","last_clean":"2023-11-20T06:42:59.428805+0000","last_became_active":"2023-11-20T06:41:03.782257+0000","last_became_peered":"2023-11-20T06:41:03.782257+0000","last_unstale":"2023-11-20T06:42:59.428805+0000","last_undegraded":"2023-11-20T06:42:59.428805+0000","last_fullsized":"2023-11-20T06:42:59.428805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:01.979090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:01.979090+0000","last_clean_scrub_stamp":"2023-11-20T06:41:01.979090+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:20:41.084382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1097728,"data_stored":808728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.80500000000000005}]},{"osd":1,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.64900000000000002}]},{"osd":2,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.73599999999999999}]},{"osd":3,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.755},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":2,"5min":2,"15min":2},"last":0.79200000000000004}]},{"osd":4,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.68500000000000005}]},{"osd":5,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.83999999999999997}]},{"osd":6,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.60799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":215864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":0.54800000000000004}]},{"osd":1,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.502}]},{"osd":2,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.60899999999999999}]},{"osd":3,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":4.3029999999999999,"5min":4.3029999999999999,"15min":4.3029999999999999},"last":0.70999999999999996}]},{"osd":4,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.65900000000000003}]},{"osd":5,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.74399999999999999}]},{"osd":7,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.75900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":221663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":4.7450000000000001,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.60199999999999998}]},{"osd":1,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.62},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.63600000000000001}]},{"osd":2,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":0.67300000000000004}]},{"osd":3,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":8.9250000000000007,"5min":8.9250000000000007,"15min":8.9250000000000007},"last":0.55100000000000005},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":8.891,"5min":8.891,"15min":8.891},"last":0.64300000000000002}]},{"osd":4,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.45800000000000002}]},{"osd":6,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.44},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.56699999999999995}]},{"osd":7,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.69799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":221663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.55400000000000005}]},{"osd":1,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":4.8710000000000004,"5min":4.8710000000000004,"15min":4.8710000000000004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.52800000000000002}]},{"osd":2,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":4.8499999999999996,"5min":4.8499999999999996,"15min":4.8499999999999996},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.76900000000000002}]},{"osd":3,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.752}]},{"osd":5,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.70799999999999996}]},{"osd":6,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.78100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":503808,"data_stored":218324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":3.714,"5min":3.714,"15min":3.714},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.28699999999999998}]},{"osd":1,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":3.8330000000000002,"5min":3.8330000000000002,"15min":3.8330000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.7629999999999999,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":0.34799999999999998}]},{"osd":2,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.0709999999999997,"5min":4.0709999999999997,"15min":4.0709999999999997},"last":0.442},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.45300000000000001}]},{"osd":4,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.9169999999999998,"5min":3.9169999999999998,"15min":3.9169999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.2069999999999999,"5min":4.2069999999999999,"15min":4.2069999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.52300000000000002}]},{"osd":6,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":4.3659999999999997,"5min":4.3659999999999997,"15min":4.3659999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.66500000000000004}]},{"osd":7,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":3.9700000000000002,"5min":3.9700000000000002,"15min":3.9700000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":0.65200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":221663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.46500000000000002}]},{"osd":1,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.39800000000000002}]},{"osd":3,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.35299999999999998}]},{"osd":4,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.749}]},{"osd":5,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.67300000000000004}]},{"osd":6,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.63900000000000001}]},{"osd":7,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.624},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.72599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":215372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.42399999999999999}]},{"osd":2,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.46100000000000002}]},{"osd":3,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.54400000000000004}]},{"osd":4,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.56200000000000006}]},{"osd":5,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.627}]},{"osd":6,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.66300000000000003}]},{"osd":7,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.68899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1093632,"data_stored":811012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.42599999999999999}]},{"osd":2,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.625,"5min":2.625,"15min":2.625},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.52800000000000002}]},{"osd":3,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.6669999999999998,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":0.47099999999999997}]},{"osd":4,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.86399999999999999}]},{"osd":5,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":3.0550000000000002,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.84099999999999997}]},{"osd":6,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.79500000000000004}]},{"osd":7,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.81999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T06:43:05.605 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-20T06:43:05.605 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T06:43:05.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.743+0000 7ff857165640 1 Processor -- start 2023-11-20T06:43:05.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.743+0000 7ff857165640 1 -- start start 2023-11-20T06:43:05.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.743+0000 7ff857165640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff8500d15d0 0x7ff8500cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:05.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.743+0000 7ff857165640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8500d3010 0x7ff8500c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:05.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.743+0000 7ff857165640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8500ce770 con 0x7ff85015cb90 2023-11-20T06:43:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.743+0000 7ff857165640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8500d0600 con 0x7ff8500d3010 2023-11-20T06:43:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.743+0000 7ff857165640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8500c6450 con 0x7ff8500d15d0 2023-11-20T06:43:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.743+0000 7ff855702640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8500d3010 0x7ff8500c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.743+0000 7ff855702640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8500d3010 0x7ff8500c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51710/0 (socket says 172.21.15.19:51710) 2023-11-20T06:43:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.743+0000 7ff855702640 1 -- 172.21.15.19:0/3036771734 learned_addr learned my addr 172.21.15.19:0/3036771734 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.743+0000 7ff84ffff640 1 --2- 172.21.15.19:0/3036771734 >> v2:172.21.15.190:3300/0 conn(0x7ff8500d15d0 0x7ff8500cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.743+0000 7ff855702640 1 -- 172.21.15.19:0/3036771734 >> v2:172.21.15.190:3300/0 conn(0x7ff8500d15d0 msgr2=0x7ff8500cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.743+0000 7ff855702640 1 --2- 172.21.15.19:0/3036771734 >> v2:172.21.15.190:3300/0 conn(0x7ff8500d15d0 0x7ff8500cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.743+0000 7ff855702640 1 -- 172.21.15.19:0/3036771734 >> v1:172.21.15.190:6789/0 conn(0x7ff85015cb90 legacy=0x7ff8500d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:05.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.743+0000 7ff855702640 1 -- 172.21.15.19:0/3036771734 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8500d08a0 con 0x7ff8500d3010 2023-11-20T06:43:05.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.747+0000 7ff855702640 1 --2- 172.21.15.19:0/3036771734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8500d3010 0x7ff8500c6c10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff85008a880 tx=0x7ff84801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de185972a8d9502 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:05.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.747+0000 7ff84f7fe640 1 -- 172.21.15.19:0/3036771734 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8480a57d0 con 0x7ff8500d3010 2023-11-20T06:43:05.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.747+0000 7ff84f7fe640 1 -- 172.21.15.19:0/3036771734 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8480a5930 con 0x7ff8500d3010 2023-11-20T06:43:05.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.747+0000 7ff84f7fe640 1 -- 172.21.15.19:0/3036771734 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8480a5cc0 con 0x7ff8500d3010 2023-11-20T06:43:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.747+0000 7ff857165640 1 -- 172.21.15.19:0/3036771734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8500d3010 msgr2=0x7ff8500c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.747+0000 7ff857165640 1 --2- 172.21.15.19:0/3036771734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8500d3010 0x7ff8500c6c10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff85008a880 tx=0x7ff84801c910 comp rx=0 tx=0).stop 2023-11-20T06:43:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.747+0000 7ff857165640 1 -- 172.21.15.19:0/3036771734 shutdown_connections 2023-11-20T06:43:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.747+0000 7ff857165640 1 --2- 172.21.15.19:0/3036771734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8500d3010 0x7ff8500c6c10 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.747+0000 7ff857165640 1 --2- 172.21.15.19:0/3036771734 >> v2:172.21.15.190:3300/0 conn(0x7ff8500d15d0 0x7ff8500cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.747+0000 7ff857165640 1 -- 172.21.15.19:0/3036771734 >> 172.21.15.19:0/3036771734 conn(0x7ff85009bc50 msgr2=0x7ff8500d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:05.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.747+0000 7ff857165640 1 -- 172.21.15.19:0/3036771734 shutdown_connections 2023-11-20T06:43:05.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.747+0000 7ff857165640 1 -- 172.21.15.19:0/3036771734 wait complete. 2023-11-20T06:43:05.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff857165640 1 Processor -- start 2023-11-20T06:43:05.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff857165640 1 -- start start 2023-11-20T06:43:05.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff857165640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8500d15d0 0x7ff850157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:05.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff857165640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8500d3010 0x7ff8500b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:05.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff857165640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff85015cb90 0x7ff8500cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:05.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff857165640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff850142a60 con 0x7ff8500d3010 2023-11-20T06:43:05.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff857165640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8501580e0 con 0x7ff8500d15d0 2023-11-20T06:43:05.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff857165640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff850141de0 con 0x7ff85015cb90 2023-11-20T06:43:05.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff84ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8500d3010 0x7ff8500b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:05.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff84ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8500d3010 0x7ff8500b0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51722/0 (socket says 172.21.15.19:51722) 2023-11-20T06:43:05.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff84ffff640 1 -- 172.21.15.19:0/2079210446 learned_addr learned my addr 172.21.15.19:0/2079210446 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:05.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff854f01640 1 --2- 172.21.15.19:0/2079210446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8500d15d0 0x7ff850157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:05.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff855702640 1 --2- 172.21.15.19:0/2079210446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff85015cb90 0x7ff8500cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:05.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff84ffff640 1 -- 172.21.15.19:0/2079210446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff85015cb90 msgr2=0x7ff8500cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:05.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff84ffff640 1 --2- 172.21.15.19:0/2079210446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff85015cb90 0x7ff8500cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff84ffff640 1 -- 172.21.15.19:0/2079210446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8500d15d0 msgr2=0x7ff850157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:05.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff84ffff640 1 --2- 172.21.15.19:0/2079210446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8500d15d0 0x7ff850157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff84ffff640 1 -- 172.21.15.19:0/2079210446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff848009b30 con 0x7ff8500d3010 2023-11-20T06:43:05.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff84ffff640 1 --2- 172.21.15.19:0/2079210446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8500d3010 0x7ff8500b0c50 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00e930 tx=0x7ff83c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:05.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff84d7fa640 1 -- 172.21.15.19:0/2079210446 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c009690 con 0x7ff8500d3010 2023-11-20T06:43:05.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff84d7fa640 1 -- 172.21.15.19:0/2079210446 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c00ca00 con 0x7ff8500d3010 2023-11-20T06:43:05.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff84d7fa640 1 -- 172.21.15.19:0/2079210446 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00cd70 con 0x7ff8500d3010 2023-11-20T06:43:05.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.751+0000 7ff857165640 1 -- 172.21.15.19:0/2079210446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8501420c0 con 0x7ff8500d3010 2023-11-20T06:43:05.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.755+0000 7ff857165640 1 -- 172.21.15.19:0/2079210446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff850142680 con 0x7ff8500d3010 2023-11-20T06:43:05.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.755+0000 7ff857165640 1 -- 172.21.15.19:0/2079210446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff850142ba0 con 0x7ff8500d3010 2023-11-20T06:43:05.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.755+0000 7ff84d7fa640 1 -- 172.21.15.19:0/2079210446 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff83c013470 con 0x7ff8500d3010 2023-11-20T06:43:05.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.755+0000 7ff84d7fa640 1 --2- 172.21.15.19:0/2079210446 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff8340664a0 0x7ff834068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:05.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.755+0000 7ff84d7fa640 1 -- 172.21.15.19:0/2079210446 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ff83c083f80 con 0x7ff8500d3010 2023-11-20T06:43:05.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.755+0000 7ff854f01640 1 --2- 172.21.15.19:0/2079210446 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff8340664a0 0x7ff834068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:05.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.755+0000 7ff854f01640 1 --2- 172.21.15.19:0/2079210446 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff8340664a0 0x7ff834068960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff8501f7e40 tx=0x7ff844009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:05.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.759+0000 7ff84d7fa640 1 -- 172.21.15.19:0/2079210446 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff850142ba0 con 0x7ff8500d3010 2023-11-20T06:43:05.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.911+0000 7ff857165640 1 -- 172.21.15.19:0/2079210446 --> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff85015cf70 con 0x7ff8340664a0 2023-11-20T06:43:05.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.915+0000 7ff84d7fa640 1 -- 172.21.15.19:0/2079210446 <== mgr.4109 v2:172.21.15.190:6832/142426253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50664 (secure 0 0 0) 0x7ff844001d70 con 0x7ff8340664a0 2023-11-20T06:43:05.922 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:43:05.922 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-20T06:43:05.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.919+0000 7ff857165640 1 -- 172.21.15.19:0/2079210446 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff8340664a0 msgr2=0x7ff834068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:05.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.919+0000 7ff857165640 1 --2- 172.21.15.19:0/2079210446 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff8340664a0 0x7ff834068960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff8501f7e40 tx=0x7ff844009040 comp rx=0 tx=0).stop 2023-11-20T06:43:05.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.919+0000 7ff857165640 1 -- 172.21.15.19:0/2079210446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8500d3010 msgr2=0x7ff8500b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:05.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.919+0000 7ff857165640 1 --2- 172.21.15.19:0/2079210446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8500d3010 0x7ff8500b0c50 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00e930 tx=0x7ff83c00edf0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.919+0000 7ff857165640 1 -- 172.21.15.19:0/2079210446 shutdown_connections 2023-11-20T06:43:05.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.919+0000 7ff857165640 1 --2- 172.21.15.19:0/2079210446 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7ff8340664a0 0x7ff834068960 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.919+0000 7ff857165640 1 --2- 172.21.15.19:0/2079210446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff85015cb90 0x7ff8500cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.919+0000 7ff857165640 1 --2- 172.21.15.19:0/2079210446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8500d3010 0x7ff8500b0c50 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.919+0000 7ff857165640 1 --2- 172.21.15.19:0/2079210446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8500d15d0 0x7ff850157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:05.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.919+0000 7ff857165640 1 -- 172.21.15.19:0/2079210446 >> 172.21.15.19:0/2079210446 conn(0x7ff85009bc50 msgr2=0x7ff8500d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:05.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.919+0000 7ff857165640 1 -- 172.21.15.19:0/2079210446 shutdown_connections 2023-11-20T06:43:05.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:05.919+0000 7ff857165640 1 -- 172.21.15.19:0/2079210446 wait complete. 2023-11-20T06:43:05.943 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2023-11-20T06:43:05.509429+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":221240,"kb_used_data":5068,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753480,"statfs":{"total":773094113280,"available":772867563520,"internally_reserved":0,"allocated":5189632,"data_stored":2934289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3806,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-48,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.502935"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":185,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-20T06:42:59.428805+0000","last_change":"2023-11-20T06:41:03.783345+0000","last_active":"2023-11-20T06:42:59.428805+0000","last_peered":"2023-11-20T06:42:59.428805+0000","last_clean":"2023-11-20T06:42:59.428805+0000","last_became_active":"2023-11-20T06:41:03.782257+0000","last_became_peered":"2023-11-20T06:41:03.782257+0000","last_unstale":"2023-11-20T06:42:59.428805+0000","last_undegraded":"2023-11-20T06:42:59.428805+0000","last_fullsized":"2023-11-20T06:42:59.428805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:01.979090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:01.979090+0000","last_clean_scrub_stamp":"2023-11-20T06:41:01.979090+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:20:41.084382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1097728,"data_stored":808728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.80500000000000005}]},{"osd":1,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.64900000000000002}]},{"osd":2,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.73599999999999999}]},{"osd":3,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.755},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":2,"5min":2,"15min":2},"last":0.79200000000000004}]},{"osd":4,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.68500000000000005}]},{"osd":5,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.83999999999999997}]},{"osd":6,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.60799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":215864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":0.54800000000000004}]},{"osd":1,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.502}]},{"osd":2,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.60899999999999999}]},{"osd":3,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":4.3029999999999999,"5min":4.3029999999999999,"15min":4.3029999999999999},"last":0.70999999999999996}]},{"osd":4,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.65900000000000003}]},{"osd":5,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.74399999999999999}]},{"osd":7,"last update":"Mon Nov 20 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.75900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":221663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":4.7450000000000001,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.60199999999999998}]},{"osd":1,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.62},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.63600000000000001}]},{"osd":2,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":0.67300000000000004}]},{"osd":3,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":8.9250000000000007,"5min":8.9250000000000007,"15min":8.9250000000000007},"last":0.55100000000000005},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":8.891,"5min":8.891,"15min":8.891},"last":0.64300000000000002}]},{"osd":4,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.45800000000000002}]},{"osd":6,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.44},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.56699999999999995}]},{"osd":7,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.69799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":221663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.55400000000000005}]},{"osd":1,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":4.8710000000000004,"5min":4.8710000000000004,"15min":4.8710000000000004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.52800000000000002}]},{"osd":2,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":4.8499999999999996,"5min":4.8499999999999996,"15min":4.8499999999999996},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.76900000000000002}]},{"osd":3,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.752}]},{"osd":5,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.70799999999999996}]},{"osd":6,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Mon Nov 20 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.78100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":503808,"data_stored":218324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":3.714,"5min":3.714,"15min":3.714},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.28699999999999998}]},{"osd":1,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":3.8330000000000002,"5min":3.8330000000000002,"15min":3.8330000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.7629999999999999,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":0.34799999999999998}]},{"osd":2,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.0709999999999997,"5min":4.0709999999999997,"15min":4.0709999999999997},"last":0.442},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.45300000000000001}]},{"osd":4,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.9169999999999998,"5min":3.9169999999999998,"15min":3.9169999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.2069999999999999,"5min":4.2069999999999999,"15min":4.2069999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.52300000000000002}]},{"osd":6,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":4.3659999999999997,"5min":4.3659999999999997,"15min":4.3659999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.66500000000000004}]},{"osd":7,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":3.9700000000000002,"5min":3.9700000000000002,"15min":3.9700000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":0.65200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":221663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.46500000000000002}]},{"osd":1,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.39800000000000002}]},{"osd":3,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.35299999999999998}]},{"osd":4,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.749}]},{"osd":5,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.67300000000000004}]},{"osd":6,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.63900000000000001}]},{"osd":7,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.624},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.72599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":215372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.42399999999999999}]},{"osd":2,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.46100000000000002}]},{"osd":3,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.54400000000000004}]},{"osd":4,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.56200000000000006}]},{"osd":5,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.627}]},{"osd":6,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.66300000000000003}]},{"osd":7,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.68899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1093632,"data_stored":811012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.42599999999999999}]},{"osd":2,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.625,"5min":2.625,"15min":2.625},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.52800000000000002}]},{"osd":3,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.6669999999999998,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":0.47099999999999997}]},{"osd":4,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.86399999999999999}]},{"osd":5,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":3.0550000000000002,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.84099999999999997}]},{"osd":6,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.79500000000000004}]},{"osd":7,"last update":"Mon Nov 20 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.81999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T06:43:05.945 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T06:43:06.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.083+0000 7f50ad454640 1 Processor -- start 2023-11-20T06:43:06.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.083+0000 7f50ad454640 1 -- start start 2023-11-20T06:43:06.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.083+0000 7f50ad454640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f50a81597c0 0x7f50a80ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:06.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.083+0000 7f50ad454640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50a8159ba0 0x7f50a80cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:06.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.083+0000 7f50ad454640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a80723d0 con 0x7f50a80adc10 2023-11-20T06:43:06.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.083+0000 7f50ad454640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a80717c0 con 0x7f50a81597c0 2023-11-20T06:43:06.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.083+0000 7f50ad454640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a8071aa0 con 0x7f50a8159ba0 2023-11-20T06:43:06.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.083+0000 7f50a6ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f50a81597c0 0x7f50a80ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:06.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.083+0000 7f50a6ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f50a81597c0 0x7f50a80ad6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51726/0 (socket says 172.21.15.19:51726) 2023-11-20T06:43:06.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.083+0000 7f50a6ffd640 1 -- 172.21.15.19:0/1055907341 learned_addr learned my addr 172.21.15.19:0/1055907341 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:06.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.083+0000 7f509ffff640 1 --2- 172.21.15.19:0/1055907341 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50a8159ba0 0x7f50a80cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:06.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.083+0000 7f50a6ffd640 1 -- 172.21.15.19:0/1055907341 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50a8159ba0 msgr2=0x7f50a80cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:06.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.083+0000 7f50a6ffd640 1 --2- 172.21.15.19:0/1055907341 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50a8159ba0 0x7f50a80cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:06.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.083+0000 7f50a6ffd640 1 -- 172.21.15.19:0/1055907341 >> v1:172.21.15.19:6789/0 conn(0x7f50a80adc10 legacy=0x7f50a80cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:06.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.087+0000 7f50a6ffd640 1 -- 172.21.15.19:0/1055907341 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a8071d80 con 0x7f50a81597c0 2023-11-20T06:43:06.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.087+0000 7f50a6ffd640 1 --2- 172.21.15.19:0/1055907341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50a81597c0 0x7f50a80ad6d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5098009870 tx=0x7f509801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f0dbad6e09f1d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:06.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.087+0000 7f50a67fc640 1 -- 172.21.15.19:0/1055907341 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50980aa640 con 0x7f50a81597c0 2023-11-20T06:43:06.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.087+0000 7f50a67fc640 1 -- 172.21.15.19:0/1055907341 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50980aa7a0 con 0x7f50a81597c0 2023-11-20T06:43:06.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.087+0000 7f50a67fc640 1 -- 172.21.15.19:0/1055907341 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50980aab30 con 0x7f50a81597c0 2023-11-20T06:43:06.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.087+0000 7f50ad454640 1 -- 172.21.15.19:0/1055907341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50a81597c0 msgr2=0x7f50a80ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:06.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.087+0000 7f50ad454640 1 --2- 172.21.15.19:0/1055907341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50a81597c0 0x7f50a80ad6d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5098009870 tx=0x7f509801c540 comp rx=0 tx=0).stop 2023-11-20T06:43:06.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.087+0000 7f50ad454640 1 -- 172.21.15.19:0/1055907341 shutdown_connections 2023-11-20T06:43:06.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.087+0000 7f50ad454640 1 --2- 172.21.15.19:0/1055907341 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50a8159ba0 0x7f50a80cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:06.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.087+0000 7f50ad454640 1 --2- 172.21.15.19:0/1055907341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50a81597c0 0x7f50a80ad6d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:06.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.087+0000 7f50ad454640 1 -- 172.21.15.19:0/1055907341 >> 172.21.15.19:0/1055907341 conn(0x7f50a806c190 msgr2=0x7f50a806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:06.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.087+0000 7f50ad454640 1 -- 172.21.15.19:0/1055907341 shutdown_connections 2023-11-20T06:43:06.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f50ad454640 1 -- 172.21.15.19:0/1055907341 wait complete. 2023-11-20T06:43:06.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f50ad454640 1 Processor -- start 2023-11-20T06:43:06.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f50ad454640 1 -- start start 2023-11-20T06:43:06.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f50ad454640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50a80adc10 0x7f50a814f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:06.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f50ad454640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50a81597c0 0x7f50a80ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:06.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f50ad454640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50a8159ba0 0x7f50a80ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:06.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f50ad454640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a81f9790 con 0x7f50a81597c0 2023-11-20T06:43:06.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f50ad454640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a81f51b0 con 0x7f50a8159ba0 2023-11-20T06:43:06.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f50ad454640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a814f950 con 0x7f50a80adc10 2023-11-20T06:43:06.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f509ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50a81597c0 0x7f50a80ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:06.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f509ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50a81597c0 0x7f50a80ce5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51730/0 (socket says 172.21.15.19:51730) 2023-11-20T06:43:06.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f509ffff640 1 -- 172.21.15.19:0/2728004295 learned_addr learned my addr 172.21.15.19:0/2728004295 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:06.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f50a6ffd640 1 --2- 172.21.15.19:0/2728004295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50a80adc10 0x7f50a814f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:06.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f50a77fe640 1 --2- 172.21.15.19:0/2728004295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50a8159ba0 0x7f50a80ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:06.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f509ffff640 1 -- 172.21.15.19:0/2728004295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50a80adc10 msgr2=0x7f50a814f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:06.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f509ffff640 1 --2- 172.21.15.19:0/2728004295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50a80adc10 0x7f50a814f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:06.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f509ffff640 1 -- 172.21.15.19:0/2728004295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50a8159ba0 msgr2=0x7f50a80ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:06.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f509ffff640 1 --2- 172.21.15.19:0/2728004295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50a8159ba0 0x7f50a80ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:06.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f509ffff640 1 -- 172.21.15.19:0/2728004295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50980094d0 con 0x7f50a81597c0 2023-11-20T06:43:06.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f509ffff640 1 --2- 172.21.15.19:0/2728004295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50a81597c0 0x7f50a80ce5f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f509000d5f0 tx=0x7f509000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:06.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f509f7fe640 1 -- 172.21.15.19:0/2728004295 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50900125f0 con 0x7f50a81597c0 2023-11-20T06:43:06.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f509f7fe640 1 -- 172.21.15.19:0/2728004295 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5090012750 con 0x7f50a81597c0 2023-11-20T06:43:06.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f50ad454640 1 -- 172.21.15.19:0/2728004295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a81f94b0 con 0x7f50a81597c0 2023-11-20T06:43:06.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.091+0000 7f509f7fe640 1 -- 172.21.15.19:0/2728004295 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090012ae0 con 0x7f50a81597c0 2023-11-20T06:43:06.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.095+0000 7f50ad454640 1 -- 172.21.15.19:0/2728004295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a81f56a0 con 0x7f50a81597c0 2023-11-20T06:43:06.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.095+0000 7f50ad454640 1 -- 172.21.15.19:0/2728004295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a8074010 con 0x7f50a81597c0 2023-11-20T06:43:06.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.095+0000 7f509f7fe640 1 -- 172.21.15.19:0/2728004295 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5090012c40 con 0x7f50a81597c0 2023-11-20T06:43:06.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.095+0000 7f509f7fe640 1 --2- 172.21.15.19:0/2728004295 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f50880664d0 0x7f5088068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:06.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.095+0000 7f509f7fe640 1 -- 172.21.15.19:0/2728004295 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f5090084030 con 0x7f50a81597c0 2023-11-20T06:43:06.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.095+0000 7f50a6ffd640 1 --2- 172.21.15.19:0/2728004295 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f50880664d0 0x7f5088068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:06.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.095+0000 7f50a6ffd640 1 --2- 172.21.15.19:0/2728004295 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f50880664d0 0x7f5088068990 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f50980ae000 tx=0x7f50980b5040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:06.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.099+0000 7f509f7fe640 1 -- 172.21.15.19:0/2728004295 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5090051700 con 0x7f50a81597c0 2023-11-20T06:43:06.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.255+0000 7f50ad454640 1 -- 172.21.15.19:0/2728004295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50a80cd3f0 con 0x7f50a81597c0 2023-11-20T06:43:06.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.259+0000 7f509f7fe640 1 -- 172.21.15.19:0/2728004295 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+13177 (secure 0 0 0) 0x7f5090054d20 con 0x7f50a81597c0 2023-11-20T06:43:06.264 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:43:06.264 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":44,"fsid":"c7c2bc89-520e-40d6-94f5-74b01db83356","created":"2023-11-20T06:40:48.429744+0000","modified":"2023-11-20T06:43:01.314159+0000","last_up_change":"2023-11-20T06:41:00.976048+0000","last_in_change":"2023-11-20T06:40:50.984686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T06:41:01.541780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"97480584-2afe-494f-8b44-72f6c2894d22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6817","nonce":404837676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6819","nonce":404837676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6823","nonce":404837676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":404837676},{"type":"v1","addr":"172.21.15.19:6821","nonce":404837676}]},"public_addr":"172.21.15.19:6817/404837676","cluster_addr":"172.21.15.19:6819/404837676","heartbeat_back_addr":"172.21.15.19:6823/404837676","heartbeat_front_addr":"172.21.15.19:6821/404837676","state":["exists","up"]},{"osd":1,"uuid":"c5914a79-b0fc-46eb-a106-10473dac1449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6801","nonce":2544072609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6803","nonce":2544072609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6807","nonce":2544072609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2544072609},{"type":"v1","addr":"172.21.15.19:6805","nonce":2544072609}]},"public_addr":"172.21.15.19:6801/2544072609","cluster_addr":"172.21.15.19:6803/2544072609","heartbeat_back_addr":"172.21.15.19:6807/2544072609","heartbeat_front_addr":"172.21.15.19:6805/2544072609","state":["exists","up"]},{"osd":2,"uuid":"b3a547ad-a724-457a-9dea-69d8d6b0fa7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6809","nonce":427773025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6811","nonce":427773025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6815","nonce":427773025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":427773025},{"type":"v1","addr":"172.21.15.19:6813","nonce":427773025}]},"public_addr":"172.21.15.19:6809/427773025","cluster_addr":"172.21.15.19:6811/427773025","heartbeat_back_addr":"172.21.15.19:6815/427773025","heartbeat_front_addr":"172.21.15.19:6813/427773025","state":["exists","up"]},{"osd":3,"uuid":"072d00a3-5b2e-42ca-8504-d7e40a8f2848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6825","nonce":2577618590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6827","nonce":2577618590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6831","nonce":2577618590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2577618590},{"type":"v1","addr":"172.21.15.19:6829","nonce":2577618590}]},"public_addr":"172.21.15.19:6825/2577618590","cluster_addr":"172.21.15.19:6827/2577618590","heartbeat_back_addr":"172.21.15.19:6831/2577618590","heartbeat_front_addr":"172.21.15.19:6829/2577618590","state":["exists","up"]},{"osd":4,"uuid":"1834e008-6cfa-45d9-a0df-ed43bd276011","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6809","nonce":4085939700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6811","nonce":4085939700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6815","nonce":4085939700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":4085939700},{"type":"v1","addr":"172.21.15.190:6813","nonce":4085939700}]},"public_addr":"172.21.15.190:6809/4085939700","cluster_addr":"172.21.15.190:6811/4085939700","heartbeat_back_addr":"172.21.15.190:6815/4085939700","heartbeat_front_addr":"172.21.15.190:6813/4085939700","state":["exists","up"]},{"osd":5,"uuid":"9dcdc181-77c4-4878-996d-78ff7d5299c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6817","nonce":1335226039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6819","nonce":1335226039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6823","nonce":1335226039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1335226039},{"type":"v1","addr":"172.21.15.190:6821","nonce":1335226039}]},"public_addr":"172.21.15.190:6817/1335226039","cluster_addr":"172.21.15.190:6819/1335226039","heartbeat_back_addr":"172.21.15.190:6823/1335226039","heartbeat_front_addr":"172.21.15.190:6821/1335226039","state":["exists","up"]},{"osd":6,"uuid":"679fc5c8-5792-4679-8dc9-c568ce54cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6825","nonce":2641951692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6827","nonce":2641951692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6831","nonce":2641951692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2641951692},{"type":"v1","addr":"172.21.15.190:6829","nonce":2641951692}]},"public_addr":"172.21.15.190:6825/2641951692","cluster_addr":"172.21.15.190:6827/2641951692","heartbeat_back_addr":"172.21.15.190:6831/2641951692","heartbeat_front_addr":"172.21.15.190:6829/2641951692","state":["exists","up"]},{"osd":7,"uuid":"aef7c06f-03d1-4d3c-b0a1-a17a0024137a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6801","nonce":1124210179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6803","nonce":1124210179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6807","nonce":1124210179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1124210179},{"type":"v1","addr":"172.21.15.190:6805","nonce":1124210179}]},"public_addr":"172.21.15.190:6801/1124210179","cluster_addr":"172.21.15.190:6803/1124210179","heartbeat_back_addr":"172.21.15.190:6807/1124210179","heartbeat_front_addr":"172.21.15.190:6805/1124210179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.535024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.694184+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.718056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.826709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.686046+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T06:40:56.710937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6835/203468016":"2023-11-21T06:42:58.000144+0000","172.21.15.19:6834/203468016":"2023-11-21T06:42:58.000144+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T06:43:06.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.259+0000 7f50ad454640 1 -- 172.21.15.19:0/2728004295 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f50880664d0 msgr2=0x7f5088068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:06.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.259+0000 7f50ad454640 1 --2- 172.21.15.19:0/2728004295 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f50880664d0 0x7f5088068990 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f50980ae000 tx=0x7f50980b5040 comp rx=0 tx=0).stop 2023-11-20T06:43:06.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.259+0000 7f50ad454640 1 -- 172.21.15.19:0/2728004295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50a81597c0 msgr2=0x7f50a80ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:06.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.259+0000 7f50ad454640 1 --2- 172.21.15.19:0/2728004295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50a81597c0 0x7f50a80ce5f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f509000d5f0 tx=0x7f509000dab0 comp rx=0 tx=0).stop 2023-11-20T06:43:06.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.259+0000 7f50ad454640 1 -- 172.21.15.19:0/2728004295 shutdown_connections 2023-11-20T06:43:06.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.259+0000 7f50ad454640 1 --2- 172.21.15.19:0/2728004295 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f50880664d0 0x7f5088068990 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:06.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.259+0000 7f50ad454640 1 --2- 172.21.15.19:0/2728004295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50a8159ba0 0x7f50a80ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:06.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.259+0000 7f50ad454640 1 --2- 172.21.15.19:0/2728004295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50a81597c0 0x7f50a80ce5f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:06.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.259+0000 7f50ad454640 1 --2- 172.21.15.19:0/2728004295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50a80adc10 0x7f50a814f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:06.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.259+0000 7f50ad454640 1 -- 172.21.15.19:0/2728004295 >> 172.21.15.19:0/2728004295 conn(0x7f50a806c190 msgr2=0x7f50a80cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:06.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.259+0000 7f50ad454640 1 -- 172.21.15.19:0/2728004295 shutdown_connections 2023-11-20T06:43:06.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:06.259+0000 7f50ad454640 1 -- 172.21.15.19:0/2728004295 wait complete. 2023-11-20T06:43:07.286 INFO:tasks.ceph:Scrubbing osd.0 2023-11-20T06:43:07.286 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-20T06:43:07.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.439+0000 7f77dc765640 1 Processor -- start 2023-11-20T06:43:07.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.439+0000 7f77dc765640 1 -- start start 2023-11-20T06:43:07.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.443+0000 7f77dc765640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d40cd2b0 0x7f77d40cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:07.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.443+0000 7f77dc765640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f77d40cbc50 0x7f77d40cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:07.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.443+0000 7f77dc765640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d40cdc50 con 0x7f77d41600e0 2023-11-20T06:43:07.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.443+0000 7f77dc765640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d40caf20 con 0x7f77d40cbc50 2023-11-20T06:43:07.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.443+0000 7f77dc765640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d40b3720 con 0x7f77d40cd2b0 2023-11-20T06:43:07.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.443+0000 7f77dad02640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f77d40cbc50 0x7f77d40cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:07.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.443+0000 7f77d9d00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d40cd2b0 0x7f77d40cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:07.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.443+0000 7f77dad02640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f77d40cbc50 0x7f77d40cc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:44624/0 (socket says 172.21.15.19:44624) 2023-11-20T06:43:07.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.443+0000 7f77dad02640 1 -- 172.21.15.19:0/726035397 learned_addr learned my addr 172.21.15.19:0/726035397 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:07.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.443+0000 7f77d9d00640 1 -- 172.21.15.19:0/726035397 >> v2:172.21.15.190:3300/0 conn(0x7f77d40cbc50 msgr2=0x7f77d40cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:07.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.443+0000 7f77d94ff640 1 -- 172.21.15.19:0/726035397 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010197917 0 0) 0x7f77d40cdc50 con 0x7f77d41600e0 2023-11-20T06:43:07.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.443+0000 7f77d9d00640 1 --2- 172.21.15.19:0/726035397 >> v2:172.21.15.190:3300/0 conn(0x7f77d40cbc50 0x7f77d40cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.443+0000 7f77d9d00640 1 -- 172.21.15.19:0/726035397 >> v1:172.21.15.190:6789/0 conn(0x7f77d41600e0 legacy=0x7f77d40cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:07.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.443+0000 7f77d9d00640 1 -- 172.21.15.19:0/726035397 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d40d02a0 con 0x7f77d40cd2b0 2023-11-20T06:43:07.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.443+0000 7f77dad02640 1 --2- 172.21.15.19:0/726035397 >> v2:172.21.15.190:3300/0 conn(0x7f77d40cbc50 0x7f77d40cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:43:07.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.447+0000 7f77d9d00640 1 --2- 172.21.15.19:0/726035397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d40cd2b0 0x7f77d40cd710 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f77c40097c0 tx=0x7f77c401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c35a6e4fbe99ea5a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:07.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.447+0000 7f77d94ff640 1 -- 172.21.15.19:0/726035397 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c40ac620 con 0x7f77d40cd2b0 2023-11-20T06:43:07.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.447+0000 7f77d94ff640 1 -- 172.21.15.19:0/726035397 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c40ac780 con 0x7f77d40cd2b0 2023-11-20T06:43:07.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.447+0000 7f77d94ff640 1 -- 172.21.15.19:0/726035397 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c40acb10 con 0x7f77d40cd2b0 2023-11-20T06:43:07.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.447+0000 7f77dc765640 1 -- 172.21.15.19:0/726035397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d40cd2b0 msgr2=0x7f77d40cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:07.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.447+0000 7f77dc765640 1 --2- 172.21.15.19:0/726035397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d40cd2b0 0x7f77d40cd710 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f77c40097c0 tx=0x7f77c401c3c0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.447+0000 7f77dc765640 1 -- 172.21.15.19:0/726035397 shutdown_connections 2023-11-20T06:43:07.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.447+0000 7f77dc765640 1 --2- 172.21.15.19:0/726035397 >> v2:172.21.15.190:3300/0 conn(0x7f77d40cbc50 0x7f77d40cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.447+0000 7f77dc765640 1 --2- 172.21.15.19:0/726035397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d40cd2b0 0x7f77d40cd710 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.447+0000 7f77dc765640 1 -- 172.21.15.19:0/726035397 >> 172.21.15.19:0/726035397 conn(0x7f77d40d08d0 msgr2=0x7f77d40d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:07.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.447+0000 7f77dc765640 1 -- 172.21.15.19:0/726035397 shutdown_connections 2023-11-20T06:43:07.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.447+0000 7f77dc765640 1 -- 172.21.15.19:0/726035397 wait complete. 2023-11-20T06:43:07.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77dc765640 1 Processor -- start 2023-11-20T06:43:07.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77dc765640 1 -- start start 2023-11-20T06:43:07.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77dc765640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77d40cbc50 0x7f77d41541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:07.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77dc765640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d40cd2b0 0x7f77d40b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:07.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77dc765640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77d41600e0 0x7f77d40c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:07.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77dc765640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d415bc20 con 0x7f77d41600e0 2023-11-20T06:43:07.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77dc765640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d40b4c10 con 0x7f77d40cbc50 2023-11-20T06:43:07.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77dc765640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d415be50 con 0x7f77d40cd2b0 2023-11-20T06:43:07.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77dad02640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77d41600e0 0x7f77d40c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:07.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77dad02640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77d41600e0 0x7f77d40c43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51732/0 (socket says 172.21.15.19:51732) 2023-11-20T06:43:07.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77dad02640 1 -- 172.21.15.19:0/2556300751 learned_addr learned my addr 172.21.15.19:0/2556300751 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:07.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77da501640 1 --2- 172.21.15.19:0/2556300751 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77d40cbc50 0x7f77d41541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77d9d00640 1 --2- 172.21.15.19:0/2556300751 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d40cd2b0 0x7f77d40b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77dad02640 1 -- 172.21.15.19:0/2556300751 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d40cd2b0 msgr2=0x7f77d40b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77dad02640 1 --2- 172.21.15.19:0/2556300751 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d40cd2b0 0x7f77d40b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77dad02640 1 -- 172.21.15.19:0/2556300751 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77d40cbc50 msgr2=0x7f77d41541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77dad02640 1 --2- 172.21.15.19:0/2556300751 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77d40cbc50 0x7f77d41541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77dad02640 1 -- 172.21.15.19:0/2556300751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc009b30 con 0x7f77d41600e0 2023-11-20T06:43:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77da501640 1 --2- 172.21.15.19:0/2556300751 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77d40cbc50 0x7f77d41541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:43:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77d9d00640 1 --2- 172.21.15.19:0/2556300751 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d40cd2b0 0x7f77d40b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:43:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77dad02640 1 --2- 172.21.15.19:0/2556300751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77d41600e0 0x7f77d40c43e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00efc0 tx=0x7f77cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77caffd640 1 -- 172.21.15.19:0/2556300751 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc018070 con 0x7f77d41600e0 2023-11-20T06:43:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77caffd640 1 -- 172.21.15.19:0/2556300751 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77cc00f040 con 0x7f77d41600e0 2023-11-20T06:43:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77dc765640 1 -- 172.21.15.19:0/2556300751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c4009420 con 0x7f77d41600e0 2023-11-20T06:43:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77caffd640 1 -- 172.21.15.19:0/2556300751 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc00ce00 con 0x7f77d41600e0 2023-11-20T06:43:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77dc765640 1 -- 172.21.15.19:0/2556300751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d415c1e0 con 0x7f77d41600e0 2023-11-20T06:43:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.451+0000 7f77dc765640 1 -- 172.21.15.19:0/2556300751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f77d40cff20 con 0x7f77d41600e0 2023-11-20T06:43:07.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.455+0000 7f77caffd640 1 -- 172.21.15.19:0/2556300751 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f77cc014480 con 0x7f77d41600e0 2023-11-20T06:43:07.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.455+0000 7f77caffd640 1 --2- 172.21.15.19:0/2556300751 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f77b80664d0 0x7f77b8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:07.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.455+0000 7f77caffd640 1 -- 172.21.15.19:0/2556300751 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f77cc084c80 con 0x7f77d41600e0 2023-11-20T06:43:07.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.455+0000 7f77caffd640 1 --2- 172.21.15.19:0/2556300751 >> [v2:172.21.15.19:6816/404837676,v1:172.21.15.19:6817/404837676] conn(0x7f77b806c7d0 0x7f77b806ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:07.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.455+0000 7f77caffd640 1 -- 172.21.15.19:0/2556300751 --> [v2:172.21.15.19:6816/404837676,v1:172.21.15.19:6817/404837676] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77b806f2e0 con 0x7f77b806c7d0 2023-11-20T06:43:07.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.455+0000 7f77caffd640 1 -- 172.21.15.19:0/2556300751 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77cc084ff0 con 0x7f77d41600e0 2023-11-20T06:43:07.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.455+0000 7f77da501640 1 --2- 172.21.15.19:0/2556300751 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f77b80664d0 0x7f77b8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:07.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.455+0000 7f77d9d00640 1 --2- 172.21.15.19:0/2556300751 >> [v2:172.21.15.19:6816/404837676,v1:172.21.15.19:6817/404837676] conn(0x7f77b806c7d0 0x7f77b806ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:07.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.455+0000 7f77d9d00640 1 --2- 172.21.15.19:0/2556300751 >> [v2:172.21.15.19:6816/404837676,v1:172.21.15.19:6817/404837676] conn(0x7f77b806c7d0 0x7f77b806ec10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:07.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.455+0000 7f77da501640 1 --2- 172.21.15.19:0/2556300751 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f77b80664d0 0x7f77b8068990 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f77d0000f70 tx=0x7f77d0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:07.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.455+0000 7f77caffd640 1 -- 172.21.15.19:0/2556300751 <== osd.0 v2:172.21.15.19:6816/404837676 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f77b806f2e0 con 0x7f77b806c7d0 2023-11-20T06:43:07.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.471+0000 7f77dc765640 1 -- 172.21.15.19:0/2556300751 --> [v2:172.21.15.19:6816/404837676,v1:172.21.15.19:6817/404837676] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f77d40cb730 con 0x7f77b806c7d0 2023-11-20T06:43:07.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.471+0000 7f77caffd640 1 -- 172.21.15.19:0/2556300751 <== osd.0 v2:172.21.15.19:6816/404837676 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f77c40ac420 con 0x7f77b806c7d0 2023-11-20T06:43:07.476 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-20T06:43:07.476 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-20T06:43:07.476 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-20T06:43:07.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.471+0000 7f77dc765640 1 -- 172.21.15.19:0/2556300751 >> [v2:172.21.15.19:6816/404837676,v1:172.21.15.19:6817/404837676] conn(0x7f77b806c7d0 msgr2=0x7f77b806ec10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:07.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.471+0000 7f77dc765640 1 --2- 172.21.15.19:0/2556300751 >> [v2:172.21.15.19:6816/404837676,v1:172.21.15.19:6817/404837676] conn(0x7f77b806c7d0 0x7f77b806ec10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.471+0000 7f77dc765640 1 -- 172.21.15.19:0/2556300751 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f77b80664d0 msgr2=0x7f77b8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:07.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.471+0000 7f77dc765640 1 --2- 172.21.15.19:0/2556300751 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f77b80664d0 0x7f77b8068990 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f77d0000f70 tx=0x7f77d0009040 comp rx=0 tx=0).stop 2023-11-20T06:43:07.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.471+0000 7f77dc765640 1 -- 172.21.15.19:0/2556300751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77d41600e0 msgr2=0x7f77d40c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:07.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.471+0000 7f77dc765640 1 --2- 172.21.15.19:0/2556300751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77d41600e0 0x7f77d40c43e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00efc0 tx=0x7f77cc00c490 comp rx=0 tx=0).stop 2023-11-20T06:43:07.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.471+0000 7f77dad02640 1 -- 172.21.15.19:0/2556300751 reap_dead start 2023-11-20T06:43:07.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.471+0000 7f77dc765640 1 -- 172.21.15.19:0/2556300751 shutdown_connections 2023-11-20T06:43:07.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.471+0000 7f77dc765640 1 -- 172.21.15.19:0/2556300751 >> 172.21.15.19:0/2556300751 conn(0x7f77d40d08d0 msgr2=0x7f77d41597b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:07.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.471+0000 7f77dc765640 1 -- 172.21.15.19:0/2556300751 shutdown_connections 2023-11-20T06:43:07.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.471+0000 7f77dc765640 1 -- 172.21.15.19:0/2556300751 wait complete. 2023-11-20T06:43:07.494 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-20T06:43:07.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.635+0000 7f9c6ecea640 1 Processor -- start 2023-11-20T06:43:07.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.635+0000 7f9c6ecea640 1 -- start start 2023-11-20T06:43:07.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.635+0000 7f9c6ecea640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9c6815cb90 0x7f9c680cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:07.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.635+0000 7f9c6ecea640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9c680d15d0 0x7f9c680c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:07.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.635+0000 7f9c6ecea640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c680ce770 con 0x7f9c680d3010 2023-11-20T06:43:07.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.635+0000 7f9c6ecea640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c680d0600 con 0x7f9c680d15d0 2023-11-20T06:43:07.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.635+0000 7f9c6ecea640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c680c6450 con 0x7f9c6815cb90 2023-11-20T06:43:07.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.635+0000 7f9c6d287640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9c680d15d0 0x7f9c680c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:07.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.639+0000 7f9c6d287640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9c680d15d0 0x7f9c680c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51748/0 (socket says 172.21.15.19:51748) 2023-11-20T06:43:07.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.639+0000 7f9c6d287640 1 -- 172.21.15.19:0/1013914286 learned_addr learned my addr 172.21.15.19:0/1013914286 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:07.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.639+0000 7f9c67fff640 1 --1- 172.21.15.19:0/1013914286 >> v1:172.21.15.19:6789/0 conn(0x7f9c680d3010 0x7f9c680d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42562/0 (socket says 172.21.15.19:42562) 2023-11-20T06:43:07.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.639+0000 7f9c6ca86640 1 --2- 172.21.15.19:0/1013914286 >> v2:172.21.15.190:3300/0 conn(0x7f9c6815cb90 0x7f9c680cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:07.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.639+0000 7f9c6d287640 1 -- 172.21.15.19:0/1013914286 >> v2:172.21.15.190:3300/0 conn(0x7f9c6815cb90 msgr2=0x7f9c680cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:07.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.639+0000 7f9c6d287640 1 --2- 172.21.15.19:0/1013914286 >> v2:172.21.15.190:3300/0 conn(0x7f9c6815cb90 0x7f9c680cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.639+0000 7f9c6d287640 1 -- 172.21.15.19:0/1013914286 >> v1:172.21.15.19:6789/0 conn(0x7f9c680d3010 legacy=0x7f9c680d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:07.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.639+0000 7f9c6d287640 1 -- 172.21.15.19:0/1013914286 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c680d08a0 con 0x7f9c680d15d0 2023-11-20T06:43:07.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.639+0000 7f9c677fe640 1 -- 172.21.15.19:0/1013914286 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197310840 0 0) 0x7f9c680ce770 con 0x7f9c680d3010 2023-11-20T06:43:07.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.639+0000 7f9c6d287640 1 --2- 172.21.15.19:0/1013914286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c680d15d0 0x7f9c680c6c10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9c6808ba70 tx=0x7f9c6001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352008f73fd9f7d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:07.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.639+0000 7f9c677fe640 1 -- 172.21.15.19:0/1013914286 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c600a57d0 con 0x7f9c680d15d0 2023-11-20T06:43:07.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.639+0000 7f9c677fe640 1 -- 172.21.15.19:0/1013914286 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c600a5930 con 0x7f9c680d15d0 2023-11-20T06:43:07.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.639+0000 7f9c677fe640 1 -- 172.21.15.19:0/1013914286 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c600a5cc0 con 0x7f9c680d15d0 2023-11-20T06:43:07.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c6ecea640 1 -- 172.21.15.19:0/1013914286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c680d15d0 msgr2=0x7f9c680c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:07.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c6ecea640 1 --2- 172.21.15.19:0/1013914286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c680d15d0 0x7f9c680c6c10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9c6808ba70 tx=0x7f9c6001c910 comp rx=0 tx=0).stop 2023-11-20T06:43:07.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c6ecea640 1 -- 172.21.15.19:0/1013914286 shutdown_connections 2023-11-20T06:43:07.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c6ecea640 1 --2- 172.21.15.19:0/1013914286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c680d15d0 0x7f9c680c6c10 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c6ecea640 1 --2- 172.21.15.19:0/1013914286 >> v2:172.21.15.190:3300/0 conn(0x7f9c6815cb90 0x7f9c680cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c6ecea640 1 -- 172.21.15.19:0/1013914286 >> 172.21.15.19:0/1013914286 conn(0x7f9c6809bc50 msgr2=0x7f9c680d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:07.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c6ecea640 1 -- 172.21.15.19:0/1013914286 shutdown_connections 2023-11-20T06:43:07.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c6ecea640 1 -- 172.21.15.19:0/1013914286 wait complete. 2023-11-20T06:43:07.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c6ecea640 1 Processor -- start 2023-11-20T06:43:07.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c6ecea640 1 -- start start 2023-11-20T06:43:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c6ecea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c680d15d0 0x7f9c680ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c6ecea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c680d3010 0x7f9c68150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c6ecea640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c6815cb90 0x7f9c680cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c6ecea640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c680cc760 con 0x7f9c680d3010 2023-11-20T06:43:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c6ecea640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c680caa50 con 0x7f9c6815cb90 2023-11-20T06:43:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c6ecea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c680cad30 con 0x7f9c680d15d0 2023-11-20T06:43:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c67fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c680d3010 0x7f9c68150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:07.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c67fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c680d3010 0x7f9c68150010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51758/0 (socket says 172.21.15.19:51758) 2023-11-20T06:43:07.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c67fff640 1 -- 172.21.15.19:0/1993525995 learned_addr learned my addr 172.21.15.19:0/1993525995 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:07.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c6ca86640 1 --2- 172.21.15.19:0/1993525995 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c680d15d0 0x7f9c680ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:07.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c6d287640 1 --2- 172.21.15.19:0/1993525995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c6815cb90 0x7f9c680cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:07.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c67fff640 1 -- 172.21.15.19:0/1993525995 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c680d15d0 msgr2=0x7f9c680ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:07.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c67fff640 1 --2- 172.21.15.19:0/1993525995 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c680d15d0 0x7f9c680ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c67fff640 1 -- 172.21.15.19:0/1993525995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c6815cb90 msgr2=0x7f9c680cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:07.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c67fff640 1 --2- 172.21.15.19:0/1993525995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c6815cb90 0x7f9c680cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c67fff640 1 -- 172.21.15.19:0/1993525995 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c60009b30 con 0x7f9c680d3010 2023-11-20T06:43:07.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.643+0000 7f9c6ca86640 1 --2- 172.21.15.19:0/1993525995 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c680d15d0 0x7f9c680ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:43:07.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.647+0000 7f9c67fff640 1 --2- 172.21.15.19:0/1993525995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c680d3010 0x7f9c68150010 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400c4b0 tx=0x7f9c5400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.647+0000 7f9c657fa640 1 -- 172.21.15.19:0/1993525995 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c54007480 con 0x7f9c680d3010 2023-11-20T06:43:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.647+0000 7f9c657fa640 1 -- 172.21.15.19:0/1993525995 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c540075e0 con 0x7f9c680d3010 2023-11-20T06:43:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.647+0000 7f9c657fa640 1 -- 172.21.15.19:0/1993525995 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c54004a30 con 0x7f9c680d3010 2023-11-20T06:43:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.647+0000 7f9c6ecea640 1 -- 172.21.15.19:0/1993525995 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c680cb010 con 0x7f9c680d3010 2023-11-20T06:43:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.647+0000 7f9c6ecea640 1 -- 172.21.15.19:0/1993525995 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c680cb5d0 con 0x7f9c680d3010 2023-11-20T06:43:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.647+0000 7f9c6ecea640 1 -- 172.21.15.19:0/1993525995 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c68074010 con 0x7f9c680d3010 2023-11-20T06:43:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.647+0000 7f9c657fa640 1 -- 172.21.15.19:0/1993525995 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9c54004b90 con 0x7f9c680d3010 2023-11-20T06:43:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.647+0000 7f9c657fa640 1 --2- 172.21.15.19:0/1993525995 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c4c0664d0 0x7f9c4c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.647+0000 7f9c657fa640 1 -- 172.21.15.19:0/1993525995 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f9c54082d20 con 0x7f9c680d3010 2023-11-20T06:43:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.647+0000 7f9c6ca86640 1 --2- 172.21.15.19:0/1993525995 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c4c0664d0 0x7f9c4c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.651+0000 7f9c6ca86640 1 --2- 172.21.15.19:0/1993525995 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c4c0664d0 0x7f9c4c068990 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c006fd0 tx=0x7f9c5c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:07.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.651+0000 7f9c657fa640 1 -- 172.21.15.19:0/1993525995 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9c540504c0 con 0x7f9c680d3010 2023-11-20T06:43:07.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.811+0000 7f9c6ecea640 1 -- 172.21.15.19:0/1993525995 --> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c6815cf70 con 0x7f9c4c0664d0 2023-11-20T06:43:07.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.811+0000 7f9c657fa640 1 -- 172.21.15.19:0/1993525995 <== mgr.4109 v2:172.21.15.190:6832/142426253 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9c5c00b6b0 con 0x7f9c4c0664d0 2023-11-20T06:43:07.816 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 0 to deep-scrub 2023-11-20T06:43:07.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.811+0000 7f9c6ecea640 1 -- 172.21.15.19:0/1993525995 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c4c0664d0 msgr2=0x7f9c4c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:07.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.811+0000 7f9c6ecea640 1 --2- 172.21.15.19:0/1993525995 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c4c0664d0 0x7f9c4c068990 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c006fd0 tx=0x7f9c5c008040 comp rx=0 tx=0).stop 2023-11-20T06:43:07.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.811+0000 7f9c6ecea640 1 -- 172.21.15.19:0/1993525995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c680d3010 msgr2=0x7f9c68150010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:07.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.811+0000 7f9c6ecea640 1 --2- 172.21.15.19:0/1993525995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c680d3010 0x7f9c68150010 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400c4b0 tx=0x7f9c5400c970 comp rx=0 tx=0).stop 2023-11-20T06:43:07.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.811+0000 7f9c6ecea640 1 -- 172.21.15.19:0/1993525995 shutdown_connections 2023-11-20T06:43:07.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.811+0000 7f9c6ecea640 1 --2- 172.21.15.19:0/1993525995 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c4c0664d0 0x7f9c4c068990 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.811+0000 7f9c6ecea640 1 --2- 172.21.15.19:0/1993525995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c6815cb90 0x7f9c680cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.811+0000 7f9c6ecea640 1 --2- 172.21.15.19:0/1993525995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c680d3010 0x7f9c68150010 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.811+0000 7f9c6ecea640 1 --2- 172.21.15.19:0/1993525995 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c680d15d0 0x7f9c680ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.811+0000 7f9c6ecea640 1 -- 172.21.15.19:0/1993525995 >> 172.21.15.19:0/1993525995 conn(0x7f9c6809bc50 msgr2=0x7f9c6806c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:07.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.811+0000 7f9c6ecea640 1 -- 172.21.15.19:0/1993525995 shutdown_connections 2023-11-20T06:43:07.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.811+0000 7f9c6ecea640 1 -- 172.21.15.19:0/1993525995 wait complete. 2023-11-20T06:43:07.838 INFO:tasks.ceph:Scrubbing osd.1 2023-11-20T06:43:07.838 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-20T06:43:07.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.979+0000 7f9c48668640 1 Processor -- start 2023-11-20T06:43:07.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.979+0000 7f9c48668640 1 -- start start 2023-11-20T06:43:07.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.979+0000 7f9c48668640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9c401441a0 0x7f9c400b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:07.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.979+0000 7f9c48668640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c400b1a90 0x7f9c400cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:07.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.979+0000 7f9c48668640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c400b1ef0 con 0x7f9c400cb360 2023-11-20T06:43:07.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.979+0000 7f9c48668640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4015e5f0 con 0x7f9c401441a0 2023-11-20T06:43:07.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.979+0000 7f9c48668640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4015e8d0 con 0x7f9c400b1a90 2023-11-20T06:43:07.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.983+0000 7f9c46404640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9c401441a0 0x7f9c400b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:07.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.983+0000 7f9c46c05640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f9c400cb360 0x7f9c4006c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:35920/0 (socket says 172.21.15.19:35920) 2023-11-20T06:43:07.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.983+0000 7f9c46c05640 1 -- 172.21.15.19:0/2018371736 learned_addr learned my addr 172.21.15.19:0/2018371736 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:43:07.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.983+0000 7f9c45c03640 1 --2- 172.21.15.19:0/2018371736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c400b1a90 0x7f9c400cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:07.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.983+0000 7f9c46404640 1 -- 172.21.15.19:0/2018371736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c400b1a90 msgr2=0x7f9c400cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:07.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.983+0000 7f9c46404640 1 --2- 172.21.15.19:0/2018371736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c400b1a90 0x7f9c400cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.983+0000 7f9c46404640 1 -- 172.21.15.19:0/2018371736 >> v1:172.21.15.190:6789/0 conn(0x7f9c400cb360 legacy=0x7f9c4006c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:07.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.983+0000 7f9c46404640 1 -- 172.21.15.19:0/2018371736 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4015ebb0 con 0x7f9c401441a0 2023-11-20T06:43:07.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.983+0000 7f9c45402640 1 -- 172.21.15.19:0/2018371736 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3540167039 0 0) 0x7f9c400b1ef0 con 0x7f9c400cb360 2023-11-20T06:43:07.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.983+0000 7f9c46404640 1 --2- 172.21.15.19:0/2018371736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c401441a0 0x7f9c400b1550 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0097c0 tx=0x7f9c3c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac1ed78a0938a9a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:07.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.983+0000 7f9c45402640 1 -- 172.21.15.19:0/2018371736 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c0ab600 con 0x7f9c401441a0 2023-11-20T06:43:07.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.983+0000 7f9c45402640 1 -- 172.21.15.19:0/2018371736 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3c0a7050 con 0x7f9c401441a0 2023-11-20T06:43:07.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.983+0000 7f9c45402640 1 -- 172.21.15.19:0/2018371736 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c0ab980 con 0x7f9c401441a0 2023-11-20T06:43:07.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.987+0000 7f9c48668640 1 -- 172.21.15.19:0/2018371736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c401441a0 msgr2=0x7f9c400b1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:07.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.987+0000 7f9c48668640 1 --2- 172.21.15.19:0/2018371736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c401441a0 0x7f9c400b1550 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0097c0 tx=0x7f9c3c01c480 comp rx=0 tx=0).stop 2023-11-20T06:43:07.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.987+0000 7f9c48668640 1 -- 172.21.15.19:0/2018371736 shutdown_connections 2023-11-20T06:43:07.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.987+0000 7f9c48668640 1 --2- 172.21.15.19:0/2018371736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c400b1a90 0x7f9c400cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.987+0000 7f9c48668640 1 --2- 172.21.15.19:0/2018371736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c401441a0 0x7f9c400b1550 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.987+0000 7f9c48668640 1 -- 172.21.15.19:0/2018371736 >> 172.21.15.19:0/2018371736 conn(0x7f9c4006a820 msgr2=0x7f9c400b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:07.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.987+0000 7f9c48668640 1 -- 172.21.15.19:0/2018371736 shutdown_connections 2023-11-20T06:43:07.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.987+0000 7f9c48668640 1 -- 172.21.15.19:0/2018371736 wait complete. 2023-11-20T06:43:07.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.987+0000 7f9c48668640 1 Processor -- start 2023-11-20T06:43:07.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.987+0000 7f9c48668640 1 -- start start 2023-11-20T06:43:07.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.987+0000 7f9c48668640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c400b1a90 0x7f9c40139170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:07.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.987+0000 7f9c48668640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c400cb360 0x7f9c401396b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:07.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.987+0000 7f9c48668640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c401441a0 0x7f9c40155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:07.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.987+0000 7f9c48668640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c40140570 con 0x7f9c401441a0 2023-11-20T06:43:07.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.987+0000 7f9c48668640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c40158770 con 0x7f9c400cb360 2023-11-20T06:43:07.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.987+0000 7f9c48668640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c40158a20 con 0x7f9c400b1a90 2023-11-20T06:43:07.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.987+0000 7f9c46c05640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c401441a0 0x7f9c40155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:07.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.987+0000 7f9c46c05640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c401441a0 0x7f9c40155440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51760/0 (socket says 172.21.15.19:51760) 2023-11-20T06:43:07.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.987+0000 7f9c46c05640 1 -- 172.21.15.19:0/3388664776 learned_addr learned my addr 172.21.15.19:0/3388664776 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:07.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.987+0000 7f9c46404640 1 --2- 172.21.15.19:0/3388664776 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c400b1a90 0x7f9c40139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:07.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.991+0000 7f9c45c03640 1 --2- 172.21.15.19:0/3388664776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c400cb360 0x7f9c401396b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:07.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.991+0000 7f9c46c05640 1 -- 172.21.15.19:0/3388664776 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c400b1a90 msgr2=0x7f9c40139170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:07.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.991+0000 7f9c46c05640 1 --2- 172.21.15.19:0/3388664776 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c400b1a90 0x7f9c40139170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.991+0000 7f9c46c05640 1 -- 172.21.15.19:0/3388664776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c400cb360 msgr2=0x7f9c401396b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:07.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.991+0000 7f9c46c05640 1 --2- 172.21.15.19:0/3388664776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c400cb360 0x7f9c401396b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:07.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.991+0000 7f9c46c05640 1 -- 172.21.15.19:0/3388664776 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c009420 con 0x7f9c401441a0 2023-11-20T06:43:07.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.991+0000 7f9c46c05640 1 --2- 172.21.15.19:0/3388664776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c401441a0 0x7f9c40155440 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9c38001570 tx=0x7f9c3800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:07.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.991+0000 7f9c36ffd640 1 -- 172.21.15.19:0/3388664776 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3800a640 con 0x7f9c401441a0 2023-11-20T06:43:07.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.991+0000 7f9c36ffd640 1 -- 172.21.15.19:0/3388664776 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3800a7c0 con 0x7f9c401441a0 2023-11-20T06:43:07.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.991+0000 7f9c48668640 1 -- 172.21.15.19:0/3388664776 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c40158d00 con 0x7f9c401441a0 2023-11-20T06:43:08.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.991+0000 7f9c36ffd640 1 -- 172.21.15.19:0/3388664776 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3800ab70 con 0x7f9c401441a0 2023-11-20T06:43:08.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.991+0000 7f9c48668640 1 -- 172.21.15.19:0/3388664776 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c401592c0 con 0x7f9c401441a0 2023-11-20T06:43:08.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.991+0000 7f9c48668640 1 -- 172.21.15.19:0/3388664776 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9c400c9fd0 con 0x7f9c401441a0 2023-11-20T06:43:08.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.991+0000 7f9c36ffd640 1 -- 172.21.15.19:0/3388664776 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9c3800acd0 con 0x7f9c401441a0 2023-11-20T06:43:08.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.991+0000 7f9c36ffd640 1 --2- 172.21.15.19:0/3388664776 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c240664a0 0x7f9c24068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:08.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.991+0000 7f9c36ffd640 1 -- 172.21.15.19:0/3388664776 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f9c380839b0 con 0x7f9c401441a0 2023-11-20T06:43:08.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.995+0000 7f9c36ffd640 1 --2- 172.21.15.19:0/3388664776 >> [v2:172.21.15.19:6800/2544072609,v1:172.21.15.19:6801/2544072609] conn(0x7f9c2406c7a0 0x7f9c2406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:08.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.995+0000 7f9c36ffd640 1 -- 172.21.15.19:0/3388664776 --> [v2:172.21.15.19:6800/2544072609,v1:172.21.15.19:6801/2544072609] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c2406f2b0 con 0x7f9c2406c7a0 2023-11-20T06:43:08.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.995+0000 7f9c36ffd640 1 -- 172.21.15.19:0/3388664776 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c38083d20 con 0x7f9c401441a0 2023-11-20T06:43:08.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.995+0000 7f9c46404640 1 --2- 172.21.15.19:0/3388664776 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c240664a0 0x7f9c24068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:08.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.995+0000 7f9c45c03640 1 --2- 172.21.15.19:0/3388664776 >> [v2:172.21.15.19:6800/2544072609,v1:172.21.15.19:6801/2544072609] conn(0x7f9c2406c7a0 0x7f9c2406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:08.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.995+0000 7f9c45c03640 1 --2- 172.21.15.19:0/3388664776 >> [v2:172.21.15.19:6800/2544072609,v1:172.21.15.19:6801/2544072609] conn(0x7f9c2406c7a0 0x7f9c2406ebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:08.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.995+0000 7f9c46404640 1 --2- 172.21.15.19:0/3388664776 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c240664a0 0x7f9c24068960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0ad000 tx=0x7f9c3c0a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:08.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:07.995+0000 7f9c36ffd640 1 -- 172.21.15.19:0/3388664776 <== osd.1 v2:172.21.15.19:6800/2544072609 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f9c2406f2b0 con 0x7f9c2406c7a0 2023-11-20T06:43:08.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.007+0000 7f9c48668640 1 -- 172.21.15.19:0/3388664776 --> [v2:172.21.15.19:6800/2544072609,v1:172.21.15.19:6801/2544072609] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9c4004e170 con 0x7f9c2406c7a0 2023-11-20T06:43:08.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.007+0000 7f9c36ffd640 1 -- 172.21.15.19:0/3388664776 <== osd.1 v2:172.21.15.19:6800/2544072609 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9c4004e170 con 0x7f9c2406c7a0 2023-11-20T06:43:08.014 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-20T06:43:08.014 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-20T06:43:08.014 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-20T06:43:08.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.007+0000 7f9c48668640 1 -- 172.21.15.19:0/3388664776 >> [v2:172.21.15.19:6800/2544072609,v1:172.21.15.19:6801/2544072609] conn(0x7f9c2406c7a0 msgr2=0x7f9c2406ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.007+0000 7f9c48668640 1 --2- 172.21.15.19:0/3388664776 >> [v2:172.21.15.19:6800/2544072609,v1:172.21.15.19:6801/2544072609] conn(0x7f9c2406c7a0 0x7f9c2406ebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.007+0000 7f9c48668640 1 -- 172.21.15.19:0/3388664776 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c240664a0 msgr2=0x7f9c24068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.007+0000 7f9c48668640 1 --2- 172.21.15.19:0/3388664776 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f9c240664a0 0x7f9c24068960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0ad000 tx=0x7f9c3c0a6000 comp rx=0 tx=0).stop 2023-11-20T06:43:08.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.007+0000 7f9c48668640 1 -- 172.21.15.19:0/3388664776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c401441a0 msgr2=0x7f9c40155440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.007+0000 7f9c48668640 1 --2- 172.21.15.19:0/3388664776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c401441a0 0x7f9c40155440 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9c38001570 tx=0x7f9c3800cca0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.007+0000 7f9c46c05640 1 -- 172.21.15.19:0/3388664776 reap_dead start 2023-11-20T06:43:08.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.007+0000 7f9c48668640 1 -- 172.21.15.19:0/3388664776 shutdown_connections 2023-11-20T06:43:08.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.007+0000 7f9c48668640 1 -- 172.21.15.19:0/3388664776 >> 172.21.15.19:0/3388664776 conn(0x7f9c4006a820 msgr2=0x7f9c40157680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:08.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.007+0000 7f9c48668640 1 -- 172.21.15.19:0/3388664776 shutdown_connections 2023-11-20T06:43:08.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.007+0000 7f9c48668640 1 -- 172.21.15.19:0/3388664776 wait complete. 2023-11-20T06:43:08.032 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-20T06:43:08.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.171+0000 7f14ada68640 1 Processor -- start 2023-11-20T06:43:08.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.171+0000 7f14ada68640 1 -- start start 2023-11-20T06:43:08.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.171+0000 7f14ada68640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a81597c0 0x7f14a80ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:08.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.171+0000 7f14ada68640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f14a80adc10 0x7f14a80cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:08.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.171+0000 7f14ada68640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a80723d0 con 0x7f14a8159ba0 2023-11-20T06:43:08.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.171+0000 7f14ada68640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a80717c0 con 0x7f14a80adc10 2023-11-20T06:43:08.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.171+0000 7f14ada68640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a8071aa0 con 0x7f14a81597c0 2023-11-20T06:43:08.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.171+0000 7f14a7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f14a80adc10 0x7f14a80cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:08.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.171+0000 7f14a7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f14a80adc10 0x7f14a80cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51770/0 (socket says 172.21.15.19:51770) 2023-11-20T06:43:08.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.171+0000 7f14a7fff640 1 -- 172.21.15.19:0/1060378515 learned_addr learned my addr 172.21.15.19:0/1060378515 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:08.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.175+0000 7f14a77fe640 1 --2- 172.21.15.19:0/1060378515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a81597c0 0x7f14a80ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:08.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.175+0000 7f14a7fff640 1 -- 172.21.15.19:0/1060378515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a81597c0 msgr2=0x7f14a80ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:08.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.175+0000 7f14a7fff640 1 --2- 172.21.15.19:0/1060378515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a81597c0 0x7f14a80ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.175+0000 7f14a7fff640 1 -- 172.21.15.19:0/1060378515 >> v1:172.21.15.190:6789/0 conn(0x7f14a8159ba0 legacy=0x7f14a80cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.175+0000 7f14a7fff640 1 -- 172.21.15.19:0/1060378515 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a8071d80 con 0x7f14a80adc10 2023-11-20T06:43:08.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.175+0000 7f14a77fe640 1 --2- 172.21.15.19:0/1060378515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a81597c0 0x7f14a80ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:43:08.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.175+0000 7f14a7fff640 1 --2- 172.21.15.19:0/1060378515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14a80adc10 0x7f14a80cb520 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f14a000d150 tx=0x7f14a001ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b376416763c38a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:08.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.175+0000 7f14a67fc640 1 -- 172.21.15.19:0/1060378515 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a000b2d0 con 0x7f14a80adc10 2023-11-20T06:43:08.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.175+0000 7f14a67fc640 1 -- 172.21.15.19:0/1060378515 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a000b430 con 0x7f14a80adc10 2023-11-20T06:43:08.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.175+0000 7f14a67fc640 1 -- 172.21.15.19:0/1060378515 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a00a7ca0 con 0x7f14a80adc10 2023-11-20T06:43:08.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.175+0000 7f14ada68640 1 -- 172.21.15.19:0/1060378515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14a80adc10 msgr2=0x7f14a80cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.175+0000 7f14ada68640 1 --2- 172.21.15.19:0/1060378515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14a80adc10 0x7f14a80cb520 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f14a000d150 tx=0x7f14a001ec10 comp rx=0 tx=0).stop 2023-11-20T06:43:08.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14ada68640 1 -- 172.21.15.19:0/1060378515 shutdown_connections 2023-11-20T06:43:08.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14ada68640 1 --2- 172.21.15.19:0/1060378515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14a80adc10 0x7f14a80cb520 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14ada68640 1 --2- 172.21.15.19:0/1060378515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a81597c0 0x7f14a80ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14ada68640 1 -- 172.21.15.19:0/1060378515 >> 172.21.15.19:0/1060378515 conn(0x7f14a806c190 msgr2=0x7f14a806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:08.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14ada68640 1 -- 172.21.15.19:0/1060378515 shutdown_connections 2023-11-20T06:43:08.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14ada68640 1 -- 172.21.15.19:0/1060378515 wait complete. 2023-11-20T06:43:08.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14ada68640 1 Processor -- start 2023-11-20T06:43:08.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14ada68640 1 -- start start 2023-11-20T06:43:08.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14ada68640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14a80adc10 0x7f14a8153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:08.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14ada68640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14a81597c0 0x7f14a8152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:08.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14ada68640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a8159ba0 0x7f14a814ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:08.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14ada68640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a8155800 con 0x7f14a80adc10 2023-11-20T06:43:08.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14ada68640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a8152550 con 0x7f14a81597c0 2023-11-20T06:43:08.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14ada68640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a815a310 con 0x7f14a8159ba0 2023-11-20T06:43:08.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14a77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14a80adc10 0x7f14a8153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:08.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14a77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14a80adc10 0x7f14a8153840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51772/0 (socket says 172.21.15.19:51772) 2023-11-20T06:43:08.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14a77fe640 1 -- 172.21.15.19:0/2022143500 learned_addr learned my addr 172.21.15.19:0/2022143500 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:08.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14a7fff640 1 --2- 172.21.15.19:0/2022143500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a8159ba0 0x7f14a814ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:08.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14a6ffd640 1 --2- 172.21.15.19:0/2022143500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14a81597c0 0x7f14a8152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:08.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14a77fe640 1 -- 172.21.15.19:0/2022143500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a8159ba0 msgr2=0x7f14a814ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14a77fe640 1 --2- 172.21.15.19:0/2022143500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a8159ba0 0x7f14a814ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14a77fe640 1 -- 172.21.15.19:0/2022143500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14a81597c0 msgr2=0x7f14a8152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14a77fe640 1 --2- 172.21.15.19:0/2022143500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14a81597c0 0x7f14a8152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14a77fe640 1 -- 172.21.15.19:0/2022143500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a000bd40 con 0x7f14a80adc10 2023-11-20T06:43:08.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14a6ffd640 1 --2- 172.21.15.19:0/2022143500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14a81597c0 0x7f14a8152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:43:08.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.179+0000 7f14a77fe640 1 --2- 172.21.15.19:0/2022143500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14a80adc10 0x7f14a8153840 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f149800c7c0 tx=0x7f149800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:08.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.183+0000 7f148ffff640 1 -- 172.21.15.19:0/2022143500 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1498007a30 con 0x7f14a80adc10 2023-11-20T06:43:08.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.183+0000 7f148ffff640 1 -- 172.21.15.19:0/2022143500 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1498007b90 con 0x7f14a80adc10 2023-11-20T06:43:08.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.183+0000 7f148ffff640 1 -- 172.21.15.19:0/2022143500 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149800ce70 con 0x7f14a80adc10 2023-11-20T06:43:08.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.183+0000 7f14ada68640 1 -- 172.21.15.19:0/2022143500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a8153ed0 con 0x7f14a80adc10 2023-11-20T06:43:08.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.183+0000 7f14ada68640 1 -- 172.21.15.19:0/2022143500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a8154490 con 0x7f14a80adc10 2023-11-20T06:43:08.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.183+0000 7f14ada68640 1 -- 172.21.15.19:0/2022143500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a815a4d0 con 0x7f14a80adc10 2023-11-20T06:43:08.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.183+0000 7f148ffff640 1 -- 172.21.15.19:0/2022143500 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f14980113f0 con 0x7f14a80adc10 2023-11-20T06:43:08.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.183+0000 7f148ffff640 1 --2- 172.21.15.19:0/2022143500 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f14940664a0 0x7f1494068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:08.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.183+0000 7f148ffff640 1 -- 172.21.15.19:0/2022143500 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1498084120 con 0x7f14a80adc10 2023-11-20T06:43:08.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.183+0000 7f14a6ffd640 1 --2- 172.21.15.19:0/2022143500 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f14940664a0 0x7f1494068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:08.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.187+0000 7f14a6ffd640 1 --2- 172.21.15.19:0/2022143500 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f14940664a0 0x7f1494068960 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f14a80aedf0 tx=0x7f149c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:08.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.187+0000 7f148ffff640 1 -- 172.21.15.19:0/2022143500 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1498051800 con 0x7f14a80adc10 2023-11-20T06:43:08.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.347+0000 7f14ada68640 1 -- 172.21.15.19:0/2022143500 --> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f14a8074010 con 0x7f14940664a0 2023-11-20T06:43:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.347+0000 7f148ffff640 1 -- 172.21.15.19:0/2022143500 <== mgr.4109 v2:172.21.15.190:6832/142426253 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f14a8074010 con 0x7f14940664a0 2023-11-20T06:43:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 1 to deep-scrub 2023-11-20T06:43:08.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.347+0000 7f14ada68640 1 -- 172.21.15.19:0/2022143500 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f14940664a0 msgr2=0x7f1494068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.347+0000 7f14ada68640 1 --2- 172.21.15.19:0/2022143500 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f14940664a0 0x7f1494068960 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f14a80aedf0 tx=0x7f149c009040 comp rx=0 tx=0).stop 2023-11-20T06:43:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.347+0000 7f14ada68640 1 -- 172.21.15.19:0/2022143500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14a80adc10 msgr2=0x7f14a8153840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.347+0000 7f14ada68640 1 --2- 172.21.15.19:0/2022143500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14a80adc10 0x7f14a8153840 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f149800c7c0 tx=0x7f149800cc80 comp rx=0 tx=0).stop 2023-11-20T06:43:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.347+0000 7f14ada68640 1 -- 172.21.15.19:0/2022143500 shutdown_connections 2023-11-20T06:43:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.347+0000 7f14ada68640 1 --2- 172.21.15.19:0/2022143500 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f14940664a0 0x7f1494068960 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.347+0000 7f14ada68640 1 --2- 172.21.15.19:0/2022143500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a8159ba0 0x7f14a814ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.347+0000 7f14ada68640 1 --2- 172.21.15.19:0/2022143500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14a81597c0 0x7f14a8152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.347+0000 7f14ada68640 1 --2- 172.21.15.19:0/2022143500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14a80adc10 0x7f14a8153840 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.347+0000 7f14ada68640 1 -- 172.21.15.19:0/2022143500 >> 172.21.15.19:0/2022143500 conn(0x7f14a806c190 msgr2=0x7f14a80cf090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:08.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.347+0000 7f14ada68640 1 -- 172.21.15.19:0/2022143500 shutdown_connections 2023-11-20T06:43:08.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.347+0000 7f14ada68640 1 -- 172.21.15.19:0/2022143500 wait complete. 2023-11-20T06:43:08.374 INFO:tasks.ceph:Scrubbing osd.2 2023-11-20T06:43:08.375 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-20T06:43:08.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.515+0000 7fa28c091640 1 Processor -- start 2023-11-20T06:43:08.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.515+0000 7fa28c091640 1 -- start start 2023-11-20T06:43:08.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.519+0000 7fa28c091640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2840cdc80 0x7fa2840cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:08.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.519+0000 7fa28c091640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2840ce460 con 0x7fa28415dec0 2023-11-20T06:43:08.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.519+0000 7fa28c091640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28415da30 con 0x7fa2840d2570 2023-11-20T06:43:08.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.519+0000 7fa28c091640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2840cd830 con 0x7fa2840cdc80 2023-11-20T06:43:08.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.519+0000 7fa28a62e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa28415dec0 0x7fa2840d0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42576/0 (socket says 172.21.15.19:42576) 2023-11-20T06:43:08.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.519+0000 7fa28a62e640 1 -- 172.21.15.19:0/4210317594 learned_addr learned my addr 172.21.15.19:0/4210317594 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:43:08.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.519+0000 7fa28962c640 1 --2- 172.21.15.19:0/4210317594 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2840cdc80 0x7fa2840cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:08.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.519+0000 7fa288e2b640 1 -- 172.21.15.19:0/4210317594 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485055512 0 0) 0x7fa2840ce460 con 0x7fa28415dec0 2023-11-20T06:43:08.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.519+0000 7fa288e2b640 1 -- 172.21.15.19:0/4210317594 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa270003530 con 0x7fa28415dec0 2023-11-20T06:43:08.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.519+0000 7fa288e2b640 1 -- 172.21.15.19:0/4210317594 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763065125 0 0) 0x7fa28415da30 con 0x7fa2840d2570 2023-11-20T06:43:08.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.519+0000 7fa288e2b640 1 -- 172.21.15.19:0/4210317594 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2840ce460 con 0x7fa2840d2570 2023-11-20T06:43:08.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.519+0000 7fa28962c640 1 -- 172.21.15.19:0/4210317594 >> v1:172.21.15.190:6789/0 conn(0x7fa2840d2570 legacy=0x7fa284161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.519+0000 7fa288e2b640 1 -- 172.21.15.19:0/4210317594 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3022707841 0 0) 0x7fa270003530 con 0x7fa28415dec0 2023-11-20T06:43:08.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.519+0000 7fa28962c640 1 -- 172.21.15.19:0/4210317594 >> v1:172.21.15.19:6789/0 conn(0x7fa28415dec0 legacy=0x7fa2840d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.519+0000 7fa28962c640 1 -- 172.21.15.19:0/4210317594 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2840ce180 con 0x7fa2840cdc80 2023-11-20T06:43:08.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.523+0000 7fa28962c640 1 --2- 172.21.15.19:0/4210317594 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2840cdc80 0x7fa2840cf610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa2740097f0 tx=0x7fa27401c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1c94116207e7a09 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:08.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.523+0000 7fa288e2b640 1 -- 172.21.15.19:0/4210317594 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c001a00 con 0x7fa2840cdc80 2023-11-20T06:43:08.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.523+0000 7fa288e2b640 1 -- 172.21.15.19:0/4210317594 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2740a7050 con 0x7fa2840cdc80 2023-11-20T06:43:08.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.523+0000 7fa288e2b640 1 -- 172.21.15.19:0/4210317594 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2740ab620 con 0x7fa2840cdc80 2023-11-20T06:43:08.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.523+0000 7fa28c091640 1 -- 172.21.15.19:0/4210317594 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2840cdc80 msgr2=0x7fa2840cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.523+0000 7fa28c091640 1 --2- 172.21.15.19:0/4210317594 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2840cdc80 0x7fa2840cf610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa2740097f0 tx=0x7fa27401c3b0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.523+0000 7fa28c091640 1 -- 172.21.15.19:0/4210317594 shutdown_connections 2023-11-20T06:43:08.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.523+0000 7fa28c091640 1 --2- 172.21.15.19:0/4210317594 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2840cdc80 0x7fa2840cf610 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.523+0000 7fa28c091640 1 -- 172.21.15.19:0/4210317594 >> 172.21.15.19:0/4210317594 conn(0x7fa2840715c0 msgr2=0x7fa2840719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:08.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.523+0000 7fa28c091640 1 -- 172.21.15.19:0/4210317594 shutdown_connections 2023-11-20T06:43:08.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.523+0000 7fa28c091640 1 -- 172.21.15.19:0/4210317594 wait complete. 2023-11-20T06:43:08.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.523+0000 7fa28c091640 1 Processor -- start 2023-11-20T06:43:08.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.523+0000 7fa28c091640 1 -- start start 2023-11-20T06:43:08.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa28c091640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2840cdc80 0x7fa2840c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:08.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa28c091640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2840d2570 0x7fa284157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:08.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa28c091640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa28415dec0 0x7fa2840c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:08.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa28c091640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2840ccb30 con 0x7fa2840d2570 2023-11-20T06:43:08.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa28c091640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2841531d0 con 0x7fa28415dec0 2023-11-20T06:43:08.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa28c091640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2841575d0 con 0x7fa2840cdc80 2023-11-20T06:43:08.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa28962c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2840d2570 0x7fa284157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:08.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa28962c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2840d2570 0x7fa284157090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51780/0 (socket says 172.21.15.19:51780) 2023-11-20T06:43:08.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa28962c640 1 -- 172.21.15.19:0/146247818 learned_addr learned my addr 172.21.15.19:0/146247818 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:08.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa28a62e640 1 --2- 172.21.15.19:0/146247818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa28415dec0 0x7fa2840c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:08.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa289e2d640 1 --2- 172.21.15.19:0/146247818 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2840cdc80 0x7fa2840c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:08.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa28962c640 1 -- 172.21.15.19:0/146247818 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2840cdc80 msgr2=0x7fa2840c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa28962c640 1 --2- 172.21.15.19:0/146247818 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2840cdc80 0x7fa2840c7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa28962c640 1 -- 172.21.15.19:0/146247818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa28415dec0 msgr2=0x7fa2840c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa28962c640 1 --2- 172.21.15.19:0/146247818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa28415dec0 0x7fa2840c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa28962c640 1 -- 172.21.15.19:0/146247818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa274009420 con 0x7fa2840d2570 2023-11-20T06:43:08.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa28962c640 1 --2- 172.21.15.19:0/146247818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2840d2570 0x7fa284157090 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa2740ae040 tx=0x7fa274019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:08.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa27a7fc640 1 -- 172.21.15.19:0/146247818 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa274004030 con 0x7fa2840d2570 2023-11-20T06:43:08.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa27a7fc640 1 -- 172.21.15.19:0/146247818 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa274004190 con 0x7fa2840d2570 2023-11-20T06:43:08.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa28c091640 1 -- 172.21.15.19:0/146247818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2840cc500 con 0x7fa2840d2570 2023-11-20T06:43:08.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa27a7fc640 1 -- 172.21.15.19:0/146247818 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa274004520 con 0x7fa2840d2570 2023-11-20T06:43:08.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa28c091640 1 -- 172.21.15.19:0/146247818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2840c8600 con 0x7fa2840d2570 2023-11-20T06:43:08.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa28c091640 1 -- 172.21.15.19:0/146247818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa2840d2950 con 0x7fa2840d2570 2023-11-20T06:43:08.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.527+0000 7fa27a7fc640 1 -- 172.21.15.19:0/146247818 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa2740b2040 con 0x7fa2840d2570 2023-11-20T06:43:08.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.531+0000 7fa27a7fc640 1 --2- 172.21.15.19:0/146247818 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa2680664f0 0x7fa2680689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:08.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.531+0000 7fa27a7fc640 1 -- 172.21.15.19:0/146247818 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa27411dfe0 con 0x7fa2840d2570 2023-11-20T06:43:08.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.531+0000 7fa27a7fc640 1 --2- 172.21.15.19:0/146247818 >> [v2:172.21.15.19:6808/427773025,v1:172.21.15.19:6809/427773025] conn(0x7fa26806c680 0x7fa26806eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:08.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.531+0000 7fa27a7fc640 1 -- 172.21.15.19:0/146247818 --> [v2:172.21.15.19:6808/427773025,v1:172.21.15.19:6809/427773025] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa26806f190 con 0x7fa26806c680 2023-11-20T06:43:08.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.531+0000 7fa27a7fc640 1 -- 172.21.15.19:0/146247818 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa27411e3d0 con 0x7fa2840d2570 2023-11-20T06:43:08.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.531+0000 7fa289e2d640 1 --2- 172.21.15.19:0/146247818 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa2680664f0 0x7fa2680689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:08.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.531+0000 7fa28a62e640 1 --2- 172.21.15.19:0/146247818 >> [v2:172.21.15.19:6808/427773025,v1:172.21.15.19:6809/427773025] conn(0x7fa26806c680 0x7fa26806eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:08.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.531+0000 7fa28a62e640 1 --2- 172.21.15.19:0/146247818 >> [v2:172.21.15.19:6808/427773025,v1:172.21.15.19:6809/427773025] conn(0x7fa26806c680 0x7fa26806eac0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:08.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.531+0000 7fa289e2d640 1 --2- 172.21.15.19:0/146247818 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa2680664f0 0x7fa2680689b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa2800011f0 tx=0x7fa280009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:08.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.531+0000 7fa27a7fc640 1 -- 172.21.15.19:0/146247818 <== osd.2 v2:172.21.15.19:6808/427773025 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa26806f190 con 0x7fa26806c680 2023-11-20T06:43:08.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.543+0000 7fa28c091640 1 -- 172.21.15.19:0/146247818 --> [v2:172.21.15.19:6808/427773025,v1:172.21.15.19:6809/427773025] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa2840ccc70 con 0x7fa26806c680 2023-11-20T06:43:08.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.543+0000 7fa27a7fc640 1 -- 172.21.15.19:0/146247818 <== osd.2 v2:172.21.15.19:6808/427773025 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa2840ccc70 con 0x7fa26806c680 2023-11-20T06:43:08.551 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-20T06:43:08.551 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-20T06:43:08.551 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-20T06:43:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.543+0000 7fa28c091640 1 -- 172.21.15.19:0/146247818 >> [v2:172.21.15.19:6808/427773025,v1:172.21.15.19:6809/427773025] conn(0x7fa26806c680 msgr2=0x7fa26806eac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.543+0000 7fa28c091640 1 --2- 172.21.15.19:0/146247818 >> [v2:172.21.15.19:6808/427773025,v1:172.21.15.19:6809/427773025] conn(0x7fa26806c680 0x7fa26806eac0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.543+0000 7fa28c091640 1 -- 172.21.15.19:0/146247818 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa2680664f0 msgr2=0x7fa2680689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.543+0000 7fa28c091640 1 --2- 172.21.15.19:0/146247818 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa2680664f0 0x7fa2680689b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa2800011f0 tx=0x7fa280009040 comp rx=0 tx=0).stop 2023-11-20T06:43:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.543+0000 7fa28c091640 1 -- 172.21.15.19:0/146247818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2840d2570 msgr2=0x7fa284157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.547+0000 7fa28c091640 1 --2- 172.21.15.19:0/146247818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2840d2570 0x7fa284157090 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa2740ae040 tx=0x7fa274019150 comp rx=0 tx=0).stop 2023-11-20T06:43:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.547+0000 7fa28a62e640 1 -- 172.21.15.19:0/146247818 reap_dead start 2023-11-20T06:43:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.547+0000 7fa28c091640 1 -- 172.21.15.19:0/146247818 shutdown_connections 2023-11-20T06:43:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.547+0000 7fa28c091640 1 -- 172.21.15.19:0/146247818 >> 172.21.15.19:0/146247818 conn(0x7fa2840715c0 msgr2=0x7fa28415eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.547+0000 7fa28c091640 1 -- 172.21.15.19:0/146247818 shutdown_connections 2023-11-20T06:43:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.547+0000 7fa28c091640 1 -- 172.21.15.19:0/146247818 wait complete. 2023-11-20T06:43:08.569 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-20T06:43:08.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.707+0000 7fd684479640 1 Processor -- start 2023-11-20T06:43:08.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.707+0000 7fd684479640 1 -- start start 2023-11-20T06:43:08.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.707+0000 7fd684479640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd67c070c40 0x7fd67c15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:08.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.707+0000 7fd684479640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd67c0b4020 0x7fd67c0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:08.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.707+0000 7fd684479640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd67c15be60 con 0x7fd67c0b0620 2023-11-20T06:43:08.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.707+0000 7fd684479640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67c15b3b0 con 0x7fd67c0b4020 2023-11-20T06:43:08.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.707+0000 7fd684479640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c0b0a90 con 0x7fd67c070c40 2023-11-20T06:43:08.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.707+0000 7fd681a14640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd67c0b4020 0x7fd67c0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:08.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.707+0000 7fd681a14640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd67c0b4020 0x7fd67c0b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:44712/0 (socket says 172.21.15.19:44712) 2023-11-20T06:43:08.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.707+0000 7fd681a14640 1 -- 172.21.15.19:0/3240367977 learned_addr learned my addr 172.21.15.19:0/3240367977 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:08.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.707+0000 7fd682215640 1 --2- 172.21.15.19:0/3240367977 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd67c070c40 0x7fd67c15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:08.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.707+0000 7fd681a14640 1 -- 172.21.15.19:0/3240367977 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd67c070c40 msgr2=0x7fd67c15ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:08.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.707+0000 7fd681a14640 1 --2- 172.21.15.19:0/3240367977 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd67c070c40 0x7fd67c15ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.707+0000 7fd681a14640 1 -- 172.21.15.19:0/3240367977 >> v1:172.21.15.190:6789/0 conn(0x7fd67c0b0620 legacy=0x7fd67c15c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.707+0000 7fd681a14640 1 -- 172.21.15.19:0/3240367977 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c15c1f0 con 0x7fd67c0b4020 2023-11-20T06:43:08.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.711+0000 7fd681a14640 1 --2- 172.21.15.19:0/3240367977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd67c0b4020 0x7fd67c0b00e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009870 tx=0x7fd66c01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b84bcfcb9141fd8e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:08.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.711+0000 7fd681213640 1 -- 172.21.15.19:0/3240367977 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c0aa610 con 0x7fd67c0b4020 2023-11-20T06:43:08.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.711+0000 7fd681213640 1 -- 172.21.15.19:0/3240367977 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66c0a6040 con 0x7fd67c0b4020 2023-11-20T06:43:08.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.711+0000 7fd681213640 1 -- 172.21.15.19:0/3240367977 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c0aa990 con 0x7fd67c0b4020 2023-11-20T06:43:08.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.711+0000 7fd684479640 1 -- 172.21.15.19:0/3240367977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd67c0b4020 msgr2=0x7fd67c0b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.711+0000 7fd684479640 1 --2- 172.21.15.19:0/3240367977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd67c0b4020 0x7fd67c0b00e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009870 tx=0x7fd66c01c4b0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.711+0000 7fd684479640 1 -- 172.21.15.19:0/3240367977 shutdown_connections 2023-11-20T06:43:08.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.711+0000 7fd684479640 1 --2- 172.21.15.19:0/3240367977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd67c0b4020 0x7fd67c0b00e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.711+0000 7fd684479640 1 --2- 172.21.15.19:0/3240367977 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd67c070c40 0x7fd67c15ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.711+0000 7fd684479640 1 -- 172.21.15.19:0/3240367977 >> 172.21.15.19:0/3240367977 conn(0x7fd67c06c190 msgr2=0x7fd67c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:08.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.711+0000 7fd684479640 1 -- 172.21.15.19:0/3240367977 shutdown_connections 2023-11-20T06:43:08.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.711+0000 7fd684479640 1 -- 172.21.15.19:0/3240367977 wait complete. 2023-11-20T06:43:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd684479640 1 Processor -- start 2023-11-20T06:43:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd684479640 1 -- start start 2023-11-20T06:43:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd684479640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd67c070c40 0x7fd67c1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:08.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd684479640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd67c0b0620 0x7fd67c14b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:08.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd684479640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd67c0b4020 0x7fd67c1549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:08.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd684479640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c1550c0 con 0x7fd67c0b4020 2023-11-20T06:43:08.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd684479640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c152ef0 con 0x7fd67c0b0620 2023-11-20T06:43:08.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd684479640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c1531d0 con 0x7fd67c070c40 2023-11-20T06:43:08.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd682a16640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd67c0b4020 0x7fd67c1549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:08.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd682a16640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd67c0b4020 0x7fd67c1549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51796/0 (socket says 172.21.15.19:51796) 2023-11-20T06:43:08.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd682a16640 1 -- 172.21.15.19:0/3965131360 learned_addr learned my addr 172.21.15.19:0/3965131360 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:08.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd681a14640 1 --2- 172.21.15.19:0/3965131360 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd67c0b0620 0x7fd67c14b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:08.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd682215640 1 --2- 172.21.15.19:0/3965131360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd67c070c40 0x7fd67c1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:08.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd682a16640 1 -- 172.21.15.19:0/3965131360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd67c070c40 msgr2=0x7fd67c1524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd682a16640 1 --2- 172.21.15.19:0/3965131360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd67c070c40 0x7fd67c1524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd682a16640 1 -- 172.21.15.19:0/3965131360 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd67c0b0620 msgr2=0x7fd67c14b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd682a16640 1 --2- 172.21.15.19:0/3965131360 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd67c0b0620 0x7fd67c14b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd682a16640 1 -- 172.21.15.19:0/3965131360 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c0094d0 con 0x7fd67c0b4020 2023-11-20T06:43:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd682a16640 1 --2- 172.21.15.19:0/3965131360 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd67c0b4020 0x7fd67c1549e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd67400c6c0 tx=0x7fd67400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd672ffd640 1 -- 172.21.15.19:0/3965131360 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674003b80 con 0x7fd67c0b4020 2023-11-20T06:43:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd672ffd640 1 -- 172.21.15.19:0/3965131360 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd674003ce0 con 0x7fd67c0b4020 2023-11-20T06:43:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd684479640 1 -- 172.21.15.19:0/3965131360 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67c0ccd70 con 0x7fd67c0b4020 2023-11-20T06:43:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd672ffd640 1 -- 172.21.15.19:0/3965131360 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6740052f0 con 0x7fd67c0b4020 2023-11-20T06:43:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.715+0000 7fd684479640 1 -- 172.21.15.19:0/3965131360 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67c1534b0 con 0x7fd67c0b4020 2023-11-20T06:43:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.719+0000 7fd684479640 1 -- 172.21.15.19:0/3965131360 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd67c0ccfb0 con 0x7fd67c0b4020 2023-11-20T06:43:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.719+0000 7fd672ffd640 1 -- 172.21.15.19:0/3965131360 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd674005450 con 0x7fd67c0b4020 2023-11-20T06:43:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.719+0000 7fd672ffd640 1 --2- 172.21.15.19:0/3965131360 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd6600664a0 0x7fd660068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.719+0000 7fd672ffd640 1 -- 172.21.15.19:0/3965131360 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd674083910 con 0x7fd67c0b4020 2023-11-20T06:43:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.719+0000 7fd682215640 1 --2- 172.21.15.19:0/3965131360 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd6600664a0 0x7fd660068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.719+0000 7fd682215640 1 --2- 172.21.15.19:0/3965131360 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd6600664a0 0x7fd660068960 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd678009b60 tx=0x7fd678009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:08.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.723+0000 7fd672ffd640 1 -- 172.21.15.19:0/3965131360 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd67c0ccfb0 con 0x7fd67c0b4020 2023-11-20T06:43:08.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.879+0000 7fd684479640 1 -- 172.21.15.19:0/3965131360 --> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd67c153060 con 0x7fd6600664a0 2023-11-20T06:43:08.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.879+0000 7fd672ffd640 1 -- 172.21.15.19:0/3965131360 <== mgr.4109 v2:172.21.15.190:6832/142426253 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd67c153060 con 0x7fd6600664a0 2023-11-20T06:43:08.886 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 2 to deep-scrub 2023-11-20T06:43:08.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.883+0000 7fd684479640 1 -- 172.21.15.19:0/3965131360 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd6600664a0 msgr2=0x7fd660068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.883+0000 7fd684479640 1 --2- 172.21.15.19:0/3965131360 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd6600664a0 0x7fd660068960 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd678009b60 tx=0x7fd678009190 comp rx=0 tx=0).stop 2023-11-20T06:43:08.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.883+0000 7fd684479640 1 -- 172.21.15.19:0/3965131360 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd67c0b4020 msgr2=0x7fd67c1549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:08.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.883+0000 7fd684479640 1 --2- 172.21.15.19:0/3965131360 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd67c0b4020 0x7fd67c1549e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd67400c6c0 tx=0x7fd67400cb80 comp rx=0 tx=0).stop 2023-11-20T06:43:08.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.883+0000 7fd684479640 1 -- 172.21.15.19:0/3965131360 shutdown_connections 2023-11-20T06:43:08.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.883+0000 7fd684479640 1 --2- 172.21.15.19:0/3965131360 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd6600664a0 0x7fd660068960 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.883+0000 7fd684479640 1 --2- 172.21.15.19:0/3965131360 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd67c0b4020 0x7fd67c1549e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.883+0000 7fd684479640 1 --2- 172.21.15.19:0/3965131360 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd67c0b0620 0x7fd67c14b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.883+0000 7fd684479640 1 --2- 172.21.15.19:0/3965131360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd67c070c40 0x7fd67c1524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:08.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.883+0000 7fd684479640 1 -- 172.21.15.19:0/3965131360 >> 172.21.15.19:0/3965131360 conn(0x7fd67c06c190 msgr2=0x7fd67c0afea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:08.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.883+0000 7fd684479640 1 -- 172.21.15.19:0/3965131360 shutdown_connections 2023-11-20T06:43:08.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:08.883+0000 7fd684479640 1 -- 172.21.15.19:0/3965131360 wait complete. 2023-11-20T06:43:08.907 INFO:tasks.ceph:Scrubbing osd.3 2023-11-20T06:43:08.907 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-20T06:43:09.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.047+0000 7f0f7813e640 1 Processor -- start 2023-11-20T06:43:09.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.047+0000 7f0f7813e640 1 -- start start 2023-11-20T06:43:09.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.051+0000 7f0f7813e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f701441a0 0x7f0f700b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.051+0000 7f0f7813e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0f700b1a90 0x7f0f700cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.051+0000 7f0f7813e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0f700cb360 0x7f0f7006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.051+0000 7f0f7813e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f700b1ef0 con 0x7f0f700b1a90 2023-11-20T06:43:09.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.051+0000 7f0f7813e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7015e5f0 con 0x7f0f700cb360 2023-11-20T06:43:09.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.051+0000 7f0f7813e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7015e8d0 con 0x7f0f701441a0 2023-11-20T06:43:09.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.051+0000 7f0f756d9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0f700b1a90 0x7f0f700cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.051+0000 7f0f756d9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0f700b1a90 0x7f0f700cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51810/0 (socket says 172.21.15.19:51810) 2023-11-20T06:43:09.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.051+0000 7f0f756d9640 1 -- 172.21.15.19:0/3880556510 learned_addr learned my addr 172.21.15.19:0/3880556510 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:09.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.051+0000 7f0f766db640 1 --2- 172.21.15.19:0/3880556510 >> v2:172.21.15.190:3300/0 conn(0x7f0f700cb360 0x7f0f7006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.051+0000 7f0f75eda640 1 --2- 172.21.15.19:0/3880556510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f701441a0 0x7f0f700b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.051+0000 7f0f756d9640 1 -- 172.21.15.19:0/3880556510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f701441a0 msgr2=0x7f0f700b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:09.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.051+0000 7f0f756d9640 1 --2- 172.21.15.19:0/3880556510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f701441a0 0x7f0f700b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.051+0000 7f0f756d9640 1 -- 172.21.15.19:0/3880556510 >> v2:172.21.15.190:3300/0 conn(0x7f0f700cb360 msgr2=0x7f0f7006c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:09.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.051+0000 7f0f756d9640 1 --2- 172.21.15.19:0/3880556510 >> v2:172.21.15.190:3300/0 conn(0x7f0f700cb360 0x7f0f7006c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.051+0000 7f0f756d9640 1 -- 172.21.15.19:0/3880556510 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7015ebb0 con 0x7f0f700b1a90 2023-11-20T06:43:09.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.051+0000 7f0f766db640 1 --2- 172.21.15.19:0/3880556510 >> v2:172.21.15.190:3300/0 conn(0x7f0f700cb360 0x7f0f7006c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:43:09.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.055+0000 7f0f756d9640 1 --2- 172.21.15.19:0/3880556510 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f700b1a90 0x7f0f700cae20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0f7006d670 tx=0x7f0f6001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984e1f0d007b0887 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:09.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.055+0000 7f0f74ed8640 1 -- 172.21.15.19:0/3880556510 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f600ab600 con 0x7f0f700b1a90 2023-11-20T06:43:09.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.055+0000 7f0f74ed8640 1 -- 172.21.15.19:0/3880556510 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f600a7050 con 0x7f0f700b1a90 2023-11-20T06:43:09.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.055+0000 7f0f74ed8640 1 -- 172.21.15.19:0/3880556510 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f600ab980 con 0x7f0f700b1a90 2023-11-20T06:43:09.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.055+0000 7f0f7813e640 1 -- 172.21.15.19:0/3880556510 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f700b1a90 msgr2=0x7f0f700cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.055+0000 7f0f7813e640 1 --2- 172.21.15.19:0/3880556510 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f700b1a90 0x7f0f700cae20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0f7006d670 tx=0x7f0f6001c240 comp rx=0 tx=0).stop 2023-11-20T06:43:09.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.055+0000 7f0f7813e640 1 -- 172.21.15.19:0/3880556510 shutdown_connections 2023-11-20T06:43:09.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.055+0000 7f0f7813e640 1 --2- 172.21.15.19:0/3880556510 >> v2:172.21.15.190:3300/0 conn(0x7f0f700cb360 0x7f0f7006c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.055+0000 7f0f7813e640 1 --2- 172.21.15.19:0/3880556510 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f700b1a90 0x7f0f700cae20 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.055+0000 7f0f7813e640 1 --2- 172.21.15.19:0/3880556510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f701441a0 0x7f0f700b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.055+0000 7f0f7813e640 1 -- 172.21.15.19:0/3880556510 >> 172.21.15.19:0/3880556510 conn(0x7f0f7006a820 msgr2=0x7f0f700b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:09.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.055+0000 7f0f7813e640 1 -- 172.21.15.19:0/3880556510 shutdown_connections 2023-11-20T06:43:09.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.055+0000 7f0f7813e640 1 -- 172.21.15.19:0/3880556510 wait complete. 2023-11-20T06:43:09.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.055+0000 7f0f7813e640 1 Processor -- start 2023-11-20T06:43:09.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.055+0000 7f0f7813e640 1 -- start start 2023-11-20T06:43:09.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f7813e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f700b1a90 0x7f0f7015dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f7813e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f700cb360 0x7f0f70155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f7813e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f701441a0 0x7f0f701f8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f7813e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f701580e0 con 0x7f0f700cb360 2023-11-20T06:43:09.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f7813e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7015caf0 con 0x7f0f700b1a90 2023-11-20T06:43:09.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f7813e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7015cdd0 con 0x7f0f701441a0 2023-11-20T06:43:09.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f756d9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f700cb360 0x7f0f70155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f756d9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f700cb360 0x7f0f70155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51816/0 (socket says 172.21.15.19:51816) 2023-11-20T06:43:09.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f756d9640 1 -- 172.21.15.19:0/4224787131 learned_addr learned my addr 172.21.15.19:0/4224787131 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:09.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f75eda640 1 --2- 172.21.15.19:0/4224787131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f700b1a90 0x7f0f7015dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f766db640 1 --2- 172.21.15.19:0/4224787131 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f701441a0 0x7f0f701f8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f756d9640 1 -- 172.21.15.19:0/4224787131 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f701441a0 msgr2=0x7f0f701f8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f756d9640 1 --2- 172.21.15.19:0/4224787131 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f701441a0 0x7f0f701f8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f756d9640 1 -- 172.21.15.19:0/4224787131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f700b1a90 msgr2=0x7f0f7015dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f756d9640 1 --2- 172.21.15.19:0/4224787131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f700b1a90 0x7f0f7015dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f756d9640 1 -- 172.21.15.19:0/4224787131 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f600094d0 con 0x7f0f700cb360 2023-11-20T06:43:09.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f75eda640 1 --2- 172.21.15.19:0/4224787131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f700b1a90 0x7f0f7015dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:43:09.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f756d9640 1 --2- 172.21.15.19:0/4224787131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f700cb360 0x7f0f70155e00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0f600ae040 tx=0x7f0f60018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:09.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f667fc640 1 -- 172.21.15.19:0/4224787131 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f600b4440 con 0x7f0f700cb360 2023-11-20T06:43:09.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f667fc640 1 -- 172.21.15.19:0/4224787131 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f600b45a0 con 0x7f0f700cb360 2023-11-20T06:43:09.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f667fc640 1 -- 172.21.15.19:0/4224787131 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f600b4930 con 0x7f0f700cb360 2023-11-20T06:43:09.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f7813e640 1 -- 172.21.15.19:0/4224787131 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7015d0b0 con 0x7f0f700cb360 2023-11-20T06:43:09.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f7813e640 1 -- 172.21.15.19:0/4224787131 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7015c780 con 0x7f0f700cb360 2023-11-20T06:43:09.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f7813e640 1 -- 172.21.15.19:0/4224787131 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f700c8fc0 con 0x7f0f700cb360 2023-11-20T06:43:09.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.059+0000 7f0f667fc640 1 -- 172.21.15.19:0/4224787131 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0f600b2070 con 0x7f0f700cb360 2023-11-20T06:43:09.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.063+0000 7f0f667fc640 1 --2- 172.21.15.19:0/4224787131 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0f540664a0 0x7f0f54068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.063+0000 7f0f667fc640 1 -- 172.21.15.19:0/4224787131 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f0f6011dd60 con 0x7f0f700cb360 2023-11-20T06:43:09.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.063+0000 7f0f667fc640 1 --2- 172.21.15.19:0/4224787131 >> [v2:172.21.15.19:6824/2577618590,v1:172.21.15.19:6825/2577618590] conn(0x7f0f5406c7a0 0x7f0f5406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.063+0000 7f0f667fc640 1 -- 172.21.15.19:0/4224787131 --> [v2:172.21.15.19:6824/2577618590,v1:172.21.15.19:6825/2577618590] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f5406f2b0 con 0x7f0f5406c7a0 2023-11-20T06:43:09.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.063+0000 7f0f667fc640 1 -- 172.21.15.19:0/4224787131 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f60120340 con 0x7f0f700cb360 2023-11-20T06:43:09.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.063+0000 7f0f75eda640 1 --2- 172.21.15.19:0/4224787131 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0f540664a0 0x7f0f54068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.063+0000 7f0f766db640 1 --2- 172.21.15.19:0/4224787131 >> [v2:172.21.15.19:6824/2577618590,v1:172.21.15.19:6825/2577618590] conn(0x7f0f5406c7a0 0x7f0f5406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.063+0000 7f0f766db640 1 --2- 172.21.15.19:0/4224787131 >> [v2:172.21.15.19:6824/2577618590,v1:172.21.15.19:6825/2577618590] conn(0x7f0f5406c7a0 0x7f0f5406ebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:09.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.063+0000 7f0f75eda640 1 --2- 172.21.15.19:0/4224787131 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0f540664a0 0x7f0f54068960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00b9f0 tx=0x7f0f6c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:09.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.063+0000 7f0f667fc640 1 -- 172.21.15.19:0/4224787131 <== osd.3 v2:172.21.15.19:6824/2577618590 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f0f5406f2b0 con 0x7f0f5406c7a0 2023-11-20T06:43:09.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.075+0000 7f0f7813e640 1 -- 172.21.15.19:0/4224787131 --> [v2:172.21.15.19:6824/2577618590,v1:172.21.15.19:6825/2577618590] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0f70142050 con 0x7f0f5406c7a0 2023-11-20T06:43:09.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.075+0000 7f0f667fc640 1 -- 172.21.15.19:0/4224787131 <== osd.3 v2:172.21.15.19:6824/2577618590 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0f70142050 con 0x7f0f5406c7a0 2023-11-20T06:43:09.082 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-20T06:43:09.082 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-20T06:43:09.083 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-20T06:43:09.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.075+0000 7f0f7813e640 1 -- 172.21.15.19:0/4224787131 >> [v2:172.21.15.19:6824/2577618590,v1:172.21.15.19:6825/2577618590] conn(0x7f0f5406c7a0 msgr2=0x7f0f5406ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.075+0000 7f0f7813e640 1 --2- 172.21.15.19:0/4224787131 >> [v2:172.21.15.19:6824/2577618590,v1:172.21.15.19:6825/2577618590] conn(0x7f0f5406c7a0 0x7f0f5406ebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.075+0000 7f0f7813e640 1 -- 172.21.15.19:0/4224787131 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0f540664a0 msgr2=0x7f0f54068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.075+0000 7f0f7813e640 1 --2- 172.21.15.19:0/4224787131 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f0f540664a0 0x7f0f54068960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00b9f0 tx=0x7f0f6c008040 comp rx=0 tx=0).stop 2023-11-20T06:43:09.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.075+0000 7f0f7813e640 1 -- 172.21.15.19:0/4224787131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f700cb360 msgr2=0x7f0f70155e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.075+0000 7f0f7813e640 1 --2- 172.21.15.19:0/4224787131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f700cb360 0x7f0f70155e00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0f600ae040 tx=0x7f0f60018fe0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.075+0000 7f0f766db640 1 -- 172.21.15.19:0/4224787131 reap_dead start 2023-11-20T06:43:09.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.075+0000 7f0f7813e640 1 -- 172.21.15.19:0/4224787131 shutdown_connections 2023-11-20T06:43:09.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.075+0000 7f0f7813e640 1 -- 172.21.15.19:0/4224787131 >> 172.21.15.19:0/4224787131 conn(0x7f0f7006a820 msgr2=0x7f0f700715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:09.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.075+0000 7f0f7813e640 1 -- 172.21.15.19:0/4224787131 shutdown_connections 2023-11-20T06:43:09.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.075+0000 7f0f7813e640 1 -- 172.21.15.19:0/4224787131 wait complete. 2023-11-20T06:43:09.100 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-20T06:43:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.239+0000 7f35399aa640 1 Processor -- start 2023-11-20T06:43:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.239+0000 7f35399aa640 1 -- start start 2023-11-20T06:43:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.239+0000 7f35399aa640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f353415cb90 0x7f35340cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.239+0000 7f35399aa640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35340ce770 con 0x7f35340d15d0 2023-11-20T06:43:09.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.239+0000 7f35399aa640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35340d0600 con 0x7f35340d3010 2023-11-20T06:43:09.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.239+0000 7f35399aa640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35340c6450 con 0x7f353415cb90 2023-11-20T06:43:09.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.239+0000 7f3532ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f353415cb90 0x7f35340cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.239+0000 7f35337fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f35340d15d0 0x7f35340c6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42584/0 (socket says 172.21.15.19:42584) 2023-11-20T06:43:09.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.239+0000 7f35337fe640 1 -- 172.21.15.19:0/126004863 learned_addr learned my addr 172.21.15.19:0/126004863 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:43:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.243+0000 7f3532ffd640 1 -- 172.21.15.19:0/126004863 >> v1:172.21.15.190:6789/0 conn(0x7f35340d3010 legacy=0x7f35340d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.243+0000 7f3532ffd640 1 -- 172.21.15.19:0/126004863 >> v1:172.21.15.19:6789/0 conn(0x7f35340d15d0 legacy=0x7f35340c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.243+0000 7f3532ffd640 1 -- 172.21.15.19:0/126004863 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35340d08a0 con 0x7f353415cb90 2023-11-20T06:43:09.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.243+0000 7f3532ffd640 1 --2- 172.21.15.19:0/126004863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f353415cb90 0x7f35340cfb10 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f35240097b0 tx=0x7f352401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03ff929af010479 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.243+0000 7f35327fc640 1 -- 172.21.15.19:0/126004863 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35240ad680 con 0x7f353415cb90 2023-11-20T06:43:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.243+0000 7f35327fc640 1 -- 172.21.15.19:0/126004863 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35240ad7e0 con 0x7f353415cb90 2023-11-20T06:43:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.243+0000 7f35327fc640 1 -- 172.21.15.19:0/126004863 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35240adb70 con 0x7f353415cb90 2023-11-20T06:43:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.243+0000 7f35399aa640 1 -- 172.21.15.19:0/126004863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f353415cb90 msgr2=0x7f35340cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.243+0000 7f35399aa640 1 --2- 172.21.15.19:0/126004863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f353415cb90 0x7f35340cfb10 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f35240097b0 tx=0x7f352401c380 comp rx=0 tx=0).stop 2023-11-20T06:43:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.243+0000 7f35399aa640 1 -- 172.21.15.19:0/126004863 shutdown_connections 2023-11-20T06:43:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.243+0000 7f35399aa640 1 --2- 172.21.15.19:0/126004863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f353415cb90 0x7f35340cfb10 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.243+0000 7f35399aa640 1 -- 172.21.15.19:0/126004863 >> 172.21.15.19:0/126004863 conn(0x7f353409bc50 msgr2=0x7f35340d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:09.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f35399aa640 1 -- 172.21.15.19:0/126004863 shutdown_connections 2023-11-20T06:43:09.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f35399aa640 1 -- 172.21.15.19:0/126004863 wait complete. 2023-11-20T06:43:09.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f35399aa640 1 Processor -- start 2023-11-20T06:43:09.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f35399aa640 1 -- start start 2023-11-20T06:43:09.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f35399aa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35340d15d0 0x7f353414e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f35399aa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35340d3010 0x7f3534158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f35399aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f353415cb90 0x7f353415a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f35399aa640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35340b5860 con 0x7f35340d15d0 2023-11-20T06:43:09.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f35399aa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35340b5ab0 con 0x7f35340d3010 2023-11-20T06:43:09.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f35399aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35340b5d90 con 0x7f353415cb90 2023-11-20T06:43:09.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f3532ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35340d15d0 0x7f353414e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f3532ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35340d15d0 0x7f353414e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51824/0 (socket says 172.21.15.19:51824) 2023-11-20T06:43:09.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f3532ffd640 1 -- 172.21.15.19:0/1275702735 learned_addr learned my addr 172.21.15.19:0/1275702735 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:09.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f352bfff640 1 --2- 172.21.15.19:0/1275702735 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35340d3010 0x7f3534158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f35337fe640 1 --2- 172.21.15.19:0/1275702735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f353415cb90 0x7f353415a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f3532ffd640 1 -- 172.21.15.19:0/1275702735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f353415cb90 msgr2=0x7f353415a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f3532ffd640 1 --2- 172.21.15.19:0/1275702735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f353415cb90 0x7f353415a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f3532ffd640 1 -- 172.21.15.19:0/1275702735 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35340d3010 msgr2=0x7f3534158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f3532ffd640 1 --2- 172.21.15.19:0/1275702735 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35340d3010 0x7f3534158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f3532ffd640 1 -- 172.21.15.19:0/1275702735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35240093c0 con 0x7f35340d15d0 2023-11-20T06:43:09.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f352bfff640 1 --2- 172.21.15.19:0/1275702735 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35340d3010 0x7f3534158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:43:09.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f3532ffd640 1 --2- 172.21.15.19:0/1275702735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35340d15d0 0x7f353414e160 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3524018f90 tx=0x7f352401abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:09.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.247+0000 7f3530ff9640 1 -- 172.21.15.19:0/1275702735 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35240adea0 con 0x7f35340d15d0 2023-11-20T06:43:09.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.251+0000 7f3530ff9640 1 -- 172.21.15.19:0/1275702735 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35240b8420 con 0x7f35340d15d0 2023-11-20T06:43:09.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.251+0000 7f3530ff9640 1 -- 172.21.15.19:0/1275702735 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35240b87f0 con 0x7f35340d15d0 2023-11-20T06:43:09.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.251+0000 7f35399aa640 1 -- 172.21.15.19:0/1275702735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35340b6070 con 0x7f35340d15d0 2023-11-20T06:43:09.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.251+0000 7f35399aa640 1 -- 172.21.15.19:0/1275702735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353414e6a0 con 0x7f35340d15d0 2023-11-20T06:43:09.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.251+0000 7f35399aa640 1 -- 172.21.15.19:0/1275702735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3534074010 con 0x7f35340d15d0 2023-11-20T06:43:09.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.251+0000 7f3530ff9640 1 -- 172.21.15.19:0/1275702735 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f35240b4040 con 0x7f35340d15d0 2023-11-20T06:43:09.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.251+0000 7f3530ff9640 1 --2- 172.21.15.19:0/1275702735 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f35140664a0 0x7f3514068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.251+0000 7f3530ff9640 1 -- 172.21.15.19:0/1275702735 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f352411e310 con 0x7f35340d15d0 2023-11-20T06:43:09.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.251+0000 7f352bfff640 1 --2- 172.21.15.19:0/1275702735 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f35140664a0 0x7f3514068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.251+0000 7f352bfff640 1 --2- 172.21.15.19:0/1275702735 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f35140664a0 0x7f3514068960 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f35340ccc00 tx=0x7f351c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:09.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.255+0000 7f3530ff9640 1 -- 172.21.15.19:0/1275702735 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f35240eb940 con 0x7f35340d15d0 2023-11-20T06:43:09.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.415+0000 7f35399aa640 1 -- 172.21.15.19:0/1275702735 --> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f353415cf70 con 0x7f35140664a0 2023-11-20T06:43:09.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.419+0000 7f3530ff9640 1 -- 172.21.15.19:0/1275702735 <== mgr.4109 v2:172.21.15.190:6832/142426253 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f351c003ab0 con 0x7f35140664a0 2023-11-20T06:43:09.423 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 3 to deep-scrub 2023-11-20T06:43:09.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.419+0000 7f35399aa640 1 -- 172.21.15.19:0/1275702735 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f35140664a0 msgr2=0x7f3514068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.419+0000 7f35399aa640 1 --2- 172.21.15.19:0/1275702735 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f35140664a0 0x7f3514068960 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f35340ccc00 tx=0x7f351c009040 comp rx=0 tx=0).stop 2023-11-20T06:43:09.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.419+0000 7f35399aa640 1 -- 172.21.15.19:0/1275702735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35340d15d0 msgr2=0x7f353414e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.419+0000 7f35399aa640 1 --2- 172.21.15.19:0/1275702735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35340d15d0 0x7f353414e160 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3524018f90 tx=0x7f352401abc0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.419+0000 7f35399aa640 1 -- 172.21.15.19:0/1275702735 shutdown_connections 2023-11-20T06:43:09.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.419+0000 7f35399aa640 1 --2- 172.21.15.19:0/1275702735 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f35140664a0 0x7f3514068960 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.419+0000 7f35399aa640 1 --2- 172.21.15.19:0/1275702735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f353415cb90 0x7f353415a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.419+0000 7f35399aa640 1 --2- 172.21.15.19:0/1275702735 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35340d3010 0x7f3534158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.419+0000 7f35399aa640 1 --2- 172.21.15.19:0/1275702735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35340d15d0 0x7f353414e160 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.419+0000 7f35399aa640 1 -- 172.21.15.19:0/1275702735 >> 172.21.15.19:0/1275702735 conn(0x7f353409bc50 msgr2=0x7f35340c6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:09.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.419+0000 7f35399aa640 1 -- 172.21.15.19:0/1275702735 shutdown_connections 2023-11-20T06:43:09.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.419+0000 7f35399aa640 1 -- 172.21.15.19:0/1275702735 wait complete. 2023-11-20T06:43:09.444 INFO:tasks.ceph:Scrubbing osd.4 2023-11-20T06:43:09.445 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-20T06:43:09.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.587+0000 7f8524e05640 1 Processor -- start 2023-11-20T06:43:09.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.587+0000 7f8524e05640 1 -- start start 2023-11-20T06:43:09.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.587+0000 7f8524e05640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85200d2570 0x7f8520161210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.587+0000 7f8524e05640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85200ce460 con 0x7f85200cdc80 2023-11-20T06:43:09.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.587+0000 7f8524e05640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852015da30 con 0x7f85200cfd20 2023-11-20T06:43:09.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.587+0000 7f8524e05640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85200cd830 con 0x7f85200d2570 2023-11-20T06:43:09.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.587+0000 7f8517fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f85200cdc80 0x7f85200cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42594/0 (socket says 172.21.15.19:42594) 2023-11-20T06:43:09.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.587+0000 7f8517fff640 1 -- 172.21.15.19:0/4118779202 learned_addr learned my addr 172.21.15.19:0/4118779202 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:43:09.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.587+0000 7f851e59c640 1 --2- 172.21.15.19:0/4118779202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85200d2570 0x7f8520161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.587+0000 7f851dd9b640 1 -- 172.21.15.19:0/4118779202 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474573609 0 0) 0x7f85200ce460 con 0x7f85200cdc80 2023-11-20T06:43:09.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.587+0000 7f851dd9b640 1 -- 172.21.15.19:0/4118779202 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f850c003530 con 0x7f85200cdc80 2023-11-20T06:43:09.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.587+0000 7f851e59c640 1 -- 172.21.15.19:0/4118779202 >> v1:172.21.15.190:6789/0 conn(0x7f85200cfd20 legacy=0x7f85200d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.587+0000 7f851dd9b640 1 -- 172.21.15.19:0/4118779202 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 18039790 0 0) 0x7f852015da30 con 0x7f85200cfd20 2023-11-20T06:43:09.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.587+0000 7f851e59c640 1 -- 172.21.15.19:0/4118779202 >> v1:172.21.15.19:6789/0 conn(0x7f85200cdc80 legacy=0x7f85200cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.587+0000 7f851e59c640 1 -- 172.21.15.19:0/4118779202 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8520161750 con 0x7f85200d2570 2023-11-20T06:43:09.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.591+0000 7f851e59c640 1 --2- 172.21.15.19:0/4118779202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85200d2570 0x7f8520161210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f85100097f0 tx=0x7f851001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf30b99fb315598e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:09.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.591+0000 7f851dd9b640 1 -- 172.21.15.19:0/4118779202 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85100ac620 con 0x7f85200d2570 2023-11-20T06:43:09.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.591+0000 7f851dd9b640 1 -- 172.21.15.19:0/4118779202 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85100ac780 con 0x7f85200d2570 2023-11-20T06:43:09.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.591+0000 7f851dd9b640 1 -- 172.21.15.19:0/4118779202 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85100acaf0 con 0x7f85200d2570 2023-11-20T06:43:09.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.591+0000 7f8524e05640 1 -- 172.21.15.19:0/4118779202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85200d2570 msgr2=0x7f8520161210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.591+0000 7f8524e05640 1 --2- 172.21.15.19:0/4118779202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85200d2570 0x7f8520161210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f85100097f0 tx=0x7f851001c4b0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.591+0000 7f8524e05640 1 -- 172.21.15.19:0/4118779202 shutdown_connections 2023-11-20T06:43:09.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.591+0000 7f8524e05640 1 --2- 172.21.15.19:0/4118779202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85200d2570 0x7f8520161210 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.591+0000 7f8524e05640 1 -- 172.21.15.19:0/4118779202 >> 172.21.15.19:0/4118779202 conn(0x7f85200715c0 msgr2=0x7f85200719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:09.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f8524e05640 1 -- 172.21.15.19:0/4118779202 shutdown_connections 2023-11-20T06:43:09.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f8524e05640 1 -- 172.21.15.19:0/4118779202 wait complete. 2023-11-20T06:43:09.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f8524e05640 1 Processor -- start 2023-11-20T06:43:09.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f8524e05640 1 -- start start 2023-11-20T06:43:09.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f8524e05640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85200cdc80 0x7f8520144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f8524e05640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85200cfd20 0x7f8520157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f8524e05640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85200d2570 0x7f8520157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f8524e05640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8520144880 con 0x7f85200cdc80 2023-11-20T06:43:09.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f8524e05640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8520158400 con 0x7f85200d2570 2023-11-20T06:43:09.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f8524e05640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85201586e0 con 0x7f85200cfd20 2023-11-20T06:43:09.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f851e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85200cdc80 0x7f8520144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f851e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85200cdc80 0x7f8520144340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51832/0 (socket says 172.21.15.19:51832) 2023-11-20T06:43:09.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f851e59c640 1 -- 172.21.15.19:0/3787378331 learned_addr learned my addr 172.21.15.19:0/3787378331 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:09.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f851ed9d640 1 --2- 172.21.15.19:0/3787378331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85200d2570 0x7f8520157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f8517fff640 1 --2- 172.21.15.19:0/3787378331 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85200cfd20 0x7f8520157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f851e59c640 1 -- 172.21.15.19:0/3787378331 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85200cfd20 msgr2=0x7f8520157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f851e59c640 1 --2- 172.21.15.19:0/3787378331 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85200cfd20 0x7f8520157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f851e59c640 1 -- 172.21.15.19:0/3787378331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85200d2570 msgr2=0x7f8520157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f851e59c640 1 --2- 172.21.15.19:0/3787378331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85200d2570 0x7f8520157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f851e59c640 1 -- 172.21.15.19:0/3787378331 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8510009420 con 0x7f85200cdc80 2023-11-20T06:43:09.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.595+0000 7f851e59c640 1 --2- 172.21.15.19:0/3787378331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85200cdc80 0x7f8520144340 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f851001a0e0 tx=0x7f8510019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:09.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.599+0000 7f8516ffd640 1 -- 172.21.15.19:0/3787378331 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85100ac620 con 0x7f85200cdc80 2023-11-20T06:43:09.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.599+0000 7f8516ffd640 1 -- 172.21.15.19:0/3787378331 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85100b6410 con 0x7f85200cdc80 2023-11-20T06:43:09.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.599+0000 7f8524e05640 1 -- 172.21.15.19:0/3787378331 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85201589c0 con 0x7f85200cdc80 2023-11-20T06:43:09.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.599+0000 7f8516ffd640 1 -- 172.21.15.19:0/3787378331 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85100b6780 con 0x7f85200cdc80 2023-11-20T06:43:09.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.599+0000 7f8524e05640 1 -- 172.21.15.19:0/3787378331 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8520158f80 con 0x7f85200cdc80 2023-11-20T06:43:09.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.599+0000 7f8524e05640 1 -- 172.21.15.19:0/3787378331 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f85200d2950 con 0x7f85200cdc80 2023-11-20T06:43:09.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.599+0000 7f8516ffd640 1 -- 172.21.15.19:0/3787378331 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f85100b3050 con 0x7f85200cdc80 2023-11-20T06:43:09.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.599+0000 7f8516ffd640 1 --2- 172.21.15.19:0/3787378331 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f85000664a0 0x7f8500068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.599+0000 7f8516ffd640 1 -- 172.21.15.19:0/3787378331 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f851011e3e0 con 0x7f85200cdc80 2023-11-20T06:43:09.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.599+0000 7f8516ffd640 1 --2- 172.21.15.19:0/3787378331 >> [v2:172.21.15.190:6808/4085939700,v1:172.21.15.190:6809/4085939700] conn(0x7f850006c7a0 0x7f850006ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.599+0000 7f8516ffd640 1 -- 172.21.15.19:0/3787378331 --> [v2:172.21.15.190:6808/4085939700,v1:172.21.15.190:6809/4085939700] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f850006f2b0 con 0x7f850006c7a0 2023-11-20T06:43:09.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.599+0000 7f8516ffd640 1 -- 172.21.15.19:0/3787378331 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f851011e750 con 0x7f85200cdc80 2023-11-20T06:43:09.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.599+0000 7f8517fff640 1 --2- 172.21.15.19:0/3787378331 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f85000664a0 0x7f8500068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.599+0000 7f851ed9d640 1 --2- 172.21.15.19:0/3787378331 >> [v2:172.21.15.190:6808/4085939700,v1:172.21.15.190:6809/4085939700] conn(0x7f850006c7a0 0x7f850006ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.603+0000 7f8517fff640 1 --2- 172.21.15.19:0/3787378331 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f85000664a0 0x7f8500068960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8508007fd0 tx=0x7f8508009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:09.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.603+0000 7f851ed9d640 1 --2- 172.21.15.19:0/3787378331 >> [v2:172.21.15.190:6808/4085939700,v1:172.21.15.190:6809/4085939700] conn(0x7f850006c7a0 0x7f850006ebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:09.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.603+0000 7f8516ffd640 1 -- 172.21.15.19:0/3787378331 <== osd.4 v2:172.21.15.190:6808/4085939700 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f850006f2b0 con 0x7f850006c7a0 2023-11-20T06:43:09.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.615+0000 7f8524e05640 1 -- 172.21.15.19:0/3787378331 --> [v2:172.21.15.190:6808/4085939700,v1:172.21.15.190:6809/4085939700] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f852015d6c0 con 0x7f850006c7a0 2023-11-20T06:43:09.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.615+0000 7f8516ffd640 1 -- 172.21.15.19:0/3787378331 <== osd.4 v2:172.21.15.190:6808/4085939700 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8518001b40 con 0x7f850006c7a0 2023-11-20T06:43:09.622 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-20T06:43:09.622 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-20T06:43:09.622 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-20T06:43:09.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.615+0000 7f8524e05640 1 -- 172.21.15.19:0/3787378331 >> [v2:172.21.15.190:6808/4085939700,v1:172.21.15.190:6809/4085939700] conn(0x7f850006c7a0 msgr2=0x7f850006ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.615+0000 7f8524e05640 1 --2- 172.21.15.19:0/3787378331 >> [v2:172.21.15.190:6808/4085939700,v1:172.21.15.190:6809/4085939700] conn(0x7f850006c7a0 0x7f850006ebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.615+0000 7f8524e05640 1 -- 172.21.15.19:0/3787378331 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f85000664a0 msgr2=0x7f8500068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.615+0000 7f8524e05640 1 --2- 172.21.15.19:0/3787378331 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f85000664a0 0x7f8500068960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8508007fd0 tx=0x7f8508009040 comp rx=0 tx=0).stop 2023-11-20T06:43:09.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.615+0000 7f8524e05640 1 -- 172.21.15.19:0/3787378331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85200cdc80 msgr2=0x7f8520144340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.615+0000 7f8524e05640 1 --2- 172.21.15.19:0/3787378331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85200cdc80 0x7f8520144340 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f851001a0e0 tx=0x7f8510019250 comp rx=0 tx=0).stop 2023-11-20T06:43:09.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.615+0000 7f851ed9d640 1 -- 172.21.15.19:0/3787378331 reap_dead start 2023-11-20T06:43:09.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.615+0000 7f8524e05640 1 -- 172.21.15.19:0/3787378331 shutdown_connections 2023-11-20T06:43:09.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.615+0000 7f8524e05640 1 -- 172.21.15.19:0/3787378331 >> 172.21.15.19:0/3787378331 conn(0x7f85200715c0 msgr2=0x7f8520160dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:09.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.615+0000 7f8524e05640 1 -- 172.21.15.19:0/3787378331 shutdown_connections 2023-11-20T06:43:09.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.615+0000 7f8524e05640 1 -- 172.21.15.19:0/3787378331 wait complete. 2023-11-20T06:43:09.641 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-20T06:43:09.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.779+0000 7f1b7c7c5640 1 Processor -- start 2023-11-20T06:43:09.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.779+0000 7f1b7c7c5640 1 -- start start 2023-11-20T06:43:09.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.779+0000 7f1b7c7c5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b741597c0 0x7f1b740ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.779+0000 7f1b7c7c5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b74159ba0 0x7f1b740cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.779+0000 7f1b7c7c5640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b740723d0 con 0x7f1b740adc10 2023-11-20T06:43:09.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.779+0000 7f1b7c7c5640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b740717c0 con 0x7f1b74159ba0 2023-11-20T06:43:09.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.779+0000 7f1b7c7c5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b74071aa0 con 0x7f1b741597c0 2023-11-20T06:43:09.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.779+0000 7f1b79d60640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b74159ba0 0x7f1b740cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.779+0000 7f1b79d60640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b74159ba0 0x7f1b740cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51848/0 (socket says 172.21.15.19:51848) 2023-11-20T06:43:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.779+0000 7f1b79d60640 1 -- 172.21.15.19:0/4220370963 learned_addr learned my addr 172.21.15.19:0/4220370963 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.779+0000 7f1b7a561640 1 --2- 172.21.15.19:0/4220370963 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b741597c0 0x7f1b740ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.783+0000 7f1b79d60640 1 -- 172.21.15.19:0/4220370963 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b741597c0 msgr2=0x7f1b740ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.783+0000 7f1b79d60640 1 --2- 172.21.15.19:0/4220370963 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b741597c0 0x7f1b740ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.783+0000 7f1b79d60640 1 -- 172.21.15.19:0/4220370963 >> v1:172.21.15.190:6789/0 conn(0x7f1b740adc10 legacy=0x7f1b740cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.783+0000 7f1b79d60640 1 -- 172.21.15.19:0/4220370963 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b74071d80 con 0x7f1b74159ba0 2023-11-20T06:43:09.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.783+0000 7f1b79d60640 1 --2- 172.21.15.19:0/4220370963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b74159ba0 0x7f1b740cae10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009870 tx=0x7f1b6401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f415d025b7f88b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:09.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.783+0000 7f1b7955f640 1 -- 172.21.15.19:0/4220370963 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b640aa640 con 0x7f1b74159ba0 2023-11-20T06:43:09.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.783+0000 7f1b7955f640 1 -- 172.21.15.19:0/4220370963 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b640aa7a0 con 0x7f1b74159ba0 2023-11-20T06:43:09.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.783+0000 7f1b7955f640 1 -- 172.21.15.19:0/4220370963 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b640aab30 con 0x7f1b74159ba0 2023-11-20T06:43:09.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.783+0000 7f1b7c7c5640 1 -- 172.21.15.19:0/4220370963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b74159ba0 msgr2=0x7f1b740cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.783+0000 7f1b7c7c5640 1 --2- 172.21.15.19:0/4220370963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b74159ba0 0x7f1b740cae10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009870 tx=0x7f1b6401c540 comp rx=0 tx=0).stop 2023-11-20T06:43:09.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7c7c5640 1 -- 172.21.15.19:0/4220370963 shutdown_connections 2023-11-20T06:43:09.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7c7c5640 1 --2- 172.21.15.19:0/4220370963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b74159ba0 0x7f1b740cae10 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7c7c5640 1 --2- 172.21.15.19:0/4220370963 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b741597c0 0x7f1b740ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7c7c5640 1 -- 172.21.15.19:0/4220370963 >> 172.21.15.19:0/4220370963 conn(0x7f1b7406c190 msgr2=0x7f1b7406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:09.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7c7c5640 1 -- 172.21.15.19:0/4220370963 shutdown_connections 2023-11-20T06:43:09.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7c7c5640 1 -- 172.21.15.19:0/4220370963 wait complete. 2023-11-20T06:43:09.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7c7c5640 1 Processor -- start 2023-11-20T06:43:09.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7c7c5640 1 -- start start 2023-11-20T06:43:09.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7c7c5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b740adc10 0x7f1b741f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7c7c5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b741597c0 0x7f1b740c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7c7c5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b74159ba0 0x7f1b741515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7c7c5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b74150510 con 0x7f1b74159ba0 2023-11-20T06:43:09.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7c7c5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b741507f0 con 0x7f1b740adc10 2023-11-20T06:43:09.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7c7c5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b74150ad0 con 0x7f1b741597c0 2023-11-20T06:43:09.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7ad62640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b74159ba0 0x7f1b741515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7ad62640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b74159ba0 0x7f1b741515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51856/0 (socket says 172.21.15.19:51856) 2023-11-20T06:43:09.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7ad62640 1 -- 172.21.15.19:0/2556563190 learned_addr learned my addr 172.21.15.19:0/2556563190 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:09.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b79d60640 1 --2- 172.21.15.19:0/2556563190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b741597c0 0x7f1b740c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7a561640 1 --2- 172.21.15.19:0/2556563190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b740adc10 0x7f1b741f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7ad62640 1 -- 172.21.15.19:0/2556563190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b741597c0 msgr2=0x7f1b740c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7ad62640 1 --2- 172.21.15.19:0/2556563190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b741597c0 0x7f1b740c4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7ad62640 1 -- 172.21.15.19:0/2556563190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b740adc10 msgr2=0x7f1b741f5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7ad62640 1 --2- 172.21.15.19:0/2556563190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b740adc10 0x7f1b741f5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.787+0000 7f1b7ad62640 1 -- 172.21.15.19:0/2556563190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b640094d0 con 0x7f1b74159ba0 2023-11-20T06:43:09.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.791+0000 7f1b7ad62640 1 --2- 172.21.15.19:0/2556563190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b74159ba0 0x7f1b741515b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00c6c0 tx=0x7f1b6c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:09.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.791+0000 7f1b6affd640 1 -- 172.21.15.19:0/2556563190 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c003b80 con 0x7f1b74159ba0 2023-11-20T06:43:09.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.791+0000 7f1b6affd640 1 -- 172.21.15.19:0/2556563190 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6c003ce0 con 0x7f1b74159ba0 2023-11-20T06:43:09.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.791+0000 7f1b6affd640 1 -- 172.21.15.19:0/2556563190 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c0052f0 con 0x7f1b74159ba0 2023-11-20T06:43:09.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.791+0000 7f1b7c7c5640 1 -- 172.21.15.19:0/2556563190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b74150db0 con 0x7f1b74159ba0 2023-11-20T06:43:09.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.791+0000 7f1b7c7c5640 1 -- 172.21.15.19:0/2556563190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b74152f90 con 0x7f1b74159ba0 2023-11-20T06:43:09.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.791+0000 7f1b7c7c5640 1 -- 172.21.15.19:0/2556563190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b74074010 con 0x7f1b74159ba0 2023-11-20T06:43:09.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.791+0000 7f1b6affd640 1 -- 172.21.15.19:0/2556563190 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1b6c005450 con 0x7f1b74159ba0 2023-11-20T06:43:09.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.791+0000 7f1b6affd640 1 --2- 172.21.15.19:0/2556563190 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f1b580664a0 0x7f1b58068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:09.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.791+0000 7f1b6affd640 1 -- 172.21.15.19:0/2556563190 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1b6c083910 con 0x7f1b74159ba0 2023-11-20T06:43:09.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.791+0000 7f1b7a561640 1 --2- 172.21.15.19:0/2556563190 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f1b580664a0 0x7f1b58068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:09.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.795+0000 7f1b7a561640 1 --2- 172.21.15.19:0/2556563190 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f1b580664a0 0x7f1b58068960 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009b60 tx=0x7f1b70009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:09.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.795+0000 7f1b6affd640 1 -- 172.21.15.19:0/2556563190 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1b6c050ff0 con 0x7f1b74159ba0 2023-11-20T06:43:09.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.951+0000 7f1b7c7c5640 1 -- 172.21.15.19:0/2556563190 --> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b740cd3f0 con 0x7f1b580664a0 2023-11-20T06:43:09.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.955+0000 7f1b6affd640 1 -- 172.21.15.19:0/2556563190 <== mgr.4109 v2:172.21.15.190:6832/142426253 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1b740cd3f0 con 0x7f1b580664a0 2023-11-20T06:43:09.960 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 4 to deep-scrub 2023-11-20T06:43:09.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.955+0000 7f1b7c7c5640 1 -- 172.21.15.19:0/2556563190 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f1b580664a0 msgr2=0x7f1b58068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.955+0000 7f1b7c7c5640 1 --2- 172.21.15.19:0/2556563190 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f1b580664a0 0x7f1b58068960 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009b60 tx=0x7f1b70009190 comp rx=0 tx=0).stop 2023-11-20T06:43:09.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.955+0000 7f1b7c7c5640 1 -- 172.21.15.19:0/2556563190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b74159ba0 msgr2=0x7f1b741515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:09.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.955+0000 7f1b7c7c5640 1 --2- 172.21.15.19:0/2556563190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b74159ba0 0x7f1b741515b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00c6c0 tx=0x7f1b6c00cb80 comp rx=0 tx=0).stop 2023-11-20T06:43:09.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.955+0000 7f1b7c7c5640 1 -- 172.21.15.19:0/2556563190 shutdown_connections 2023-11-20T06:43:09.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.955+0000 7f1b7c7c5640 1 --2- 172.21.15.19:0/2556563190 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f1b580664a0 0x7f1b58068960 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.955+0000 7f1b7c7c5640 1 --2- 172.21.15.19:0/2556563190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b74159ba0 0x7f1b741515b0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.955+0000 7f1b7c7c5640 1 --2- 172.21.15.19:0/2556563190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b741597c0 0x7f1b740c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.955+0000 7f1b7c7c5640 1 --2- 172.21.15.19:0/2556563190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b740adc10 0x7f1b741f5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:09.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.955+0000 7f1b7c7c5640 1 -- 172.21.15.19:0/2556563190 >> 172.21.15.19:0/2556563190 conn(0x7f1b7406c190 msgr2=0x7f1b740ae7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:09.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.955+0000 7f1b7c7c5640 1 -- 172.21.15.19:0/2556563190 shutdown_connections 2023-11-20T06:43:09.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:09.955+0000 7f1b7c7c5640 1 -- 172.21.15.19:0/2556563190 wait complete. 2023-11-20T06:43:09.980 INFO:tasks.ceph:Scrubbing osd.5 2023-11-20T06:43:09.980 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-20T06:43:10.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.123+0000 7f44b8bf5640 1 Processor -- start 2023-11-20T06:43:10.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.123+0000 7f44b8bf5640 1 -- start start 2023-11-20T06:43:10.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.123+0000 7f44b8bf5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f44b40cd2b0 0x7f44b40cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.123+0000 7f44b8bf5640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b40caf20 con 0x7f44b41600e0 2023-11-20T06:43:10.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.123+0000 7f44b8bf5640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b40b3720 con 0x7f44b40cbc50 2023-11-20T06:43:10.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.123+0000 7f44b8bf5640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b40cdc80 con 0x7f44b40cd2b0 2023-11-20T06:43:10.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.123+0000 7f44b259c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f44b41600e0 0x7f44b40cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42602/0 (socket says 172.21.15.19:42602) 2023-11-20T06:43:10.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.123+0000 7f44b259c640 1 -- 172.21.15.19:0/329630238 learned_addr learned my addr 172.21.15.19:0/329630238 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:43:10.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.123+0000 7f44abfff640 1 --2- 172.21.15.19:0/329630238 >> v2:172.21.15.190:3300/0 conn(0x7f44b40cd2b0 0x7f44b40cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.123+0000 7f44b1d9b640 1 -- 172.21.15.19:0/329630238 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661711901 0 0) 0x7f44b40caf20 con 0x7f44b41600e0 2023-11-20T06:43:10.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.123+0000 7f44b1d9b640 1 -- 172.21.15.19:0/329630238 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44a0003530 con 0x7f44b41600e0 2023-11-20T06:43:10.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.123+0000 7f44b1d9b640 1 -- 172.21.15.19:0/329630238 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1313450132 0 0) 0x7f44a0003530 con 0x7f44b41600e0 2023-11-20T06:43:10.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.123+0000 7f44abfff640 1 -- 172.21.15.19:0/329630238 >> v1:172.21.15.190:6789/0 conn(0x7f44b40cbc50 legacy=0x7f44b40cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.123+0000 7f44abfff640 1 -- 172.21.15.19:0/329630238 >> v1:172.21.15.19:6789/0 conn(0x7f44b41600e0 legacy=0x7f44b40cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.123+0000 7f44abfff640 1 -- 172.21.15.19:0/329630238 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b40d02a0 con 0x7f44b40cd2b0 2023-11-20T06:43:10.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.127+0000 7f44abfff640 1 --2- 172.21.15.19:0/329630238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44b40cd2b0 0x7f44b40cd740 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f449c0097c0 tx=0x7f449c01c190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e39b11122492e0ce server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:10.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.127+0000 7f44b1d9b640 1 -- 172.21.15.19:0/329630238 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a4001680 con 0x7f44b40cd2b0 2023-11-20T06:43:10.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.127+0000 7f44b1d9b640 1 -- 172.21.15.19:0/329630238 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c0a7050 con 0x7f44b40cd2b0 2023-11-20T06:43:10.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.127+0000 7f44b1d9b640 1 -- 172.21.15.19:0/329630238 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c0ab620 con 0x7f44b40cd2b0 2023-11-20T06:43:10.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.127+0000 7f44b8bf5640 1 -- 172.21.15.19:0/329630238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44b40cd2b0 msgr2=0x7f44b40cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.127+0000 7f44b8bf5640 1 --2- 172.21.15.19:0/329630238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44b40cd2b0 0x7f44b40cd740 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f449c0097c0 tx=0x7f449c01c190 comp rx=0 tx=0).stop 2023-11-20T06:43:10.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.127+0000 7f44b8bf5640 1 -- 172.21.15.19:0/329630238 shutdown_connections 2023-11-20T06:43:10.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.127+0000 7f44b8bf5640 1 --2- 172.21.15.19:0/329630238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44b40cd2b0 0x7f44b40cd740 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.127+0000 7f44b8bf5640 1 -- 172.21.15.19:0/329630238 >> 172.21.15.19:0/329630238 conn(0x7f44b40d08d0 msgr2=0x7f44b40d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:10.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.127+0000 7f44b8bf5640 1 -- 172.21.15.19:0/329630238 shutdown_connections 2023-11-20T06:43:10.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.127+0000 7f44b8bf5640 1 -- 172.21.15.19:0/329630238 wait complete. 2023-11-20T06:43:10.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44b8bf5640 1 Processor -- start 2023-11-20T06:43:10.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44b8bf5640 1 -- start start 2023-11-20T06:43:10.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44b8bf5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44b40cbc50 0x7f44b41543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44b8bf5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44b40cd2b0 0x7f44b40b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44b8bf5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44b41600e0 0x7f44b40b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44b8bf5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b4156930 con 0x7f44b40cbc50 2023-11-20T06:43:10.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44b8bf5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b4156b80 con 0x7f44b41600e0 2023-11-20T06:43:10.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44b8bf5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b4156e60 con 0x7f44b40cd2b0 2023-11-20T06:43:10.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44b259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44b40cbc50 0x7f44b41543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44b259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44b40cbc50 0x7f44b41543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51872/0 (socket says 172.21.15.19:51872) 2023-11-20T06:43:10.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44b259c640 1 -- 172.21.15.19:0/1359705617 learned_addr learned my addr 172.21.15.19:0/1359705617 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:10.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44b2d9d640 1 --2- 172.21.15.19:0/1359705617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44b41600e0 0x7f44b40b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44abfff640 1 --2- 172.21.15.19:0/1359705617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44b40cd2b0 0x7f44b40b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44b259c640 1 -- 172.21.15.19:0/1359705617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44b40cd2b0 msgr2=0x7f44b40b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44b259c640 1 --2- 172.21.15.19:0/1359705617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44b40cd2b0 0x7f44b40b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44b259c640 1 -- 172.21.15.19:0/1359705617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44b41600e0 msgr2=0x7f44b40b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44b259c640 1 --2- 172.21.15.19:0/1359705617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44b41600e0 0x7f44b40b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44b259c640 1 -- 172.21.15.19:0/1359705617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c009420 con 0x7f44b40cbc50 2023-11-20T06:43:10.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44abfff640 1 --2- 172.21.15.19:0/1359705617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44b40cd2b0 0x7f44b40b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T06:43:10.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44b259c640 1 --2- 172.21.15.19:0/1359705617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44b40cbc50 0x7f44b41543e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f44a4007fd0 tx=0x7f44a400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:10.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44aaffd640 1 -- 172.21.15.19:0/1359705617 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a40072d0 con 0x7f44b40cbc50 2023-11-20T06:43:10.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44aaffd640 1 -- 172.21.15.19:0/1359705617 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a4007450 con 0x7f44b40cbc50 2023-11-20T06:43:10.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44aaffd640 1 -- 172.21.15.19:0/1359705617 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a40047f0 con 0x7f44b40cbc50 2023-11-20T06:43:10.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44b8bf5640 1 -- 172.21.15.19:0/1359705617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b4157140 con 0x7f44b40cbc50 2023-11-20T06:43:10.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.131+0000 7f44b8bf5640 1 -- 172.21.15.19:0/1359705617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b4154920 con 0x7f44b40cbc50 2023-11-20T06:43:10.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.135+0000 7f44b8bf5640 1 -- 172.21.15.19:0/1359705617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f44b40cff20 con 0x7f44b40cbc50 2023-11-20T06:43:10.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.135+0000 7f44aaffd640 1 -- 172.21.15.19:0/1359705617 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f44a4004950 con 0x7f44b40cbc50 2023-11-20T06:43:10.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.135+0000 7f44aaffd640 1 --2- 172.21.15.19:0/1359705617 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f44940664a0 0x7f4494068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.135+0000 7f44aaffd640 1 -- 172.21.15.19:0/1359705617 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f44a4082ff0 con 0x7f44b40cbc50 2023-11-20T06:43:10.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.135+0000 7f44aaffd640 1 --2- 172.21.15.19:0/1359705617 >> [v2:172.21.15.190:6816/1335226039,v1:172.21.15.190:6817/1335226039] conn(0x7f449406c7a0 0x7f449406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.135+0000 7f44aaffd640 1 -- 172.21.15.19:0/1359705617 --> [v2:172.21.15.190:6816/1335226039,v1:172.21.15.190:6817/1335226039] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f449406f2b0 con 0x7f449406c7a0 2023-11-20T06:43:10.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.135+0000 7f44aaffd640 1 -- 172.21.15.19:0/1359705617 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44a40855d0 con 0x7f44b40cbc50 2023-11-20T06:43:10.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.135+0000 7f44abfff640 1 --2- 172.21.15.19:0/1359705617 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f44940664a0 0x7f4494068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.135+0000 7f44b2d9d640 1 --2- 172.21.15.19:0/1359705617 >> [v2:172.21.15.190:6816/1335226039,v1:172.21.15.190:6817/1335226039] conn(0x7f449406c7a0 0x7f449406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.139+0000 7f44b2d9d640 1 --2- 172.21.15.19:0/1359705617 >> [v2:172.21.15.190:6816/1335226039,v1:172.21.15.190:6817/1335226039] conn(0x7f449406c7a0 0x7f449406ebe0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:10.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.139+0000 7f44abfff640 1 --2- 172.21.15.19:0/1359705617 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f44940664a0 0x7f4494068960 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f449c0ad000 tx=0x7f449c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:10.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.139+0000 7f44aaffd640 1 -- 172.21.15.19:0/1359705617 <== osd.5 v2:172.21.15.190:6816/1335226039 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f449406f2b0 con 0x7f449406c7a0 2023-11-20T06:43:10.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.151+0000 7f44b8bf5640 1 -- 172.21.15.19:0/1359705617 --> [v2:172.21.15.190:6816/1335226039,v1:172.21.15.190:6817/1335226039] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f44b40cb730 con 0x7f449406c7a0 2023-11-20T06:43:10.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.151+0000 7f44aaffd640 1 -- 172.21.15.19:0/1359705617 <== osd.5 v2:172.21.15.190:6816/1335226039 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f44ac001fe0 con 0x7f449406c7a0 2023-11-20T06:43:10.157 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-20T06:43:10.158 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-20T06:43:10.158 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-20T06:43:10.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.151+0000 7f44b8bf5640 1 -- 172.21.15.19:0/1359705617 >> [v2:172.21.15.190:6816/1335226039,v1:172.21.15.190:6817/1335226039] conn(0x7f449406c7a0 msgr2=0x7f449406ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.151+0000 7f44b8bf5640 1 --2- 172.21.15.19:0/1359705617 >> [v2:172.21.15.190:6816/1335226039,v1:172.21.15.190:6817/1335226039] conn(0x7f449406c7a0 0x7f449406ebe0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.151+0000 7f44b8bf5640 1 -- 172.21.15.19:0/1359705617 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f44940664a0 msgr2=0x7f4494068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.151+0000 7f44b8bf5640 1 --2- 172.21.15.19:0/1359705617 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f44940664a0 0x7f4494068960 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f449c0ad000 tx=0x7f449c008040 comp rx=0 tx=0).stop 2023-11-20T06:43:10.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.151+0000 7f44b8bf5640 1 -- 172.21.15.19:0/1359705617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44b40cbc50 msgr2=0x7f44b41543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.151+0000 7f44b8bf5640 1 --2- 172.21.15.19:0/1359705617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44b40cbc50 0x7f44b41543e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f44a4007fd0 tx=0x7f44a400cbe0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.151+0000 7f44b2d9d640 1 -- 172.21.15.19:0/1359705617 reap_dead start 2023-11-20T06:43:10.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.151+0000 7f44b8bf5640 1 -- 172.21.15.19:0/1359705617 shutdown_connections 2023-11-20T06:43:10.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.151+0000 7f44b8bf5640 1 -- 172.21.15.19:0/1359705617 >> 172.21.15.19:0/1359705617 conn(0x7f44b40d08d0 msgr2=0x7f44b406e600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:10.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.151+0000 7f44b8bf5640 1 -- 172.21.15.19:0/1359705617 shutdown_connections 2023-11-20T06:43:10.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.151+0000 7f44b8bf5640 1 -- 172.21.15.19:0/1359705617 wait complete. 2023-11-20T06:43:10.177 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-20T06:43:10.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.315+0000 7fd14769c640 1 Processor -- start 2023-11-20T06:43:10.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.315+0000 7fd14769c640 1 -- start start 2023-11-20T06:43:10.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.315+0000 7fd14769c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd1400caba0 0x7fd14006de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.315+0000 7fd14769c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd140159de0 con 0x7fd14006a5a0 2023-11-20T06:43:10.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.315+0000 7fd14769c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd14006e4f0 con 0x7fd140159a00 2023-11-20T06:43:10.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.315+0000 7fd14769c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1400cd720 con 0x7fd1400caba0 2023-11-20T06:43:10.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.315+0000 7fd144c37640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd14006a5a0 0x7fd14006d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42618/0 (socket says 172.21.15.19:42618) 2023-11-20T06:43:10.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.315+0000 7fd144c37640 1 -- 172.21.15.19:0/389730989 learned_addr learned my addr 172.21.15.19:0/389730989 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:43:10.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.315+0000 7fd145c39640 1 --2- 172.21.15.19:0/389730989 >> v2:172.21.15.190:3300/0 conn(0x7fd1400caba0 0x7fd14006de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.319+0000 7fd137fff640 1 -- 172.21.15.19:0/389730989 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285596017 0 0) 0x7fd140159de0 con 0x7fd14006a5a0 2023-11-20T06:43:10.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.319+0000 7fd137fff640 1 -- 172.21.15.19:0/389730989 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd12c003530 con 0x7fd14006a5a0 2023-11-20T06:43:10.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.319+0000 7fd145c39640 1 -- 172.21.15.19:0/389730989 >> v1:172.21.15.190:6789/0 conn(0x7fd140159a00 legacy=0x7fd140069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.319+0000 7fd145c39640 1 -- 172.21.15.19:0/389730989 >> v1:172.21.15.19:6789/0 conn(0x7fd14006a5a0 legacy=0x7fd14006d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.319+0000 7fd145c39640 1 -- 172.21.15.19:0/389730989 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1400c8dd0 con 0x7fd1400caba0 2023-11-20T06:43:10.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.319+0000 7fd145c39640 1 --2- 172.21.15.19:0/389730989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1400caba0 0x7fd14006de60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd138009d90 tx=0x7fd13801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8ab31fedc156fdc server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:10.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.319+0000 7fd137fff640 1 -- 172.21.15.19:0/389730989 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1380a59e0 con 0x7fd1400caba0 2023-11-20T06:43:10.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.319+0000 7fd137fff640 1 -- 172.21.15.19:0/389730989 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1380a5b40 con 0x7fd1400caba0 2023-11-20T06:43:10.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.319+0000 7fd137fff640 1 -- 172.21.15.19:0/389730989 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1380ad440 con 0x7fd1400caba0 2023-11-20T06:43:10.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd14769c640 1 -- 172.21.15.19:0/389730989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1400caba0 msgr2=0x7fd14006de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd14769c640 1 --2- 172.21.15.19:0/389730989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1400caba0 0x7fd14006de60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd138009d90 tx=0x7fd13801c920 comp rx=0 tx=0).stop 2023-11-20T06:43:10.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd14769c640 1 -- 172.21.15.19:0/389730989 shutdown_connections 2023-11-20T06:43:10.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd14769c640 1 --2- 172.21.15.19:0/389730989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1400caba0 0x7fd14006de60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd14769c640 1 -- 172.21.15.19:0/389730989 >> 172.21.15.19:0/389730989 conn(0x7fd1400b0d30 msgr2=0x7fd1400ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:10.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd14769c640 1 -- 172.21.15.19:0/389730989 shutdown_connections 2023-11-20T06:43:10.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd14769c640 1 -- 172.21.15.19:0/389730989 wait complete. 2023-11-20T06:43:10.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd14769c640 1 Processor -- start 2023-11-20T06:43:10.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd14769c640 1 -- start start 2023-11-20T06:43:10.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd14769c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd14006a5a0 0x7fd140155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd14769c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1400caba0 0x7fd140154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd14769c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd140159a00 0x7fd1401f4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd14769c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1400c3420 con 0x7fd140159a00 2023-11-20T06:43:10.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd14769c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1400c5110 con 0x7fd1400caba0 2023-11-20T06:43:10.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd14769c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd140155120 con 0x7fd14006a5a0 2023-11-20T06:43:10.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd145c39640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd140159a00 0x7fd1401f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd145c39640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd140159a00 0x7fd1401f4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51874/0 (socket says 172.21.15.19:51874) 2023-11-20T06:43:10.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd145c39640 1 -- 172.21.15.19:0/3725255656 learned_addr learned my addr 172.21.15.19:0/3725255656 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:10.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd145438640 1 --2- 172.21.15.19:0/3725255656 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd14006a5a0 0x7fd140155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd144c37640 1 --2- 172.21.15.19:0/3725255656 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1400caba0 0x7fd140154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd145c39640 1 -- 172.21.15.19:0/3725255656 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd14006a5a0 msgr2=0x7fd140155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd145c39640 1 --2- 172.21.15.19:0/3725255656 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd14006a5a0 0x7fd140155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd145c39640 1 -- 172.21.15.19:0/3725255656 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1400caba0 msgr2=0x7fd140154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd145c39640 1 --2- 172.21.15.19:0/3725255656 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1400caba0 0x7fd140154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd145c39640 1 -- 172.21.15.19:0/3725255656 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd138009a70 con 0x7fd140159a00 2023-11-20T06:43:10.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd145438640 1 --2- 172.21.15.19:0/3725255656 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd14006a5a0 0x7fd140155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:43:10.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.323+0000 7fd144c37640 1 --2- 172.21.15.19:0/3725255656 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1400caba0 0x7fd140154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:43:10.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.327+0000 7fd145c39640 1 --2- 172.21.15.19:0/3725255656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd140159a00 0x7fd1401f4cb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd1380b0040 tx=0x7fd1380196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:10.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.327+0000 7fd135ffb640 1 -- 172.21.15.19:0/3725255656 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1380add90 con 0x7fd140159a00 2023-11-20T06:43:10.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.327+0000 7fd135ffb640 1 -- 172.21.15.19:0/3725255656 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd138009450 con 0x7fd140159a00 2023-11-20T06:43:10.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.327+0000 7fd135ffb640 1 -- 172.21.15.19:0/3725255656 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1380b9690 con 0x7fd140159a00 2023-11-20T06:43:10.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.327+0000 7fd14769c640 1 -- 172.21.15.19:0/3725255656 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1401f5b00 con 0x7fd140159a00 2023-11-20T06:43:10.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.327+0000 7fd14769c640 1 -- 172.21.15.19:0/3725255656 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1400c3040 con 0x7fd140159a00 2023-11-20T06:43:10.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.327+0000 7fd14769c640 1 -- 172.21.15.19:0/3725255656 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14004e170 con 0x7fd140159a00 2023-11-20T06:43:10.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.327+0000 7fd135ffb640 1 -- 172.21.15.19:0/3725255656 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd1380b97f0 con 0x7fd140159a00 2023-11-20T06:43:10.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.327+0000 7fd135ffb640 1 --2- 172.21.15.19:0/3725255656 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd1240664a0 0x7fd124068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.327+0000 7fd135ffb640 1 -- 172.21.15.19:0/3725255656 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd13811f540 con 0x7fd140159a00 2023-11-20T06:43:10.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.327+0000 7fd145438640 1 --2- 172.21.15.19:0/3725255656 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd1240664a0 0x7fd124068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.331+0000 7fd145438640 1 --2- 172.21.15.19:0/3725255656 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd1240664a0 0x7fd124068960 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd1400ad7f0 tx=0x7fd13c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:10.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.331+0000 7fd135ffb640 1 -- 172.21.15.19:0/3725255656 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd1380ecc10 con 0x7fd140159a00 2023-11-20T06:43:10.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.491+0000 7fd14769c640 1 -- 172.21.15.19:0/3725255656 --> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1400c9670 con 0x7fd1240664a0 2023-11-20T06:43:10.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.491+0000 7fd135ffb640 1 -- 172.21.15.19:0/3725255656 <== mgr.4109 v2:172.21.15.190:6832/142426253 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd13c001c40 con 0x7fd1240664a0 2023-11-20T06:43:10.496 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 5 to deep-scrub 2023-11-20T06:43:10.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.491+0000 7fd14769c640 1 -- 172.21.15.19:0/3725255656 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd1240664a0 msgr2=0x7fd124068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.491+0000 7fd14769c640 1 --2- 172.21.15.19:0/3725255656 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd1240664a0 0x7fd124068960 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd1400ad7f0 tx=0x7fd13c009040 comp rx=0 tx=0).stop 2023-11-20T06:43:10.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.491+0000 7fd14769c640 1 -- 172.21.15.19:0/3725255656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd140159a00 msgr2=0x7fd1401f4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.491+0000 7fd14769c640 1 --2- 172.21.15.19:0/3725255656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd140159a00 0x7fd1401f4cb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd1380b0040 tx=0x7fd1380196c0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.491+0000 7fd14769c640 1 -- 172.21.15.19:0/3725255656 shutdown_connections 2023-11-20T06:43:10.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.491+0000 7fd14769c640 1 --2- 172.21.15.19:0/3725255656 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fd1240664a0 0x7fd124068960 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.491+0000 7fd14769c640 1 --2- 172.21.15.19:0/3725255656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd140159a00 0x7fd1401f4cb0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.491+0000 7fd14769c640 1 --2- 172.21.15.19:0/3725255656 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1400caba0 0x7fd140154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.491+0000 7fd14769c640 1 --2- 172.21.15.19:0/3725255656 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd14006a5a0 0x7fd140155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.491+0000 7fd14769c640 1 -- 172.21.15.19:0/3725255656 >> 172.21.15.19:0/3725255656 conn(0x7fd1400b0d30 msgr2=0x7fd14006d710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:10.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.491+0000 7fd14769c640 1 -- 172.21.15.19:0/3725255656 shutdown_connections 2023-11-20T06:43:10.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.491+0000 7fd14769c640 1 -- 172.21.15.19:0/3725255656 wait complete. 2023-11-20T06:43:10.518 INFO:tasks.ceph:Scrubbing osd.6 2023-11-20T06:43:10.518 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-20T06:43:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.659+0000 7fa98aa9e640 1 Processor -- start 2023-11-20T06:43:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.659+0000 7fa98aa9e640 1 -- start start 2023-11-20T06:43:10.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.663+0000 7fa98aa9e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa9840d2570 0x7fa984161210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.663+0000 7fa98aa9e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9840ce460 con 0x7fa9840cdc80 2023-11-20T06:43:10.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.663+0000 7fa98aa9e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98415da30 con 0x7fa9840cfd20 2023-11-20T06:43:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.663+0000 7fa98aa9e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9840cd830 con 0x7fa9840d2570 2023-11-20T06:43:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.663+0000 7fa983fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa9840cdc80 0x7fa9840cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42622/0 (socket says 172.21.15.19:42622) 2023-11-20T06:43:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.663+0000 7fa983fff640 1 -- 172.21.15.19:0/1076229037 learned_addr learned my addr 172.21.15.19:0/1076229037 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:43:10.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.663+0000 7fa98883a640 1 --2- 172.21.15.19:0/1076229037 >> v2:172.21.15.190:3300/0 conn(0x7fa9840d2570 0x7fa984161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.663+0000 7fa9837fe640 1 -- 172.21.15.19:0/1076229037 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926434727 0 0) 0x7fa9840ce460 con 0x7fa9840cdc80 2023-11-20T06:43:10.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.663+0000 7fa9837fe640 1 -- 172.21.15.19:0/1076229037 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa974003530 con 0x7fa9840cdc80 2023-11-20T06:43:10.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.663+0000 7fa98883a640 1 -- 172.21.15.19:0/1076229037 >> v1:172.21.15.190:6789/0 conn(0x7fa9840cfd20 legacy=0x7fa9840d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.663+0000 7fa98883a640 1 -- 172.21.15.19:0/1076229037 >> v1:172.21.15.19:6789/0 conn(0x7fa9840cdc80 legacy=0x7fa9840cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.663+0000 7fa9837fe640 1 -- 172.21.15.19:0/1076229037 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601472901 0 0) 0x7fa98415da30 con 0x7fa9840cfd20 2023-11-20T06:43:10.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.663+0000 7fa98883a640 1 -- 172.21.15.19:0/1076229037 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa984161750 con 0x7fa9840d2570 2023-11-20T06:43:10.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.667+0000 7fa98883a640 1 --2- 172.21.15.19:0/1076229037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9840d2570 0x7fa984161210 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa9780097c0 tx=0x7fa97801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=954700117b915e39 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:10.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.667+0000 7fa9837fe640 1 -- 172.21.15.19:0/1076229037 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9780ad660 con 0x7fa9840d2570 2023-11-20T06:43:10.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.667+0000 7fa9837fe640 1 -- 172.21.15.19:0/1076229037 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9780ad7c0 con 0x7fa9840d2570 2023-11-20T06:43:10.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.667+0000 7fa9837fe640 1 -- 172.21.15.19:0/1076229037 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9780adb50 con 0x7fa9840d2570 2023-11-20T06:43:10.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.667+0000 7fa98aa9e640 1 -- 172.21.15.19:0/1076229037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9840d2570 msgr2=0x7fa984161210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.667+0000 7fa98aa9e640 1 --2- 172.21.15.19:0/1076229037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9840d2570 0x7fa984161210 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa9780097c0 tx=0x7fa97801c450 comp rx=0 tx=0).stop 2023-11-20T06:43:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.667+0000 7fa98aa9e640 1 -- 172.21.15.19:0/1076229037 shutdown_connections 2023-11-20T06:43:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.667+0000 7fa98aa9e640 1 --2- 172.21.15.19:0/1076229037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9840d2570 0x7fa984161210 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.667+0000 7fa98aa9e640 1 -- 172.21.15.19:0/1076229037 >> 172.21.15.19:0/1076229037 conn(0x7fa9840715c0 msgr2=0x7fa9840719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.667+0000 7fa98aa9e640 1 -- 172.21.15.19:0/1076229037 shutdown_connections 2023-11-20T06:43:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.667+0000 7fa98aa9e640 1 -- 172.21.15.19:0/1076229037 wait complete. 2023-11-20T06:43:10.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.667+0000 7fa98aa9e640 1 Processor -- start 2023-11-20T06:43:10.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.667+0000 7fa98aa9e640 1 -- start start 2023-11-20T06:43:10.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa98aa9e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9840cdc80 0x7fa98414e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa98aa9e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9840cfd20 0x7fa9840c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa98aa9e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9840d2570 0x7fa9840ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa98aa9e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9840cb6c0 con 0x7fa9840cfd20 2023-11-20T06:43:10.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa98aa9e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9840c6cd0 con 0x7fa9840cdc80 2023-11-20T06:43:10.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa98aa9e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa984154430 con 0x7fa9840d2570 2023-11-20T06:43:10.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa983fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9840cfd20 0x7fa9840c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa983fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9840cfd20 0x7fa9840c9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51876/0 (socket says 172.21.15.19:51876) 2023-11-20T06:43:10.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa983fff640 1 -- 172.21.15.19:0/3606829418 learned_addr learned my addr 172.21.15.19:0/3606829418 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:10.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa98883a640 1 --2- 172.21.15.19:0/3606829418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9840cdc80 0x7fa98414e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa98903b640 1 --2- 172.21.15.19:0/3606829418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9840d2570 0x7fa9840ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa983fff640 1 -- 172.21.15.19:0/3606829418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9840d2570 msgr2=0x7fa9840ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa983fff640 1 --2- 172.21.15.19:0/3606829418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9840d2570 0x7fa9840ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa983fff640 1 -- 172.21.15.19:0/3606829418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9840cdc80 msgr2=0x7fa98414e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa983fff640 1 --2- 172.21.15.19:0/3606829418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9840cdc80 0x7fa98414e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa983fff640 1 -- 172.21.15.19:0/3606829418 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa978009420 con 0x7fa9840cfd20 2023-11-20T06:43:10.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa983fff640 1 --2- 172.21.15.19:0/3606829418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9840cfd20 0x7fa9840c9cf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa97000c3c0 tx=0x7fa97000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:10.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa9817fa640 1 -- 172.21.15.19:0/3606829418 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970005cf0 con 0x7fa9840cfd20 2023-11-20T06:43:10.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa9817fa640 1 -- 172.21.15.19:0/3606829418 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa970005e50 con 0x7fa9840cfd20 2023-11-20T06:43:10.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa98aa9e640 1 -- 172.21.15.19:0/3606829418 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa984154710 con 0x7fa9840cfd20 2023-11-20T06:43:10.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa9817fa640 1 -- 172.21.15.19:0/3606829418 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9700072f0 con 0x7fa9840cfd20 2023-11-20T06:43:10.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa98aa9e640 1 -- 172.21.15.19:0/3606829418 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa984154cd0 con 0x7fa9840cfd20 2023-11-20T06:43:10.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa98aa9e640 1 -- 172.21.15.19:0/3606829418 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa9840d2950 con 0x7fa9840cfd20 2023-11-20T06:43:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.671+0000 7fa9817fa640 1 -- 172.21.15.19:0/3606829418 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa970007450 con 0x7fa9840cfd20 2023-11-20T06:43:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.675+0000 7fa9817fa640 1 --2- 172.21.15.19:0/3606829418 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa9680664d0 0x7fa968068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.675+0000 7fa9817fa640 1 -- 172.21.15.19:0/3606829418 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa970083200 con 0x7fa9840cfd20 2023-11-20T06:43:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.675+0000 7fa9817fa640 1 --2- 172.21.15.19:0/3606829418 >> [v2:172.21.15.190:6824/2641951692,v1:172.21.15.190:6825/2641951692] conn(0x7fa96806c7d0 0x7fa96806ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.675+0000 7fa9817fa640 1 -- 172.21.15.19:0/3606829418 --> [v2:172.21.15.190:6824/2641951692,v1:172.21.15.190:6825/2641951692] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa96806f2e0 con 0x7fa96806c7d0 2023-11-20T06:43:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.675+0000 7fa9817fa640 1 -- 172.21.15.19:0/3606829418 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9700857e0 con 0x7fa9840cfd20 2023-11-20T06:43:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.675+0000 7fa98883a640 1 --2- 172.21.15.19:0/3606829418 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa9680664d0 0x7fa968068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.675+0000 7fa98903b640 1 --2- 172.21.15.19:0/3606829418 >> [v2:172.21.15.190:6824/2641951692,v1:172.21.15.190:6825/2641951692] conn(0x7fa96806c7d0 0x7fa96806ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.675+0000 7fa98903b640 1 --2- 172.21.15.19:0/3606829418 >> [v2:172.21.15.190:6824/2641951692,v1:172.21.15.190:6825/2641951692] conn(0x7fa96806c7d0 0x7fa96806ec10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:10.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.675+0000 7fa98883a640 1 --2- 172.21.15.19:0/3606829418 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa9680664d0 0x7fa968068990 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa9780af000 tx=0x7fa978008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:10.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.675+0000 7fa9817fa640 1 -- 172.21.15.19:0/3606829418 <== osd.6 v2:172.21.15.190:6824/2641951692 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa96806f2e0 con 0x7fa96806c7d0 2023-11-20T06:43:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.687+0000 7fa98aa9e640 1 -- 172.21.15.19:0/3606829418 --> [v2:172.21.15.190:6824/2641951692,v1:172.21.15.190:6825/2641951692] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa98415d6c0 con 0x7fa96806c7d0 2023-11-20T06:43:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.691+0000 7fa9817fa640 1 -- 172.21.15.19:0/3606829418 <== osd.6 v2:172.21.15.190:6824/2641951692 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa97c001b90 con 0x7fa96806c7d0 2023-11-20T06:43:10.695 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-20T06:43:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-20T06:43:10.696 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-20T06:43:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.691+0000 7fa98aa9e640 1 -- 172.21.15.19:0/3606829418 >> [v2:172.21.15.190:6824/2641951692,v1:172.21.15.190:6825/2641951692] conn(0x7fa96806c7d0 msgr2=0x7fa96806ec10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.691+0000 7fa98aa9e640 1 --2- 172.21.15.19:0/3606829418 >> [v2:172.21.15.190:6824/2641951692,v1:172.21.15.190:6825/2641951692] conn(0x7fa96806c7d0 0x7fa96806ec10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.691+0000 7fa98aa9e640 1 -- 172.21.15.19:0/3606829418 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa9680664d0 msgr2=0x7fa968068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.691+0000 7fa98aa9e640 1 --2- 172.21.15.19:0/3606829418 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fa9680664d0 0x7fa968068990 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa9780af000 tx=0x7fa978008040 comp rx=0 tx=0).stop 2023-11-20T06:43:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.691+0000 7fa98aa9e640 1 -- 172.21.15.19:0/3606829418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9840cfd20 msgr2=0x7fa9840c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.691+0000 7fa98aa9e640 1 --2- 172.21.15.19:0/3606829418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9840cfd20 0x7fa9840c9cf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa97000c3c0 tx=0x7fa97000c880 comp rx=0 tx=0).stop 2023-11-20T06:43:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.691+0000 7fa98903b640 1 -- 172.21.15.19:0/3606829418 reap_dead start 2023-11-20T06:43:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.691+0000 7fa98aa9e640 1 -- 172.21.15.19:0/3606829418 shutdown_connections 2023-11-20T06:43:10.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.691+0000 7fa98aa9e640 1 -- 172.21.15.19:0/3606829418 >> 172.21.15.19:0/3606829418 conn(0x7fa9840715c0 msgr2=0x7fa9840d0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:10.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.691+0000 7fa98aa9e640 1 -- 172.21.15.19:0/3606829418 shutdown_connections 2023-11-20T06:43:10.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.691+0000 7fa98aa9e640 1 -- 172.21.15.19:0/3606829418 wait complete. 2023-11-20T06:43:10.714 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-20T06:43:10.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.851+0000 7f2d31165640 1 Processor -- start 2023-11-20T06:43:10.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.851+0000 7f2d31165640 1 -- start start 2023-11-20T06:43:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.855+0000 7f2d31165640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d2c1597c0 0x7f2d2c0ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.855+0000 7f2d31165640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d2c0adc10 0x7f2d2c0cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.855+0000 7f2d31165640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2c0723d0 con 0x7f2d2c159ba0 2023-11-20T06:43:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.855+0000 7f2d31165640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2c0717c0 con 0x7f2d2c1597c0 2023-11-20T06:43:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.855+0000 7f2d31165640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c071aa0 con 0x7f2d2c0adc10 2023-11-20T06:43:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.855+0000 7f2d2ad9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d2c1597c0 0x7f2d2c0ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.855+0000 7f2d2ad9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d2c1597c0 0x7f2d2c0ad6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51886/0 (socket says 172.21.15.19:51886) 2023-11-20T06:43:10.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.855+0000 7f2d2ad9d640 1 -- 172.21.15.19:0/1266805933 learned_addr learned my addr 172.21.15.19:0/1266805933 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:10.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.855+0000 7f2d2ad9d640 1 -- 172.21.15.19:0/1266805933 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d2c0adc10 msgr2=0x7f2d2c0cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:10.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.855+0000 7f2d2ad9d640 1 --2- 172.21.15.19:0/1266805933 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d2c0adc10 0x7f2d2c0cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.855+0000 7f2d2ad9d640 1 -- 172.21.15.19:0/1266805933 >> v1:172.21.15.190:6789/0 conn(0x7f2d2c159ba0 legacy=0x7f2d2c0cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:10.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.855+0000 7f2d2ad9d640 1 -- 172.21.15.19:0/1266805933 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c071d80 con 0x7f2d2c1597c0 2023-11-20T06:43:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.855+0000 7f2d2ad9d640 1 --2- 172.21.15.19:0/1266805933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d2c1597c0 0x7f2d2c0ad6d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c009870 tx=0x7f2d1c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce52e2f78e1da62b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.859+0000 7f2d2a59c640 1 -- 172.21.15.19:0/1266805933 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0ab660 con 0x7f2d2c1597c0 2023-11-20T06:43:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.859+0000 7f2d2a59c640 1 -- 172.21.15.19:0/1266805933 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c0ab7c0 con 0x7f2d2c1597c0 2023-11-20T06:43:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.859+0000 7f2d2a59c640 1 -- 172.21.15.19:0/1266805933 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0abb50 con 0x7f2d2c1597c0 2023-11-20T06:43:10.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.859+0000 7f2d31165640 1 -- 172.21.15.19:0/1266805933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d2c1597c0 msgr2=0x7f2d2c0ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.859+0000 7f2d31165640 1 --2- 172.21.15.19:0/1266805933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d2c1597c0 0x7f2d2c0ad6d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c009870 tx=0x7f2d1c01c500 comp rx=0 tx=0).stop 2023-11-20T06:43:10.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.859+0000 7f2d31165640 1 -- 172.21.15.19:0/1266805933 shutdown_connections 2023-11-20T06:43:10.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.859+0000 7f2d31165640 1 --2- 172.21.15.19:0/1266805933 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d2c0adc10 0x7f2d2c0cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.859+0000 7f2d31165640 1 --2- 172.21.15.19:0/1266805933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d2c1597c0 0x7f2d2c0ad6d0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.859+0000 7f2d31165640 1 -- 172.21.15.19:0/1266805933 >> 172.21.15.19:0/1266805933 conn(0x7f2d2c06c190 msgr2=0x7f2d2c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:10.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.859+0000 7f2d31165640 1 -- 172.21.15.19:0/1266805933 shutdown_connections 2023-11-20T06:43:10.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.859+0000 7f2d31165640 1 -- 172.21.15.19:0/1266805933 wait complete. 2023-11-20T06:43:10.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.859+0000 7f2d31165640 1 Processor -- start 2023-11-20T06:43:10.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.859+0000 7f2d31165640 1 -- start start 2023-11-20T06:43:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.859+0000 7f2d31165640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d2c0adc10 0x7f2d2c1583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.859+0000 7f2d31165640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d2c1597c0 0x7f2d2c1575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.859+0000 7f2d31165640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d2c159ba0 0x7f2d2c157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d31165640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c0c58d0 con 0x7f2d2c159ba0 2023-11-20T06:43:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d31165640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c156590 con 0x7f2d2c1597c0 2023-11-20T06:43:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d31165640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c156870 con 0x7f2d2c0adc10 2023-11-20T06:43:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d23fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d2c1597c0 0x7f2d2c1575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d2ad9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d2c0adc10 0x7f2d2c1583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d2b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d2c159ba0 0x7f2d2c157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d2ad9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d2c0adc10 0x7f2d2c1583a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:51114/0 (socket says 172.21.15.19:51114) 2023-11-20T06:43:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d2ad9d640 1 -- 172.21.15.19:0/1303504235 learned_addr learned my addr 172.21.15.19:0/1303504235 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:10.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d2b59e640 1 -- 172.21.15.19:0/1303504235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d2c0adc10 msgr2=0x7f2d2c1583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d2b59e640 1 --2- 172.21.15.19:0/1303504235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d2c0adc10 0x7f2d2c1583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d2b59e640 1 -- 172.21.15.19:0/1303504235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d2c1597c0 msgr2=0x7f2d2c1575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:10.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d2b59e640 1 --2- 172.21.15.19:0/1303504235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d2c1597c0 0x7f2d2c1575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:10.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d2b59e640 1 -- 172.21.15.19:0/1303504235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c0094d0 con 0x7f2d2c159ba0 2023-11-20T06:43:10.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d2ad9d640 1 --2- 172.21.15.19:0/1303504235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d2c0adc10 0x7f2d2c1583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:43:10.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d2b59e640 1 --2- 172.21.15.19:0/1303504235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d2c159ba0 0x7f2d2c157b20 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400bdf0 tx=0x7f2d2400bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:10.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d237fe640 1 -- 172.21.15.19:0/1303504235 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2400cd70 con 0x7f2d2c159ba0 2023-11-20T06:43:10.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d237fe640 1 -- 172.21.15.19:0/1303504235 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d24014440 con 0x7f2d2c159ba0 2023-11-20T06:43:10.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d31165640 1 -- 172.21.15.19:0/1303504235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2c156b50 con 0x7f2d2c159ba0 2023-11-20T06:43:10.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d237fe640 1 -- 172.21.15.19:0/1303504235 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24014830 con 0x7f2d2c159ba0 2023-11-20T06:43:10.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d31165640 1 -- 172.21.15.19:0/1303504235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2c157110 con 0x7f2d2c159ba0 2023-11-20T06:43:10.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d31165640 1 -- 172.21.15.19:0/1303504235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2c0c5a40 con 0x7f2d2c159ba0 2023-11-20T06:43:10.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.863+0000 7f2d237fe640 1 -- 172.21.15.19:0/1303504235 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2d2401d3b0 con 0x7f2d2c159ba0 2023-11-20T06:43:10.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.867+0000 7f2d237fe640 1 --2- 172.21.15.19:0/1303504235 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2d0c0664a0 0x7f2d0c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:10.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.867+0000 7f2d237fe640 1 -- 172.21.15.19:0/1303504235 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f2d24083d90 con 0x7f2d2c159ba0 2023-11-20T06:43:10.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.867+0000 7f2d2ad9d640 1 --2- 172.21.15.19:0/1303504235 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2d0c0664a0 0x7f2d0c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:10.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.867+0000 7f2d2ad9d640 1 --2- 172.21.15.19:0/1303504235 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2d0c0664a0 0x7f2d0c068960 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c01c540 tx=0x7f2d1c0b6040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:10.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:10.867+0000 7f2d237fe640 1 -- 172.21.15.19:0/1303504235 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2d240513e0 con 0x7f2d2c159ba0 2023-11-20T06:43:11.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.027+0000 7f2d31165640 1 -- 172.21.15.19:0/1303504235 --> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d2c074010 con 0x7f2d0c0664a0 2023-11-20T06:43:11.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.027+0000 7f2d237fe640 1 -- 172.21.15.19:0/1303504235 <== mgr.4109 v2:172.21.15.190:6832/142426253 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2d2c074010 con 0x7f2d0c0664a0 2023-11-20T06:43:11.033 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 6 to deep-scrub 2023-11-20T06:43:11.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.027+0000 7f2d31165640 1 -- 172.21.15.19:0/1303504235 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2d0c0664a0 msgr2=0x7f2d0c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:11.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.027+0000 7f2d31165640 1 --2- 172.21.15.19:0/1303504235 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2d0c0664a0 0x7f2d0c068960 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c01c540 tx=0x7f2d1c0b6040 comp rx=0 tx=0).stop 2023-11-20T06:43:11.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.027+0000 7f2d31165640 1 -- 172.21.15.19:0/1303504235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d2c159ba0 msgr2=0x7f2d2c157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.027+0000 7f2d31165640 1 --2- 172.21.15.19:0/1303504235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d2c159ba0 0x7f2d2c157b20 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400bdf0 tx=0x7f2d2400bee0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.027+0000 7f2d31165640 1 -- 172.21.15.19:0/1303504235 shutdown_connections 2023-11-20T06:43:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.027+0000 7f2d31165640 1 --2- 172.21.15.19:0/1303504235 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f2d0c0664a0 0x7f2d0c068960 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.027+0000 7f2d31165640 1 --2- 172.21.15.19:0/1303504235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d2c159ba0 0x7f2d2c157b20 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.027+0000 7f2d31165640 1 --2- 172.21.15.19:0/1303504235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d2c1597c0 0x7f2d2c1575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.027+0000 7f2d31165640 1 --2- 172.21.15.19:0/1303504235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2d2c0adc10 0x7f2d2c1583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.027+0000 7f2d31165640 1 -- 172.21.15.19:0/1303504235 >> 172.21.15.19:0/1303504235 conn(0x7f2d2c06c190 msgr2=0x7f2d2c0af4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.031+0000 7f2d31165640 1 -- 172.21.15.19:0/1303504235 shutdown_connections 2023-11-20T06:43:11.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.031+0000 7f2d31165640 1 -- 172.21.15.19:0/1303504235 wait complete. 2023-11-20T06:43:11.054 INFO:tasks.ceph:Scrubbing osd.7 2023-11-20T06:43:11.054 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-20T06:43:11.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.195+0000 7fafb7d80640 1 Processor -- start 2023-11-20T06:43:11.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.195+0000 7fafb7d80640 1 -- start start 2023-11-20T06:43:11.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.195+0000 7fafb7d80640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fafb01595a0 0x7fafb006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.195+0000 7fafb7d80640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fafb0159980 0x7fafb006c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.195+0000 7fafb7d80640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fafb00b3bc0 0x7fafb00b4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.195+0000 7fafb7d80640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb00b45b0 con 0x7fafb01595a0 2023-11-20T06:43:11.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.195+0000 7fafb7d80640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb00c8a20 con 0x7fafb0159980 2023-11-20T06:43:11.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.195+0000 7fafb7d80640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00c8c10 con 0x7fafb00b3bc0 2023-11-20T06:43:11.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.195+0000 7fafb5b1c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fafb01595a0 0x7fafb006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:11.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.195+0000 7fafb5b1c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fafb01595a0 0x7fafb006c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51912/0 (socket says 172.21.15.19:51912) 2023-11-20T06:43:11.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.195+0000 7fafb5b1c640 1 -- 172.21.15.19:0/2444606525 learned_addr learned my addr 172.21.15.19:0/2444606525 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:11.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.199+0000 7fafb631d640 1 --2- 172.21.15.19:0/2444606525 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fafb00b3bc0 0x7fafb00b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:11.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.199+0000 7fafb531b640 1 --2- 172.21.15.19:0/2444606525 >> v2:172.21.15.190:3300/0 conn(0x7fafb0159980 0x7fafb006c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:11.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.199+0000 7fafb5b1c640 1 -- 172.21.15.19:0/2444606525 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fafb00b3bc0 msgr2=0x7fafb00b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:11.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.199+0000 7fafb5b1c640 1 --2- 172.21.15.19:0/2444606525 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fafb00b3bc0 0x7fafb00b4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.199+0000 7fafb5b1c640 1 -- 172.21.15.19:0/2444606525 >> v2:172.21.15.190:3300/0 conn(0x7fafb0159980 msgr2=0x7fafb006c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:11.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.199+0000 7fafb5b1c640 1 --2- 172.21.15.19:0/2444606525 >> v2:172.21.15.190:3300/0 conn(0x7fafb0159980 0x7fafb006c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.199+0000 7fafb5b1c640 1 -- 172.21.15.19:0/2444606525 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb00c8ef0 con 0x7fafb01595a0 2023-11-20T06:43:11.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.199+0000 7fafb531b640 1 --2- 172.21.15.19:0/2444606525 >> v2:172.21.15.190:3300/0 conn(0x7fafb0159980 0x7fafb006c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:43:11.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.199+0000 7fafb631d640 1 --2- 172.21.15.19:0/2444606525 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fafb00b3bc0 0x7fafb00b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:43:11.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.199+0000 7fafb5b1c640 1 --2- 172.21.15.19:0/2444606525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb01595a0 0x7fafb006c4b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fafb00b1df0 tx=0x7fafac01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696c377fd9affdbc server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:11.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.199+0000 7fafb4b1a640 1 -- 172.21.15.19:0/2444606525 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac0ab600 con 0x7fafb01595a0 2023-11-20T06:43:11.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.199+0000 7fafb4b1a640 1 -- 172.21.15.19:0/2444606525 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac0ab760 con 0x7fafb01595a0 2023-11-20T06:43:11.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.199+0000 7fafb4b1a640 1 -- 172.21.15.19:0/2444606525 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac0abaf0 con 0x7fafb01595a0 2023-11-20T06:43:11.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.199+0000 7fafb7d80640 1 -- 172.21.15.19:0/2444606525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb01595a0 msgr2=0x7fafb006c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:11.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.199+0000 7fafb7d80640 1 --2- 172.21.15.19:0/2444606525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb01595a0 0x7fafb006c4b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fafb00b1df0 tx=0x7fafac01c440 comp rx=0 tx=0).stop 2023-11-20T06:43:11.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb7d80640 1 -- 172.21.15.19:0/2444606525 shutdown_connections 2023-11-20T06:43:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb7d80640 1 --2- 172.21.15.19:0/2444606525 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fafb00b3bc0 0x7fafb00b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb7d80640 1 --2- 172.21.15.19:0/2444606525 >> v2:172.21.15.190:3300/0 conn(0x7fafb0159980 0x7fafb006c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb7d80640 1 --2- 172.21.15.19:0/2444606525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb01595a0 0x7fafb006c4b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb7d80640 1 -- 172.21.15.19:0/2444606525 >> 172.21.15.19:0/2444606525 conn(0x7fafb006a820 msgr2=0x7fafb00b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb7d80640 1 -- 172.21.15.19:0/2444606525 shutdown_connections 2023-11-20T06:43:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb7d80640 1 -- 172.21.15.19:0/2444606525 wait complete. 2023-11-20T06:43:11.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb7d80640 1 Processor -- start 2023-11-20T06:43:11.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb7d80640 1 -- start start 2023-11-20T06:43:11.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb7d80640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fafb00b3bc0 0x7fafb014a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb7d80640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fafb01595a0 0x7fafb00cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb7d80640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb014ce10 0x7fafb00ce380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb7d80640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb014c9f0 con 0x7fafb014ce10 2023-11-20T06:43:11.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb7d80640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb014aa90 con 0x7fafb00b3bc0 2023-11-20T06:43:11.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb7d80640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb01f9650 con 0x7fafb01595a0 2023-11-20T06:43:11.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb631d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb014ce10 0x7fafb00ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:11.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb631d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb014ce10 0x7fafb00ce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51914/0 (socket says 172.21.15.19:51914) 2023-11-20T06:43:11.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb631d640 1 -- 172.21.15.19:0/1398112801 learned_addr learned my addr 172.21.15.19:0/1398112801 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:11.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb531b640 1 --2- 172.21.15.19:0/1398112801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fafb01595a0 0x7fafb00cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:11.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb5b1c640 1 --2- 172.21.15.19:0/1398112801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fafb00b3bc0 0x7fafb014a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:11.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb631d640 1 -- 172.21.15.19:0/1398112801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fafb01595a0 msgr2=0x7fafb00cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:11.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb631d640 1 --2- 172.21.15.19:0/1398112801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fafb01595a0 0x7fafb00cde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb631d640 1 -- 172.21.15.19:0/1398112801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fafb00b3bc0 msgr2=0x7fafb014a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:11.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb631d640 1 --2- 172.21.15.19:0/1398112801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fafb00b3bc0 0x7fafb014a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb631d640 1 -- 172.21.15.19:0/1398112801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac0094d0 con 0x7fafb014ce10 2023-11-20T06:43:11.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb531b640 1 --2- 172.21.15.19:0/1398112801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fafb01595a0 0x7fafb00cde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:43:11.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb5b1c640 1 --2- 172.21.15.19:0/1398112801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fafb00b3bc0 0x7fafb014a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:43:11.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.203+0000 7fafb631d640 1 --2- 172.21.15.19:0/1398112801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb014ce10 0x7fafb00ce380 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fafa8007e40 tx=0x7fafa800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:11.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.207+0000 7fafa67fc640 1 -- 172.21.15.19:0/1398112801 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa80039a0 con 0x7fafb014ce10 2023-11-20T06:43:11.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.207+0000 7fafa67fc640 1 -- 172.21.15.19:0/1398112801 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa800f040 con 0x7fafb014ce10 2023-11-20T06:43:11.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.207+0000 7fafa67fc640 1 -- 172.21.15.19:0/1398112801 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa8003d20 con 0x7fafb014ce10 2023-11-20T06:43:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.207+0000 7fafb7d80640 1 -- 172.21.15.19:0/1398112801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb014c050 con 0x7fafb014ce10 2023-11-20T06:43:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.207+0000 7fafb7d80640 1 -- 172.21.15.19:0/1398112801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb014c610 con 0x7fafb014ce10 2023-11-20T06:43:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.207+0000 7fafb7d80640 1 -- 172.21.15.19:0/1398112801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fafb00c9790 con 0x7fafb014ce10 2023-11-20T06:43:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.207+0000 7fafa67fc640 1 -- 172.21.15.19:0/1398112801 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fafa8004030 con 0x7fafb014ce10 2023-11-20T06:43:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.207+0000 7fafa67fc640 1 --2- 172.21.15.19:0/1398112801 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faf940664a0 0x7faf94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.207+0000 7fafa67fc640 1 -- 172.21.15.19:0/1398112801 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fafa8084730 con 0x7fafb014ce10 2023-11-20T06:43:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.207+0000 7fafa67fc640 1 --2- 172.21.15.19:0/1398112801 >> [v2:172.21.15.190:6800/1124210179,v1:172.21.15.190:6801/1124210179] conn(0x7faf9406c7a0 0x7faf9406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.207+0000 7fafa67fc640 1 -- 172.21.15.19:0/1398112801 --> [v2:172.21.15.190:6800/1124210179,v1:172.21.15.190:6801/1124210179] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf9406f2b0 con 0x7faf9406c7a0 2023-11-20T06:43:11.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.207+0000 7fafa67fc640 1 -- 172.21.15.19:0/1398112801 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafa8084aa0 con 0x7fafb014ce10 2023-11-20T06:43:11.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.207+0000 7fafb5b1c640 1 --2- 172.21.15.19:0/1398112801 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faf940664a0 0x7faf94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:11.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.207+0000 7fafb531b640 1 --2- 172.21.15.19:0/1398112801 >> [v2:172.21.15.190:6800/1124210179,v1:172.21.15.190:6801/1124210179] conn(0x7faf9406c7a0 0x7faf9406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:11.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.211+0000 7fafb5b1c640 1 --2- 172.21.15.19:0/1398112801 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faf940664a0 0x7faf94068960 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fafac0af000 tx=0x7fafac0a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.211+0000 7fafb531b640 1 --2- 172.21.15.19:0/1398112801 >> [v2:172.21.15.190:6800/1124210179,v1:172.21.15.190:6801/1124210179] conn(0x7faf9406c7a0 0x7faf9406ebe0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.211+0000 7fafa67fc640 1 -- 172.21.15.19:0/1398112801 <== osd.7 v2:172.21.15.190:6800/1124210179 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7faf9406f2b0 con 0x7faf9406c7a0 2023-11-20T06:43:11.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.223+0000 7fafb7d80640 1 -- 172.21.15.19:0/1398112801 --> [v2:172.21.15.190:6800/1124210179,v1:172.21.15.190:6801/1124210179] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fafb004e170 con 0x7faf9406c7a0 2023-11-20T06:43:11.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.223+0000 7fafa67fc640 1 -- 172.21.15.19:0/1398112801 <== osd.7 v2:172.21.15.190:6800/1124210179 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fafb004e170 con 0x7faf9406c7a0 2023-11-20T06:43:11.230 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-20T06:43:11.230 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-20T06:43:11.230 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-20T06:43:11.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.223+0000 7fafb7d80640 1 -- 172.21.15.19:0/1398112801 >> [v2:172.21.15.190:6800/1124210179,v1:172.21.15.190:6801/1124210179] conn(0x7faf9406c7a0 msgr2=0x7faf9406ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:11.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.223+0000 7fafb7d80640 1 --2- 172.21.15.19:0/1398112801 >> [v2:172.21.15.190:6800/1124210179,v1:172.21.15.190:6801/1124210179] conn(0x7faf9406c7a0 0x7faf9406ebe0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.223+0000 7fafb7d80640 1 -- 172.21.15.19:0/1398112801 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faf940664a0 msgr2=0x7faf94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:11.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.223+0000 7fafb7d80640 1 --2- 172.21.15.19:0/1398112801 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faf940664a0 0x7faf94068960 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fafac0af000 tx=0x7fafac0a7000 comp rx=0 tx=0).stop 2023-11-20T06:43:11.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.223+0000 7fafb7d80640 1 -- 172.21.15.19:0/1398112801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb014ce10 msgr2=0x7fafb00ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:11.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.223+0000 7fafb7d80640 1 --2- 172.21.15.19:0/1398112801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb014ce10 0x7fafb00ce380 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fafa8007e40 tx=0x7fafa800d4a0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.223+0000 7fafb631d640 1 -- 172.21.15.19:0/1398112801 reap_dead start 2023-11-20T06:43:11.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.223+0000 7fafb7d80640 1 -- 172.21.15.19:0/1398112801 shutdown_connections 2023-11-20T06:43:11.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.223+0000 7fafb7d80640 1 -- 172.21.15.19:0/1398112801 >> 172.21.15.19:0/1398112801 conn(0x7fafb006a820 msgr2=0x7fafb00ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:11.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.223+0000 7fafb7d80640 1 -- 172.21.15.19:0/1398112801 shutdown_connections 2023-11-20T06:43:11.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.223+0000 7fafb7d80640 1 -- 172.21.15.19:0/1398112801 wait complete. 2023-11-20T06:43:11.248 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-20T06:43:11.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.387+0000 7f79c9417640 1 Processor -- start 2023-11-20T06:43:11.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.387+0000 7f79c9417640 1 -- start start 2023-11-20T06:43:11.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.387+0000 7f79c9417640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f79c41597c0 0x7f79c40ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.387+0000 7f79c9417640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79c4159ba0 0x7f79c40cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.387+0000 7f79c9417640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f79c40adc10 0x7f79c40cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.387+0000 7f79c9417640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c40723d0 con 0x7f79c41597c0 2023-11-20T06:43:11.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.387+0000 7f79c9417640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c40717c0 con 0x7f79c40adc10 2023-11-20T06:43:11.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.387+0000 7f79c9417640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4071aa0 con 0x7f79c4159ba0 2023-11-20T06:43:11.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.387+0000 7f79c2ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f79c41597c0 0x7f79c40ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:11.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.387+0000 7f79c2ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f79c41597c0 0x7f79c40ad6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51930/0 (socket says 172.21.15.19:51930) 2023-11-20T06:43:11.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.387+0000 7f79c2ffd640 1 -- 172.21.15.19:0/2986792934 learned_addr learned my addr 172.21.15.19:0/2986792934 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:11.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.387+0000 7f79bbfff640 1 --2- 172.21.15.19:0/2986792934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79c4159ba0 0x7f79c40cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:11.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.387+0000 7f79c37fe640 1 --2- 172.21.15.19:0/2986792934 >> v2:172.21.15.190:3300/0 conn(0x7f79c40adc10 0x7f79c40cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:11.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.387+0000 7f79c2ffd640 1 -- 172.21.15.19:0/2986792934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79c4159ba0 msgr2=0x7f79c40cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:11.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.387+0000 7f79c2ffd640 1 --2- 172.21.15.19:0/2986792934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79c4159ba0 0x7f79c40cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.387+0000 7f79c2ffd640 1 -- 172.21.15.19:0/2986792934 >> v2:172.21.15.190:3300/0 conn(0x7f79c40adc10 msgr2=0x7f79c40cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:11.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.387+0000 7f79c2ffd640 1 --2- 172.21.15.19:0/2986792934 >> v2:172.21.15.190:3300/0 conn(0x7f79c40adc10 0x7f79c40cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.387+0000 7f79c2ffd640 1 -- 172.21.15.19:0/2986792934 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c4071d80 con 0x7f79c41597c0 2023-11-20T06:43:11.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.391+0000 7f79c2ffd640 1 --2- 172.21.15.19:0/2986792934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c41597c0 0x7f79c40ad6d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f79c406e330 tx=0x7f79b401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c797be4e5b7248 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:11.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.391+0000 7f79c27fc640 1 -- 172.21.15.19:0/2986792934 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b40a7070 con 0x7f79c41597c0 2023-11-20T06:43:11.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.391+0000 7f79c27fc640 1 -- 172.21.15.19:0/2986792934 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b40ab430 con 0x7f79c41597c0 2023-11-20T06:43:11.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.391+0000 7f79c27fc640 1 -- 172.21.15.19:0/2986792934 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b40ab7c0 con 0x7f79c41597c0 2023-11-20T06:43:11.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.391+0000 7f79c9417640 1 -- 172.21.15.19:0/2986792934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c41597c0 msgr2=0x7f79c40ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:11.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.391+0000 7f79c9417640 1 --2- 172.21.15.19:0/2986792934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c41597c0 0x7f79c40ad6d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f79c406e330 tx=0x7f79b401c4d0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79c9417640 1 -- 172.21.15.19:0/2986792934 shutdown_connections 2023-11-20T06:43:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79c9417640 1 --2- 172.21.15.19:0/2986792934 >> v2:172.21.15.190:3300/0 conn(0x7f79c40adc10 0x7f79c40cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79c9417640 1 --2- 172.21.15.19:0/2986792934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79c4159ba0 0x7f79c40cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79c9417640 1 --2- 172.21.15.19:0/2986792934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c41597c0 0x7f79c40ad6d0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79c9417640 1 -- 172.21.15.19:0/2986792934 >> 172.21.15.19:0/2986792934 conn(0x7f79c406c190 msgr2=0x7f79c406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79c9417640 1 -- 172.21.15.19:0/2986792934 shutdown_connections 2023-11-20T06:43:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79c9417640 1 -- 172.21.15.19:0/2986792934 wait complete. 2023-11-20T06:43:11.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79c9417640 1 Processor -- start 2023-11-20T06:43:11.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79c9417640 1 -- start start 2023-11-20T06:43:11.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79c9417640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79c40adc10 0x7f79c40cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79c9417640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c41597c0 0x7f79c414ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79c9417640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79c4159ba0 0x7f79c4159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79c9417640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c40ca6a0 con 0x7f79c41597c0 2023-11-20T06:43:11.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79c9417640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c40cac20 con 0x7f79c40adc10 2023-11-20T06:43:11.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79c9417640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c415aa30 con 0x7f79c4159ba0 2023-11-20T06:43:11.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79bbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c41597c0 0x7f79c414ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:11.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79bbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c41597c0 0x7f79c414ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51934/0 (socket says 172.21.15.19:51934) 2023-11-20T06:43:11.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79bbfff640 1 -- 172.21.15.19:0/3535711800 learned_addr learned my addr 172.21.15.19:0/3535711800 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:11.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79bbfff640 1 -- 172.21.15.19:0/3535711800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79c4159ba0 msgr2=0x7f79c4159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:11.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79bbfff640 1 --2- 172.21.15.19:0/3535711800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79c4159ba0 0x7f79c4159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79bbfff640 1 -- 172.21.15.19:0/3535711800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79c40adc10 msgr2=0x7f79c40cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:11.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79bbfff640 1 --2- 172.21.15.19:0/3535711800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79c40adc10 0x7f79c40cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79bbfff640 1 -- 172.21.15.19:0/3535711800 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b40094d0 con 0x7f79c41597c0 2023-11-20T06:43:11.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79bbfff640 1 --2- 172.21.15.19:0/3535711800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c41597c0 0x7f79c414ae20 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f79ac00e870 tx=0x7f79ac00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:11.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79bb7fe640 1 -- 172.21.15.19:0/3535711800 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac009510 con 0x7f79c41597c0 2023-11-20T06:43:11.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79bb7fe640 1 -- 172.21.15.19:0/3535711800 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac00eec0 con 0x7f79c41597c0 2023-11-20T06:43:11.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79bb7fe640 1 -- 172.21.15.19:0/3535711800 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac00cac0 con 0x7f79c41597c0 2023-11-20T06:43:11.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.395+0000 7f79c9417640 1 -- 172.21.15.19:0/3535711800 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c415ad10 con 0x7f79c41597c0 2023-11-20T06:43:11.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.399+0000 7f79c9417640 1 -- 172.21.15.19:0/3535711800 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c40cb5f0 con 0x7f79c41597c0 2023-11-20T06:43:11.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.399+0000 7f79c9417640 1 -- 172.21.15.19:0/3535711800 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c40cb870 con 0x7f79c41597c0 2023-11-20T06:43:11.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.399+0000 7f79bb7fe640 1 -- 172.21.15.19:0/3535711800 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f79ac00cc20 con 0x7f79c41597c0 2023-11-20T06:43:11.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.399+0000 7f79bb7fe640 1 --2- 172.21.15.19:0/3535711800 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f79a40664a0 0x7f79a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.399+0000 7f79bb7fe640 1 -- 172.21.15.19:0/3535711800 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f79ac083df0 con 0x7f79c41597c0 2023-11-20T06:43:11.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.399+0000 7f79c2ffd640 1 --2- 172.21.15.19:0/3535711800 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f79a40664a0 0x7f79a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:11.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.399+0000 7f79c2ffd640 1 --2- 172.21.15.19:0/3535711800 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f79a40664a0 0x7f79a4068960 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f79b40af000 tx=0x7f79b4004740 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:11.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.403+0000 7f79bb7fe640 1 -- 172.21.15.19:0/3535711800 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f79c40cb870 con 0x7f79c41597c0 2023-11-20T06:43:11.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.559+0000 7f79c9417640 1 -- 172.21.15.19:0/3535711800 --> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f79c415af50 con 0x7f79a40664a0 2023-11-20T06:43:11.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.563+0000 7f79bb7fe640 1 -- 172.21.15.19:0/3535711800 <== mgr.4109 v2:172.21.15.190:6832/142426253 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f79c415af50 con 0x7f79a40664a0 2023-11-20T06:43:11.567 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 7 to deep-scrub 2023-11-20T06:43:11.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.563+0000 7f79c9417640 1 -- 172.21.15.19:0/3535711800 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f79a40664a0 msgr2=0x7f79a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.563+0000 7f79c9417640 1 --2- 172.21.15.19:0/3535711800 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f79a40664a0 0x7f79a4068960 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f79b40af000 tx=0x7f79b4004740 comp rx=0 tx=0).stop 2023-11-20T06:43:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.563+0000 7f79c9417640 1 -- 172.21.15.19:0/3535711800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c41597c0 msgr2=0x7f79c414ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.563+0000 7f79c9417640 1 --2- 172.21.15.19:0/3535711800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c41597c0 0x7f79c414ae20 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f79ac00e870 tx=0x7f79ac00ec70 comp rx=0 tx=0).stop 2023-11-20T06:43:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.563+0000 7f79c9417640 1 -- 172.21.15.19:0/3535711800 shutdown_connections 2023-11-20T06:43:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.563+0000 7f79c9417640 1 --2- 172.21.15.19:0/3535711800 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f79a40664a0 0x7f79a4068960 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.563+0000 7f79c9417640 1 --2- 172.21.15.19:0/3535711800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79c4159ba0 0x7f79c4159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.563+0000 7f79c9417640 1 --2- 172.21.15.19:0/3535711800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c41597c0 0x7f79c414ae20 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.563+0000 7f79c9417640 1 --2- 172.21.15.19:0/3535711800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79c40adc10 0x7f79c40cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.563+0000 7f79c9417640 1 -- 172.21.15.19:0/3535711800 >> 172.21.15.19:0/3535711800 conn(0x7f79c406c190 msgr2=0x7f79c414d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:11.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.563+0000 7f79c9417640 1 -- 172.21.15.19:0/3535711800 shutdown_connections 2023-11-20T06:43:11.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.563+0000 7f79c9417640 1 -- 172.21.15.19:0/3535711800 wait complete. 2023-11-20T06:43:11.589 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T06:43:11.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.727+0000 7fde38bc5640 1 Processor -- start 2023-11-20T06:43:11.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.727+0000 7fde38bc5640 1 -- start start 2023-11-20T06:43:11.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.727+0000 7fde38bc5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde3415ca70 0x7fde340d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.727+0000 7fde38bc5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fde340cf7a0 0x7fde340c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.727+0000 7fde38bc5640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde340c65f0 con 0x7fde340d3550 2023-11-20T06:43:11.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.727+0000 7fde38bc5640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde340ce820 con 0x7fde340cf7a0 2023-11-20T06:43:11.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.727+0000 7fde38bc5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde340cdf80 con 0x7fde3415ca70 2023-11-20T06:43:11.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.727+0000 7fde32d9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fde340cf7a0 0x7fde340c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:11.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.727+0000 7fde3259c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde3415ca70 0x7fde340d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:11.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.727+0000 7fde32d9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fde340cf7a0 0x7fde340c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.19:44880/0 (socket says 172.21.15.19:44880) 2023-11-20T06:43:11.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.727+0000 7fde3259c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde3415ca70 0x7fde340d3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.19:51156/0 (socket says 172.21.15.19:51156) 2023-11-20T06:43:11.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.727+0000 7fde32d9d640 1 -- 172.21.15.19:0/3265017117 learned_addr learned my addr 172.21.15.19:0/3265017117 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:11.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.727+0000 7fde2bfff640 1 --1- 172.21.15.19:0/3265017117 >> v1:172.21.15.190:6789/0 conn(0x7fde340d3550 0x7fde340cf090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.19:36004/0 (socket says 172.21.15.19:36004) 2023-11-20T06:43:11.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.727+0000 7fde3259c640 1 -- 172.21.15.19:0/3265017117 >> v2:172.21.15.190:3300/0 conn(0x7fde340cf7a0 msgr2=0x7fde340c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:11.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.727+0000 7fde3259c640 1 --2- 172.21.15.19:0/3265017117 >> v2:172.21.15.190:3300/0 conn(0x7fde340cf7a0 0x7fde340c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.727+0000 7fde3259c640 1 -- 172.21.15.19:0/3265017117 >> v1:172.21.15.190:6789/0 conn(0x7fde340d3550 legacy=0x7fde340cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:11.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.727+0000 7fde3259c640 1 -- 172.21.15.19:0/3265017117 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde340ce260 con 0x7fde3415ca70 2023-11-20T06:43:11.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.731+0000 7fde3259c640 1 --2- 172.21.15.19:0/3265017117 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde3415ca70 0x7fde340d3010 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fde240097a0 tx=0x7fde2401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cf67834fec3c7a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:11.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.731+0000 7fde31d9b640 1 -- 172.21.15.19:0/3265017117 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde240ad640 con 0x7fde3415ca70 2023-11-20T06:43:11.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.731+0000 7fde31d9b640 1 -- 172.21.15.19:0/3265017117 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde240ad7a0 con 0x7fde3415ca70 2023-11-20T06:43:11.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.731+0000 7fde31d9b640 1 -- 172.21.15.19:0/3265017117 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde240adb30 con 0x7fde3415ca70 2023-11-20T06:43:11.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.731+0000 7fde38bc5640 1 -- 172.21.15.19:0/3265017117 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde3415ca70 msgr2=0x7fde340d3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:11.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.731+0000 7fde38bc5640 1 --2- 172.21.15.19:0/3265017117 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde3415ca70 0x7fde340d3010 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fde240097a0 tx=0x7fde2401c430 comp rx=0 tx=0).stop 2023-11-20T06:43:11.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.731+0000 7fde38bc5640 1 -- 172.21.15.19:0/3265017117 shutdown_connections 2023-11-20T06:43:11.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.731+0000 7fde38bc5640 1 --2- 172.21.15.19:0/3265017117 >> v2:172.21.15.190:3300/0 conn(0x7fde340cf7a0 0x7fde340c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.731+0000 7fde38bc5640 1 --2- 172.21.15.19:0/3265017117 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde3415ca70 0x7fde340d3010 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.731+0000 7fde38bc5640 1 -- 172.21.15.19:0/3265017117 >> 172.21.15.19:0/3265017117 conn(0x7fde3409bc50 msgr2=0x7fde340d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:11.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.731+0000 7fde38bc5640 1 -- 172.21.15.19:0/3265017117 shutdown_connections 2023-11-20T06:43:11.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.731+0000 7fde38bc5640 1 -- 172.21.15.19:0/3265017117 wait complete. 2023-11-20T06:43:11.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde38bc5640 1 Processor -- start 2023-11-20T06:43:11.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde38bc5640 1 -- start start 2023-11-20T06:43:11.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde38bc5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde340cf7a0 0x7fde34150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde38bc5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde340d3550 0x7fde34153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde38bc5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde3415ca70 0x7fde3415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde38bc5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde34152fe0 con 0x7fde340d3550 2023-11-20T06:43:11.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde38bc5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde34152360 con 0x7fde340cf7a0 2023-11-20T06:43:11.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde38bc5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde34152640 con 0x7fde3415ca70 2023-11-20T06:43:11.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde2bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde340d3550 0x7fde34153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:11.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde2bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde340d3550 0x7fde34153400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51942/0 (socket says 172.21.15.19:51942) 2023-11-20T06:43:11.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde2bfff640 1 -- 172.21.15.19:0/2854013642 learned_addr learned my addr 172.21.15.19:0/2854013642 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:11.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde32d9d640 1 --2- 172.21.15.19:0/2854013642 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde3415ca70 0x7fde3415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:11.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde3259c640 1 --2- 172.21.15.19:0/2854013642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde340cf7a0 0x7fde34150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:11.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde2bfff640 1 -- 172.21.15.19:0/2854013642 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde3415ca70 msgr2=0x7fde3415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:11.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde2bfff640 1 --2- 172.21.15.19:0/2854013642 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde3415ca70 0x7fde3415aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde2bfff640 1 -- 172.21.15.19:0/2854013642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde340cf7a0 msgr2=0x7fde34150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:11.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde2bfff640 1 --2- 172.21.15.19:0/2854013642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde340cf7a0 0x7fde34150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde2bfff640 1 -- 172.21.15.19:0/2854013642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde240093b0 con 0x7fde340d3550 2023-11-20T06:43:11.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde2bfff640 1 --2- 172.21.15.19:0/2854013642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde340d3550 0x7fde34153400 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00c490 tx=0x7fde1c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:11.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde2affd640 1 -- 172.21.15.19:0/2854013642 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c007480 con 0x7fde340d3550 2023-11-20T06:43:11.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde2affd640 1 -- 172.21.15.19:0/2854013642 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c0075e0 con 0x7fde340d3550 2023-11-20T06:43:11.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde2affd640 1 -- 172.21.15.19:0/2854013642 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c004a10 con 0x7fde340d3550 2023-11-20T06:43:11.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.735+0000 7fde38bc5640 1 -- 172.21.15.19:0/2854013642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde34152920 con 0x7fde340d3550 2023-11-20T06:43:11.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.739+0000 7fde38bc5640 1 -- 172.21.15.19:0/2854013642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3414fcb0 con 0x7fde340d3550 2023-11-20T06:43:11.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.739+0000 7fde38bc5640 1 -- 172.21.15.19:0/2854013642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde34153120 con 0x7fde340d3550 2023-11-20T06:43:11.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.739+0000 7fde2affd640 1 -- 172.21.15.19:0/2854013642 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fde1c004b70 con 0x7fde340d3550 2023-11-20T06:43:11.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.739+0000 7fde2affd640 1 --2- 172.21.15.19:0/2854013642 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fde140664a0 0x7fde14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:11.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.739+0000 7fde2affd640 1 -- 172.21.15.19:0/2854013642 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fde1c082e10 con 0x7fde340d3550 2023-11-20T06:43:11.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.739+0000 7fde3259c640 1 --2- 172.21.15.19:0/2854013642 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fde140664a0 0x7fde14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:11.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.739+0000 7fde3259c640 1 --2- 172.21.15.19:0/2854013642 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fde140664a0 0x7fde14068960 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fde240af000 tx=0x7fde240a7070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:11.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.743+0000 7fde2affd640 1 -- 172.21.15.19:0/2854013642 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fde34153120 con 0x7fde340d3550 2023-11-20T06:43:11.899 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T06:43:11.903 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T06:43:11.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.895+0000 7fde38bc5640 1 -- 172.21.15.19:0/2854013642 --> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde340c7820 con 0x7fde140664a0 2023-11-20T06:43:11.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.899+0000 7fde2affd640 1 -- 172.21.15.19:0/2854013642 <== mgr.4109 v2:172.21.15.190:6832/142426253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50543 (secure 0 0 0) 0x7fde240a6040 con 0x7fde140664a0 2023-11-20T06:43:11.905 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:43:11.906 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-20T06:43:11.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.903+0000 7fde38bc5640 1 -- 172.21.15.19:0/2854013642 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fde140664a0 msgr2=0x7fde14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:11.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.903+0000 7fde38bc5640 1 --2- 172.21.15.19:0/2854013642 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fde140664a0 0x7fde14068960 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fde240af000 tx=0x7fde240a7070 comp rx=0 tx=0).stop 2023-11-20T06:43:11.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.903+0000 7fde38bc5640 1 -- 172.21.15.19:0/2854013642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde340d3550 msgr2=0x7fde34153400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:11.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.903+0000 7fde38bc5640 1 --2- 172.21.15.19:0/2854013642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde340d3550 0x7fde34153400 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00c490 tx=0x7fde1c00c950 comp rx=0 tx=0).stop 2023-11-20T06:43:11.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.903+0000 7fde38bc5640 1 -- 172.21.15.19:0/2854013642 shutdown_connections 2023-11-20T06:43:11.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.903+0000 7fde38bc5640 1 --2- 172.21.15.19:0/2854013642 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7fde140664a0 0x7fde14068960 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.903+0000 7fde38bc5640 1 --2- 172.21.15.19:0/2854013642 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde3415ca70 0x7fde3415aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.903+0000 7fde38bc5640 1 --2- 172.21.15.19:0/2854013642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde340d3550 0x7fde34153400 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.903+0000 7fde38bc5640 1 --2- 172.21.15.19:0/2854013642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde340cf7a0 0x7fde34150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:11.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.903+0000 7fde38bc5640 1 -- 172.21.15.19:0/2854013642 >> 172.21.15.19:0/2854013642 conn(0x7fde3409bc50 msgr2=0x7fde3406c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:11.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.903+0000 7fde38bc5640 1 -- 172.21.15.19:0/2854013642 shutdown_connections 2023-11-20T06:43:11.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:11.903+0000 7fde38bc5640 1 -- 172.21.15.19:0/2854013642 wait complete. 2023-11-20T06:43:11.927 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2023-11-20T06:43:11.510457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221400,"kb_used_data":5220,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753320,"statfs":{"total":773094113280,"available":772867399680,"internally_reserved":0,"allocated":5345280,"data_stored":3000237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.189621"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":186,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-20T06:43:01.326127+0000","last_change":"2023-11-20T06:41:03.783345+0000","last_active":"2023-11-20T06:43:01.326127+0000","last_peered":"2023-11-20T06:43:01.326127+0000","last_clean":"2023-11-20T06:43:01.326127+0000","last_became_active":"2023-11-20T06:41:03.782257+0000","last_became_peered":"2023-11-20T06:41:03.782257+0000","last_unstale":"2023-11-20T06:43:01.326127+0000","last_undegraded":"2023-11-20T06:43:01.326127+0000","last_fullsized":"2023-11-20T06:43:01.326127+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T06:41:01.979090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T06:41:01.979090+0000","last_clean_scrub_stamp":"2023-11-20T06:41:01.979090+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:20:41.084382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1114112,"data_stored":817933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.71099999999999997,"15min":0.72199999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81499999999999995,"5min":1.196,"15min":1.196},"last":0.624}]},{"osd":1,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.73699999999999999,"15min":0.75},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85899999999999999,"5min":1.881,"15min":1.881},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71299999999999997,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.88,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.54500000000000004}]},{"osd":2,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.749,"15min":0.76500000000000001},"min":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83199999999999996,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.57099999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0449999999999999,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.57099999999999995}]},{"osd":3,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.97399999999999998,"5min":1.157,"15min":1.157},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96299999999999997,"5min":2,"15min":2},"last":0.53000000000000003}]},{"osd":4,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.65700000000000003,"15min":0.66000000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.873,"5min":1.006,"15min":1.006},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68100000000000005,"15min":0.68000000000000005},"min":{"1min":0.41799999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96399999999999997,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.50600000000000001}]},{"osd":5,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.73599999999999999,"15min":0.73499999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.999,"5min":1.359,"15min":1.359},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.752,"15min":0.752},"min":{"1min":0.58199999999999996,"5min":0.436,"15min":0.436},"max":{"1min":0.98899999999999999,"5min":1.516,"15min":1.516},"last":0.58199999999999996}]},{"osd":6,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76600000000000001,"15min":0.76300000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.496},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.55100000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92300000000000004,"5min":1.224,"15min":1.224},"last":0.55400000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":520192,"data_stored":227565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91800000000000004,"5min":1.014,"15min":1.014},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.77600000000000002,"15min":0.80100000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84099999999999997,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":0.51800000000000002}]},{"osd":1,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.70999999999999996,"15min":0.72399999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82199999999999995,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.73599999999999999,"15min":0.752},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.84499999999999997,"5min":1.343,"15min":1.343},"last":0.46000000000000002}]},{"osd":2,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91700000000000004,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.5},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.75,"15min":0.76300000000000001},"min":{"1min":0.52000000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86199999999999999,"5min":1.381,"15min":1.381},"last":0.623}]},{"osd":3,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.57199999999999995,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.90800000000000003,"5min":1.833,"15min":1.833},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.84799999999999998,"15min":0.874},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.94199999999999995,"5min":4.3029999999999999,"15min":4.3029999999999999},"last":0.67100000000000004}]},{"osd":4,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63600000000000001,"15min":0.63500000000000001},"min":{"1min":0.375,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66100000000000003,"15min":0.65700000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90700000000000003,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.58599999999999997}]},{"osd":5,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65900000000000003,"15min":0.65500000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.53000000000000003}]},{"osd":7,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.74099999999999999,"15min":0.73799999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.96199999999999997,"5min":1.117,"15min":1.117},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72799999999999998,"15min":0.72699999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.032,"5min":1.101,"15min":1.101},"last":0.63400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":227565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.82899999999999996,"15min":0.86899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.84199999999999997,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65800000000000003,"15min":0.66000000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.56499999999999995}]},{"osd":1,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.623},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.73399999999999999}]},{"osd":2,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.79600000000000004,"15min":0.81799999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.03,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.82999999999999996,"15min":0.85399999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.81999999999999995,"5min":3.113,"15min":3.113},"last":0.75600000000000001}]},{"osd":3,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":1.073,"15min":1.131},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.093,"5min":8.9250000000000007,"15min":8.9250000000000007},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":1.081,"15min":1.143},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93400000000000005,"5min":8.891,"15min":8.891},"last":0.71099999999999997}]},{"osd":4,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.42299999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.621,"15min":0.625},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80400000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.78100000000000003}]},{"osd":6,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92800000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70399999999999996,"15min":0.70499999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88400000000000001,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.80300000000000005}]},{"osd":7,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.70199999999999996,"15min":0.71399999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81100000000000005,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76100000000000001,"15min":0.76200000000000001},"min":{"1min":0.61199999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.69399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":227565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.70199999999999996,"15min":0.71199999999999997},"min":{"1min":0.46000000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.872,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.751,"15min":0.76800000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93100000000000005,"5min":1.96,"15min":1.96},"last":0.58099999999999996}]},{"osd":1,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.91400000000000003,"15min":0.94799999999999995},"min":{"1min":0.53300000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.879,"5min":4.8710000000000004,"15min":4.8710000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67400000000000004,"15min":0.67900000000000005},"min":{"1min":0.5,"5min":0.441,"15min":0.441},"max":{"1min":0.84699999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.61599999999999999}]},{"osd":2,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.89200000000000002,"15min":0.92600000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.90000000000000002,"5min":4.8499999999999996,"15min":4.8499999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.73199999999999998},"min":{"1min":0.54300000000000004,"5min":0.439,"15min":0.439},"max":{"1min":0.82399999999999995,"5min":0.995,"15min":0.995},"last":0.70099999999999996}]},{"osd":3,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.72899999999999998,"15min":0.74099999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.80100000000000005,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.56999999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.86299999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.47399999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85199999999999998,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91800000000000004,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.499}]},{"osd":6,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64900000000000002,"15min":0.64500000000000002},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92600000000000005,"5min":1.139,"15min":1.139},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89400000000000002,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.53100000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.872,"5min":1.304,"15min":1.304},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.52600000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96299999999999997,"5min":1.244,"15min":1.244},"last":0.68300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":227565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":3.714,"5min":3.714,"15min":3.714},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57799999999999996}]},{"osd":1,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":3.8330000000000002,"5min":3.8330000000000002,"15min":3.8330000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.7629999999999999,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":0.42899999999999999}]},{"osd":2,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.0709999999999997,"5min":4.0709999999999997,"15min":4.0709999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.51000000000000001}]},{"osd":4,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.9169999999999998,"5min":3.9169999999999998,"15min":3.9169999999999998},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.2069999999999999,"5min":4.2069999999999999,"15min":4.2069999999999999},"last":0.94299999999999995}]},{"osd":5,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.92900000000000005}]},{"osd":6,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":4.3659999999999997,"5min":4.3659999999999997,"15min":4.3659999999999997},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.80100000000000005}]},{"osd":7,"last update":"Mon Nov 20 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":3.9700000000000002,"5min":3.9700000000000002,"15min":3.9700000000000002},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":0.98299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":227565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.504,"15min":0.52200000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58999999999999997,"5min":1.905,"15min":1.905},"last":0.433},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.47399999999999998,"15min":0.47799999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.59899999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.33200000000000002}]},{"osd":1,"last update":"Mon Nov 20 06:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58499999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70099999999999996,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.38}]},{"osd":3,"last update":"Mon Nov 20 06:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48899999999999999,"15min":0.495},"min":{"1min":0.35799999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.53900000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.627,"15min":0.64700000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.61199999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.47899999999999998}]},{"osd":4,"last update":"Mon Nov 20 06:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79400000000000004,"15min":0.80600000000000005},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.94999999999999996,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.749},"min":{"1min":0.56999999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.68200000000000005}]},{"osd":5,"last update":"Mon Nov 20 06:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.77100000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.83399999999999996,"15min":0.84599999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.006,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Nov 20 06:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.81899999999999995,"15min":0.83299999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.99199999999999999,"5min":1.546,"15min":1.546},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79700000000000004,"15min":0.80600000000000005},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":0.92700000000000005,"5min":1.268,"15min":1.268},"last":0.59599999999999997}]},{"osd":7,"last update":"Mon Nov 20 06:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.83799999999999997,"15min":0.85499999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.91500000000000004,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.97699999999999998,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.72699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":520192,"data_stored":227565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.44}]},{"osd":2,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.47099999999999997}]},{"osd":3,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.49199999999999999}]},{"osd":4,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.625}]},{"osd":5,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.68700000000000006}]},{"osd":6,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.70699999999999996}]},{"osd":7,"last update":"Mon Nov 20 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.66200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1110016,"data_stored":816914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.50700000000000001,"15min":0.52300000000000002},"min":{"1min":0.30499999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72399999999999998,"5min":1.393,"15min":1.393},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.53500000000000003,"15min":0.54900000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.999,"5min":1.532,"15min":1.532},"last":0.34499999999999997}]},{"osd":2,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.60999999999999999,"15min":0.63400000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.78200000000000003,"5min":2.625,"15min":2.625},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.57999999999999996,"15min":0.59699999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.876,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.39300000000000002}]},{"osd":3,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.55400000000000005,"15min":0.56799999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.0589999999999999,"5min":1.718,"15min":1.718},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.67600000000000005,"15min":0.69999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79000000000000004,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":0.79000000000000004}]},{"osd":4,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.81299999999999994,"15min":0.82899999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94899999999999995,"5min":2.411,"15min":2.411},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.82099999999999995},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.88400000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.77400000000000002}]},{"osd":5,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.81399999999999995,"15min":0.82299999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.022,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.88,"15min":0.90800000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.91700000000000004,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.85499999999999998}]},{"osd":6,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.90900000000000003,"15min":0.93200000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.103,"5min":3.008,"15min":3.008},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.85699999999999998,"15min":0.879},"min":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0409999999999999,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.746}]},{"osd":7,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.89700000000000002,"15min":0.91700000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.071,"5min":2.508,"15min":2.508},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.83699999999999997,"15min":0.85299999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.97899999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T06:43:11.931 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-20T06:41:01.979090+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=20, tm_hour=6, tm_min=41, tm_sec=1, tm_wday=0, tm_yday=324, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=20, tm_hour=6, tm_min=43, tm_sec=6, tm_wday=0, tm_yday=324, tm_isdst=0) 2023-11-20T06:43:11.931 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-20T06:43:31.933 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T06:43:32.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.082+0000 7faf08f63640 1 Processor -- start 2023-11-20T06:43:32.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.082+0000 7faf08f63640 1 -- start start 2023-11-20T06:43:32.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.082+0000 7faf08f63640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faf0415c910 0x7faf040d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:32.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.082+0000 7faf08f63640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7faf040d3170 0x7faf040cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:32.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.082+0000 7faf08f63640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf040ce730 con 0x7faf040cefe0 2023-11-20T06:43:32.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.082+0000 7faf08f63640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf040d17a0 con 0x7faf0415c910 2023-11-20T06:43:32.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.082+0000 7faf08f63640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf040d0dd0 con 0x7faf040d3170 2023-11-20T06:43:32.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.082+0000 7faf037fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faf0415c910 0x7faf040d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:32.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.082+0000 7faf037fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faf0415c910 0x7faf040d1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59836/0 (socket says 172.21.15.19:59836) 2023-11-20T06:43:32.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.082+0000 7faf037fe640 1 -- 172.21.15.19:0/915069995 learned_addr learned my addr 172.21.15.19:0/915069995 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:32.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.082+0000 7faf02ffd640 1 --2- 172.21.15.19:0/915069995 >> v2:172.21.15.190:3300/0 conn(0x7faf040d3170 0x7faf040cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:32.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.082+0000 7faf037fe640 1 -- 172.21.15.19:0/915069995 >> v2:172.21.15.190:3300/0 conn(0x7faf040d3170 msgr2=0x7faf040cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:32.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.082+0000 7faf037fe640 1 --2- 172.21.15.19:0/915069995 >> v2:172.21.15.190:3300/0 conn(0x7faf040d3170 0x7faf040cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.082+0000 7faf037fe640 1 -- 172.21.15.19:0/915069995 >> v1:172.21.15.190:6789/0 conn(0x7faf040cefe0 legacy=0x7faf0406b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:32.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.082+0000 7faf037fe640 1 -- 172.21.15.19:0/915069995 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf040d04a0 con 0x7faf0415c910 2023-11-20T06:43:32.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.086+0000 7faf037fe640 1 --2- 172.21.15.19:0/915069995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0415c910 0x7faf040d1260 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7faf04160400 tx=0x7faef401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221debf7ac668256 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:32.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.086+0000 7faf027fc640 1 -- 172.21.15.19:0/915069995 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef40ab640 con 0x7faf0415c910 2023-11-20T06:43:32.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.086+0000 7faf027fc640 1 -- 172.21.15.19:0/915069995 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef40a7070 con 0x7faf0415c910 2023-11-20T06:43:32.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.086+0000 7faf027fc640 1 -- 172.21.15.19:0/915069995 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef40ab9c0 con 0x7faf0415c910 2023-11-20T06:43:32.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.086+0000 7faf08f63640 1 -- 172.21.15.19:0/915069995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0415c910 msgr2=0x7faf040d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:32.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.086+0000 7faf08f63640 1 --2- 172.21.15.19:0/915069995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0415c910 0x7faf040d1260 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7faf04160400 tx=0x7faef401c440 comp rx=0 tx=0).stop 2023-11-20T06:43:32.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.086+0000 7faf08f63640 1 -- 172.21.15.19:0/915069995 shutdown_connections 2023-11-20T06:43:32.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.086+0000 7faf08f63640 1 --2- 172.21.15.19:0/915069995 >> v2:172.21.15.190:3300/0 conn(0x7faf040d3170 0x7faf040cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.086+0000 7faf08f63640 1 --2- 172.21.15.19:0/915069995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0415c910 0x7faf040d1260 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.086+0000 7faf08f63640 1 -- 172.21.15.19:0/915069995 >> 172.21.15.19:0/915069995 conn(0x7faf0409bb50 msgr2=0x7faf040d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:32.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.086+0000 7faf08f63640 1 -- 172.21.15.19:0/915069995 shutdown_connections 2023-11-20T06:43:32.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.086+0000 7faf08f63640 1 -- 172.21.15.19:0/915069995 wait complete. 2023-11-20T06:43:32.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf08f63640 1 Processor -- start 2023-11-20T06:43:32.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf08f63640 1 -- start start 2023-11-20T06:43:32.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf08f63640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf040cefe0 0x7faf040cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:32.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf08f63640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf040d3170 0x7faf04156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:32.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf08f63640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0415c910 0x7faf040c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:32.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf08f63640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf040c8b90 con 0x7faf0415c910 2023-11-20T06:43:32.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf08f63640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf041f9760 con 0x7faf040d3170 2023-11-20T06:43:32.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf08f63640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf04158000 con 0x7faf040cefe0 2023-11-20T06:43:32.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf03fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0415c910 0x7faf040c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:32.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf03fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0415c910 0x7faf040c8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59850/0 (socket says 172.21.15.19:59850) 2023-11-20T06:43:32.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf03fff640 1 -- 172.21.15.19:0/292415285 learned_addr learned my addr 172.21.15.19:0/292415285 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:32.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf02ffd640 1 --2- 172.21.15.19:0/292415285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf040d3170 0x7faf04156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:32.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf037fe640 1 --2- 172.21.15.19:0/292415285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf040cefe0 0x7faf040cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:32.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf03fff640 1 -- 172.21.15.19:0/292415285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf040cefe0 msgr2=0x7faf040cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:32.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf03fff640 1 --2- 172.21.15.19:0/292415285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf040cefe0 0x7faf040cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf03fff640 1 -- 172.21.15.19:0/292415285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf040d3170 msgr2=0x7faf04156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:32.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf03fff640 1 --2- 172.21.15.19:0/292415285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf040d3170 0x7faf04156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf03fff640 1 -- 172.21.15.19:0/292415285 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef4009480 con 0x7faf0415c910 2023-11-20T06:43:32.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf03fff640 1 --2- 172.21.15.19:0/292415285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0415c910 0x7faf040c8650 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7faefc00c760 tx=0x7faefc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:32.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faeebfff640 1 -- 172.21.15.19:0/292415285 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc003b80 con 0x7faf0415c910 2023-11-20T06:43:32.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faeebfff640 1 -- 172.21.15.19:0/292415285 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc003ce0 con 0x7faf0415c910 2023-11-20T06:43:32.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faeebfff640 1 -- 172.21.15.19:0/292415285 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc00aa30 con 0x7faf0415c910 2023-11-20T06:43:32.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf08f63640 1 -- 172.21.15.19:0/292415285 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf040cace0 con 0x7faf0415c910 2023-11-20T06:43:32.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.090+0000 7faf08f63640 1 -- 172.21.15.19:0/292415285 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf041576d0 con 0x7faf0415c910 2023-11-20T06:43:32.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.094+0000 7faf08f63640 1 -- 172.21.15.19:0/292415285 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0404e9c0 con 0x7faf0415c910 2023-11-20T06:43:32.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.094+0000 7faeebfff640 1 -- 172.21.15.19:0/292415285 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faefc00ab90 con 0x7faf0415c910 2023-11-20T06:43:32.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.094+0000 7faeebfff640 1 --2- 172.21.15.19:0/292415285 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faef00664a0 0x7faef0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:32.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.094+0000 7faeebfff640 1 -- 172.21.15.19:0/292415285 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7faefc0839b0 con 0x7faf0415c910 2023-11-20T06:43:32.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.094+0000 7faf037fe640 1 --2- 172.21.15.19:0/292415285 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faef00664a0 0x7faef0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:32.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.094+0000 7faf037fe640 1 --2- 172.21.15.19:0/292415285 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faef00664a0 0x7faef0068960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7faef40af000 tx=0x7faef40a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:32.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.098+0000 7faeebfff640 1 -- 172.21.15.19:0/292415285 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faefc051000 con 0x7faf0415c910 2023-11-20T06:43:32.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.250+0000 7faf08f63640 1 -- 172.21.15.19:0/292415285 --> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf040cf820 con 0x7faef00664a0 2023-11-20T06:43:32.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.254+0000 7faeebfff640 1 -- 172.21.15.19:0/292415285 <== mgr.4109 v2:172.21.15.190:6832/142426253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50642 (secure 0 0 0) 0x7faef4004420 con 0x7faef00664a0 2023-11-20T06:43:32.262 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:43:32.262 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-20T06:43:32.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.258+0000 7faf08f63640 1 -- 172.21.15.19:0/292415285 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faef00664a0 msgr2=0x7faef0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:32.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.258+0000 7faf08f63640 1 --2- 172.21.15.19:0/292415285 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faef00664a0 0x7faef0068960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7faef40af000 tx=0x7faef40a7000 comp rx=0 tx=0).stop 2023-11-20T06:43:32.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.258+0000 7faf08f63640 1 -- 172.21.15.19:0/292415285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0415c910 msgr2=0x7faf040c8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:32.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.258+0000 7faf08f63640 1 --2- 172.21.15.19:0/292415285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0415c910 0x7faf040c8650 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7faefc00c760 tx=0x7faefc00cc20 comp rx=0 tx=0).stop 2023-11-20T06:43:32.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.258+0000 7faf08f63640 1 -- 172.21.15.19:0/292415285 shutdown_connections 2023-11-20T06:43:32.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.258+0000 7faf08f63640 1 --2- 172.21.15.19:0/292415285 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7faef00664a0 0x7faef0068960 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.258+0000 7faf08f63640 1 --2- 172.21.15.19:0/292415285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0415c910 0x7faf040c8650 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.258+0000 7faf08f63640 1 --2- 172.21.15.19:0/292415285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf040d3170 0x7faf04156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.258+0000 7faf08f63640 1 --2- 172.21.15.19:0/292415285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf040cefe0 0x7faf040cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.258+0000 7faf08f63640 1 -- 172.21.15.19:0/292415285 >> 172.21.15.19:0/292415285 conn(0x7faf0409bb50 msgr2=0x7faf04155010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.258+0000 7faf08f63640 1 -- 172.21.15.19:0/292415285 shutdown_connections 2023-11-20T06:43:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.258+0000 7faf08f63640 1 -- 172.21.15.19:0/292415285 wait complete. 2023-11-20T06:43:32.283 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-11-20T06:43:31.515441+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221388,"kb_used_data":5220,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753332,"statfs":{"total":773094113280,"available":772867411968,"internally_reserved":0,"allocated":5345280,"data_stored":3000237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002980"},"pg_stats":[{"pgid":"1.0","version":"44'119","reported_seq":197,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-20T06:43:15.721285+0000","last_change":"2023-11-20T06:43:15.721342+0000","last_active":"2023-11-20T06:43:15.721285+0000","last_peered":"2023-11-20T06:43:15.721285+0000","last_clean":"2023-11-20T06:43:15.721285+0000","last_became_active":"2023-11-20T06:41:03.782257+0000","last_became_peered":"2023-11-20T06:41:03.782257+0000","last_unstale":"2023-11-20T06:43:15.721285+0000","last_undegraded":"2023-11-20T06:43:15.721285+0000","last_fullsized":"2023-11-20T06:43:15.721285+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'119","last_scrub_stamp":"2023-11-20T06:43:15.721183+0000","last_deep_scrub":"44'119","last_deep_scrub_stamp":"2023-11-20T06:43:15.721183+0000","last_clean_scrub_stamp":"2023-11-20T06:43:15.721183+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:10:31.650048+0000","scrub_duration":0.0077591149999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28104,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343736,"statfs":{"total":96636764160,"available":96607985664,"internally_reserved":0,"allocated":1114112,"data_stored":817933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.71099999999999997,"15min":0.72199999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81499999999999995,"5min":1.196,"15min":1.196},"last":0.69699999999999995}]},{"osd":1,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.73699999999999999,"15min":0.75},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85899999999999999,"5min":1.881,"15min":1.881},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71299999999999997,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.88,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.85599999999999998}]},{"osd":2,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.749,"15min":0.76500000000000001},"min":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83199999999999996,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.754},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.57099999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0449999999999999,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.91100000000000003}]},{"osd":3,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.97399999999999998,"5min":1.157,"15min":1.157},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96299999999999997,"5min":2,"15min":2},"last":0.77700000000000002}]},{"osd":4,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.65700000000000003,"15min":0.66000000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.873,"5min":1.006,"15min":1.006},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68100000000000005,"15min":0.68000000000000005},"min":{"1min":0.41799999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96399999999999997,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.53500000000000003}]},{"osd":5,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.73599999999999999,"15min":0.73499999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.999,"5min":1.359,"15min":1.359},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.752,"15min":0.752},"min":{"1min":0.58199999999999996,"5min":0.436,"15min":0.436},"max":{"1min":0.98899999999999999,"5min":1.516,"15min":1.516},"last":0.57799999999999996}]},{"osd":6,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76600000000000001,"15min":0.76300000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.55100000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92300000000000004,"5min":1.224,"15min":1.224},"last":0.61099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":520192,"data_stored":227565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91800000000000004,"5min":1.014,"15min":1.014},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.77600000000000002,"15min":0.80100000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84099999999999997,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":0.68799999999999994}]},{"osd":1,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.70999999999999996,"15min":0.72399999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82199999999999995,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.73599999999999999,"15min":0.752},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.84499999999999997,"5min":1.343,"15min":1.343},"last":0.65200000000000002}]},{"osd":2,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91700000000000004,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.75,"15min":0.76300000000000001},"min":{"1min":0.52000000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86199999999999999,"5min":1.381,"15min":1.381},"last":0.63800000000000001}]},{"osd":3,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.57199999999999995,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.90800000000000003,"5min":1.833,"15min":1.833},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.84799999999999998,"15min":0.874},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.94199999999999995,"5min":4.3029999999999999,"15min":4.3029999999999999},"last":0.76000000000000001}]},{"osd":4,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63600000000000001,"15min":0.63500000000000001},"min":{"1min":0.375,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.503},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66100000000000003,"15min":0.65700000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90700000000000003,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.47699999999999998}]},{"osd":5,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65900000000000003,"15min":0.65500000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.623}]},{"osd":7,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.74099999999999999,"15min":0.73799999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.96199999999999997,"5min":1.117,"15min":1.117},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72799999999999998,"15min":0.72699999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.032,"5min":1.101,"15min":1.101},"last":0.70399999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":227565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.82899999999999996,"15min":0.86899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.84199999999999997,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65800000000000003,"15min":0.66000000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.49099999999999999}]},{"osd":1,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.73899999999999999}]},{"osd":2,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.79600000000000004,"15min":0.81799999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.03,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.82999999999999996,"15min":0.85399999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.81999999999999995,"5min":3.113,"15min":3.113},"last":0.59999999999999998}]},{"osd":3,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":1.073,"15min":1.131},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.093,"5min":8.9250000000000007,"15min":8.9250000000000007},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":1.081,"15min":1.143},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93400000000000005,"5min":8.891,"15min":8.891},"last":0.65500000000000003}]},{"osd":4,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.42299999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.621,"15min":0.625},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80400000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.53800000000000003}]},{"osd":6,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92800000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70399999999999996,"15min":0.70499999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88400000000000001,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.68300000000000005}]},{"osd":7,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.70199999999999996,"15min":0.71399999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81100000000000005,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76100000000000001,"15min":0.76200000000000001},"min":{"1min":0.61199999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.75900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":227565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.70199999999999996,"15min":0.71199999999999997},"min":{"1min":0.46000000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.872,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.751,"15min":0.76800000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93100000000000005,"5min":1.96,"15min":1.96},"last":0.68500000000000005}]},{"osd":1,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.91400000000000003,"15min":0.94799999999999995},"min":{"1min":0.53300000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.879,"5min":4.8710000000000004,"15min":4.8710000000000004},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67400000000000004,"15min":0.67900000000000005},"min":{"1min":0.5,"5min":0.441,"15min":0.441},"max":{"1min":0.84699999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.755}]},{"osd":2,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.89200000000000002,"15min":0.92600000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.90000000000000002,"5min":4.8499999999999996,"15min":4.8499999999999996},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.73199999999999998},"min":{"1min":0.54300000000000004,"5min":0.439,"15min":0.439},"max":{"1min":0.82399999999999995,"5min":0.995,"15min":0.995},"last":0.77500000000000002}]},{"osd":3,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.72899999999999998,"15min":0.74099999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.80100000000000005,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.56999999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.86299999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.79600000000000004}]},{"osd":5,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.47399999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85199999999999998,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91800000000000004,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.42699999999999999}]},{"osd":6,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64900000000000002,"15min":0.64500000000000002},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92600000000000005,"5min":1.139,"15min":1.139},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89400000000000002,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.51000000000000001}]},{"osd":7,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.53100000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.872,"5min":1.304,"15min":1.304},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.52600000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96299999999999997,"5min":1.244,"15min":1.244},"last":0.53800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":227565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.54600000000000004,"15min":0.57099999999999995},"min":{"1min":0.29499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.50800000000000001,"5min":3.714,"15min":3.714},"last":0.5},{"interface":"front","average":{"1min":0.443,"5min":0.48499999999999999,"15min":0.49199999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69199999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.53000000000000003}]},{"osd":1,"last update":"Mon Nov 20 06:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.59899999999999998,"15min":0.627},"min":{"1min":0.29799999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.71899999999999997,"5min":3.8330000000000002,"15min":3.8330000000000002},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.65000000000000002,"15min":0.68200000000000005},"min":{"1min":0.34799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.58499999999999996,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":0.56000000000000005}]},{"osd":2,"last update":"Mon Nov 20 06:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.76700000000000002,"15min":0.81399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73999999999999999,"5min":4.0709999999999997,"15min":4.0709999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.58599999999999997,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.65200000000000002,"5min":1.113,"15min":1.113},"last":0.60799999999999998}]},{"osd":4,"last update":"Mon Nov 20 06:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.89900000000000002,"15min":0.92800000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.91700000000000004,"5min":3.9169999999999998,"15min":3.9169999999999998},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.92100000000000004,"15min":0.95499999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.94299999999999995,"5min":4.2069999999999999,"15min":4.2069999999999999},"last":0.89600000000000002}]},{"osd":5,"last update":"Mon Nov 20 06:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.81999999999999995,"15min":0.83399999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91200000000000003,"5min":1.452,"15min":1.452},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.83599999999999997,"15min":0.85399999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.92900000000000005,"5min":1.476,"15min":1.476},"last":0.80000000000000004}]},{"osd":6,"last update":"Mon Nov 20 06:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.98199999999999998,"15min":1.024},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.93600000000000005,"5min":4.3659999999999997,"15min":4.3659999999999997},"last":0.872},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.85699999999999998,"15min":0.873},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.93300000000000005,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.88100000000000001}]},{"osd":7,"last update":"Mon Nov 20 06:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.95399999999999996,"15min":0.98599999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.0609999999999999,"5min":3.9700000000000002,"15min":3.9700000000000002},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.97399999999999998,"15min":1.008},"min":{"1min":0.63400000000000001,"5min":0.62,"15min":0.62},"max":{"1min":0.98299999999999998,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":0.83699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":227565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.504,"15min":0.52200000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58999999999999997,"5min":1.905,"15min":1.905},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.47399999999999998,"15min":0.47799999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.59899999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.50900000000000001}]},{"osd":1,"last update":"Mon Nov 20 06:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58499999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70099999999999996,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.42699999999999999}]},{"osd":3,"last update":"Mon Nov 20 06:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48899999999999999,"15min":0.495},"min":{"1min":0.35799999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.53900000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.627,"15min":0.64700000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.61199999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.495}]},{"osd":4,"last update":"Mon Nov 20 06:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79400000000000004,"15min":0.80600000000000005},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.94999999999999996,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.749},"min":{"1min":0.56999999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.84599999999999997}]},{"osd":5,"last update":"Mon Nov 20 06:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.77100000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.83399999999999996,"15min":0.84599999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.006,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.72599999999999998}]},{"osd":6,"last update":"Mon Nov 20 06:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.81899999999999995,"15min":0.83299999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.99199999999999999,"5min":1.546,"15min":1.546},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79700000000000004,"15min":0.80600000000000005},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":0.92700000000000005,"5min":1.268,"15min":1.268},"last":0.79000000000000004}]},{"osd":7,"last update":"Mon Nov 20 06:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.83799999999999997,"15min":0.85499999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.91500000000000004,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.745},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.97699999999999998,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.67000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":520192,"data_stored":227565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 06:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.47599999999999998,"15min":0.48599999999999999},"min":{"1min":0.309,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.67600000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.46100000000000002,"15min":0.46600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58699999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.63200000000000001}]},{"osd":2,"last update":"Mon Nov 20 06:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47199999999999998,"15min":0.48299999999999998},"min":{"1min":0.28100000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.54600000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.377,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":1.268,"15min":1.268},"last":0.54400000000000004}]},{"osd":3,"last update":"Mon Nov 20 06:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.57999999999999996,"15min":0.58999999999999997},"min":{"1min":0.45000000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.63600000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.53600000000000003,"15min":0.54600000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.58899999999999997,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.69299999999999995}]},{"osd":4,"last update":"Mon Nov 20 06:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.56000000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.90800000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.53900000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.004,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.92900000000000005}]},{"osd":5,"last update":"Mon Nov 20 06:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78300000000000003,"15min":0.79600000000000004},"min":{"1min":0.58599999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94799999999999995,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.77000000000000002,"15min":0.77800000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.92700000000000005,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.95299999999999996}]},{"osd":6,"last update":"Mon Nov 20 06:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.53600000000000003,"5min":0.504,"15min":0.504},"max":{"1min":0.93500000000000005,"5min":1.611,"15min":1.611},"last":0.88},{"interface":"front","average":{"1min":0.749,"5min":0.78800000000000003,"15min":0.79400000000000004},"min":{"1min":0.56699999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96799999999999997,"5min":1.663,"15min":1.663},"last":0.90800000000000003}]},{"osd":7,"last update":"Mon Nov 20 06:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77300000000000002,"15min":0.78100000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93400000000000005,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.81399999999999995,"15min":0.82599999999999996},"min":{"1min":0.63600000000000001,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0449999999999999,"5min":1.718,"15min":1.718},"last":0.86199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343740,"statfs":{"total":96636764160,"available":96607989760,"internally_reserved":0,"allocated":1110016,"data_stored":816914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.50700000000000001,"15min":0.52300000000000002},"min":{"1min":0.30499999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72399999999999998,"5min":1.393,"15min":1.393},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.53500000000000003,"15min":0.54900000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.999,"5min":1.532,"15min":1.532},"last":0.54300000000000004}]},{"osd":2,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.60999999999999999,"15min":0.63400000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.78200000000000003,"5min":2.625,"15min":2.625},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.57999999999999996,"15min":0.59699999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.876,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.60099999999999998}]},{"osd":3,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.55400000000000005,"15min":0.56799999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.0589999999999999,"5min":1.718,"15min":1.718},"last":0.622},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.67600000000000005,"15min":0.69999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79000000000000004,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":0.58399999999999996}]},{"osd":4,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.81299999999999994,"15min":0.82899999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94899999999999995,"5min":2.411,"15min":2.411},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.82099999999999995},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.88400000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.79800000000000004}]},{"osd":5,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.81399999999999995,"15min":0.82299999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.022,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.88,"15min":0.90800000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.91700000000000004,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.81699999999999995}]},{"osd":6,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.90900000000000003,"15min":0.93200000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.103,"5min":3.008,"15min":3.008},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.85699999999999998,"15min":0.879},"min":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0409999999999999,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.84599999999999997}]},{"osd":7,"last update":"Mon Nov 20 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.89700000000000002,"15min":0.91700000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.071,"5min":2.508,"15min":2.508},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.83699999999999997,"15min":0.85299999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.97899999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.75900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T06:43:32.286 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-20T06:43:32.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.418+0000 7f103343c640 1 Processor -- start 2023-11-20T06:43:32.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.418+0000 7f103343c640 1 -- start start 2023-11-20T06:43:32.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.422+0000 7f103343c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f102c0cf210 0x7f102c0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:32.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.422+0000 7f103343c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f102c0cfb30 con 0x7f102c15cdc0 2023-11-20T06:43:32.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.422+0000 7f103343c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f102c0d0880 con 0x7f102c0d3320 2023-11-20T06:43:32.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.422+0000 7f103343c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f102c0b1c00 con 0x7f102c0cf210 2023-11-20T06:43:32.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.422+0000 7f103243a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f102c0cf210 0x7f102c0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:32.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.422+0000 7f1031c39640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f102c15cdc0 0x7f102c0b2ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34896/0 (socket says 172.21.15.19:34896) 2023-11-20T06:43:32.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.422+0000 7f1031c39640 1 -- 172.21.15.19:0/3541123665 learned_addr learned my addr 172.21.15.19:0/3541123665 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-20T06:43:32.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.422+0000 7f103243a640 1 -- 172.21.15.19:0/3541123665 >> v1:172.21.15.190:6789/0 conn(0x7f102c0d3320 legacy=0x7f102c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:32.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.422+0000 7f103243a640 1 -- 172.21.15.19:0/3541123665 >> v1:172.21.15.19:6789/0 conn(0x7f102c15cdc0 legacy=0x7f102c0b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:32.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.422+0000 7f103243a640 1 -- 172.21.15.19:0/3541123665 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c0b1ee0 con 0x7f102c0cf210 2023-11-20T06:43:32.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.426+0000 7f103243a640 1 --2- 172.21.15.19:0/3541123665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f102c0cf210 0x7f102c0cf5f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f10280097a0 tx=0x7f102801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298b6abfd9edc96a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:32.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.426+0000 7f1031438640 1 -- 172.21.15.19:0/3541123665 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10280ab600 con 0x7f102c0cf210 2023-11-20T06:43:32.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.426+0000 7f1031438640 1 -- 172.21.15.19:0/3541123665 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10280a7050 con 0x7f102c0cf210 2023-11-20T06:43:32.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.426+0000 7f1031438640 1 -- 172.21.15.19:0/3541123665 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10280ab980 con 0x7f102c0cf210 2023-11-20T06:43:32.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.426+0000 7f103343c640 1 -- 172.21.15.19:0/3541123665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f102c0cf210 msgr2=0x7f102c0cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:32.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.426+0000 7f103343c640 1 --2- 172.21.15.19:0/3541123665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f102c0cf210 0x7f102c0cf5f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f10280097a0 tx=0x7f102801c260 comp rx=0 tx=0).stop 2023-11-20T06:43:32.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.426+0000 7f103343c640 1 -- 172.21.15.19:0/3541123665 shutdown_connections 2023-11-20T06:43:32.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.426+0000 7f103343c640 1 --2- 172.21.15.19:0/3541123665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f102c0cf210 0x7f102c0cf5f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.426+0000 7f103343c640 1 -- 172.21.15.19:0/3541123665 >> 172.21.15.19:0/3541123665 conn(0x7f102c0d2800 msgr2=0x7f102c0d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:32.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.426+0000 7f103343c640 1 -- 172.21.15.19:0/3541123665 shutdown_connections 2023-11-20T06:43:32.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.426+0000 7f103343c640 1 -- 172.21.15.19:0/3541123665 wait complete. 2023-11-20T06:43:32.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.426+0000 7f103343c640 1 Processor -- start 2023-11-20T06:43:32.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.426+0000 7f103343c640 1 -- start start 2023-11-20T06:43:32.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f103343c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f102c0cf210 0x7f102c156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:32.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f103343c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f102c0d3320 0x7f102c0ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:32.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f103343c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f102c15cdc0 0x7f102c0afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:32.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f103343c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c1582b0 con 0x7f102c15cdc0 2023-11-20T06:43:32.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f103343c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c1f1eb0 con 0x7f102c0d3320 2023-11-20T06:43:32.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f103343c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102c157630 con 0x7f102c0cf210 2023-11-20T06:43:32.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f1032c3b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f102c15cdc0 0x7f102c0afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:32.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f1032c3b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f102c15cdc0 0x7f102c0afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59870/0 (socket says 172.21.15.19:59870) 2023-11-20T06:43:32.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f1032c3b640 1 -- 172.21.15.19:0/1674906956 learned_addr learned my addr 172.21.15.19:0/1674906956 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:32.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f1031c39640 1 --2- 172.21.15.19:0/1674906956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f102c0d3320 0x7f102c0ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:32.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f103243a640 1 --2- 172.21.15.19:0/1674906956 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f102c0cf210 0x7f102c156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:32.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f1032c3b640 1 -- 172.21.15.19:0/1674906956 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f102c0cf210 msgr2=0x7f102c156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:32.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f1032c3b640 1 --2- 172.21.15.19:0/1674906956 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f102c0cf210 0x7f102c156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f1032c3b640 1 -- 172.21.15.19:0/1674906956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f102c0d3320 msgr2=0x7f102c0ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:32.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f1032c3b640 1 --2- 172.21.15.19:0/1674906956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f102c0d3320 0x7f102c0ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f1032c3b640 1 -- 172.21.15.19:0/1674906956 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10280093b0 con 0x7f102c15cdc0 2023-11-20T06:43:32.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f1032c3b640 1 --2- 172.21.15.19:0/1674906956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f102c15cdc0 0x7f102c0afc10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f102400c7a0 tx=0x7f102400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:32.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f1022ffd640 1 -- 172.21.15.19:0/1674906956 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1024003b80 con 0x7f102c15cdc0 2023-11-20T06:43:32.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f1022ffd640 1 -- 172.21.15.19:0/1674906956 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1024003ce0 con 0x7f102c15cdc0 2023-11-20T06:43:32.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f1022ffd640 1 -- 172.21.15.19:0/1674906956 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102400aa90 con 0x7f102c15cdc0 2023-11-20T06:43:32.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f103343c640 1 -- 172.21.15.19:0/1674906956 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102c157910 con 0x7f102c15cdc0 2023-11-20T06:43:32.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f103343c640 1 -- 172.21.15.19:0/1674906956 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102c157ed0 con 0x7f102c15cdc0 2023-11-20T06:43:32.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.430+0000 7f103343c640 1 -- 172.21.15.19:0/1674906956 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f102c1583f0 con 0x7f102c15cdc0 2023-11-20T06:43:32.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.434+0000 7f1022ffd640 1 -- 172.21.15.19:0/1674906956 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f102400abf0 con 0x7f102c15cdc0 2023-11-20T06:43:32.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.434+0000 7f1022ffd640 1 --2- 172.21.15.19:0/1674906956 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f10100664a0 0x7f1010068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:32.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.434+0000 7f1022ffd640 1 -- 172.21.15.19:0/1674906956 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f10240839f0 con 0x7f102c15cdc0 2023-11-20T06:43:32.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.434+0000 7f103243a640 1 --2- 172.21.15.19:0/1674906956 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f10100664a0 0x7f1010068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:32.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.434+0000 7f103243a640 1 --2- 172.21.15.19:0/1674906956 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f10100664a0 0x7f1010068960 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f10280ad000 tx=0x7f1028008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:32.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.438+0000 7f1022ffd640 1 -- 172.21.15.19:0/1674906956 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f102c1583f0 con 0x7f102c15cdc0 2023-11-20T06:43:32.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.594+0000 7f103343c640 1 -- 172.21.15.19:0/1674906956 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f102c1583f0 con 0x7f102c15cdc0 2023-11-20T06:43:32.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.598+0000 7f1022ffd640 1 -- 172.21.15.19:0/1674906956 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f102c1583f0 con 0x7f102c15cdc0 2023-11-20T06:43:32.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.602+0000 7f1022ffd640 1 -- 172.21.15.19:0/1674906956 <== mon.0 v2:172.21.15.19:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f10240510d0 con 0x7f102c15cdc0 2023-11-20T06:43:32.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.602+0000 7f103343c640 1 -- 172.21.15.19:0/1674906956 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f10100664a0 msgr2=0x7f1010068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:32.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.602+0000 7f103343c640 1 --2- 172.21.15.19:0/1674906956 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f10100664a0 0x7f1010068960 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f10280ad000 tx=0x7f1028008040 comp rx=0 tx=0).stop 2023-11-20T06:43:32.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.602+0000 7f103343c640 1 -- 172.21.15.19:0/1674906956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f102c15cdc0 msgr2=0x7f102c0afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:32.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.602+0000 7f103343c640 1 --2- 172.21.15.19:0/1674906956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f102c15cdc0 0x7f102c0afc10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f102400c7a0 tx=0x7f102400cc60 comp rx=0 tx=0).stop 2023-11-20T06:43:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.602+0000 7f103343c640 1 -- 172.21.15.19:0/1674906956 shutdown_connections 2023-11-20T06:43:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.602+0000 7f103343c640 1 --2- 172.21.15.19:0/1674906956 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f10100664a0 0x7f1010068960 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.602+0000 7f103343c640 1 --2- 172.21.15.19:0/1674906956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f102c15cdc0 0x7f102c0afc10 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.602+0000 7f103343c640 1 --2- 172.21.15.19:0/1674906956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f102c0d3320 0x7f102c0ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.602+0000 7f103343c640 1 --2- 172.21.15.19:0/1674906956 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f102c0cf210 0x7f102c156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.602+0000 7f103343c640 1 -- 172.21.15.19:0/1674906956 >> 172.21.15.19:0/1674906956 conn(0x7f102c0d2800 msgr2=0x7f102c0b2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.602+0000 7f103343c640 1 -- 172.21.15.19:0/1674906956 shutdown_connections 2023-11-20T06:43:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.602+0000 7f103343c640 1 -- 172.21.15.19:0/1674906956 wait complete. 2023-11-20T06:43:32.628 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-20T06:43:32.628 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T06:43:32.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.766+0000 7f482891d640 1 Processor -- start 2023-11-20T06:43:32.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.766+0000 7f482891d640 1 -- start start 2023-11-20T06:43:32.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.766+0000 7f482891d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4824159ba0 0x7f48240cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:32.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.766+0000 7f482891d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f48240c8cb0 0x7f48240cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:32.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.766+0000 7f482891d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48240723d0 con 0x7f48241597c0 2023-11-20T06:43:32.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.766+0000 7f482891d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48240717c0 con 0x7f4824159ba0 2023-11-20T06:43:32.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.766+0000 7f482891d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4824071aa0 con 0x7f48240c8cb0 2023-11-20T06:43:32.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.766+0000 7f481bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4824159ba0 0x7f48240cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:32.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.766+0000 7f481bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4824159ba0 0x7f48240cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59874/0 (socket says 172.21.15.19:59874) 2023-11-20T06:43:32.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.766+0000 7f481bfff640 1 -- 172.21.15.19:0/2812702128 learned_addr learned my addr 172.21.15.19:0/2812702128 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:32.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.766+0000 7f4822d9d640 1 --2- 172.21.15.19:0/2812702128 >> v2:172.21.15.190:3300/0 conn(0x7f48240c8cb0 0x7f48240cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:32.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.766+0000 7f481bfff640 1 -- 172.21.15.19:0/2812702128 >> v2:172.21.15.190:3300/0 conn(0x7f48240c8cb0 msgr2=0x7f48240cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T06:43:32.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.766+0000 7f481bfff640 1 --2- 172.21.15.19:0/2812702128 >> v2:172.21.15.190:3300/0 conn(0x7f48240c8cb0 0x7f48240cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.766+0000 7f481bfff640 1 -- 172.21.15.19:0/2812702128 >> v1:172.21.15.190:6789/0 conn(0x7f48241597c0 legacy=0x7f48240ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:32.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.766+0000 7f481bfff640 1 -- 172.21.15.19:0/2812702128 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4824071d80 con 0x7f4824159ba0 2023-11-20T06:43:32.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.766+0000 7f4822d9d640 1 --2- 172.21.15.19:0/2812702128 >> v2:172.21.15.190:3300/0 conn(0x7f48240c8cb0 0x7f48240cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T06:43:32.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.770+0000 7f481bfff640 1 --2- 172.21.15.19:0/2812702128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4824159ba0 0x7f48240cae10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4824072340 tx=0x7f480c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e0d1edc66d4b3f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:32.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.770+0000 7f4821d9b640 1 -- 172.21.15.19:0/2812702128 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c0ab670 con 0x7f4824159ba0 2023-11-20T06:43:32.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.770+0000 7f4821d9b640 1 -- 172.21.15.19:0/2812702128 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f480c0ab7d0 con 0x7f4824159ba0 2023-11-20T06:43:32.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.770+0000 7f4821d9b640 1 -- 172.21.15.19:0/2812702128 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c0abb80 con 0x7f4824159ba0 2023-11-20T06:43:32.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.770+0000 7f482891d640 1 -- 172.21.15.19:0/2812702128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4824159ba0 msgr2=0x7f48240cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:32.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.770+0000 7f482891d640 1 --2- 172.21.15.19:0/2812702128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4824159ba0 0x7f48240cae10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4824072340 tx=0x7f480c01c4d0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.770+0000 7f482891d640 1 -- 172.21.15.19:0/2812702128 shutdown_connections 2023-11-20T06:43:32.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.770+0000 7f482891d640 1 --2- 172.21.15.19:0/2812702128 >> v2:172.21.15.190:3300/0 conn(0x7f48240c8cb0 0x7f48240cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.770+0000 7f482891d640 1 --2- 172.21.15.19:0/2812702128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4824159ba0 0x7f48240cae10 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.770+0000 7f482891d640 1 -- 172.21.15.19:0/2812702128 >> 172.21.15.19:0/2812702128 conn(0x7f482406c190 msgr2=0x7f482406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:32.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.770+0000 7f482891d640 1 -- 172.21.15.19:0/2812702128 shutdown_connections 2023-11-20T06:43:32.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.770+0000 7f482891d640 1 -- 172.21.15.19:0/2812702128 wait complete. 2023-11-20T06:43:32.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f482891d640 1 Processor -- start 2023-11-20T06:43:32.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f482891d640 1 -- start start 2023-11-20T06:43:32.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f482891d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48240c8cb0 0x7f4824152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:32.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f482891d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f48241597c0 0x7f48240c4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:32.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f482891d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4824159ba0 0x7f48240c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:32.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f482891d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4824150860 con 0x7f4824159ba0 2023-11-20T06:43:32.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f482891d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48240c4ea0 con 0x7f48240c8cb0 2023-11-20T06:43:32.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f482891d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48240c5df0 con 0x7f48241597c0 2023-11-20T06:43:32.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f4822d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4824159ba0 0x7f48240c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:32.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f4822d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4824159ba0 0x7f48240c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59878/0 (socket says 172.21.15.19:59878) 2023-11-20T06:43:32.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f4822d9d640 1 -- 172.21.15.19:0/3529763696 learned_addr learned my addr 172.21.15.19:0/3529763696 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-20T06:43:32.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f481bfff640 1 --2- 172.21.15.19:0/3529763696 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f48241597c0 0x7f48240c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:32.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f482259c640 1 --2- 172.21.15.19:0/3529763696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48240c8cb0 0x7f4824152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:32.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f481bfff640 1 -- 172.21.15.19:0/3529763696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48240c8cb0 msgr2=0x7f4824152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:32.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f481bfff640 1 --2- 172.21.15.19:0/3529763696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48240c8cb0 0x7f4824152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f481bfff640 1 -- 172.21.15.19:0/3529763696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4824159ba0 msgr2=0x7f48240c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:32.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f481bfff640 1 --2- 172.21.15.19:0/3529763696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4824159ba0 0x7f48240c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f481bfff640 1 -- 172.21.15.19:0/3529763696 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c0094d0 con 0x7f48241597c0 2023-11-20T06:43:32.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f4822d9d640 1 --2- 172.21.15.19:0/3529763696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4824159ba0 0x7f48240c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T06:43:32.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f481bfff640 1 --2- 172.21.15.19:0/3529763696 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f48241597c0 0x7f48240c4960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f480c0ac000 tx=0x7f480c01ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:32.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f481affd640 1 -- 172.21.15.19:0/3529763696 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c0b4800 con 0x7f48241597c0 2023-11-20T06:43:32.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f481affd640 1 -- 172.21.15.19:0/3529763696 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f480c0b49a0 con 0x7f48241597c0 2023-11-20T06:43:32.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f481affd640 1 -- 172.21.15.19:0/3529763696 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c0b4d70 con 0x7f48241597c0 2023-11-20T06:43:32.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f482891d640 1 -- 172.21.15.19:0/3529763696 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48240c85e0 con 0x7f48241597c0 2023-11-20T06:43:32.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f482891d640 1 -- 172.21.15.19:0/3529763696 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48240c5730 con 0x7f48241597c0 2023-11-20T06:43:32.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.774+0000 7f482891d640 1 -- 172.21.15.19:0/3529763696 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48240c5f30 con 0x7f48241597c0 2023-11-20T06:43:32.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.778+0000 7f481affd640 1 -- 172.21.15.19:0/3529763696 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f480c0c83a0 con 0x7f48241597c0 2023-11-20T06:43:32.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.778+0000 7f481affd640 1 --2- 172.21.15.19:0/3529763696 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f48040664a0 0x7f4804068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T06:43:32.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.778+0000 7f481affd640 1 -- 172.21.15.19:0/3529763696 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f480c11e880 con 0x7f48241597c0 2023-11-20T06:43:32.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.778+0000 7f482259c640 1 --2- 172.21.15.19:0/3529763696 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f48040664a0 0x7f4804068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T06:43:32.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.778+0000 7f482259c640 1 --2- 172.21.15.19:0/3529763696 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f48040664a0 0x7f4804068960 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4814007fd0 tx=0x7f4814009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T06:43:32.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.782+0000 7f481affd640 1 -- 172.21.15.19:0/3529763696 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f48240c5f30 con 0x7f48241597c0 2023-11-20T06:43:32.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.974+0000 7f482891d640 1 -- 172.21.15.19:0/3529763696 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48240c5f30 con 0x7f48241597c0 2023-11-20T06:43:32.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.974+0000 7f481affd640 1 -- 172.21.15.19:0/3529763696 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f48240c5f30 con 0x7f48241597c0 2023-11-20T06:43:32.980 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-20T06:43:32.980 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3692171038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3692171038},{"type":"v1","addr":"172.21.15.190:6835","nonce":3692171038}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/2633535615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":2633535615},{"type":"v1","addr":"172.21.15.190:6837","nonce":2633535615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/1822146855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1822146855},{"type":"v1","addr":"172.21.15.19:6833","nonce":1822146855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5742,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1003696857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1003696857},{"type":"v1","addr":"172.21.15.19:6835","nonce":1003696857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[]} 2023-11-20T06:43:32.981 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 20 2023-11-20T06:43:32.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.974+0000 7f482891d640 1 -- 172.21.15.19:0/3529763696 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f48040664a0 msgr2=0x7f4804068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:32.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.974+0000 7f482891d640 1 --2- 172.21.15.19:0/3529763696 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f48040664a0 0x7f4804068960 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4814007fd0 tx=0x7f4814009040 comp rx=0 tx=0).stop 2023-11-20T06:43:32.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.974+0000 7f482891d640 1 -- 172.21.15.19:0/3529763696 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f48241597c0 msgr2=0x7f48240c4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T06:43:32.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.974+0000 7f482891d640 1 --2- 172.21.15.19:0/3529763696 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f48241597c0 0x7f48240c4960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f480c0ac000 tx=0x7f480c01ad10 comp rx=0 tx=0).stop 2023-11-20T06:43:32.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.974+0000 7f482891d640 1 -- 172.21.15.19:0/3529763696 shutdown_connections 2023-11-20T06:43:32.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.974+0000 7f482891d640 1 --2- 172.21.15.19:0/3529763696 >> [v2:172.21.15.190:6832/142426253,v1:172.21.15.190:6833/142426253] conn(0x7f48040664a0 0x7f4804068960 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.974+0000 7f482891d640 1 --2- 172.21.15.19:0/3529763696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4824159ba0 0x7f48240c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.974+0000 7f482891d640 1 --2- 172.21.15.19:0/3529763696 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f48241597c0 0x7f48240c4960 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.974+0000 7f482891d640 1 --2- 172.21.15.19:0/3529763696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48240c8cb0 0x7f4824152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T06:43:32.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.974+0000 7f482891d640 1 -- 172.21.15.19:0/3529763696 >> 172.21.15.19:0/3529763696 conn(0x7f482406c190 msgr2=0x7f48240adf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T06:43:32.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.974+0000 7f482891d640 1 -- 172.21.15.19:0/3529763696 shutdown_connections 2023-11-20T06:43:32.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-20T06:43:32.974+0000 7f482891d640 1 -- 172.21.15.19:0/3529763696 wait complete. 2023-11-20T06:43:33.001 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-20T06:43:33.002 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-20T06:43:33.002 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-20T06:43:33.002 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:43:33.013 INFO:tasks.ceph.mds.a:Stopped 2023-11-20T06:43:33.013 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-20T06:43:33.013 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:43:33.070 INFO:tasks.ceph.mds.c:Stopped 2023-11-20T06:43:33.071 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-20T06:43:33.071 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:43:33.085 INFO:tasks.ceph.mds.b:Stopped 2023-11-20T06:43:33.085 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-20T06:43:33.085 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:43:33.142 INFO:tasks.ceph.mds.d:Stopped 2023-11-20T06:43:33.142 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-20T06:43:33.143 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-20T06:43:33.143 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:43:33.225 INFO:tasks.ceph.osd.0:Stopped 2023-11-20T06:43:33.225 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-20T06:43:33.225 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:43:35.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-11-20T06:43:39.327 INFO:tasks.ceph.osd.1:Stopped 2023-11-20T06:43:39.328 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-20T06:43:39.328 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:43:39.391 INFO:tasks.ceph.osd.2:Stopped 2023-11-20T06:43:39.391 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-20T06:43:39.392 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:43:39.492 INFO:tasks.ceph.osd.3:Stopped 2023-11-20T06:43:39.492 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-20T06:43:39.492 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:43:39.554 INFO:tasks.ceph.osd.4:Stopped 2023-11-20T06:43:39.555 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-20T06:43:39.555 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:43:39.643 INFO:tasks.ceph.osd.5:Stopped 2023-11-20T06:43:39.644 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-20T06:43:39.644 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:43:39.721 INFO:tasks.ceph.osd.6:Stopped 2023-11-20T06:43:39.722 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-20T06:43:39.722 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:43:40.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-11-20T06:43:40.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-11-20T06:43:41.950 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T06:43:41.954 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T06:43:45.825 INFO:tasks.ceph.osd.7:Stopped 2023-11-20T06:43:45.825 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-20T06:43:45.825 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-20T06:43:45.825 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:43:45.880 INFO:tasks.ceph.mgr.y:Stopped 2023-11-20T06:43:45.881 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-20T06:43:45.881 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:43:45.938 INFO:tasks.ceph.mgr.x:Stopped 2023-11-20T06:43:45.938 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-20T06:43:45.939 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-20T06:43:45.939 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:43:45.958 INFO:tasks.ceph.mon.a:Stopped 2023-11-20T06:43:45.959 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-20T06:43:45.959 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:43:45.975 INFO:tasks.ceph.mon.b:Stopped 2023-11-20T06:43:45.975 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-20T06:43:45.975 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T06:43:46.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~6s 2023-11-20T06:43:46.037 INFO:tasks.ceph.mon.c:Stopped 2023-11-20T06:43:46.037 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-20T06:43:46.037 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'unmatched fragstat' | egrep -v 'unmatched rstat' | egrep -v 'was unreadable, recreating it now' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v 'inconsistent rstat on inode' | egrep -v 'Error recovering journal' | head -n 1 2023-11-20T06:43:46.075 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi019.front.sepia.ceph.com 2023-11-20T06:43:46.075 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-20T06:43:46.397 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi019.front.sepia.ceph.com 2023-11-20T06:43:46.397 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-20T06:43:46.571 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi019.front.sepia.ceph.com 2023-11-20T06:43:46.571 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-20T06:43:46.731 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi019.front.sepia.ceph.com 2023-11-20T06:43:46.731 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-20T06:43:46.872 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi190.front.sepia.ceph.com 2023-11-20T06:43:46.872 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-20T06:43:47.108 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi190.front.sepia.ceph.com 2023-11-20T06:43:47.108 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-20T06:43:47.333 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi190.front.sepia.ceph.com 2023-11-20T06:43:47.333 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-20T06:43:47.515 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi190.front.sepia.ceph.com 2023-11-20T06:43:47.515 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-20T06:43:47.676 INFO:tasks.ceph:Archiving mon data... 2023-11-20T06:43:47.677 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463035/data/mon.a.tgz 2023-11-20T06:43:47.678 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2023-11-20T06:43:47.687 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.0lVqPPvaYa 2023-11-20T06:43:47.687 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.0lVqPPvaYa 2023-11-20T06:43:47.819 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.0lVqPPvaYa 2023-11-20T06:43:47.896 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.0lVqPPvaYa is 303KB 2023-11-20T06:43:47.965 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.0lVqPPvaYa 2023-11-20T06:43:47.974 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463035/data/mon.b.tgz 2023-11-20T06:43:47.974 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2023-11-20T06:43:47.983 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.DDaLGeJMd2 2023-11-20T06:43:47.983 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.DDaLGeJMd2 2023-11-20T06:43:48.126 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.DDaLGeJMd2 2023-11-20T06:43:48.200 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.DDaLGeJMd2 is 407KB 2023-11-20T06:43:48.265 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.DDaLGeJMd2 2023-11-20T06:43:48.274 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463035/data/mon.c.tgz 2023-11-20T06:43:48.274 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2023-11-20T06:43:48.323 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.uNrr7VWq5W 2023-11-20T06:43:48.323 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.uNrr7VWq5W 2023-11-20T06:43:48.464 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.uNrr7VWq5W 2023-11-20T06:43:48.544 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.uNrr7VWq5W is 407KB 2023-11-20T06:43:48.606 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.uNrr7VWq5W 2023-11-20T06:43:48.614 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-20T06:43:48.615 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-20T06:43:48.618 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-20T06:43:48.677 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-20T06:43:48.677 DEBUG:teuthology.orchestra.run.smithi019:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-20T06:43:48.681 DEBUG:teuthology.orchestra.run.smithi190:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-20T06:43:48.715 INFO:teuthology.orchestra.run.smithi019.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-20T06:43:48.756 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-20T06:43:48.762 INFO:tasks.ceph:Archiving crash dumps... 2023-11-20T06:43:48.764 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463035/remote/smithi019/crash 2023-11-20T06:43:48.765 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-20T06:43:48.792 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463035/remote/smithi190/crash 2023-11-20T06:43:48.793 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-20T06:43:48.822 INFO:tasks.ceph:Shutting down logrotate 2023-11-20T06:43:48.822 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T06:43:48.838 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T06:43:48.923 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-20T06:43:48.945 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-20T06:43:48.965 INFO:tasks.ceph:Compressing logs... 2023-11-20T06:43:48.965 DEBUG:teuthology.orchestra.run.smithi019:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-20T06:43:48.990 DEBUG:teuthology.orchestra.run.smithi190:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-20T06:43:49.017 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48348.log 2023-11-20T06:43:49.018 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47745.log 2023-11-20T06:43:49.019 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49498.log 2023-11-20T06:43:49.019 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48348.log.gz 2023-11-20T06:43:49.020 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48296.log 2023-11-20T06:43:49.020 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47745.log.gz 2023-11-20T06:43:49.021 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44742.log 2023-11-20T06:43:49.021 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49498.log.gz 2023-11-20T06:43:49.022 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48296.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48296.log.gz 2023-11-20T06:43:49.022 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45618.log 2023-11-20T06:43:49.023 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44742.log: gzip -5 88.5% --verbose -- replaced with /var/log/ceph/ceph-client.admin.44742.log.gz -- 2023-11-20T06:43:49.023 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.45358.log 2023-11-20T06:43:49.024 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48010.log 2023-11-20T06:43:49.024 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45618.log.gz 2023-11-20T06:43:49.025 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45358.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45358.log.gz 2023-11-20T06:43:49.025 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44754.log 2023-11-20T06:43:49.026 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48010.log: gzip -5 --verbose 89.4% -- -- replaced with /var/log/ceph/ceph-client.admin.48010.log.gz /var/log/ceph/ceph-client.admin.47113.log 2023-11-20T06:43:49.026 INFO:teuthology.orchestra.run.smithi019.stderr: 2023-11-20T06:43:49.027 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50064.log 2023-11-20T06:43:49.028 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44754.log.gz 2023-11-20T06:43:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47113.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-20T06:43:49.029 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47113.log.gz 2023-11-20T06:43:49.029 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50064.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50064.log.gz 2023-11-20T06:43:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45164.log 2023-11-20T06:43:49.031 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45644.log 2023-11-20T06:43:49.032 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45164.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45164.log.gz 2023-11-20T06:43:49.032 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50584.log 2023-11-20T06:43:49.033 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50090.log 2023-11-20T06:43:49.033 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45644.log.gz 2023-11-20T06:43:49.034 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50584.log: 93.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-20T06:43:49.034 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49791.log 2023-11-20T06:43:49.034 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50584.log.gz 2023-11-20T06:43:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50116.log 2023-11-20T06:43:49.035 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50090.log.gz 2023-11-20T06:43:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49791.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33148.log 2023-11-20T06:43:49.036 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49791.log.gz 2023-11-20T06:43:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50116.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50116.log.gz 2023-11-20T06:43:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49183.log 2023-11-20T06:43:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.tmp-client.admin.33148.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33148.log.gz 2023-11-20T06:43:49.038 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45670.log 2023-11-20T06:43:49.039 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49183.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49183.log.gz 2023-11-20T06:43:49.039 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48989.log 2023-11-20T06:43:49.040 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45670.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.45670.log.gz --verbose 2023-11-20T06:43:49.040 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.50220.log 2023-11-20T06:43:49.041 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48989.log: gzip 88.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.48989.log.gz 2023-11-20T06:43:49.041 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48749.log 2023-11-20T06:43:49.042 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38200.log 2023-11-20T06:43:49.042 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46980.log 2023-11-20T06:43:49.042 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50220.log.gz 2023-11-20T06:43:49.043 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48749.log: gzip -5 --verbose -- 89.4% /var/log/ceph/ceph-osd.0.log -- replaced with /var/log/ceph/ceph-client.admin.48749.log.gz 2023-11-20T06:43:49.043 INFO:teuthology.orchestra.run.smithi019.stderr: 2023-11-20T06:43:49.044 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38272.log 2023-11-20T06:43:49.044 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.38200.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-20T06:43:49.044 INFO:teuthology.orchestra.run.smithi190.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38200.log.gz 2023-11-20T06:43:49.045 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.38272.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-20T06:43:49.045 INFO:teuthology.orchestra.run.smithi190.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38272.log.gz 2023-11-20T06:43:49.046 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38248.log 2023-11-20T06:43:49.046 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48114.log 2023-11-20T06:43:49.046 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46980.log.gz 2023-11-20T06:43:49.047 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49635.log 2023-11-20T06:43:49.047 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48933.log 2023-11-20T06:43:49.047 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48114.log.gz 2023-11-20T06:43:49.048 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49635.log: gzip -5 --verbose 89.2% -- -- replaced with /var/log/ceph/ceph-client.admin.49635.log.gz 2023-11-20T06:43:49.048 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.46348.log 2023-11-20T06:43:49.049 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-20T06:43:49.049 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.38248.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38248.log.gz 2023-11-20T06:43:49.049 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38224.log 2023-11-20T06:43:49.049 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-20T06:43:49.050 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.38224.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38224.log.gz 2023-11-20T06:43:49.051 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-20T06:43:49.052 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48933.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.46401.log 2023-11-20T06:43:49.052 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48933.log.gz 2023-11-20T06:43:49.052 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46348.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46348.log.gz 2023-11-20T06:43:49.052 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43346.log 2023-11-20T06:43:49.052 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48140.log 2023-11-20T06:43:49.052 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46401.log.gz 2023-11-20T06:43:49.052 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43768.log 2023-11-20T06:43:49.053 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43346.log.gz 2023-11-20T06:43:49.054 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-20T06:43:49.054 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38296.log 2023-11-20T06:43:49.055 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mon.c.log: 92.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-20T06:43:49.055 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49966.log 2023-11-20T06:43:49.055 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48140.log.gz 2023-11-20T06:43:49.055 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43768.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43768.log.gz 2023-11-20T06:43:49.056 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44743.log 2023-11-20T06:43:49.056 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45514.log 2023-11-20T06:43:49.056 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49966.log.gz 2023-11-20T06:43:49.057 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44451.log 2023-11-20T06:43:49.057 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.38296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38344.log 2023-11-20T06:43:49.057 INFO:teuthology.orchestra.run.smithi190.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38296.log.gz 2023-11-20T06:43:49.058 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44743.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44743.log.gz -5 2023-11-20T06:43:49.058 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43411.log 2023-11-20T06:43:49.058 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47352.log 2023-11-20T06:43:49.059 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45514.log.gz 2023-11-20T06:43:49.059 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48959.log 2023-11-20T06:43:49.059 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43411.log.gz 2023-11-20T06:43:49.060 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.3.44451.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-20T06:43:49.060 INFO:teuthology.orchestra.run.smithi190.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.3.44451.log.gz 2023-11-20T06:43:49.061 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.38344.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38344.log.gz 2023-11-20T06:43:49.061 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46928.log 2023-11-20T06:43:49.061 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47352.log.gz 2023-11-20T06:43:49.061 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49903.log 2023-11-20T06:43:49.061 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48959.log.gz 2023-11-20T06:43:49.062 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46270.log 2023-11-20T06:43:49.062 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46928.log.gz 2023-11-20T06:43:49.062 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49903.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49903.log.gz 2023-11-20T06:43:49.062 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47849.log 2023-11-20T06:43:49.063 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46270.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46270.log.gz 2023-11-20T06:43:49.063 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37956.log 2023-11-20T06:43:49.063 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph.audit.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-20T06:43:49.064 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44337.log 2023-11-20T06:43:49.065 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47849.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47849.log.gz 2023-11-20T06:43:49.065 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50454.log 2023-11-20T06:43:49.065 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50324.log 2023-11-20T06:43:49.066 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37956.log.gz 2023-11-20T06:43:49.066 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-20T06:43:49.067 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50454.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50454.log.gz 2023-11-20T06:43:49.067 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50272.log 2023-11-20T06:43:49.067 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49077.log 89.3% 2023-11-20T06:43:49.067 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50324.log.gz 2023-11-20T06:43:49.069 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.1.44337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38320.log 2023-11-20T06:43:49.069 INFO:teuthology.orchestra.run.smithi190.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.1.44337.log.gz 2023-11-20T06:43:49.069 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50272.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50272.log.gz 2023-11-20T06:43:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50402.log 2023-11-20T06:43:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46186.log 2023-11-20T06:43:49.070 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49077.log.gz 2023-11-20T06:43:49.071 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-client.admin.38320.log: 91.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-20T06:43:49.071 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38368.log 2023-11-20T06:43:49.071 INFO:teuthology.orchestra.run.smithi190.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38320.log.gz 2023-11-20T06:43:49.071 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-20T06:43:49.072 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50402.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50402.log.gz 2023-11-20T06:43:49.072 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45696.log 2023-11-20T06:43:49.072 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48723.log 88.0% 2023-11-20T06:43:49.073 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46186.log.gz 2023-11-20T06:43:49.073 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46609.log 2023-11-20T06:43:49.073 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45696.log.gz 2023-11-20T06:43:49.074 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.38368.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-20T06:43:49.074 INFO:teuthology.orchestra.run.smithi190.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38368.log.gz 2023-11-20T06:43:49.075 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45722.log 2023-11-20T06:43:49.075 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48723.log.gz 2023-11-20T06:43:49.075 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46453.log 2023-11-20T06:43:49.075 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46609.log.gz 2023-11-20T06:43:49.076 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-20T06:43:49.076 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-20T06:43:49.077 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45722.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.45722.log.gz 2023-11-20T06:43:49.077 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47034.log 2023-11-20T06:43:49.077 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46453.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.46453.log.gz 2023-11-20T06:43:49.077 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-20T06:43:49.078 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44446.log 2023-11-20T06:43:49.078 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47034.log.gz 2023-11-20T06:43:49.079 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45592.log 2023-11-20T06:43:49.079 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44206.log 2023-11-20T06:43:49.080 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44446.log.gz 2023-11-20T06:43:49.081 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45592.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45592.log.gz 2023-11-20T06:43:49.081 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43464.log 2023-11-20T06:43:49.082 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50194.log 2023-11-20T06:43:49.082 INFO:teuthology.orchestra.run.smithi019.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.44206.log.gz 2023-11-20T06:43:49.083 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47880.log 2023-11-20T06:43:49.083 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43464.log.gz 2023-11-20T06:43:49.084 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50194.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50194.log.gz 2023-11-20T06:43:49.084 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50376.log 2023-11-20T06:43:49.086 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49287.log 2023-11-20T06:43:49.086 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47880.log.gz 2023-11-20T06:43:49.087 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50376.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50376.log.gz 2023-11-20T06:43:49.087 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38074.log 2023-11-20T06:43:49.088 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43598.log 2023-11-20T06:43:49.088 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49287.log.gz 2023-11-20T06:43:49.089 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38074.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38074.log.gz 2023-11-20T06:43:49.089 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49313.log 2023-11-20T06:43:49.090 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46427.log 2023-11-20T06:43:49.091 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43598.log.gz 2023-11-20T06:43:49.092 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47060.log 2023-11-20T06:43:49.092 INFO:teuthology.orchestra.run.smithi019.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49313.log.gz 2023-11-20T06:43:49.093 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46531.log 2023-11-20T06:43:49.093 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46427.log.gz 2023-11-20T06:43:49.093 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47060.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47060.log.gz 2023-11-20T06:43:49.094 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-20T06:43:49.095 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44363.log 2023-11-20T06:43:49.097 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46531.log.gz 2023-11-20T06:43:49.098 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49687.log 2023-11-20T06:43:49.098 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44363.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44363.log.gz 2023-11-20T06:43:49.099 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48218.log 2023-11-20T06:43:49.099 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43437.log 2023-11-20T06:43:49.100 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49687.log.gz 2023-11-20T06:43:49.100 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48218.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48218.log.gz 2023-11-20T06:43:49.100 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49235.log 2023-11-20T06:43:49.101 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48374.log 2023-11-20T06:43:49.102 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43437.log.gz 2023-11-20T06:43:49.102 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49235.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49235.log.gz 2023-11-20T06:43:49.103 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44758.log 2023-11-20T06:43:49.104 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49576.log 2023-11-20T06:43:49.104 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48374.log.gz 2023-11-20T06:43:49.105 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44758.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44758.log.gz 2023-11-20T06:43:49.105 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.4.log: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-20T06:43:49.106 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47958.log 2023-11-20T06:43:49.106 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47404.log 2023-11-20T06:43:49.107 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49576.log.gz 2023-11-20T06:43:49.107 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47958.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47958.log.gz 2023-11-20T06:43:49.108 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48270.log 2023-11-20T06:43:49.109 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45800.log 2023-11-20T06:43:49.109 INFO:teuthology.orchestra.run.smithi019.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.47404.log.gz 2023-11-20T06:43:49.110 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48270.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48270.log.gz 2023-11-20T06:43:49.110 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46025.log 2023-11-20T06:43:49.111 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46687.log 2023-11-20T06:43:49.112 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46025.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.45800.log.gz 2023-11-20T06:43:49.112 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46025.log.gz 2023-11-20T06:43:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48322.log 2023-11-20T06:43:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44258.log 2023-11-20T06:43:49.114 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46687.log.gz 2023-11-20T06:43:49.115 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48322.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48322.log.gz 2023-11-20T06:43:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49609.log 2023-11-20T06:43:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43716.log 2023-11-20T06:43:49.117 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44258.log.gz 2023-11-20T06:43:49.118 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49609.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49609.log.gz 2023-11-20T06:43:49.118 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45436.log 2023-11-20T06:43:49.119 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49661.log 2023-11-20T06:43:49.120 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43716.log.gz 2023-11-20T06:43:49.121 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45436.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45436.log.gz 2023-11-20T06:43:49.121 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44550.log 2023-11-20T06:43:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49661.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49661.log.gz 2023-11-20T06:43:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46713.log 2023-11-20T06:43:49.123 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49157.log 2023-11-20T06:43:49.124 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44550.log.gz 2023-11-20T06:43:49.124 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46713.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46713.log.gz 2023-11-20T06:43:49.125 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45861.log 2023-11-20T06:43:49.126 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46661.log 2023-11-20T06:43:49.126 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49157.log.gz 2023-11-20T06:43:49.127 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45861.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45861.log.gz 2023-11-20T06:43:49.128 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49550.log 2023-11-20T06:43:49.129 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43660.log 2023-11-20T06:43:49.129 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46661.log.gz 2023-11-20T06:43:49.130 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49550.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49550.log.gz 2023-11-20T06:43:49.131 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43313.log 2023-11-20T06:43:49.131 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43660.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43660.log.gz 2023-11-20T06:43:49.132 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49051.log 2023-11-20T06:43:49.133 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48803.log 2023-11-20T06:43:49.133 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43313.log.gz 2023-11-20T06:43:49.135 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49051.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49051.log.gz 2023-11-20T06:43:49.135 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44969.log 2023-11-20T06:43:49.136 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48803.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48803.log.gz 2023-11-20T06:43:49.136 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50018.log 2023-11-20T06:43:49.138 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44969.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44969.log.gz 2023-11-20T06:43:49.138 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50532.log 2023-11-20T06:43:49.140 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50018.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50018.log.gz 2023-11-20T06:43:49.140 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47614.log 2023-11-20T06:43:49.141 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43742.log 2023-11-20T06:43:49.141 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50532.log.gz 2023-11-20T06:43:49.143 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47614.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47614.log.gz 2023-11-20T06:43:49.143 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44955.log 2023-11-20T06:43:49.144 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46583.log 2023-11-20T06:43:49.144 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43742.log.gz 2023-11-20T06:43:49.146 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44154.log 2023-11-20T06:43:49.146 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44955.log.gz 2023-11-20T06:43:49.148 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47588.log 2023-11-20T06:43:49.148 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46583.log.gz 2023-11-20T06:43:49.149 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44154.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-20T06:43:49.149 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44154.log.gz 2023-11-20T06:43:49.150 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47588.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47588.log.gz 2023-11-20T06:43:49.150 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43516.log 2023-11-20T06:43:49.152 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47430.log 2023-11-20T06:43:49.153 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49524.log 2023-11-20T06:43:49.153 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43516.log.gz 2023-11-20T06:43:49.155 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44311.log 2023-11-20T06:43:49.155 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47430.log.gz 2023-11-20T06:43:49.156 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48504.log 2023-11-20T06:43:49.156 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49524.log.gz 2023-11-20T06:43:49.158 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44311.log: gzip -5 --verbose -- 89.4% /var/log/ceph/ceph-client.admin.47300.log -- replaced with /var/log/ceph/ceph-client.admin.44311.log.gz 2023-11-20T06:43:49.158 INFO:teuthology.orchestra.run.smithi019.stderr: 2023-11-20T06:43:49.159 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48504.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48504.log.gz 2023-11-20T06:43:49.160 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43256.log 2023-11-20T06:43:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47300.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.47300.log.gz 2023-11-20T06:43:49.161 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43820.log 2023-11-20T06:43:49.162 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49131.log 2023-11-20T06:43:49.163 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43256.log.gz 2023-11-20T06:43:49.164 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43898.log 2023-11-20T06:43:49.164 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43820.log.gz 2023-11-20T06:43:49.165 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49131.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49131.log.gz 2023-11-20T06:43:49.165 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43626.log 2023-11-20T06:43:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47692.log 2023-11-20T06:43:49.167 INFO:teuthology.orchestra.run.smithi019.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43898.log.gz 2023-11-20T06:43:49.168 INFO:teuthology.orchestra.run.smithi190.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-20T06:43:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43626.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43626.log.gz 2023-11-20T06:43:49.169 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44602.log 2023-11-20T06:43:49.170 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47692.log: gzip 89.9% -- replaced with /var/log/ceph/ceph-client.admin.47692.log.gz -5 2023-11-20T06:43:49.170 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47906.log 2023-11-20T06:43:49.171 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46505.log 2023-11-20T06:43:49.172 INFO:teuthology.orchestra.run.smithi019.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44602.log.gz 2023-11-20T06:43:49.172 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47906.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47906.log.gz 2023-11-20T06:43:49.173 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47562.log 2023-11-20T06:43:49.174 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49363.log 2023-11-20T06:43:49.174 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46505.log.gz 2023-11-20T06:43:49.176 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47562.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-20T06:43:49.176 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47562.log.gz 2023-11-20T06:43:49.177 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49363.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49363.log.gz 2023-11-20T06:43:49.177 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48192.log 2023-11-20T06:43:49.178 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49017.log 2023-11-20T06:43:49.180 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49869.log 2023-11-20T06:43:49.180 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48192.log.gz 2023-11-20T06:43:49.182 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49017.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49017.log.gz 2023-11-20T06:43:49.182 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49992.log 2023-11-20T06:43:49.183 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45981.log 2023-11-20T06:43:49.183 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49869.log.gz 2023-11-20T06:43:49.185 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49992.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49992.log.gz 2023-11-20T06:43:49.185 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38175.log 2023-11-20T06:43:49.187 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.45981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45566.log 2023-11-20T06:43:49.187 INFO:teuthology.orchestra.run.smithi019.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.0.45981.log.gz 2023-11-20T06:43:49.188 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38175.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38175.log.gz 2023-11-20T06:43:49.188 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43490.log 2023-11-20T06:43:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45566.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45566.log.gz 2023-11-20T06:43:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48088.log 2023-11-20T06:43:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43490.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.43490.log.gz 2023-11-20T06:43:49.191 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48601.log 2023-11-20T06:43:49.193 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50428.log 2023-11-20T06:43:49.193 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48088.log.gz 2023-11-20T06:43:49.193 INFO:teuthology.orchestra.run.smithi190.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-20T06:43:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48601.log: gzip 89.5% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.48601.log.gz -- 2023-11-20T06:43:49.194 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.47666.log 2023-11-20T06:43:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47640.log 2023-11-20T06:43:49.196 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50428.log.gz 2023-11-20T06:43:49.197 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47666.log: gzip -5 88.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.47666.log.gz 2023-11-20T06:43:49.197 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.50298.log 2023-11-20T06:43:49.199 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44760.log 2023-11-20T06:43:49.199 INFO:teuthology.orchestra.run.smithi019.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47640.log.gz 2023-11-20T06:43:49.200 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44389.log 2023-11-20T06:43:49.200 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50298.log.gz 2023-11-20T06:43:49.201 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49103.log 2023-11-20T06:43:49.202 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44760.log.gz 2023-11-20T06:43:49.203 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44389.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44389.log.gz 2023-11-20T06:43:49.203 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44752.log 2023-11-20T06:43:49.204 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49103.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49103.log.gz 2023-11-20T06:43:49.204 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44128.log 2023-11-20T06:43:49.206 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44752.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44752.log.gz -5 2023-11-20T06:43:49.206 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44956.log 2023-11-20T06:43:49.207 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44128.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44128.log.gz 2023-11-20T06:43:49.207 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43542.log 2023-11-20T06:43:49.210 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44956.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44956.log.gz 2023-11-20T06:43:49.210 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48633.log 2023-11-20T06:43:49.210 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43542.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43542.log.gz 2023-11-20T06:43:49.211 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45384.log 2023-11-20T06:43:49.212 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46954.log 2023-11-20T06:43:49.212 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48633.log.gz 2023-11-20T06:43:49.214 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45384.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-20T06:43:49.214 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45384.log.gz 2023-11-20T06:43:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46954.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46954.log.gz 2023-11-20T06:43:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47984.log 2023-11-20T06:43:49.217 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43570.log 2023-11-20T06:43:49.217 INFO:teuthology.orchestra.run.smithi019.stderr: 85.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-20T06:43:49.218 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47984.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47984.log.gz 2023-11-20T06:43:49.218 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47274.log 2023-11-20T06:43:49.220 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46479.log 2023-11-20T06:43:49.220 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43570.log.gz 2023-11-20T06:43:49.221 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47248.log 2023-11-20T06:43:49.221 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47274.log.gz 2023-11-20T06:43:49.223 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46817.log 2023-11-20T06:43:49.223 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46479.log.gz 2023-11-20T06:43:49.224 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47248.log: gzip 89.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.47248.log.gz --verbose 2023-11-20T06:43:49.224 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.44337.log 2023-11-20T06:43:49.226 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49713.log 2023-11-20T06:43:49.226 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46817.log.gz 2023-11-20T06:43:49.227 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44285.log 2023-11-20T06:43:49.227 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44337.log.gz 2023-11-20T06:43:49.229 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44415.log 2023-11-20T06:43:49.229 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49713.log.gz 2023-11-20T06:43:49.230 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48907.log 2023-11-20T06:43:49.230 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44285.log.gz 2023-11-20T06:43:49.232 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44966.log 2023-11-20T06:43:49.232 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44415.log.gz 2023-11-20T06:43:49.233 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46635.log 2023-11-20T06:43:49.233 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48907.log.gz 2023-11-20T06:43:49.235 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46374.log 2023-11-20T06:43:49.235 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44966.log.gz 2023-11-20T06:43:49.236 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48400.log 2023-11-20T06:43:49.236 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46635.log.gz 2023-11-20T06:43:49.237 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46374.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46374.log.gz 2023-11-20T06:43:49.238 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46895.log 2023-11-20T06:43:49.239 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43794.log 2023-11-20T06:43:49.239 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48400.log.gz 2023-11-20T06:43:49.241 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44748.log 2023-11-20T06:43:49.241 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46895.log.gz 2023-11-20T06:43:49.242 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44576.log 2023-11-20T06:43:49.242 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43794.log.gz 2023-11-20T06:43:49.243 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49843.log 2023-11-20T06:43:49.244 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44748.log.gz 2023-11-20T06:43:49.245 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44576.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44576.log.gzgzip 2023-11-20T06:43:49.245 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50558.log 2023-11-20T06:43:49.247 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50480.log 2023-11-20T06:43:49.247 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49843.log.gz 2023-11-20T06:43:49.248 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47217.log 2023-11-20T06:43:49.248 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50558.log.gz 2023-11-20T06:43:49.249 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43948.log 2023-11-20T06:43:49.250 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50480.log.gz 2023-11-20T06:43:49.251 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47217.log: gzip 88.4% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.47217.log.gz -- 2023-11-20T06:43:49.251 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.50665.log 2023-11-20T06:43:49.252 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43948.log: gzip -5 88.4% --verbose -- replaced with /var/log/ceph/ceph-client.admin.43948.log.gz -- 2023-11-20T06:43:49.253 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.50142.log 2023-11-20T06:43:49.254 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50665.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.50665.log.gz 2023-11-20T06:43:49.254 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45748.log 2023-11-20T06:43:49.255 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49940.log 2023-11-20T06:43:49.256 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50142.log.gz 2023-11-20T06:43:49.257 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45748.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.48036.log -- replaced with /var/log/ceph/ceph-client.admin.45748.log.gz 2023-11-20T06:43:49.257 INFO:teuthology.orchestra.run.smithi019.stderr: 2023-11-20T06:43:49.258 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49940.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49940.log.gz 2023-11-20T06:43:49.258 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49472.log 2023-11-20T06:43:49.260 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44232.log 2023-11-20T06:43:49.260 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48036.log.gz 2023-11-20T06:43:49.261 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49472.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.49472.log.gz 2023-11-20T06:43:49.261 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43872.log 2023-11-20T06:43:49.263 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44074.log 2023-11-20T06:43:49.263 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44232.log.gz 2023-11-20T06:43:49.264 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44967.log 2023-11-20T06:43:49.264 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43872.log.gz 2023-11-20T06:43:49.267 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44074.log: /var/log/ceph/ceph-client.admin.44967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47534.log 2023-11-20T06:43:49.267 INFO:teuthology.orchestra.run.smithi019.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.44074.log.gz 2023-11-20T06:43:49.268 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44967.log.gz 2023-11-20T06:43:49.268 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50168.log 2023-11-20T06:43:49.270 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48549.log 2023-11-20T06:43:49.270 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47534.log.gz 2023-11-20T06:43:49.272 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50168.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50168.log.gz 2023-11-20T06:43:49.273 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48549.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48549.log.gz 2023-11-20T06:43:49.273 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46296.log 2023-11-20T06:43:49.275 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47087.log 2023-11-20T06:43:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44498.log 2023-11-20T06:43:49.277 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46296.log.gz 2023-11-20T06:43:49.278 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47087.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47087.log.gz 2023-11-20T06:43:49.278 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47482.log 2023-11-20T06:43:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45170.log 2023-11-20T06:43:49.280 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44498.log.gz 2023-11-20T06:43:49.281 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47482.log: gzip 88.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.47482.log.gz -- 2023-11-20T06:43:49.281 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph.audit.log 2023-11-20T06:43:49.282 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45170.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-20T06:43:49.283 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45170.log.gz 2023-11-20T06:43:49.284 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47508.log 2023-11-20T06:43:49.285 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mds.c.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-20T06:43:49.286 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-20T06:43:49.287 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47508.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47508.log.gz 2023-11-20T06:43:49.291 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43688.log 2023-11-20T06:43:49.294 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49261.log 2023-11-20T06:43:49.294 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47139.log 2023-11-20T06:43:49.294 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43688.log.gz 2023-11-20T06:43:49.296 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49261.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49261.log.gz 2023-11-20T06:43:49.299 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45488.log 2023-11-20T06:43:49.301 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49209.log 2023-11-20T06:43:49.301 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47139.log.gz 2023-11-20T06:43:49.302 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50615.log 2023-11-20T06:43:49.302 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49209.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49209.log.gz 2023-11-20T06:43:49.304 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45488.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45488.log.gz 2023-11-20T06:43:49.305 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50615.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50615.log.gz 2023-11-20T06:43:49.305 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45410.log 2023-11-20T06:43:49.306 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-20T06:43:49.309 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45177.log 2023-11-20T06:43:49.309 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45410.log.gz 2023-11-20T06:43:49.310 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48697.log 2023-11-20T06:43:49.312 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45177.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45177.log.gz 2023-11-20T06:43:49.312 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46843.log 2023-11-20T06:43:49.313 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48697.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48697.log.gz 2023-11-20T06:43:49.315 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46843.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46843.log.gz 2023-11-20T06:43:49.315 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44472.log 2023-11-20T06:43:49.317 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45174.log 2023-11-20T06:43:49.318 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44472.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44472.log.gz 2023-11-20T06:43:49.320 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45174.log: 92.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-20T06:43:49.320 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45174.log.gz 2023-11-20T06:43:49.320 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46765.log 2023-11-20T06:43:49.321 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45175.log 2023-11-20T06:43:49.323 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46116.log 2023-11-20T06:43:49.324 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46765.log.gz 2023-11-20T06:43:49.324 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45175.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45175.log.gz 2023-11-20T06:43:49.327 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.2.46116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48777.log 2023-11-20T06:43:49.327 INFO:teuthology.orchestra.run.smithi019.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.2.46116.log.gz 2023-11-20T06:43:49.328 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46791.log 2023-11-20T06:43:49.330 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44628.log 2023-11-20T06:43:49.330 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48777.log.gz 2023-11-20T06:43:49.331 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45540.log 2023-11-20T06:43:49.331 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46791.log.gz 2023-11-20T06:43:49.333 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46218.log 2023-11-20T06:43:49.333 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44628.log.gz 2023-11-20T06:43:49.334 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47191.log 2023-11-20T06:43:49.334 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45540.log.gz 2023-11-20T06:43:49.336 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46218.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46218.log.gz 2023-11-20T06:43:49.337 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47191.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47191.log.gz 2023-11-20T06:43:49.337 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48452.log 2023-11-20T06:43:49.339 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47932.log 2023-11-20T06:43:49.341 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50639.log 2023-11-20T06:43:49.341 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48452.log.gz 2023-11-20T06:43:49.342 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45153.log 2023-11-20T06:43:49.343 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47932.log.gz 2023-11-20T06:43:49.344 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50639.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.50639.log.gz -5 2023-11-20T06:43:49.344 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46869.log 2023-11-20T06:43:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45153.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.47165.log 2023-11-20T06:43:49.345 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45153.log.gz 2023-11-20T06:43:49.347 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44970.log 2023-11-20T06:43:49.347 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46869.log.gz 2023-11-20T06:43:49.348 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45178.log 2023-11-20T06:43:49.349 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47165.log.gz 2023-11-20T06:43:49.350 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43846.log 2023-11-20T06:43:49.350 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44970.log.gz 2023-11-20T06:43:49.351 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45178.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45178.log.gz 2023-11-20T06:43:49.352 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49739.log 2023-11-20T06:43:49.353 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43846.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43846.log.gz 2023-11-20T06:43:49.353 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44680.log 2023-11-20T06:43:49.354 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49739.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49739.log.gz 2023-11-20T06:43:49.355 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46244.log 2023-11-20T06:43:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44680.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44680.log.gz 2023-11-20T06:43:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48478.log 2023-11-20T06:43:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46244.log: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-20T06:43:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44706.log 2023-11-20T06:43:49.358 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46244.log.gz 2023-11-20T06:43:49.358 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47326.log 2023-11-20T06:43:49.359 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48478.log.gz 2023-11-20T06:43:49.360 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44706.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44706.log.gz 2023-11-20T06:43:49.360 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45154.log 2023-11-20T06:43:49.362 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47326.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47326.log.gz 2023-11-20T06:43:49.362 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48166.log 2023-11-20T06:43:49.363 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45154.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45154.log.gz 2023-11-20T06:43:49.363 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47006.log 2023-11-20T06:43:49.365 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48166.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48166.log.gz 2023-11-20T06:43:49.365 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44963.log 2023-11-20T06:43:49.366 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47006.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47006.log.gz 2023-11-20T06:43:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46160.log 2023-11-20T06:43:49.368 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44963.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44963.log.gz 2023-11-20T06:43:49.368 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47797.log 2023-11-20T06:43:49.370 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46160.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46160.log.gz 2023-11-20T06:43:49.370 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44654.log 2023-11-20T06:43:49.371 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47797.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47797.log.gz 2023-11-20T06:43:49.371 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48426.log 2023-11-20T06:43:49.373 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47823.log 2023-11-20T06:43:49.373 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44654.log.gz 2023-11-20T06:43:49.374 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44951.log 2023-11-20T06:43:49.375 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48426.log.gz 2023-11-20T06:43:49.376 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50506.log 2023-11-20T06:43:49.376 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47823.log.gz 2023-11-20T06:43:49.378 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44759.log 2023-11-20T06:43:49.378 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44951.log.gz 2023-11-20T06:43:49.379 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47378.log 2023-11-20T06:43:49.379 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50506.log.gz 2023-11-20T06:43:49.381 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48575.log 2023-11-20T06:43:49.381 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44759.log.gz 2023-11-20T06:43:49.382 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50246.log 2023-11-20T06:43:49.382 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47378.log.gz 2023-11-20T06:43:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48575.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48575.log.gz 2023-11-20T06:43:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44180.log 2023-11-20T06:43:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48881.log 2023-11-20T06:43:49.385 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50246.log.gz 2023-11-20T06:43:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44180.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44180.log.gz 2023-11-20T06:43:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47719.log 2023-11-20T06:43:49.388 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48881.log: 89.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.48881.log.gz -5 2023-11-20T06:43:49.388 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49817.log 2023-11-20T06:43:49.389 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47719.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.47719.log.gz -5 2023-11-20T06:43:49.389 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47771.log 2023-11-20T06:43:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49765.log 2023-11-20T06:43:49.391 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49817.log.gz 2023-11-20T06:43:49.393 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47456.log 2023-11-20T06:43:49.393 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47771.log.gz 2023-11-20T06:43:49.394 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50350.log 2023-11-20T06:43:49.394 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49765.log.gz 2023-11-20T06:43:49.395 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47456.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47456.log.gz 2023-11-20T06:43:49.395 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46557.log 2023-11-20T06:43:49.397 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49418.log 2023-11-20T06:43:49.397 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50350.log.gz 2023-11-20T06:43:49.398 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46557.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46557.log.gz 2023-11-20T06:43:49.399 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48062.log 2023-11-20T06:43:49.400 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.49418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46739.log 2023-11-20T06:43:49.401 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.0.49418.log.gz 2023-11-20T06:43:49.401 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48062.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.48244.log -- replaced with /var/log/ceph/ceph-client.admin.48062.log.gz 2023-11-20T06:43:49.402 INFO:teuthology.orchestra.run.smithi019.stderr: 2023-11-20T06:43:49.403 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48829.log 2023-11-20T06:43:49.403 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46739.log.gz 2023-11-20T06:43:49.404 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48244.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48244.log.gz 2023-11-20T06:43:49.404 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48855.log 2023-11-20T06:43:49.406 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44524.log 2023-11-20T06:43:49.406 INFO:teuthology.orchestra.run.smithi019.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48829.log.gz 2023-11-20T06:43:49.406 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48855.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48855.log.gz 2023-11-20T06:43:49.407 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46322.log 2023-11-20T06:43:49.408 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44524.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44524.log.gz 2023-11-20T06:43:49.408 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45774.log 2023-11-20T06:43:49.409 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46322.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46322.log.gz 2023-11-20T06:43:49.410 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45462.log 2023-11-20T06:43:49.411 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45774.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45774.log.gz 2023-11-20T06:43:49.412 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45462.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45462.log.gz 2023-11-20T06:43:49.724 INFO:teuthology.orchestra.run.smithi190.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-20T06:43:49.744 INFO:teuthology.orchestra.run.smithi190.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-20T06:43:49.781 INFO:teuthology.orchestra.run.smithi190.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-20T06:43:49.795 INFO:teuthology.orchestra.run.smithi019.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-20T06:43:49.802 INFO:teuthology.orchestra.run.smithi190.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-20T06:43:49.804 INFO:teuthology.orchestra.run.smithi190.stderr: 2023-11-20T06:43:49.804 INFO:teuthology.orchestra.run.smithi190.stderr:real 0m0.791s 2023-11-20T06:43:49.804 INFO:teuthology.orchestra.run.smithi190.stderr:user 0m2.882s 2023-11-20T06:43:49.804 INFO:teuthology.orchestra.run.smithi190.stderr:sys 0m0.329s 2023-11-20T06:43:49.845 INFO:teuthology.orchestra.run.smithi019.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-20T06:43:49.928 INFO:teuthology.orchestra.run.smithi019.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-20T06:43:49.950 INFO:teuthology.orchestra.run.smithi019.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-20T06:43:49.952 INFO:teuthology.orchestra.run.smithi019.stderr: 2023-11-20T06:43:49.952 INFO:teuthology.orchestra.run.smithi019.stderr:real 0m0.959s 2023-11-20T06:43:49.952 INFO:teuthology.orchestra.run.smithi019.stderr:user 0m3.470s 2023-11-20T06:43:49.952 INFO:teuthology.orchestra.run.smithi019.stderr:sys 0m0.771s 2023-11-20T06:43:49.953 INFO:tasks.ceph:Archiving logs... 2023-11-20T06:43:49.953 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463035/remote/smithi019/log 2023-11-20T06:43:49.955 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-20T06:43:50.541 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463035/remote/smithi190/log 2023-11-20T06:43:50.542 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-20T06:43:50.918 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-20T06:43:50.927 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-20T06:43:50.928 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-20T06:43:50.933 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-20T06:43:51.008 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-20T06:43:51.017 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-20T06:43:51.017 DEBUG:teuthology.orchestra.run.smithi019:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-20T06:43:51.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-11-20T06:43:51.021 DEBUG:teuthology.orchestra.run.smithi190:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-20T06:43:51.032 INFO:teuthology.orchestra.run.smithi019.stdout: remote refid st t when poll reach delay offset jitter 2023-11-20T06:43:51.032 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================== 2023-11-20T06:43:51.033 INFO:teuthology.orchestra.run.smithi019.stdout:*hv01.front.sepi 44.4.53.2 2 u 49 64 77 0.090 -0.886 0.678 2023-11-20T06:43:51.033 INFO:teuthology.orchestra.run.smithi019.stdout: hv02.front.sepi 63.231.80.2 3 u 47 64 77 0.096 +0.701 1.198 2023-11-20T06:43:51.033 INFO:teuthology.orchestra.run.smithi019.stdout: hv03.front.sepi 74.6.168.72 3 u 45 64 77 0.087 +1.806 0.054 2023-11-20T06:43:51.033 INFO:teuthology.orchestra.run.smithi019.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-20T06:43:51.035 INFO:teuthology.orchestra.run.smithi190.stdout: remote refid st t when poll reach delay offset jitter 2023-11-20T06:43:51.035 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================== 2023-11-20T06:43:51.035 INFO:teuthology.orchestra.run.smithi190.stdout:*hv01.front.sepi 44.4.53.2 2 u 54 64 77 0.162 -1.045 2.899 2023-11-20T06:43:51.035 INFO:teuthology.orchestra.run.smithi190.stdout:+hv02.front.sepi 63.231.80.2 3 u 46 64 77 0.090 -3.077 2.891 2023-11-20T06:43:51.036 INFO:teuthology.orchestra.run.smithi190.stdout:+hv03.front.sepi 74.6.168.72 3 u 47 64 77 0.104 -0.055 1.948 2023-11-20T06:43:51.036 INFO:teuthology.orchestra.run.smithi190.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-20T06:43:51.037 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-20T06:43:51.083 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-20T06:43:51.083 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-20T06:43:51.133 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-20T06:43:51.183 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-20T06:43:51.233 INFO:teuthology.task.internal:Duration was 898.539965 seconds 2023-11-20T06:43:51.233 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-20T06:43:51.284 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-20T06:43:51.284 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-20T06:43:51.288 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-20T06:43:51.377 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-20T06:43:51.377 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi019.front.sepia.ceph.com 2023-11-20T06:43:51.377 DEBUG:teuthology.orchestra.run.smithi019:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-20T06:43:51.399 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi190.front.sepia.ceph.com 2023-11-20T06:43:51.399 DEBUG:teuthology.orchestra.run.smithi190:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-20T06:43:51.422 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-20T06:43:51.422 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-20T06:43:51.450 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-20T06:43:51.499 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-20T06:43:51.500 DEBUG:teuthology.orchestra.run.smithi019:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-20T06:43:51.533 DEBUG:teuthology.orchestra.run.smithi190:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-20T06:43:51.607 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-20T06:43:51.617 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-20T06:43:51.617 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-20T06:43:51.639 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-20T06:43:51.660 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-20T06:43:51.670 DEBUG:teuthology.orchestra.run.smithi019:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-20T06:43:51.685 DEBUG:teuthology.orchestra.run.smithi190:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-20T06:43:51.701 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = core 2023-11-20T06:43:51.725 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = core 2023-11-20T06:43:51.743 DEBUG:teuthology.orchestra.run.smithi019:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-20T06:43:51.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:43:51.770 DEBUG:teuthology.orchestra.run.smithi190:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-20T06:43:51.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:43:51.794 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-20T06:43:51.804 INFO:teuthology.task.internal:Transferring archived files... 2023-11-20T06:43:51.805 DEBUG:teuthology.misc:Transferring archived files from smithi019:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463035/remote/smithi019 2023-11-20T06:43:51.805 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-20T06:43:51.840 DEBUG:teuthology.misc:Transferring archived files from smithi190:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463035/remote/smithi190 2023-11-20T06:43:51.840 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-20T06:43:51.864 INFO:teuthology.task.internal:Removing archive directory... 2023-11-20T06:43:51.864 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-20T06:43:51.881 DEBUG:teuthology.orchestra.run.smithi190:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-20T06:43:51.919 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-20T06:43:51.930 INFO:teuthology.task.internal:Not uploading archives. 2023-11-20T06:43:51.931 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-20T06:43:51.968 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-20T06:43:51.968 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-20T06:43:51.972 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-20T06:43:51.978 INFO:teuthology.orchestra.run.smithi019.stdout: 658033 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 20 06:43 /home/ubuntu/cephtest 2023-11-20T06:43:51.980 INFO:teuthology.orchestra.run.smithi190.stdout: 658035 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 20 06:43 /home/ubuntu/cephtest 2023-11-20T06:43:51.982 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-20T06:43:52.018 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-20T06:43:52.136 INFO:teuthology.nuke:Checking targets against current locks 2023-11-20T06:43:52.163 DEBUG:teuthology.nuke:shortname: smithi019 2023-11-20T06:43:52.163 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-20T06:43:52.190 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463035', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-20 06:19:18.002533', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEGoUEYvv8Xx4Y3u448+gdyzT3VDVyIvIQ0BBsftBrnQIp3iGuixD10crS4Lqyw3w63VGQkE2rdYq+2T+5uGOGM='} 2023-11-20T06:43:52.191 DEBUG:teuthology.nuke:shortname: smithi190 2023-11-20T06:43:52.191 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-20T06:43:52.217 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463035', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-20 06:19:18.004123', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBYMWoE2uFuoUOEUElZDU1ZN8xpaiogsPDQMBOGBzoRjhquNJsZno6nE8l9XUVzazdqi3+MVusP36wRDJsfPOfQ='} 2023-11-20T06:43:52.246 INFO:teuthology.orchestra.console.smithi019:Power off 2023-11-20T06:43:52.246 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-20T06:43:52.262 INFO:teuthology.orchestra.console.smithi190:Power off 2023-11-20T06:43:52.263 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-20T06:43:52.273 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off 2023-11-20T06:43:52.273 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-20T06:43:52.285 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-11-20T06:43:52.285 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-20T06:43:52.294 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2023-11-20T06:43:52.306 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-11-20T06:43:56.296 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-20T06:43:56.307 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-20T06:43:56.405 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2023-11-20T06:43:56.415 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-11-20T06:44:00.410 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-20T06:44:00.418 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-20T06:44:00.520 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2023-11-20T06:44:00.527 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-11-20T06:44:00.621 INFO:teuthology.orchestra.console.smithi019:Power off completed 2023-11-20T06:44:00.628 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-11-20T06:44:00.732 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} duration: 898.5399653911591 failure_reason: 'Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)' flavor: default mon.a-kernel-sha1: 7678e1afe51c4ac0c30e2c032e042c836160928a mon.b-kernel-sha1: 7678e1afe51c4ac0c30e2c032e042c836160928a owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=91487e8155134dd9bbeb048aaf957ea3 status: fail success: false 2023-11-20T06:44:00.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-20T06:44:00.809 INFO:teuthology.run:FAIL